-- Logs begin at Tue 2022-09-13 15:45:07 UTC, end at Tue 2022-09-13 18:26:51 UTC. -- Sep 13 16:19:38.617405 n-d-857467-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 16:19:38.627017 n-d-857467-1 devstack@n-api.service[106276]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 16:19:38 2022] *** Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: nodename: n-d-857467-1 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: machine: x86_64 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: clock source: unix Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: pcre jit disabled Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: detected number of CPU cores: 4 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: current working directory: / Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: detected binary path: /usr/bin/uwsgi-core Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: your processes number limit is 47680 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: your memory page size is 4096 bytes Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: detected max file descriptor number: 2048 Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: lock engine: pthread robust mutexes Sep 13 16:19:38.629947 n-d-857467-1 devstack@n-api.service[106276]: thunder lock: enabled Sep 13 16:19:38.630785 n-d-857467-1 devstack@n-api.service[106276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 16:19:38.630785 n-d-857467-1 devstack@n-api.service[106276]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 16:19:38.668417 n-d-857467-1 devstack@n-api.service[106276]: Python main interpreter initialized at 0x5628feb039c0 Sep 13 16:19:38.668417 n-d-857467-1 devstack@n-api.service[106276]: python threads support enabled Sep 13 16:19:38.668417 n-d-857467-1 devstack@n-api.service[106276]: your server socket listen backlog is limited to 100 connections Sep 13 16:19:38.668417 n-d-857467-1 devstack@n-api.service[106276]: your mercy for graceful operations on workers is 90 seconds Sep 13 16:19:38.668744 n-d-857467-1 devstack@n-api.service[106276]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 16:19:38.668820 n-d-857467-1 devstack@n-api.service[106276]: *** Operational MODE: preforking *** Sep 13 16:19:38.669071 n-d-857467-1 devstack@n-api.service[106276]: *** uWSGI is running in multiple interpreter mode *** Sep 13 16:19:38.669071 n-d-857467-1 devstack@n-api.service[106276]: spawned uWSGI master process (pid: 106276) Sep 13 16:19:38.669261 n-d-857467-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 13 16:19:38.670439 n-d-857467-1 devstack@n-api.service[106276]: spawned uWSGI worker 1 (pid: 106277, cores: 1) Sep 13 16:19:38.672010 n-d-857467-1 devstack@n-api.service[106276]: spawned uWSGI worker 2 (pid: 106278, cores: 1) Sep 13 16:19:38.672010 n-d-857467-1 devstack@n-api.service[106276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 16:19:39.341348 n-d-857467-1 devstack@n-api.service[106278]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 16:19:39.359745 n-d-857467-1 devstack@n-api.service[106277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 16:19:40.446247 n-d-857467-1 devstack@n-api.service[106277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:19:40.446247 n-d-857467-1 devstack@n-api.service[106277]: from cryptography.utils import int_from_bytes Sep 13 16:19:40.446911 n-d-857467-1 devstack@n-api.service[106277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:19:40.446911 n-d-857467-1 devstack@n-api.service[106277]: from cryptography.utils import int_from_bytes Sep 13 16:19:40.447091 n-d-857467-1 devstack@n-api.service[106278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:19:40.447091 n-d-857467-1 devstack@n-api.service[106278]: from cryptography.utils import int_from_bytes Sep 13 16:19:40.447585 n-d-857467-1 devstack@n-api.service[106278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:19:40.447585 n-d-857467-1 devstack@n-api.service[106278]: from cryptography.utils import int_from_bytes Sep 13 16:19:42.942505 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 16:19:42.943169 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 16:19:42.943263 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 16:19:42.943619 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 16:19:42.943874 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 16:19:42.944260 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.944584 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.944905 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.945225 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.945551 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.945884 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.946203 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.946521 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.946847 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.947107 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.947421 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.947742 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857467-1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.948064 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.948364 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.948671 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.948987 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.949198 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 16:19:42.949562 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.949659 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 16:19:42.949753 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.949916 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.950026 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 16:19:42.950349 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 16:19:42.950437 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.950605 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 16:19:42.951711 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.951937 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.952130 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.952339 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.952523 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.952731 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.952921 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.953123 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.953306 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.953495 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.953951 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.954139 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.954334 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.954527 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.954706 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.954895 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.955082 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.955857 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.956114 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.956371 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.956634 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857467-1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.956965 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.957170 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.957353 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857467-1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.957527 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.957687 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.957815 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958006 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958006 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958281 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958281 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958541 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958678 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958678 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.958972 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959102 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959236 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959364 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959491 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959702 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959702 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.959963 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960103 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960239 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960239 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960522 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960650 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960776 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.960776 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961100 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961243 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961371 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961496 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961623 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961765 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.961918 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962045 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962172 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962298 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962424 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962567 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962698 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.962830 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963007 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857467-1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963160 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963291 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963425 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963564 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963693 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963693 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.963990 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964125 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964253 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964380 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964517 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964644 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964771 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.964897 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965043 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965177 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965313 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965452 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965591 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965727 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965870 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.965998 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966138 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966267 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966394 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966527 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966655 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966783 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.966923 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967051 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967189 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967317 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967443 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967579 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967713 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967843 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.967976 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968110 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968238 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968378 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968507 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968633 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968759 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.968886 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969020 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969160 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969302 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969430 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969557 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969705 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969885 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.969885 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970129 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970266 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970395 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970531 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970681 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970842 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.970983 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971300 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971435 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971562 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971699 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971833 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971961 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.971961 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972208 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972343 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972343 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972581 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972715 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972850 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.972988 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973130 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973266 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973405 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973532 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973659 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973785 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.973987 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974119 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974255 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974383 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974510 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974636 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974772 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.974907 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975034 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975162 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975301 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975430 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975565 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975694 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.975821 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976000 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976137 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976275 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976412 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976540 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976673 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976809 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.976937 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977073 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977199 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977335 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977471 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977598 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977734 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.977890 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978032 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978161 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978287 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978422 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978550 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978686 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978814 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.978950 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979085 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979213 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979347 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979620 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979754 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.979911 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980049 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980218 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980390 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980530 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980665 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980802 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.980931 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.981099 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.981240 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.981405 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.981545 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.981711 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.981904 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982048 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982178 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982335 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982464 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982638 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982777 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.982943 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.983086 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.983248 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.983387 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.983551 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.983687 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.983854 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.984020 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.984149 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.984411 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.984543 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.984749 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.984888 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985016 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985016 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985278 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985422 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985549 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985687 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985820 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.985971 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.986098 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.986224 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.986366 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.986570 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.986755 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.987009 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.987140 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.987356 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.987501 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.987675 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.987814 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.988010 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.988142 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.988342 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.988483 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.988664 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.988789 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.988966 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.989095 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.989339 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.989478 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.989606 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.989740 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.989899 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.990028 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.990196 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.990328 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.990499 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.990629 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.990802 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.990948 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.991090 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.991218 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.991396 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.991526 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.991697 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.991829 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.991998 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.992130 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.992297 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.992427 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.992613 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.992757 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.992928 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.993058 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.993233 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.993373 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.993544 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.993691 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.993866 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.993999 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.994170 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:19:42.994298 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.994509 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.994653 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.994839 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.994979 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.995168 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.995306 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.995479 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.995619 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.995788 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.995958 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.996090 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.996219 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.996396 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.996537 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.996724 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.996854 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997037 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997177 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997346 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997485 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997658 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997788 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.997993 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.998124 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.998305 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.998450 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.998616 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.998746 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.998927 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999058 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999238 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999372 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999549 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999681 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999860 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:42.999998 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.000177 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.000310 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.000488 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.000628 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.001051 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.001186 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.001367 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.001498 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.001678 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.001810 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.002008 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.002623 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.002838 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.003027 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.003190 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.003446 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.003582 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.003751 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.003892 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004055 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004224 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004351 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004478 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004652 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004798 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.004956 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.005094 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.005279 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.005410 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.005605 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.005749 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.005936 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.006080 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.006269 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.006400 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.006578 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.006711 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.006890 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007021 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007199 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007408 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007539 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007665 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007792 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.007918 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.008096 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.008240 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.008403 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.008531 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.008708 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.008845 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009029 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009167 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009339 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009471 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009645 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009784 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.009985 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.010129 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.010296 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.010426 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.010604 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.010735 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.010912 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011042 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011220 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011349 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011528 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011656 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011834 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.011966 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.012186 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.012355 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.012485 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.012611 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.012747 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.012876 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013004 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013144 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013330 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013475 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013658 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013789 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.013985 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.014116 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.014311 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.014457 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.014617 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.014746 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.014927 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015067 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015226 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015366 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015533 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015664 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015835 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.015965 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.016138 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.016279 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.016441 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.016572 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.016743 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.016881 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.017042 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.017174 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.017345 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.017475 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.017647 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.018417 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.018567 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.018837 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.018976 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.019151 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.019284 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.019460 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.019599 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.019766 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.019897 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020075 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020207 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020377 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020517 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020689 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020818 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.020999 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.021130 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.021322 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.021466 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.021633 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.021773 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.021992 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.022133 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.022276 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.022407 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.022594 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.022724 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.022897 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023026 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023203 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023334 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023514 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023645 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023825 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.023955 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.024126 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.024310 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.024441 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.024568 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.024730 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.024861 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025034 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025167 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025339 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025469 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025644 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025792 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.025980 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026111 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026262 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026397 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026565 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026707 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026867 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.026999 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.027171 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.027302 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.027493 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.027634 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.027800 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.027932 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.028102 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.028234 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.028405 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.028545 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.028706 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.028837 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029015 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029145 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029325 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029465 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029635 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029775 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.029971 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.030103 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.030290 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.030421 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.030597 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.030730 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.030914 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031053 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031221 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031361 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031529 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031658 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031837 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.031967 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.032144 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.032275 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.032444 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.032585 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.032756 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.032887 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.033063 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.033193 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.033404 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.033595 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.033983 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.034136 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.034381 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.034518 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.034677 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.034808 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.034988 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.035128 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.035294 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.035431 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.035604 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.035745 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.035911 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.036060 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.036218 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.036349 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.036529 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.036660 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.036845 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037057 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037188 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037365 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037493 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037624 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037750 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.037904 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038062 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038196 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038371 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038502 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038675 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038815 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.038977 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.039108 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.039282 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.039410 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.039599 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.039732 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.039905 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040034 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040226 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040357 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040536 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040679 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040837 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.040967 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.041141 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.041282 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.041452 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.041589 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.041758 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.041916 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.042088 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.042233 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.042392 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.042531 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.042695 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.042826 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043017 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043155 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043329 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043468 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043632 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043761 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.043939 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044070 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044246 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044378 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044546 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044675 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044848 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.044988 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.045157 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.045288 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.045464 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.045601 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.045772 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.045928 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.046146 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.046276 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.046456 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.046588 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.046765 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.046899 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.047074 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.047212 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.047383 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.047514 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.047690 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.047820 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048010 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048152 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048317 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048446 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048623 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048753 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.048960 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.049103 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.049435 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.049573 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.049765 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.049984 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.050125 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.050318 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.050893 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051036 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051157 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051275 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051387 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051497 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051605 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051722 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051859 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.051985 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.052171 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.052299 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.052478 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.052595 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.052795 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.052914 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.053184 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.053313 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.053423 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.053531 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.053727 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.053906 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054065 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054182 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054377 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054506 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054677 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054796 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.054980 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.055098 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.055784 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.055921 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056050 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056178 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056305 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056431 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056568 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056697 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056824 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.056959 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057087 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057229 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057366 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057516 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057636 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057762 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.057907 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058037 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058183 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058312 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058447 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058576 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058702 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058842 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.058971 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.059107 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.059235 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.059413 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.059939 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060077 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060197 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060307 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060423 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060533 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060651 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060777 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.060971 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061083 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061192 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061301 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061410 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061597 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061727 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.061935 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.062050 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.064300 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.064470 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.065156 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.065307 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.065443 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.065574 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.065574 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.065946 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066099 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066241 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066241 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066725 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.066863 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067000 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067000 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067254 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067383 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067521 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067521 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067763 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.067890 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068017 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068152 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068289 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068426 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068557 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068693 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068823 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.068958 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069086 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069236 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069366 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069505 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069635 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069762 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.069916 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070054 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070190 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070318 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070454 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070583 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070720 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070856 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.070985 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071112 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071239 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071366 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071503 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071632 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071759 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.071886 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072012 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072152 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072280 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072398 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072524 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072662 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072791 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.072927 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073056 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073184 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073311 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073438 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073565 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073705 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073859 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.073989 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074117 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074255 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074384 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074521 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074656 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074785 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.074912 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075039 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075214 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075346 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075474 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075590 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075716 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075852 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.075995 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076124 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076251 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076379 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076505 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076632 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076769 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.076899 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077027 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077154 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077281 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077416 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077553 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077690 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077818 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.077978 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078106 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078249 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078379 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078506 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078632 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078759 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.078886 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079027 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079157 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079283 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079422 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079550 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079676 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079802 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.079928 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.080056 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.080189 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081030 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081030 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081353 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081527 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081659 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081854 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.081989 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.082171 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.082304 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.082485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.082623 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.082793 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.082924 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.083111 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.083251 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.083389 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.083517 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.083702 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.083842 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084006 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084163 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084294 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084482 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084611 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084748 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.084913 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085046 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085225 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085355 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085508 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085639 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085813 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.085970 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.086148 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.086272 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.086452 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.086583 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.086757 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.087695 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.087836 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.087836 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.087836 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088194 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088327 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088463 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088598 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088723 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088848 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.088983 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089110 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089235 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089412 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089550 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089679 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089819 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.089970 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090099 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090225 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090356 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090572 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090705 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090833 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.090968 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091106 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091234 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091370 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091499 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091661 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091793 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.091983 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.092114 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.092296 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.092429 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.092608 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.092740 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.092922 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.093054 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.093228 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.093361 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.093543 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.093684 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.093930 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094088 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094219 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094346 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094473 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094600 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094772 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.094913 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.095095 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.095275 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.095408 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.095544 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.095706 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.095865 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.096125 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.096257 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.096444 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.096642 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.096781 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.096984 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.097124 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.097293 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.097426 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.097605 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.097745 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.097942 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098078 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098244 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098374 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098547 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098696 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098856 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.098989 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.099164 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.099294 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.099467 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.099606 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.099774 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.099903 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.100083 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.100214 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.100392 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.100533 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.100697 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.100835 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101006 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101173 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101317 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101486 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101617 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101795 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.101939 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.102139 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.102282 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.102460 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.102590 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.102788 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.102917 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.103094 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.103236 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.103399 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.103536 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.103704 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.103835 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104024 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104164 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104347 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104478 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104659 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104789 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.104971 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.105103 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.105276 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.105443 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.105598 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.105730 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.105921 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.106052 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.106235 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.106368 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.106538 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.106670 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.106953 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.107091 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.107266 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.107397 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.107572 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.107712 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.107880 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108018 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108185 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108326 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108485 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108617 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108787 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.108917 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.109100 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.109240 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.109402 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.109532 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.109706 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.109876 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110037 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110169 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110347 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110488 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110649 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110788 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.110963 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.111100 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.111273 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.111405 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.111664 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.111823 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.111953 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.112352 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.112485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.112762 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.112893 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.113090 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.113229 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.113404 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.113534 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.113729 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.113896 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.114075 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.114204 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.114385 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.114529 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.114700 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.114840 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115011 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115141 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115316 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115490 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115621 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115760 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.115914 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116046 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116244 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116374 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116548 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116692 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116859 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.116988 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.117183 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.117315 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.117505 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.117638 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.117814 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.117970 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.118160 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.118291 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.118485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.118616 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.118806 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.118939 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.119117 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.119250 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.119436 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.119576 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.119760 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.119893 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120068 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120191 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120371 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120502 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120680 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120809 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.120982 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.121126 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.121287 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.121419 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.121590 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.121721 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.121922 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122068 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122228 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122361 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122534 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122666 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122839 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.122984 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.123142 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.123280 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.123448 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.123579 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.123768 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.123908 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124070 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124202 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124373 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124503 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124681 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124821 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.124985 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.125110 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.125308 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.125438 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.125610 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.125748 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.126204 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.126337 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.126514 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.126643 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.126822 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.126953 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.127644 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.127778 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.128030 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.128224 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.128464 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.128597 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.128725 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.128889 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.129029 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.129216 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.129358 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.129543 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.129673 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.129871 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130005 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130190 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130380 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130512 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130641 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130806 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.130938 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.131146 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.131349 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.131483 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.131685 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.131817 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.131999 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.132144 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.132310 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.132442 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.132620 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.132752 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.132933 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.133057 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.133244 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.133373 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.133551 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.133682 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.133878 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134014 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134191 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134323 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134494 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134632 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134799 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.134939 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.135103 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.135227 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.135426 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.135567 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.135748 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.135890 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136028 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136157 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136338 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136479 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136649 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136781 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.136953 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.137082 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.137256 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.137397 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.137599 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.137733 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.137926 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138068 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138271 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138403 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138530 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138658 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138839 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.138971 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.139149 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.139283 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.139459 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.139590 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.139770 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.139910 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.140081 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.140214 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.140390 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.140529 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.140699 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.140841 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141009 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141149 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141317 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141447 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141632 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141772 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.141970 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.142103 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.142287 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.142420 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.142598 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.143453 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.143730 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.143883 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.144053 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.144262 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.144448 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.144593 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.144771 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.144903 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.145092 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.145223 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.145413 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.145545 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.145714 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.145870 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.146061 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.146204 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.146399 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.146530 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.146686 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.146818 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147000 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147133 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147331 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147470 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147640 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147772 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.147944 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.148091 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.148266 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.148398 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.148577 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.148717 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.148882 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.149027 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.149194 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.149332 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.149500 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.149630 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.149869 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.150065 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.150208 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.150416 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.150547 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.150734 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.150888 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.151061 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.151206 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.151387 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.151518 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.151695 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.151834 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152002 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152134 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152311 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152443 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152619 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152759 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.152924 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153056 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153230 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153360 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153538 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153669 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153862 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.153996 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.154171 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.154315 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.154481 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.154615 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.154788 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.154920 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.155091 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.155223 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.155399 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.155532 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.155699 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.155873 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.156025 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.156218 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.156365 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.156543 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.156675 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.156879 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157011 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157201 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157332 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157503 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157636 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157805 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.157962 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.158132 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.158265 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.158459 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.158773 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159075 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159210 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159383 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159524 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159687 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159828 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.159995 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.160142 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.160317 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.160447 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.160599 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.160731 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.160924 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.161067 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.161235 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.161365 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.161541 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.161680 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.161882 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.162030 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.162161 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.162289 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.162475 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.162703 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.162836 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.163055 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.163187 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.163375 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.163508 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.163703 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.163834 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.164017 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.164148 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.164337 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.164546 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.164677 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.164879 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.165021 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.165200 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.165332 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.165533 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.165666 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.165873 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166010 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166187 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166318 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166490 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166627 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166794 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.166927 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.167105 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.167235 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.167412 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.167552 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.167714 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.167844 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168020 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168158 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168320 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168459 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168624 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168747 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.168934 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.169066 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.169236 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.169377 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.169541 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.169672 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.169876 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170022 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170159 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170302 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170457 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170589 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170760 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.170897 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171063 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171195 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171373 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171503 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171673 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171804 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.171980 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.172121 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.172282 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.172415 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.172593 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.172726 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.172909 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.173048 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.173225 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.173366 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.173528 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.173670 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.173846 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.174022 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.174198 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.174407 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.174555 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.174806 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.174994 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.175129 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.175260 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.175430 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.175563 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.175767 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.175898 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.176131 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.176396 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.176531 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.176715 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.176862 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.177037 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.177180 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.177358 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.177602 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.177745 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.177962 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.178106 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.178286 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.178426 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.178619 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.178765 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.178942 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179082 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179245 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179382 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179554 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179697 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179862 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.179994 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.180184 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.180316 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.180497 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.180631 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.180806 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.180936 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.181113 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.181245 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.181422 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.181554 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.181728 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.181902 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182064 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182195 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182375 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182508 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182684 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182817 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.182992 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.183131 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.183301 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.183434 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.183600 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.183730 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.183901 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184047 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184205 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184335 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184505 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184635 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184813 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.184955 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.185113 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.185245 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.185418 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.185549 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.185719 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.185893 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186065 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186197 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186325 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186453 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186618 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186752 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.186914 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187046 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187211 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187343 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187516 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187650 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187818 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.187950 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.188120 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.188260 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.188422 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.188556 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.188754 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.188888 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.189084 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.189396 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.189540 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.190270 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.190463 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.190603 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.190893 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191033 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191204 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191345 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191534 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191668 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191857 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.191999 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.192174 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.192307 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.192485 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.192661 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.192822 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.192969 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.193135 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.193269 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.193448 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.193580 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.193760 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.193931 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.194096 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.194228 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.194409 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.194541 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.194719 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.194860 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195044 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195176 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195353 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195484 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195662 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195794 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.195978 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.196149 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.196280 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.196418 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.196583 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.196723 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.196889 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197022 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197196 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197338 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197500 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197633 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197806 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.197962 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.198132 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.198278 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.198435 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.198568 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.198740 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.198872 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199042 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199187 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199346 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199487 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199648 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199780 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.199950 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200084 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200251 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200384 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200555 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200688 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200862 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.200998 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.201165 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.201297 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.201466 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.201597 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.201767 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.201969 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.202101 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.202230 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.202365 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.202494 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.202700 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.202834 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203033 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203166 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203346 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203488 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203669 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203811 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.203980 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.204113 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.204303 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.204443 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.204573 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 16:19:43.204701 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.204917 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.205301 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.206414 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.206752 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.207088 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.207404 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.207722 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.208038 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.208351 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.208662 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.208974 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.209302 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.209628 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.209962 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.210293 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.210613 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.210934 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.211251 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.211564 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.211893 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.212205 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.212517 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.212827 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.213139 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.213450 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.213762 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.214104 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.214416 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.214733 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.215048 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.215376 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.215701 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.216012 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.216337 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.216665 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.217010 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.217321 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.217665 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.218023 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.218338 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.218651 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.218960 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:19:43.219204 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 16:19:43.362392 n-d-857467-1 devstack@n-api.service[106278]: INFO dbcounter [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Registered counter for database nova_api Sep 13 16:19:43.376058 n-d-857467-1 devstack@n-api.service[106277]: INFO dbcounter [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Registered counter for database nova_api Sep 13 16:19:43.383229 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_db.sqlalchemy.engines [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.389708 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writer thread running {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.396805 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.403191 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.448190 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.context [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=106278) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 16:19:43.451997 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:43.452469 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:43.454094 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:43.454775 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:43.455241 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:43.457241 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:43.459258 n-d-857467-1 devstack@n-api.service[106278]: INFO dbcounter [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Registered counter for database nova_cell0 Sep 13 16:19:43.461410 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.context [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=106277) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 16:19:43.463529 n-d-857467-1 devstack@n-api.service[106278]: INFO dbcounter [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Registered counter for database nova_cell1 Sep 13 16:19:43.465268 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:43.465738 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:43.467327 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:43.468049 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:19:43.468492 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:19:43.470507 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:19:43.472921 n-d-857467-1 devstack@n-api.service[106277]: INFO dbcounter [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Registered counter for database nova_cell0 Sep 13 16:19:43.473321 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_db.sqlalchemy.engines [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.475077 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_db.sqlalchemy.engines [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.477077 n-d-857467-1 devstack@n-api.service[106277]: INFO dbcounter [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Registered counter for database nova_cell1 Sep 13 16:19:43.480564 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writer thread running {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.483821 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.486120 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writer thread running {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.488890 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.490754 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.635337 n-d-857467-1 devstack@n-api.service[106278]: INFO dbcounter [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Registered counter for database nova_cell0 Sep 13 16:19:43.636129 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.642026 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_db.sqlalchemy.engines [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.645446 n-d-857467-1 devstack@n-api.service[106277]: INFO dbcounter [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Registered counter for database nova_cell0 Sep 13 16:19:43.647649 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writer thread running {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.654155 n-d-857467-1 devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:19:43.659109 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:19:43.994523 n-d-857467-1 devstack@n-api.service[106278]: WARNING keystonemiddleware.auth_token [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:19:43.998023 n-d-857467-1 devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:19:44.001957 n-d-857467-1 devstack@n-api.service[106278]: WARNING keystonemiddleware.auth_token [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:19:44.006824 n-d-857467-1 devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:19:44.351334 n-d-857467-1 devstack@n-api.service[106278]: WARNING keystonemiddleware.auth_token [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:19:44.357210 n-d-857467-1 devstack@n-api.service[106278]: WARNING keystonemiddleware.auth_token [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:19:44.358771 n-d-857467-1 devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:19:44.363232 n-d-857467-1 devstack@n-api.service[106278]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628feb039c0 pid: 106278 (default app) Sep 13 16:19:44.365290 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:19:44.365491 n-d-857467-1 devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-c53d1317-1f10-4f8b-938a-fa78e19fae31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:19:44.366490 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Sep 13 16:19:44.366915 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Tue Sep 13 16:19:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:19:44.370777 n-d-857467-1 devstack@n-api.service[106277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628feb039c0 pid: 106277 (default app) Sep 13 16:21:07.076463 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:07.078335 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Sep 13 16:21:07.080602 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:07.090869 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:07.092751 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell0:SELECT=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:07.094024 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell1:SELECT=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:07.095092 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:07.973253 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-b6f93ba4-1665-48b4-a544-48c64542fe5e admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:08.006700 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-b6f93ba4-1665-48b4-a544-48c64542fe5e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921041 Sep 13 16:21:08.007459 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:21:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:21:10.682847 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:10.683927 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-ffa7d545-1df0-4e93-ac55-7b3e6bbb5d63 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Sep 13 16:21:10.684515 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:11.141049 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-b7e890d5-abad-47b0-9b90-11f03474a914 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:11.189309 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-b7e890d5-abad-47b0-9b90-11f03474a914 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498099 Sep 13 16:21:11.189883 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:21:11.204297 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_api:SELECT=3 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:11.205091 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_cell0:SELECT=3 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:11.207022 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_cell1:SELECT=3 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:11.207762 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:11.411436 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-2c0627b4-f45b-4a7d-ab0d-578148630ec4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:11.484204 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-2c0627b4-f45b-4a7d-ab0d-578148630ec4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285930 Sep 13 16:21:11.484794 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Sep 13 16:21:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:21:14.149912 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-b7e890d5-abad-47b0-9b90-11f03474a914 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:14.151025 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-b7e890d5-abad-47b0-9b90-11f03474a914 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Sep 13 16:21:14.151523 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:15.002450 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-b2390872-f76b-4d97-a1bc-7867644c25e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:15.067513 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-b2390872-f76b-4d97-a1bc-7867644c25e1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.908626 Sep 13 16:21:15.069313 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:21:15.083521 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ac364a39-db07-4c4e-9d02-3ea9e25cce55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:15.138596 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-ac364a39-db07-4c4e-9d02-3ea9e25cce55 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059588 Sep 13 16:21:15.145891 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Sep 13 16:21:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:21:18.074438 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-b2390872-f76b-4d97-a1bc-7867644c25e1 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:18.075474 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-b2390872-f76b-4d97-a1bc-7867644c25e1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 13 16:21:18.093634 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:18 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:18.687049 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ec730887-4684-4a3b-9a4e-d501d0f3f2ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:18.709369 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-ec730887-4684-4a3b-9a4e-d501d0f3f2ea admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.626381 Sep 13 16:21:18.714225 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:21:18.722722 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-929cd053-5989-47e6-bf62-2b58e3175508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:18.751777 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-929cd053-5989-47e6-bf62-2b58e3175508 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032676 Sep 13 16:21:18.752367 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Sep 13 16:21:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:21:21.391157 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ec730887-4684-4a3b-9a4e-d501d0f3f2ea admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:21.392788 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-ec730887-4684-4a3b-9a4e-d501d0f3f2ea admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Sep 13 16:21:21.393211 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:21.954256 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-609a9497-03a7-4f37-ac4d-0e2e7af3d122 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:21.981281 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-609a9497-03a7-4f37-ac4d-0e2e7af3d122 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581269 Sep 13 16:21:21.982037 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:21:21.996257 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-eba4e3ce-ab1b-4893-9726-b7017eebc2d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:22.055021 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-eba4e3ce-ab1b-4893-9726-b7017eebc2d8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063436 Sep 13 16:21:22.056206 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Sep 13 16:21:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:21:24.788430 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-609a9497-03a7-4f37-ac4d-0e2e7af3d122 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:24.788430 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-609a9497-03a7-4f37-ac4d-0e2e7af3d122 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Sep 13 16:21:24.792580 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:25.260304 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-fabde2ae-a391-4812-93d6-8cc1f3d6ac36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:25.290557 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-fabde2ae-a391-4812-93d6-8cc1f3d6ac36 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501103 Sep 13 16:21:25.299795 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:21:25.315861 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-cfb51050-ad9b-42d7-9764-dcef860e4854 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:25.360677 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-cfb51050-ad9b-42d7-9764-dcef860e4854 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054599 Sep 13 16:21:25.361263 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Sep 13 16:21:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:21:28.094386 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-fabde2ae-a391-4812-93d6-8cc1f3d6ac36 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:28.095393 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-fabde2ae-a391-4812-93d6-8cc1f3d6ac36 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 13 16:21:28.095799 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:28.554103 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-a42dd5a3-ee6c-468a-a52f-c4f935098b82 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:28.585477 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-a42dd5a3-ee6c-468a-a52f-c4f935098b82 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483239 Sep 13 16:21:28.586193 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:21:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:21:31.781760 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-fabde2ae-a391-4812-93d6-8cc1f3d6ac36 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:31.782825 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-fabde2ae-a391-4812-93d6-8cc1f3d6ac36 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 13 16:21:31.783232 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:32.245961 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-dd0b9351-8af3-41cb-ad8a-9c6750e5643d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:32.266590 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-dd0b9351-8af3-41cb-ad8a-9c6750e5643d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475803 Sep 13 16:21:32.267084 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:21:32.282143 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-29c1e428-055b-4999-b1a1-955c8315a037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:32.306094 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-29c1e428-055b-4999-b1a1-955c8315a037 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028491 Sep 13 16:21:32.306687 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Sep 13 16:21:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:21:35.173150 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-dd0b9351-8af3-41cb-ad8a-9c6750e5643d admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:35.174320 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-dd0b9351-8af3-41cb-ad8a-9c6750e5643d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Sep 13 16:21:35.174799 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:35.583563 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-4b8002c9-6eca-468b-8385-793a1f3c2f01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:35.603921 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-4b8002c9-6eca-468b-8385-793a1f3c2f01 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422785 Sep 13 16:21:35.604410 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:21:35.616923 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-a042ad20-95e8-4b25-aba1-aacd6e801515 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:35.641593 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-a042ad20-95e8-4b25-aba1-aacd6e801515 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028360 Sep 13 16:21:35.642375 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Sep 13 16:21:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:21:38.270836 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-4b8002c9-6eca-468b-8385-793a1f3c2f01 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:38.271842 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-4b8002c9-6eca-468b-8385-793a1f3c2f01 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 13 16:21:38.272241 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:38.799813 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-6cd64ff7-1907-4363-90e3-2b7ff5537739 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:38.823012 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-6cd64ff7-1907-4363-90e3-2b7ff5537739 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.544358 Sep 13 16:21:38.823641 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:21:38.836541 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-88809413-da4b-40ee-b653-bf9b7a631d85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:38.842092 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:38.868500 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-88809413-da4b-40ee-b653-bf9b7a631d85 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035662 Sep 13 16:21:38.869629 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Sep 13 16:21:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:21:41.522540 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-6cd64ff7-1907-4363-90e3-2b7ff5537739 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:41.528149 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-6cd64ff7-1907-4363-90e3-2b7ff5537739 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006004 Sep 13 16:21:41.528580 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:41.974597 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-32ade825-ef3e-4403-b900-ccb5c005f7d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:41.996608 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-32ade825-ef3e-4403-b900-ccb5c005f7d5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460775 Sep 13 16:21:41.997159 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:21:42.010790 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-e0b192cc-902b-4ae0-b324-1fac62bc6eb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:42.016844 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:21:42.037007 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-e0b192cc-902b-4ae0-b324-1fac62bc6eb4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031312 Sep 13 16:21:42.037589 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Sep 13 16:21:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:21:44.669161 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-32ade825-ef3e-4403-b900-ccb5c005f7d5 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:21:44.670963 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-32ade825-ef3e-4403-b900-ccb5c005f7d5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Sep 13 16:21:44.671809 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:21:45.236937 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-7e419403-75ee-456e-9d4b-9b6bfbdb09a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:45.260400 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-7e419403-75ee-456e-9d4b-9b6bfbdb09a6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.582433 Sep 13 16:21:45.261252 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Sep 13 16:21:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:21:45.273965 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-f57edaab-0969-4aac-8bed-32d5b8675eb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:21:45.305121 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-f57edaab-0969-4aac-8bed-32d5b8675eb6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034846 Sep 13 16:21:45.306088 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Sep 13 16:21:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:22:05.184375 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-7e419403-75ee-456e-9d4b-9b6bfbdb09a6 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:05.185434 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-7e419403-75ee-456e-9d4b-9b6bfbdb09a6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 13 16:22:05.186077 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:05.196698 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:05.583594 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-2c6dfb3f-db47-4c38-96fa-fe853bd5b3dc admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:05.601603 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-2c6dfb3f-db47-4c38-96fa-fe853bd5b3dc admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409384 Sep 13 16:22:05.602103 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:22:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:22:06.952860 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-7e419403-75ee-456e-9d4b-9b6bfbdb09a6 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:06.953885 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-7e419403-75ee-456e-9d4b-9b6bfbdb09a6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 13 16:22:06.954303 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:07.495835 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-d0ab8612-6686-4cce-90f5-ef9300b15fae admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:07.502379 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.wsgi [None req-d0ab8612-6686-4cce-90f5-ef9300b15fae admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-d0ab8612-6686-4cce-90f5-ef9300b15fae admin admin] Request method failure captured: Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Accept: application/json Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Accept-Encoding: gzip, deflate Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Connection: keep-alive Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Content-Length: 0 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Host: 10.222.0.61 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Openstack-Api-Version: compute 2.92 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: Openstack-System-Scope: None Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: User-Agent: python-novaclient Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Auth-Token: gAAAAABjIK4uxnSb9V6Wl-d8lkAOw16Wl7YJuAfJNUhvw2ChsgInZdcusZEH1-3Vbq8KHaGZbWAqYGVtURqSQPWIlfZ3Le3uExhSoOZ3GjYzZB2TXxQpgTudg3gfw7OaWDu1G1qQyUw43eixECK2MR0yAb1AsdhQ_ibzd5zs2nQvSqbNuM6div0 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Domain-Id: None Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Domain-Name: None Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Identity-Status: Confirmed Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Is-Admin-Project: True Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Domain-Id: default Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Domain-Name: Default Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Name: admin Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Role: admin,member,reader Sep 13 16:22:07.505588 n-d-857467-1 devstack@n-api.service[106277]: X-Roles: admin,member,reader Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed42fcae2acd40b591113db491d739d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant: admin Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant-Name: admin Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-User: admin Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-User-Domain-Id: default Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-User-Domain-Name: Default Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-User-Id: 9a8174feae12467882aeb8be4cb75e27 Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: X-User-Name: admin Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: method: > Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: exception: Flavor 42 could not be found. Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: action_args: {'id': '42'} Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:22:07.507364 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:07.508461 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.510016 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-d0ab8612-6686-4cce-90f5-ef9300b15fae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:22:07.511309 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-d0ab8612-6686-4cce-90f5-ef9300b15fae admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392189 Sep 13 16:22:07.511309 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Sep 13 16:22:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:22:07.517401 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-b1cde4f2-bc97-4ca5-afee-0169223985ce admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:07.521456 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:22:07.541012 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-b1cde4f2-bc97-4ca5-afee-0169223985ce admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027730 Sep 13 16:22:07.541552 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Sep 13 16:22:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:22:07.553090 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-660c5558-7f62-48d9-b868-85b8fb06a6e6 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:07.574700 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-660c5558-7f62-48d9-b868-85b8fb06a6e6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026391 Sep 13 16:22:07.575248 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Sep 13 16:22:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:22:07.585913 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-03dade15-830e-4fe9-ab0c-63964a2cb54c admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:07.591363 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.wsgi [None req-03dade15-830e-4fe9-ab0c-63964a2cb54c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-03dade15-830e-4fe9-ab0c-63964a2cb54c admin admin] Request method failure captured: Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Accept: application/json Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Accept-Encoding: gzip, deflate Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Connection: keep-alive Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Content-Length: 0 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Host: 10.222.0.61 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Openstack-Api-Version: compute 2.92 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: Openstack-System-Scope: None Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: User-Agent: python-novaclient Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Auth-Token: gAAAAABjIK4uxnSb9V6Wl-d8lkAOw16Wl7YJuAfJNUhvw2ChsgInZdcusZEH1-3Vbq8KHaGZbWAqYGVtURqSQPWIlfZ3Le3uExhSoOZ3GjYzZB2TXxQpgTudg3gfw7OaWDu1G1qQyUw43eixECK2MR0yAb1AsdhQ_ibzd5zs2nQvSqbNuM6div0 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Domain-Id: None Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Domain-Name: None Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Identity-Status: Confirmed Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Is-Admin-Project: True Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Domain-Id: default Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Domain-Name: Default Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Name: admin Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Role: admin,member,reader Sep 13 16:22:07.595388 n-d-857467-1 devstack@n-api.service[106278]: X-Roles: admin,member,reader Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed42fcae2acd40b591113db491d739d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant: admin Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant-Name: admin Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-User: admin Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-User-Domain-Id: default Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-User-Domain-Name: Default Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-User-Id: 9a8174feae12467882aeb8be4cb75e27 Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: X-User-Name: admin Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: method: > Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: exception: Flavor 42 could not be found. Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: action_args: {'id': '42'} Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:22:07.597036 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:07.598026 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:07.599125 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-03dade15-830e-4fe9-ab0c-63964a2cb54c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:22:07.600163 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-03dade15-830e-4fe9-ab0c-63964a2cb54c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015027 Sep 13 16:22:07.600163 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Sep 13 16:22:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:22:08.819245 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-660c5558-7f62-48d9-b868-85b8fb06a6e6 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:08.820261 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-660c5558-7f62-48d9-b868-85b8fb06a6e6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 13 16:22:08.820663 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:09.347793 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-02f1b829-2df3-43f8-9182-5ca536967c6f admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:09.352794 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.wsgi [None req-02f1b829-2df3-43f8-9182-5ca536967c6f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-02f1b829-2df3-43f8-9182-5ca536967c6f admin admin] Request method failure captured: Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Accept: application/json Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Accept-Encoding: gzip, deflate Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Connection: keep-alive Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Content-Length: 0 Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Host: 10.222.0.61 Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Openstack-Api-Version: compute 2.92 Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: Openstack-System-Scope: None Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: User-Agent: python-novaclient Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Auth-Token: gAAAAABjIK4wVumY-kinVwjmV8qGRLTm-eASdH2EFieqWzAU-OL81tIi1we7uzxT0bI75QJ3Ux3GpUuSDUr4KgTPjAmuQ6_4RlRRkXAwAgFMAYRa1X6e4fI_cjloP2FOB4m8RCVsrRfKD1U9sHgEDyfDWPqBGw-NK5keyGikQs_9355AhcaeZzo Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Domain-Id: None Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Domain-Name: None Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Identity-Status: Confirmed Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Is-Admin-Project: True Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Domain-Id: default Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Domain-Name: Default Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Name: admin Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Role: admin,member,reader Sep 13 16:22:09.354345 n-d-857467-1 devstack@n-api.service[106278]: X-Roles: admin,member,reader Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed42fcae2acd40b591113db491d739d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant: admin Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant-Name: admin Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-User: admin Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-User-Domain-Id: default Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-User-Domain-Name: Default Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-User-Id: 9a8174feae12467882aeb8be4cb75e27 Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: X-User-Name: admin Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: method: > Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: exception: Flavor 84 could not be found. Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: action_args: {'id': '84'} Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:22:09.355925 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:09.356916 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.358927 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-02f1b829-2df3-43f8-9182-5ca536967c6f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:22:09.360205 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-02f1b829-2df3-43f8-9182-5ca536967c6f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391381 Sep 13 16:22:09.360205 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Sep 13 16:22:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:22:09.366433 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-41073cc9-d4ee-4cae-949b-5ae5c106074b admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:09.381685 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-41073cc9-d4ee-4cae-949b-5ae5c106074b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018797 Sep 13 16:22:09.382257 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Sep 13 16:22:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:22:09.391629 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-29d16699-b6d5-481c-a9b3-e279b120c9f7 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:09.407897 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-29d16699-b6d5-481c-a9b3-e279b120c9f7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019887 Sep 13 16:22:09.408412 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Sep 13 16:22:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:22:09.417570 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-9a0088d1-4fe7-41c2-b5ba-6b36ad236547 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:09.423135 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.wsgi [None req-9a0088d1-4fe7-41c2-b5ba-6b36ad236547 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-9a0088d1-4fe7-41c2-b5ba-6b36ad236547 admin admin] Request method failure captured: Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Accept: application/json Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Accept-Encoding: gzip, deflate Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Connection: keep-alive Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Content-Length: 0 Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Host: 10.222.0.61 Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Openstack-Api-Version: compute 2.92 Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: Openstack-System-Scope: None Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: User-Agent: python-novaclient Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Auth-Token: gAAAAABjIK4wVumY-kinVwjmV8qGRLTm-eASdH2EFieqWzAU-OL81tIi1we7uzxT0bI75QJ3Ux3GpUuSDUr4KgTPjAmuQ6_4RlRRkXAwAgFMAYRa1X6e4fI_cjloP2FOB4m8RCVsrRfKD1U9sHgEDyfDWPqBGw-NK5keyGikQs_9355AhcaeZzo Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Domain-Id: None Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Domain-Name: None Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Identity-Status: Confirmed Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Is-Admin-Project: True Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Domain-Id: default Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Domain-Name: Default Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Name: admin Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Role: admin,member,reader Sep 13 16:22:09.424627 n-d-857467-1 devstack@n-api.service[106277]: X-Roles: admin,member,reader Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed42fcae2acd40b591113db491d739d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant: admin Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant-Name: admin Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-User: admin Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-User-Domain-Id: default Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-User-Domain-Name: Default Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-User-Id: 9a8174feae12467882aeb8be4cb75e27 Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: X-User-Name: admin Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: method: > Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: exception: Flavor 84 could not be found. Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: action_args: {'id': '84'} Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:22:09.426223 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:09.427175 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:09.428418 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-9a0088d1-4fe7-41c2-b5ba-6b36ad236547 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:22:09.429737 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-9a0088d1-4fe7-41c2-b5ba-6b36ad236547 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011843 Sep 13 16:22:09.429737 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Sep 13 16:22:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:22:10.636553 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-29d16699-b6d5-481c-a9b3-e279b120c9f7 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:10.637608 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-29d16699-b6d5-481c-a9b3-e279b120c9f7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 13 16:22:10.638034 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:11.159898 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-246874d8-74bb-4d78-8457-f81a887fb11a admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:11.165635 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.wsgi [None req-246874d8-74bb-4d78-8457-f81a887fb11a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-246874d8-74bb-4d78-8457-f81a887fb11a admin admin] Request method failure captured: Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Accept: application/json Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Accept-Encoding: gzip, deflate Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Connection: keep-alive Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Content-Length: 0 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Host: 10.222.0.61 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Openstack-Api-Version: compute 2.92 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: Openstack-System-Scope: None Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: User-Agent: python-novaclient Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Auth-Token: gAAAAABjIK4y6S_ulCY1v8KvLTUDiaijXkavkzzjXjwirSd_tJKeECXjY5OY4bjCPxcvJcmpsOZQxE9_MOfg3GFJ9HRSYPMFoXmVOaAup69ikCafcRhF5ZuWmYOh0i4jtHhCHDy7Esn7HN3GgqXVySpeCc8AIbeHbBoKFY38QKL0r26_DhbP974 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Domain-Id: None Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Domain-Name: None Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Identity-Status: Confirmed Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Is-Admin-Project: True Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Domain-Id: default Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Domain-Name: Default Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Project-Name: admin Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Role: admin,member,reader Sep 13 16:22:11.167164 n-d-857467-1 devstack@n-api.service[106277]: X-Roles: admin,member,reader Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed42fcae2acd40b591113db491d739d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant: admin Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-Tenant-Name: admin Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-User: admin Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-User-Domain-Id: default Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-User-Domain-Name: Default Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-User-Id: 9a8174feae12467882aeb8be4cb75e27 Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: X-User-Name: admin Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: method: > Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: exception: Flavor 451 could not be found. Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: action_args: {'id': '451'} Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:22:11.168745 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:11.169598 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.171466 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-246874d8-74bb-4d78-8457-f81a887fb11a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:22:11.172731 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-246874d8-74bb-4d78-8457-f81a887fb11a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388299 Sep 13 16:22:11.172731 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:22:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:22:11.179120 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-f360f255-405a-423a-a748-1a9f4ee10e1b admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:11.194629 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-f360f255-405a-423a-a748-1a9f4ee10e1b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019125 Sep 13 16:22:11.195164 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Sep 13 16:22:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:22:11.204694 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:11.219926 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019039 Sep 13 16:22:11.220459 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Sep 13 16:22:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:22:11.229774 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-45ad48c0-c13c-4f35-8720-942236206f9a admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:11.235345 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.wsgi [None req-45ad48c0-c13c-4f35-8720-942236206f9a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-45ad48c0-c13c-4f35-8720-942236206f9a admin admin] Request method failure captured: Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Accept: application/json Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Accept-Encoding: gzip, deflate Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Connection: keep-alive Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Content-Length: 0 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Host: 10.222.0.61 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Openstack-Api-Version: compute 2.92 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: Openstack-System-Scope: None Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: User-Agent: python-novaclient Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Auth-Token: gAAAAABjIK4y6S_ulCY1v8KvLTUDiaijXkavkzzjXjwirSd_tJKeECXjY5OY4bjCPxcvJcmpsOZQxE9_MOfg3GFJ9HRSYPMFoXmVOaAup69ikCafcRhF5ZuWmYOh0i4jtHhCHDy7Esn7HN3GgqXVySpeCc8AIbeHbBoKFY38QKL0r26_DhbP974 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Domain-Id: None Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Domain-Name: None Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Identity-Status: Confirmed Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Is-Admin-Project: True Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Domain-Id: default Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Domain-Name: Default Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Project-Name: admin Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Role: admin,member,reader Sep 13 16:22:11.236851 n-d-857467-1 devstack@n-api.service[106278]: X-Roles: admin,member,reader Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed42fcae2acd40b591113db491d739d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed42fcae2acd40b591113db491d739d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant: admin Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant-Id: ed42fcae2acd40b591113db491d739d4 Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-Tenant-Name: admin Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-User: admin Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-User-Domain-Id: default Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-User-Domain-Name: Default Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-User-Id: 9a8174feae12467882aeb8be4cb75e27 Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: X-User-Name: admin Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: method: > Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: exception: Flavor 451 could not be found. Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: action_args: {'id': '451'} Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:22:11.238447 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:11.239381 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: ERROR nova.api.openstack.wsgi Sep 13 16:22:11.240555 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-45ad48c0-c13c-4f35-8720-942236206f9a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:22:11.241638 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-45ad48c0-c13c-4f35-8720-942236206f9a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012015 Sep 13 16:22:11.241638 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:22:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:22:12.472314 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:12.473402 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 13 16:22:12.473804 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:13.008643 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-462387a0-b7aa-47d8-b506-170b2b16d5a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:22:13.028022 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-462387a0-b7aa-47d8-b506-170b2b16d5a5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.417318 Sep 13 16:22:13.028558 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Sep 13 16:22:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:22:14.268561 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:14.269692 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 13 16:22:14.270190 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:14.796890 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-0b6115de-ab55-43ef-a6f4-e97954db1c6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:22:14.815411 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-0b6115de-ab55-43ef-a6f4-e97954db1c6e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408718 Sep 13 16:22:14.815898 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Sep 13 16:22:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:22:16.053510 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:16.054549 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 13 16:22:16.054967 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:16.574801 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-cd534aab-ccc3-4c1c-8d69-7966adeda1e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:22:16.593477 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-cd534aab-ccc3-4c1c-8d69-7966adeda1e9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401927 Sep 13 16:22:16.594055 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Sep 13 16:22:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:22:17.816867 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:17.817899 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 13 16:22:17.818299 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:18.338663 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-e7b743e1-a1a8-481f-b282-1e65b54a11f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:22:18.361776 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-e7b743e1-a1a8-481f-b282-1e65b54a11f0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.403956 Sep 13 16:22:18.362731 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Sep 13 16:22:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:22:19.582492 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:19.583497 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 13 16:22:19.583896 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:22:20.106873 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-ffde7770-d8eb-47f8-84a5-0e3bb1da56d2 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:22:20.128558 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-ffde7770-d8eb-47f8-84a5-0e3bb1da56d2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405747 Sep 13 16:22:20.129091 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Sep 13 16:22:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:17.690664 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:17.691601 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-58c2a8f7-5e73-4ec4-a7d2-f0faa7ef7ff1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 13 16:23:17.692011 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Tue Sep 13 16:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:23:17.703385 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:18.083410 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-bfe43342-9959-4973-90c0-f913e390bc4f admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.103705 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-bfe43342-9959-4973-90c0-f913e390bc4f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405867 Sep 13 16:23:18.104243 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:23:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:23:18.125858 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=14 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:23:18.129773 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-124fb140-e4bd-40a6-8df1-2d6e82f59224 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.136951 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-124fb140-e4bd-40a6-8df1-2d6e82f59224 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012505 Sep 13 16:23:18.137475 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Tue Sep 13 16:23:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:18.148899 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-1272ebfc-fc07-4fe8-91e5-fe3c6ca1a881 admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.156246 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-1272ebfc-fc07-4fe8-91e5-fe3c6ca1a881 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010920 Sep 13 16:23:18.156760 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Tue Sep 13 16:23:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:18.167807 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-5ac4b531-198a-44bf-822b-a0ef3171eb7c admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.175552 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-5ac4b531-198a-44bf-822b-a0ef3171eb7c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011135 Sep 13 16:23:18.176074 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Tue Sep 13 16:23:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:23:18.187433 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-fd56dc6b-5b93-4413-999f-d99dbc481fdd admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:23:18.194463 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-fd56dc6b-5b93-4413-999f-d99dbc481fdd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010946 Sep 13 16:23:18.194972 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Tue Sep 13 16:23:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:28:42.449295 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-5ac4b531-198a-44bf-822b-a0ef3171eb7c admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:42.450340 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-5ac4b531-198a-44bf-822b-a0ef3171eb7c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 13 16:28:42.450736 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:28:42.590688 n-d-857467-1 devstack@n-api.service[106278]: DEBUG dbcounter [-] [106278] Writing DB stats nova_api:SELECT=6 {{(pid=106278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:28:42.733038 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:42.738364 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.738842 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.739274 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.739989 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:42.740440 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:42.740856 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:42.778976 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-13084b79-e41e-4e38-86a8-9e3a869f145c admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189576 Sep 13 16:28:42.779537 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:28:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:28:43.882654 n-d-857467-1 devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-5ac4b531-198a-44bf-822b-a0ef3171eb7c admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:43.883664 n-d-857467-1 devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-5ac4b531-198a-44bf-822b-a0ef3171eb7c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 13 16:28:43.884063 n-d-857467-1 devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Sep 13 16:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:28:44.077560 n-d-857467-1 devstack@n-api.service[106278]: DEBUG nova.api.openstack.wsgi [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Calling method '>' {{(pid=106278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:28:44.081139 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.081628 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.082102 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.082852 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:28:44.083510 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:28:44.084164 n-d-857467-1 devstack@n-api.service[106278]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:28:44.108804 n-d-857467-1 devstack@n-api.service[106278]: INFO nova.api.openstack.requestlog [None req-5f1b3a0b-9a25-4d06-a3b1-89170265b13c admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.085003 Sep 13 16:28:44.109519 n-d-857467-1 devstack@n-api.service[106278]: [pid: 106278|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:28:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:29:33.299464 n-d-857467-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 16:29:33.299987 n-d-857467-1 devstack@n-api.service[106276]: Tue Sep 13 16:29:33 2022 - graceful shutdown triggered... Sep 13 16:29:33.300991 n-d-857467-1 devstack@n-api.service[106277]: Gracefully killing worker 1 (pid: 106277)... Sep 13 16:29:33.302307 n-d-857467-1 devstack@n-api.service[106278]: Gracefully killing worker 2 (pid: 106278)... Sep 13 16:29:33.426812 n-d-857467-1 devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=4 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:29:34.300879 n-d-857467-1 devstack@n-api.service[106276]: worker 1 buried after 1 seconds Sep 13 16:29:34.301332 n-d-857467-1 devstack@n-api.service[106276]: worker 2 buried after 1 seconds Sep 13 16:29:34.301332 n-d-857467-1 devstack@n-api.service[106276]: goodbye to uWSGI. Sep 13 16:29:34.302493 n-d-857467-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 13 16:29:34.303098 n-d-857467-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 16:29:34.305887 n-d-857467-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 16:29:34.322986 n-d-857467-1 devstack@n-api.service[122317]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 16:29:34 2022] *** Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: nodename: n-d-857467-1 Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: machine: x86_64 Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: clock source: unix Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: pcre jit disabled Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: detected number of CPU cores: 4 Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: current working directory: / Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: detected binary path: /usr/bin/uwsgi-core Sep 13 16:29:34.340704 n-d-857467-1 devstack@n-api.service[122317]: your processes number limit is 47680 Sep 13 16:29:34.341639 n-d-857467-1 devstack@n-api.service[122317]: your memory page size is 4096 bytes Sep 13 16:29:34.341639 n-d-857467-1 devstack@n-api.service[122317]: detected max file descriptor number: 2048 Sep 13 16:29:34.341639 n-d-857467-1 devstack@n-api.service[122317]: lock engine: pthread robust mutexes Sep 13 16:29:34.341639 n-d-857467-1 devstack@n-api.service[122317]: thunder lock: enabled Sep 13 16:29:34.341639 n-d-857467-1 devstack@n-api.service[122317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 16:29:34.341639 n-d-857467-1 devstack@n-api.service[122317]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 16:29:34.383409 n-d-857467-1 devstack@n-api.service[122317]: Python main interpreter initialized at 0x56403fa349c0 Sep 13 16:29:34.383409 n-d-857467-1 devstack@n-api.service[122317]: python threads support enabled Sep 13 16:29:34.383409 n-d-857467-1 devstack@n-api.service[122317]: your server socket listen backlog is limited to 100 connections Sep 13 16:29:34.383409 n-d-857467-1 devstack@n-api.service[122317]: your mercy for graceful operations on workers is 90 seconds Sep 13 16:29:34.383881 n-d-857467-1 devstack@n-api.service[122317]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 16:29:34.383881 n-d-857467-1 devstack@n-api.service[122317]: *** Operational MODE: preforking *** Sep 13 16:29:34.384104 n-d-857467-1 devstack@n-api.service[122317]: *** uWSGI is running in multiple interpreter mode *** Sep 13 16:29:34.384104 n-d-857467-1 devstack@n-api.service[122317]: spawned uWSGI master process (pid: 122317) Sep 13 16:29:34.384311 n-d-857467-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 13 16:29:34.384924 n-d-857467-1 devstack@n-api.service[122317]: spawned uWSGI worker 1 (pid: 122327, cores: 1) Sep 13 16:29:34.385859 n-d-857467-1 devstack@n-api.service[122317]: spawned uWSGI worker 2 (pid: 122328, cores: 1) Sep 13 16:29:34.385859 n-d-857467-1 devstack@n-api.service[122317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 16:29:35.064566 n-d-857467-1 devstack@n-api.service[122327]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 16:29:35.066813 n-d-857467-1 devstack@n-api.service[122328]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 16:29:36.245755 n-d-857467-1 devstack@n-api.service[122328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:29:36.245755 n-d-857467-1 devstack@n-api.service[122328]: from cryptography.utils import int_from_bytes Sep 13 16:29:36.246515 n-d-857467-1 devstack@n-api.service[122328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:29:36.246515 n-d-857467-1 devstack@n-api.service[122328]: from cryptography.utils import int_from_bytes Sep 13 16:29:36.257532 n-d-857467-1 devstack@n-api.service[122327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:29:36.257532 n-d-857467-1 devstack@n-api.service[122327]: from cryptography.utils import int_from_bytes Sep 13 16:29:36.258052 n-d-857467-1 devstack@n-api.service[122327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 16:29:36.258052 n-d-857467-1 devstack@n-api.service[122327]: from cryptography.utils import int_from_bytes Sep 13 16:29:38.709885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 16:29:38.710513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 16:29:38.710733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 16:29:38.711058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 16:29:38.711318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 16:29:38.711712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.712041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.712363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.712681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.713014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.713326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.713652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.713997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.714332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.714593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.714913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.715401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857467-1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.715729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.716042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.716362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.716686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.716995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.717322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.717631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.718165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.718612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.718919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.719231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.719592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.719890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.720201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.720523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.720844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.721155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.721464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.721899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857467-1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.722839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.723171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.723488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.723898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.724211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.724519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.724840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.725163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.725471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.725797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.726153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.726481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.726802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.727106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.727412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.727722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.728041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.728344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.728650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.728902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.729208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.729527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.729867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.730197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.730447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.730698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.731019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.731339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.731433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 16:29:38.731855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.731954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 16:29:38.732051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.732170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 16:29:38.732266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.732522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.732616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 16:29:38.732785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 16:29:38.732896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.733118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.733235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.733423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.733519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.733729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.733851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.734073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.734169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.734388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.734504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.734711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.734818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.735919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.736027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.736237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.736339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.736585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.736685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857467-1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.736905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.737013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.737214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.737316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.737533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.737627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.737913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.738050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.738225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.738526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.738620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.738830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.738926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.739149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.739246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.739484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.739658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.739788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.739967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.740069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.740315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.740427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.740587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.740683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.740915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.741965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.742157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.742261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.742464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.742573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.742770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.742872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857467-1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.743989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.744083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.744295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.744457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.744600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.744775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.744914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.745087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.745241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.745412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.745572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.745731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.745914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.746067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.746226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.746372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.746526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.746679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.746784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.747923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.748940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.749142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.749251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.749397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.749502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.749706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.749800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.750920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.751918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.752123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.752225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.752433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.752537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.752734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.752849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.753038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.753156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.753368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.753474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.753713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.753892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.754049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.754293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.754388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.754608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.754711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.754933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.755968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.756199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.756310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.756815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.756908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.757096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.757197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.757405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.757534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.757746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.757865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.758096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.758190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.758408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.758515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.758719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.758821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.759037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.759138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.759343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.759440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.759650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.759751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.759956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.760050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.760271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.760365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.760593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.760708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.760893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.761001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.761146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.761241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.761447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.761541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.761750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.761882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.762094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.762206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.762407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.762510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.762711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.762816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.763019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.763145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.763318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.763427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.763626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.763748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.763938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.764043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.764233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.764335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.764537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.764646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.764842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.764959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.765149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.765263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.765449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.765558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.765754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.765878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.766167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.766274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.766471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.766575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.766789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.766884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.767107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.767213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.767414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.767510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.767720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.767816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.768026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.768128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.768331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.768426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.768640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.768749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.769445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.769544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.769767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.769996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.770117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.770426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.770520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.770734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.770850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.771050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.771153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.771358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.771453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.771663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.771772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.771981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.772076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.772283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.772386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.772588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.772689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.772909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.773004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.773218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.773345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.773521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.774261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.774386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.774485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.774485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.774656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.774742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.774835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.774835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.774991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.775090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.775201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.775298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.775399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.775605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.775713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.775921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.776016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.776240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.776339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.776549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.776652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.776855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.776951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.777159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.777262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.777471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.777572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 16:29:38.777785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.777926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.778121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.778226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.778451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.778556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.778764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.778866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.779086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.779191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.779397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.779503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.779709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.779811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.780961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.781066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.781272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.781367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.781580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.781676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.781928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.782982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.783198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.783309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.783513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.783626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.783822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.783927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.784141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.784285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.784459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.784561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.785316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.785495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.785616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.785818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.785986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.786147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.786331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.786451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.786647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.786751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.786974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.787077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.787294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.787398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.787609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.787712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.787922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.788971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.789178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.789286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.789483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.789596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.789789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.789918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.790120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.790223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.790440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.790533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.790756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.790850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.791072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.791188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.791383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.791479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.791693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.791789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.792975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.793072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.793283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.793376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.793600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.793744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.793932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.794953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.795167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.795278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.795476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.795650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.795820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.795913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.796109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.796252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.796407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.796570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.796725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.796884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.797916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.798928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.799151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.799254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.799464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.799559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.799773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.799865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.800094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.800217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.800437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.800745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.801109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.801420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.801729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.802075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.802291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.802390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.802631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.802743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.802952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.803056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.803289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.803392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.803612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.803729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.803920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.804974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.805188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.805293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.805521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.805619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.805855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.805988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.806190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.806299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.806481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.806651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.806790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.806893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.807092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.807397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.807500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.807702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.807797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.808925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.809986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.810165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.810271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.810470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.810571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.810775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.810876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.811076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.811176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.811402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.811513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.811712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.811814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.812976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.813072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.813301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.813407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.813615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.813724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.813948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.814990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.815243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.815348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.815558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.815669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.815917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.816997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.817212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.817308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.817524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.817620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.817864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.817975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.818186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.818287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.818500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.818607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.818823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.818926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.819137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.819239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.819447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.819541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.819756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.819849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.820998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.821106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.821303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.821391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.821614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.821715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.821954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.822064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.822266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.822538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.822633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.822876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.822971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.823198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.823301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.823502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.823602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.823818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.823918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.824150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.824316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.824479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.824577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.824788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.824886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.825102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.825204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.825408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.825510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.825734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.825866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.826970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.827984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.828192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.828293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.828497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.828586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.828808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.828901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.829114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.829216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.829420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.829523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.829724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.829816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.830985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.831084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.831291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.831384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.832161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.832276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.832546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.832709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.832894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.833044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.833203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.833364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.833546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.833673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.833906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.834987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.835210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.835316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.835517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.835621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.835824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.835933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.836129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.836228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.836445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.836561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.836758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.836890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.837059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.837170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.837368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.837466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.837677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.837783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.838956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.839062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.839262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.839406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.839557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.839713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.839866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.840892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.841999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.842216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.842323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.842522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.842629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.842830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.842932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.843137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.843246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.843450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.843555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.843763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.843868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.844068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.844171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.844396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.844506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.844708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.844820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.845949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.846977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.847816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.847944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.848155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.848249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.848538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.848633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.848848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.848965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.849152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.849249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.849467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.849629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.849787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.849931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.850098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.850204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.850405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.850506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.850708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.850831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.851930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.852944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.853194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.853303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.853504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.853601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.853855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.853971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.854158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.854254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.854499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.854619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.854803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.854897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.855099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.855223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.855405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.855509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.855716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.855818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.856941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.857997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.858196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.858290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.858498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.858591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.858816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.858922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.859129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.859233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.859434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.859529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.859739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.859898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.860048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.860193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.860346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.860497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.860728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.860876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.861907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.862097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.862243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.862386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.862546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.862726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.862872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.863915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.864923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.865112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.865198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.865416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.865502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.865719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.865801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.866055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.866141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.866365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.866467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.866874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.866997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.867968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.868154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.868260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.868458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.868569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.868761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.868864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.869061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.869173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.869366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.869572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.869684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.869911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.870944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.871157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.871266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.871468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.871563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.871792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.871972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.872988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.873099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.873295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.873399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.873620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.873716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.873966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.874062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.874276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.874399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.874592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.874695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.874903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.875071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.875212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.875385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.875514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.875698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.875806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.876990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.877111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.877307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.877413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.877621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.877722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.877965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.878083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.878283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.878903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.879215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.879321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.879530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.879642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.879850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.879985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.880165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.880281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.880477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.880581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.880793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.880888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.881183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.881294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.881676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.881812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.882958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.883068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.883267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.883370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.883593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.883688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.883907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.884957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.885173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.885277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.885444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.885548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.885752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.885919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.886088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.886237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.886397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.886554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.886704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.886862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.887967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.888107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.888283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.888432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.888607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.888835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.888934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.889147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.889279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.889461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.889566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.889774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.889890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.890111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.890301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.890418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.890512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.890726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.890828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.891969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.892065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.892293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.892387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.892599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.892708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.892920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.893033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.893247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.893381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.893562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.893671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.893901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.894561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.894776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.895964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.896066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.896272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.896378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.896581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.896685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.896891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.897999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.898157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.898315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.898460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.898613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.898765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.898924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.899966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.900149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.900300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.900461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.900615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.900774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.900922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.901992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.902160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.902306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.902460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.902612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.902756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.902863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.903893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.904948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.905191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.905289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.905499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.905643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.905840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.905959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.906155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.906250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.906482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.906577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.906799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.906903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.907124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.907229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.907480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.907585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.907758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.907863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.908992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.909096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.909298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.909401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.909666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.909779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.910074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.910229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.910424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.910595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.910745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.910934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.911063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.911269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.911423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.911586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.911741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.911922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.912052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.912255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.912351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.912585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.912710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.912898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.913011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.913220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.913326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.913548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.913658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.913878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.914964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.915114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.915272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.915418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.915561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.915704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.915864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.916938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.917091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.917243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.917393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.917532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.917761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.917961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.918116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.918260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.918416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.918567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.918715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.918868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.919925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.920973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.921181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.921277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.921488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.921585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.921799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.921936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.922140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.922237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.922444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.922546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.922753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.922855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.923061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.923150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.923374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.923602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.923761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.923953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.924212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.945011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.945384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.945561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.945652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.945892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.946986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.947092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.947185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.947366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.947537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.947698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.947939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.948183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.948317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.948412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.948542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.948698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.948903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.949978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.950930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.951972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.952977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.953986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.954948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.955812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.956568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.957820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.958900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.959978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.960955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.961996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.962940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.963943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.964970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.965987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.966970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.967049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.967681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.967793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.967873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.967950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.968849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.969028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.969174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.969329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.969590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.969744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.969951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.970300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.970480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.970739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.970976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.971202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.971374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.971514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.971610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.971823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.971905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.972299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.972507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.972671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.972671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.972955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.973094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.973422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.973575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.973705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.973908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.973992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.974281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.974356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.974607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.974939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.975313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.975526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.975673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.975814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.975953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.976121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.976405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.976568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.976706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.976839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.977037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.977185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.977320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.977404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.977605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.977952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.978522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.978747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.978915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.979073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.979349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.979484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.979607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.979849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.980946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.981064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.981278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.981402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.981584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.981733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.982069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.982531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.982894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.983222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.983552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.983628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.983876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.984001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.984262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.984394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.984598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.984727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.984952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.985978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.986224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.986416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.986542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.986827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.986895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.987169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.987236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.987525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.987706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.987928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.988102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.988336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.988436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.988662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.988824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.988909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 16:29:38.989130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.989540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.990001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.990333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.990675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.991012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.991345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.991669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.992020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.992374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.992700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.993029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.993353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.993676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.994023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.994365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.994704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.995025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.995362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.995692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.996023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.996349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.996676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.997018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.997340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.997715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.998060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.998383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.998703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.999029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.999348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.999670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:38.999997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.000324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.000668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.001003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.001324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.001661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.002022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.002409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.002697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.003049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.003973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.004336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.004664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.004985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 16:29:39.005240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 16:29:39.054712 n-d-857467-1 devstack@n-api.service[122328]: INFO dbcounter [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Registered counter for database nova_api Sep 13 16:29:39.069951 n-d-857467-1 devstack@n-api.service[122327]: INFO dbcounter [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Registered counter for database nova_api Sep 13 16:29:39.076719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.084036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writer thread running {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.090869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.098396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writer thread running {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.141890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.context [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=122328) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 16:29:39.146248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.146733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.148437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.149218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.149643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.151659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.153693 n-d-857467-1 devstack@n-api.service[122328]: INFO dbcounter [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Registered counter for database nova_cell0 Sep 13 16:29:39.156333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.context [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=122327) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 16:29:39.157739 n-d-857467-1 devstack@n-api.service[122328]: INFO dbcounter [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Registered counter for database nova_cell1 Sep 13 16:29:39.161283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.161763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.163967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.164771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:29:39.165241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:29:39.166123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.167362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:29:39.168310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.169614 n-d-857467-1 devstack@n-api.service[122327]: INFO dbcounter [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Registered counter for database nova_cell0 Sep 13 16:29:39.173805 n-d-857467-1 devstack@n-api.service[122327]: INFO dbcounter [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Registered counter for database nova_cell1 Sep 13 16:29:39.177342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writer thread running {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.177639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writer thread running {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.182455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.185865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.192573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writer thread running {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.195410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writer thread running {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.333389 n-d-857467-1 devstack@n-api.service[122328]: INFO dbcounter [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Registered counter for database nova_cell0 Sep 13 16:29:39.340273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.345343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writer thread running {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.356464 n-d-857467-1 devstack@n-api.service[122327]: INFO dbcounter [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Registered counter for database nova_cell0 Sep 13 16:29:39.366790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_db.sqlalchemy.engines [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 16:29:39.371315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writer thread running {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 16:29:39.671245 n-d-857467-1 devstack@n-api.service[122328]: WARNING keystonemiddleware.auth_token [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:29:39.679152 n-d-857467-1 devstack@n-api.service[122328]: WARNING keystonemiddleware.auth_token [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:29:39.707456 n-d-857467-1 devstack@n-api.service[122327]: WARNING keystonemiddleware.auth_token [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:29:39.714941 n-d-857467-1 devstack@n-api.service[122327]: WARNING keystonemiddleware.auth_token [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:29:40.030276 n-d-857467-1 devstack@n-api.service[122328]: WARNING keystonemiddleware.auth_token [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:29:40.036322 n-d-857467-1 devstack@n-api.service[122328]: WARNING keystonemiddleware.auth_token [None req-dcc15405-825c-4158-a74d-7b95a7cd5c55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:29:40.041643 n-d-857467-1 devstack@n-api.service[122328]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56403fa349c0 pid: 122328 (default app) Sep 13 16:29:40.063001 n-d-857467-1 devstack@n-api.service[122327]: WARNING keystonemiddleware.auth_token [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 16:29:40.069653 n-d-857467-1 devstack@n-api.service[122327]: WARNING keystonemiddleware.auth_token [None req-20ee5fa9-9da0-49af-8053-f8b96fe6045b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 16:29:40.075030 n-d-857467-1 devstack@n-api.service[122327]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56403fa349c0 pid: 122327 (default app) Sep 13 16:30:21.153744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.154603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.155346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.156084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.769415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.770895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.772077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:21.772931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:22.497942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1847244474", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:22.960869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:22.965659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:22.966184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:22.966623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:22.967393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:22.967849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:22.968277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.018586 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-babceb04-fb75-439e-b688-be34994a689c tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.258533 Sep 13 16:30:23.019796 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1/1] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:30:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:30:23.082402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:30:23.209281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9382fe1c-1859-45e0-aa78-7611a31dd407 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1723988500", "ram": 512, "vcpus": 1, "disk": 10, "id": 917517275, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:23.268373 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9382fe1c-1859-45e0-aa78-7611a31dd407 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.240625 Sep 13 16:30:23.268975 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:23 2022] POST /compute/v2.1/flavors => generated 413 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:23.462086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4d35f71-e2bc-49f2-bb92-18e8acbaf546 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1572438353", "id": 1604723283, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:23.482663 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b4d35f71-e2bc-49f2-bb92-18e8acbaf546 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.212347 Sep 13 16:30:23.483572 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3/3] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:23 2022] POST /compute/v2.1/flavors => generated 430 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:23.485091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:30:23.485620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:30:23.486234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:30:23.486875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:30:23.487489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:30:23.505594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.506489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.506961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.507896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.508523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.509135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.543094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Getting quotas for project 524aaaf44c2844aba44b186af0447f92. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:30:23.549648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Getting quotas for user 937e91d31b0e40528917884dcd038387 and project 524aaaf44c2844aba44b186af0447f92. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:30:23.560982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:30:23.563789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:30:23.635135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fd4bd6c-cb23-4aed-808a-9e8e781c4531 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.486470 Sep 13 16:30:23.635792 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1/4] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:30:23.682375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:23.684316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.685021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.686297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.687046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.687900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.688560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.713532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6f43bbee-5fee-4812-8976-4388e9af0dee tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.228794 Sep 13 16:30:23.718164 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4/5] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Sep 13 16:30:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:23.753810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1e3cd17-f5ec-4c85-85ec-d43bf9868788 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] Calling method '.version_select at 0x7fbeb64c2ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:23.768762 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1e3cd17-f5ec-4c85-85ec-d43bf9868788 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.131786 Sep 13 16:30:23.769336 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2/6] 10.222.0.61 () {60 vars in 1226 bytes} [Tue Sep 13 16:30:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:30:23.774859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85e75e89-0536-4d19-88e6-c7185a264d1f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-466216128"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:23.778691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-85e75e89-0536-4d19-88e6-c7185a264d1f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 2b24f135-f6c2-4f04-a2c9-833d76be3117 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:23.831475 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85e75e89-0536-4d19-88e6-c7185a264d1f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060371 Sep 13 16:30:23.832301 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3/7] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:23.838814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-803554e9-b471-4497-9739-3662f699d96c tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:23.877049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '.version_select at 0x7fbeb6d484c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:23.885208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=122327) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 13 16:30:23.886080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.886705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.887387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.901070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-803554e9-b471-4497-9739-3662f699d96c tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066053 Sep 13 16:30:23.907107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4/8] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Sep 13 16:30:23 2022] POST /compute/v2.1/flavors/917517275/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:23.912572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08a59ee7-b35b-45f9-8b70-4aeaf0c11f26 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:23.920142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.920901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.921543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.938283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:23.942909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:23.943446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:23.951258 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1286f32-a26b-45ec-af90-5a7a58b6a0b3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.231818 Sep 13 16:30:23.952355 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 16:30:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:23.966530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08a59ee7-b35b-45f9-8b70-4aeaf0c11f26 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1604723283" status: 202 len: 0 microversion: 2.1 time: 0.058037 Sep 13 16:30:23.973717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:30:23 2022] DELETE /compute/v2.1/flavors/1604723283 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:23.985468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58ab87fa-745b-4def-b9fe-e85c98675f3b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:23.991022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-58ab87fa-745b-4def-b9fe-e85c98675f3b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:24.104784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-58ab87fa-745b-4def-b9fe-e85c98675f3b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:24.120110 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58ab87fa-745b-4def-b9fe-e85c98675f3b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1220 microversion: 2.1 time: 0.143171 Sep 13 16:30:24.120684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:23 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:24.124552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2622a9a4-0fe8-46d7-976f-f815ae7259ad tempest-AZAdminNegativeTestJSON-800879898 tempest-AZAdminNegativeTestJSON-800879898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:24.125722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:24.127249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2622a9a4-0fe8-46d7-976f-f815ae7259ad tempest-AZAdminNegativeTestJSON-800879898 tempest-AZAdminNegativeTestJSON-800879898-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '5445bc5b9e13476394956680743d4e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d7b655367441e3ba753e2aa213f6d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:24.127816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:24.128429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:24.129007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:24.130299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:24.130899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2622a9a4-0fe8-46d7-976f-f815ae7259ad tempest-AZAdminNegativeTestJSON-800879898 tempest-AZAdminNegativeTestJSON-800879898-project] Request method failure captured: Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAepUkZEkzgnFinbmiKp84YktuTK-Vn78e-h5MTOCc-YwiNenFjtZfBqnb_h9s5-hARUO-LIOgekCIUaklLvNrZja1y5pLG-oDkgcKZGSW6ekf2O-8ouCWBgy3h7weY9np0yFBf8qkn1IPjCYEbc27CNgzD8sRSSnSievYIoakn7xw Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 02d7b655367441e3ba753e2aa213f6d0 Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AZAdminNegativeTestJSON-800879898 Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:30:24.131072 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/02d7b655367441e3ba753e2aa213f6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_02d7b655367441e3ba753e2aa213f6d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/02d7b655367441e3ba753e2aa213f6d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/02d7b655367441e3ba753e2aa213f6d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AZAdminNegativeTestJSON-800879898 Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 02d7b655367441e3ba753e2aa213f6d0 Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-800879898 Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AZAdminNegativeTestJSON-800879898-project Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5445bc5b9e13476394956680743d4e7d Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AZAdminNegativeTestJSON-800879898-project Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 13 16:30:24.132371 n-d-857467-1 devstack@n-api.service[122327]: action_args: {} Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:24.132949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:24.133873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2622a9a4-0fe8-46d7-976f-f815ae7259ad tempest-AZAdminNegativeTestJSON-800879898 tempest-AZAdminNegativeTestJSON-800879898-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:24.134742 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2622a9a4-0fe8-46d7-976f-f815ae7259ad tempest-AZAdminNegativeTestJSON-800879898 tempest-AZAdminNegativeTestJSON-800879898-project] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.179628 Sep 13 16:30:24.134742 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:30:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:24.136142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:24.140816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7b385c6b-fb6d-40dc-adea-bb98d271d660 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb75ffdc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:24.181380 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10c7c58f-e381-4594-b6c1-b0d579263ccf tempest-AZAdminV2TestJSON-405452212 tempest-AZAdminV2TestJSON-405452212-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.058622 Sep 13 16:30:24.182766 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:30:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:24.188755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1ea186e-03ce-4a56-944a-b27483d1c1f9 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:24.210915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ea186e-03ce-4a56-944a-b27483d1c1f9 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:24.211617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ea186e-03ce-4a56-944a-b27483d1c1f9 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:24.212273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ea186e-03ce-4a56-944a-b27483d1c1f9 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:24.482630 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7b385c6b-fb6d-40dc-adea-bb98d271d660 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.347910 Sep 13 16:30:24.492590 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 7/14] 10.222.0.61 () {62 vars in 1247 bytes} [Tue Sep 13 16:30:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:30:24.856655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6fbef86-cd75-48e2-8c34-371cac1063cb tempest-FlavorsExtraSpecsTestJSON-1311237510 tempest-FlavorsExtraSpecsTestJSON-1311237510-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:24.885719 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6fbef86-cd75-48e2-8c34-371cac1063cb tempest-FlavorsExtraSpecsTestJSON-1311237510 tempest-FlavorsExtraSpecsTestJSON-1311237510-project] 10.222.0.61 "GET /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.392473 Sep 13 16:30:24.886352 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Sep 13 16:30:24 2022] GET /compute/v2.1/flavors/917517275/os-extra_specs => generated 66 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:24.895069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e3b465e-306d-4ceb-96b1-a988b28748f7 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:24.938892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e3b465e-306d-4ceb-96b1-a988b28748f7 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.050023 Sep 13 16:30:24.939552 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:24 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:24.947952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed1d527e-e386-4346-b9ed-d6deecfe96f3 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] Calling method '.version_select at 0x7fbeb6d48700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:24.975325 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed1d527e-e386-4346-b9ed-d6deecfe96f3 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.034365 Sep 13 16:30:24.985012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 10/17] 10.222.0.61 () {60 vars in 1226 bytes} [Tue Sep 13 16:30:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:30:24.990858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8956f6c4-ad43-42b2-9a1b-59e160db50e9 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.044706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8956f6c4-ad43-42b2-9a1b-59e160db50e9 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058445 Sep 13 16:30:25.045798 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 11/18] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Sep 13 16:30:24 2022] POST /compute/v2.1/flavors/917517275/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.053603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d657a63b-6f61-45e6-afa1-207f1d043f3a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1266643704", "id": 508150019, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.073930 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1ea186e-03ce-4a56-944a-b27483d1c1f9 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.889700 Sep 13 16:30:25.074542 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 8/19] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:30:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:25.079771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80eec287-5532-470c-bece-feb84320be89 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb6388430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.105133 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d657a63b-6f61-45e6-afa1-207f1d043f3a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057715 Sep 13 16:30:25.106946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 12/20] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:25.116820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce3817ec-9a68-4425-8e7a-ec37f846e750 tempest-FlavorsExtraSpecsTestJSON-1311237510 tempest-FlavorsExtraSpecsTestJSON-1311237510-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.133160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce3817ec-9a68-4425-8e7a-ec37f846e750 tempest-FlavorsExtraSpecsTestJSON-1311237510 tempest-FlavorsExtraSpecsTestJSON-1311237510-project] 10.222.0.61 "GET /compute/v2.1/flavors/917517275/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023815 Sep 13 16:30:25.139496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 13/21] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/917517275/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.146883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.184167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:25.184778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:25.185302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:25.224956 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80eec287-5532-470c-bece-feb84320be89 tempest-QuotaClassesAdmin257Test-758114726 tempest-QuotaClassesAdmin257Test-758114726-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.147162 Sep 13 16:30:25.230319 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 9/22] 10.222.0.61 () {62 vars in 1247 bytes} [Tue Sep 13 16:30:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:30:25.242183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a7a4d954-b503-4d2a-9c51-b7511d16898b tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.259309 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-857467-1. Sep 13 16:30:25.278104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a7a4d954-b503-4d2a-9c51-b7511d16898b tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.045914 Sep 13 16:30:25.279420 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 10/23] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:25.284183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41a198a3-73d6-4d4d-9d2b-77dd34e61287 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.314557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41a198a3-73d6-4d4d-9d2b-77dd34e61287 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033799 Sep 13 16:30:25.315446 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 11/24] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Sep 13 16:30:25 2022] POST /compute/v2.1/flavors/917517275/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 39 Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:25.318607 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: {"add_host": {"host": "n-h1-857467-1"}} Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:25.319681 n-d-857467-1 devstack@n-api.service[122327]: exception: Aggregate 1 already has host n-h1-857467-1. Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-857467-1'}}} Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result.read() Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 16:30:25.320350 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-857467-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi session.flush() Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 16:30:25.321252 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 16:30:25.322476 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 16:30:25.323565 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result.read() Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-857467-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 13, 16, 30, 25, 221681), 'updated_at': None, 'host': 'n-h1-857467-1', 'aggregate_id': 1}] Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:25.324644 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-857467-1. Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.325564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-857467-1. Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:25.326702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:25.331326 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-857467-1. Sep 13 16:30:25.331326 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:25.331326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-857467-1. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:25.331326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd50a661-252a-49e3-b6a1-73c8fa697063 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.178992 Sep 13 16:30:25.332099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.332099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:25.332099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:25.332099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:25.333158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:25.333158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:25.333158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:25.333498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:25.341706 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 14/25] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:30:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 13 16:30:25.346574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b7630ebd-92e4-47ab-a9e0-3e360f00f7be tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.414076 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b7630ebd-92e4-47ab-a9e0-3e360f00f7be tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/508150019" status: 202 len: 0 microversion: 2.1 time: 0.071011 Sep 13 16:30:25.414892 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 15/26] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:25 2022] DELETE /compute/v2.1/flavors/508150019 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:25.419460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24d7e2a8-6d9c-4ad5-9605-c0f90d391239 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.439618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24d7e2a8-6d9c-4ad5-9605-c0f90d391239 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023819 Sep 13 16:30:25.440483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 16/27] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/917517275/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.446630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5596406-9261-45d3-b4c1-cf085aa86839 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.479102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5596406-9261-45d3-b4c1-cf085aa86839 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:25.479606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5596406-9261-45d3-b4c1-cf085aa86839 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:25.480056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5596406-9261-45d3-b4c1-cf085aa86839 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:25.494330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=11,nova_api:UPDATE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:25.499304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:25.513262 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebb60bbb-f0a1-475d-a54e-8a630428de34 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1224 microversion: 2.1 time: 0.196762 Sep 13 16:30:25.514208 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 12/28] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:25.521557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca942fb6-6272-4519-be8d-bd0852f8d725 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.552843 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca942fb6-6272-4519-be8d-bd0852f8d725 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.037396 Sep 13 16:30:25.553809 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 13/29] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:25.562735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6547bc2-83db-4ac7-bcb7-4176358bfe82 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.618214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=3,nova_api:UPDATE=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:25.630535 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6547bc2-83db-4ac7-bcb7-4176358bfe82 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/917517275/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.074200 Sep 13 16:30:25.631880 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 14/30] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:30:25 2022] PUT /compute/v2.1/flavors/917517275/os-extra_specs/hw:numa_nodes => generated 22 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.643211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13c581d2-b60b-4e95-8457-284b04e2859e tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1274025804", "id": 939963764, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.703408 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13c581d2-b60b-4e95-8457-284b04e2859e tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.069270 Sep 13 16:30:25.705236 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 15/31] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:25 2022] POST /compute/v2.1/flavors => generated 426 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:25.724261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e15f99bb-7256-427a-bfd7-f6b5973b332f tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.737179 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e15f99bb-7256-427a-bfd7-f6b5973b332f tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030892 Sep 13 16:30:25.737767 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/917517275/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.746296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed429b86-3a7d-45c4-b139-488a61267ff1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.789564 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed429b86-3a7d-45c4-b139-488a61267ff1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/939963764" status: 202 len: 0 microversion: 2.1 time: 0.050692 Sep 13 16:30:25.791027 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 17/33] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:25 2022] DELETE /compute/v2.1/flavors/939963764 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:25.796249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a7bc472-5a47-4af7-81f4-a5653bd45869 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.830896 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a7bc472-5a47-4af7-81f4-a5653bd45869 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/917517275/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.038548 Sep 13 16:30:25.831694 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 18/34] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:30:25 2022] DELETE /compute/v2.1/flavors/917517275/os-extra_specs/hw:numa_nodes => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:25.840204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a46b0d99-cad0-4c22-8d87-12927b94bbce tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.863371 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a46b0d99-cad0-4c22-8d87-12927b94bbce tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.030756 Sep 13 16:30:25.864627 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:25.870003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06ec2d4e-86ae-4091-a9c2-3bc5f3d6c0aa tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.899714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06ec2d4e-86ae-4091-a9c2-3bc5f3d6c0aa tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/917517275/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.033310 Sep 13 16:30:25.899911 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 20/36] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:30:25 2022] DELETE /compute/v2.1/flavors/917517275/os-extra_specs/hw:cpu_policy => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:25.904779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e75aa17e-487e-4cb0-a1c5-336f36e30e6e tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-235289902", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:25.930874 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e75aa17e-487e-4cb0-a1c5-336f36e30e6e tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.030013 Sep 13 16:30:25.931954 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 21/37] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:25 2022] POST /compute/v2.1/flavors => generated 506 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:25.939317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-931b4b89-1a5d-479f-9b8d-4d8fbfb714cf tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.949118 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-931b4b89-1a5d-479f-9b8d-4d8fbfb714cf tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/917517275/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015872 Sep 13 16:30:25.950229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 22/38] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Sep 13 16:30:25 2022] GET /compute/v2.1/flavors/917517275/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:25.958856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-407f54d3-733f-4f40-87b6-bcb518bf66da tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:25.979049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-407f54d3-733f-4f40-87b6-bcb518bf66da tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/ccff1746-1453-4e99-abd9-1225bf8673ed" status: 202 len: 0 microversion: 2.1 time: 0.027413 Sep 13 16:30:25.979998 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 23/39] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:30:25 2022] DELETE /compute/v2.1/flavors/ccff1746-1453-4e99-abd9-1225bf8673ed => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:25.985587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3db26af8-297a-4c37-ac87-3a20cd61b226 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.010485 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3db26af8-297a-4c37-ac87-3a20cd61b226 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/917517275" status: 202 len: 0 microversion: 2.1 time: 0.028667 Sep 13 16:30:26.011942 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 24/40] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:25 2022] DELETE /compute/v2.1/flavors/917517275 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:26.017814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3406bb85-b0ca-464d-b9e0-1ddbcb349a8a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.041552 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3406bb85-b0ca-464d-b9e0-1ddbcb349a8a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028471 Sep 13 16:30:26.042740 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 25/41] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:26.047090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ffb0b53-1cb8-486f-80e3-30d7ad168520 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.082227 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ffb0b53-1cb8-486f-80e3-30d7ad168520 tempest-FlavorsExtraSpecsTestJSON-61169837 tempest-FlavorsExtraSpecsTestJSON-61169837-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038384 Sep 13 16:30:26.084044 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 26/42] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:26.088646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8308b94d-b35f-4499-99a7-3e254a108407 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-741089992", "id": "979c6ca7-d310-4a80-a02b-63ffb8070506", "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:26.128490 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8308b94d-b35f-4499-99a7-3e254a108407 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.043514 Sep 13 16:30:26.129781 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 27/43] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:26 2022] POST /compute/v2.1/flavors => generated 506 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:26.142571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f0dcdfd-f25d-4569-8182-15a8cfef4b03 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.165867 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f0dcdfd-f25d-4569-8182-15a8cfef4b03 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/979c6ca7-d310-4a80-a02b-63ffb8070506" status: 202 len: 0 microversion: 2.1 time: 0.026424 Sep 13 16:30:26.168134 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 28/44] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:30:26 2022] DELETE /compute/v2.1/flavors/979c6ca7-d310-4a80-a02b-63ffb8070506 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:30:26.173890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e2079b1-4132-41c6-8570-cc6b646b166b tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.206091 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e2079b1-4132-41c6-8570-cc6b646b166b tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035602 Sep 13 16:30:26.206877 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 29/45] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:26.231922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38a9cdbf-33f6-4695-8c3b-77327646360b tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1673012581", "id": 902920621, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:26.266184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38a9cdbf-33f6-4695-8c3b-77327646360b tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.040019 Sep 13 16:30:26.267049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 30/46] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:26 2022] POST /compute/v2.1/flavors => generated 411 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:26.278923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a000ef3-2a82-418a-b9eb-fe209fc2fcf6 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.303670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a000ef3-2a82-418a-b9eb-fe209fc2fcf6 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/902920621" status: 200 len: 411 microversion: 2.1 time: 0.028495 Sep 13 16:30:26.304551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 31/47] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/flavors/902920621 => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:26.792602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5596406-9261-45d3-b4c1-cf085aa86839 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 1.347365 Sep 13 16:30:26.794007 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 17/48] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:30:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:26.805168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:26.809099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:26.840802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:26.841303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:26.845721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:26.846992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:26.847607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:26.848390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:27.074180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55094a40-a908-46bc-b5ad-5aa753842b51 tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.140841 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55094a40-a908-46bc-b5ad-5aa753842b51 tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.827779 Sep 13 16:30:27.146473 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 32/49] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:27.157548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7814201-4b82-48a8-87e5-45a954ff6778 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.203938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7814201-4b82-48a8-87e5-45a954ff6778 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.056007 Sep 13 16:30:27.205458 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 33/50] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:27 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:27.211171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75720d1e-bb58-44bc-afdb-c9effc15a6d1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.235847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75720d1e-bb58-44bc-afdb-c9effc15a6d1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/902920621" status: 202 len: 0 microversion: 2.1 time: 0.029098 Sep 13 16:30:27.236970 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 34/51] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:27 2022] DELETE /compute/v2.1/flavors/902920621 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:27.246910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2012bd6-6e7d-432d-9f6e-5e7bc3dae40b tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1985796467"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:27.253276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-a2012bd6-6e7d-432d-9f6e-5e7bc3dae40b tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 71312c4b-8f8d-4bd7-a8ba-5da5dd42a955 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:27.279678 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a2012bd6-6e7d-432d-9f6e-5e7bc3dae40b tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038212 Sep 13 16:30:27.281310 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 35/52] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:27.287339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-741a53a9-5f4f-4242-834c-28a401880c6f tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1795275612", "name": "tempest-test_aggregate-1011146908"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:27.309730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-741a53a9-5f4f-4242-834c-28a401880c6f tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid e88ea7bb-f4e6-4566-9afe-fe19129103cd for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:27.328890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:DELETE=19,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:27.351028 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-741a53a9-5f4f-4242-834c-28a401880c6f tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.068118 Sep 13 16:30:27.351655 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 36/53] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Sep 13 16:30:27 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:27.363378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c15c826d-032e-45f9-b321-0563c6a04baa tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.420228 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c15c826d-032e-45f9-b321-0563c6a04baa tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067402 Sep 13 16:30:27.421666 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 37/54] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:27.940648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13d0bd71-501f-4690-924b-d27b526560de tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:27.944097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13d0bd71-501f-4690-924b-d27b526560de tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '7d3964f2b37b4c5991e8eb85a111e346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61779f585dd24cbe887ad5531a9755b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13d0bd71-501f-4690-924b-d27b526560de tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Request method failure captured: Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 39 Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAbY5Sfa9ak0VxWNnYu7RKzemO-0vxogEeIezeh7GcoobzGOUdtY8AeLTHdyMydReRMPq0dbYbZApulZhQ1vImOnDqDvkxwAadILlGnGlhje5A_SoX_euJFW2EmfOsWT4YOZkW0DQp-BHYNa_lGFK-Z_t6pVME78Mq--TWaB4qjOrs Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:27.947952 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7d3964f2b37b4c5991e8eb85a111e346 Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: {"add_host": {"host": "n-h1-857467-1"}} Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:27.949020 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-857467-1'}}} Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:27.949674 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 13 16:30:27.951120 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:27.952158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13d0bd71-501f-4690-924b-d27b526560de tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:27.952158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13d0bd71-501f-4690-924b-d27b526560de tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.526886 Sep 13 16:30:27.952158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 38/55] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:30:27 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 528 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:27.968031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8ad9d337-8e08-4460-b16c-ae133a4d1b45 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:27.992053 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8ad9d337-8e08-4460-b16c-ae133a4d1b45 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.041048 Sep 13 16:30:27.992943 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 39/56] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:30:27 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.002223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-262cfea2-aa85-4477-a9c2-2fdeadeac504 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-454433743", "id": 1287412668, "os-flavor-access:is_public": "False"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.049120 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-262cfea2-aa85-4477-a9c2-2fdeadeac504 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.054227 Sep 13 16:30:28.050906 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 40/57] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:27 2022] POST /compute/v2.1/flavors => generated 429 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.076092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b28edbc-c354-4bf3-9aa4-50d4aa247d25 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:28.101098 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b28edbc-c354-4bf3-9aa4-50d4aa247d25 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.047470 Sep 13 16:30:28.104223 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 41/58] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:28 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:28.115196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2fcc837-87b9-48f9-8a3f-5f5a6832c3d7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.136494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2fcc837-87b9-48f9-8a3f-5f5a6832c3d7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:28.137025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2fcc837-87b9-48f9-8a3f-5f5a6832c3d7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:28.137458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2fcc837-87b9-48f9-8a3f-5f5a6832c3d7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:28.411525 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2fcc837-87b9-48f9-8a3f-5f5a6832c3d7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.304716 Sep 13 16:30:28.417887 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 42/59] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.428909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24a0b76d-8784-472a-a0f8-df2c3d50d64b tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "1287412668"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.456625 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-24a0b76d-8784-472a-a0f8-df2c3d50d64b tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] HTTP exception thrown: Flavor 1287412668 could not be found. Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24a0b76d-8784-472a-a0f8-df2c3d50d64b tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] Request method failure captured: Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 107 Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAbKO_eBVswJjMVK4rnGPDDf4_pCQsP2NSZfGKfJJzI3lgdSc4otkcMcORYXvkcYYnx6lKYNJ0HW6fShUOKt1bSyG_MGtW0qgJHQpgytsz3OC8xnHljgcnmsitsOGDXyCYVw4rFYhzXp8lxdZ2nw2MdB0SQFmnWriiLLaR-8e8LwIg Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 784f9a2876444d14b926d8b87260d807 Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsAdminTestJSON-1204647196 Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:28.480899 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/784f9a2876444d14b926d8b87260d807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_784f9a2876444d14b926d8b87260d807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/784f9a2876444d14b926d8b87260d807"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/784f9a2876444d14b926d8b87260d807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsAdminTestJSON-1204647196 Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 784f9a2876444d14b926d8b87260d807 Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1204647196 Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsAdminTestJSON-1204647196-project Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 79abd9f008fc4c3599caa27670e89f09 Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsAdminTestJSON-1204647196-project Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "test", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "1287412668"}} Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:28.482339 n-d-857467-1 devstack@n-api.service[122328]: exception: Flavor 1287412668 could not be found. Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '1287412668'}}} Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1287412668 could not be found. Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.483218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1287412668 could not be found. Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.484298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.486962 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.486962 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:28.486962 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:28.486962 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1287412668 could not be found. Sep 13 16:30:28.486962 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.489121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24a0b76d-8784-472a-a0f8-df2c3d50d64b tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] Returning 400 to user: Flavor 1287412668 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:28.490506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-24a0b76d-8784-472a-a0f8-df2c3d50d64b tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.071411 Sep 13 16:30:28.495760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:28.509104 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 43/60] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/servers => generated 81 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:30:28.521855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c506c708-7cb1-4097-aafe-eb5b6e9dbdf1 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1120198729"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.535633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-c506c708-7cb1-4097-aafe-eb5b6e9dbdf1 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 9e1cacf5-3394-483e-b0bf-d21b0c287bbb for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:28.538444 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c53417b-aae1-4cea-9ede-7ca5e346eb8c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1320 microversion: 2.1 time: 1.743119 Sep 13 16:30:28.539121 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 18/61] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:26 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1320 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:28.584194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e43ce08b-02e4-472e-87e8-668e26797da1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:28.612544 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c506c708-7cb1-4097-aafe-eb5b6e9dbdf1 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093725 Sep 13 16:30:28.613686 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 44/62] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.628889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1302739281"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.642408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e43ce08b-02e4-472e-87e8-668e26797da1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1287412668" status: 202 len: 0 microversion: 2.1 time: 0.079302 Sep 13 16:30:28.643027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 19/63] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:30:28 2022] DELETE /compute/v2.1/flavors/1287412668 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:28.659112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=122328) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 13 16:30:28.660329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:28.661130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:28.661982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:28.673997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7f0c9ef6-f529-43e6-87cb-957d24e74625 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:28.675008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:28.675594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:28.676866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:28.697466 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1302739281 could not be found. Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 58 Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:28.704857 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: {"add_host": {"host": "tempest-nonexist_host-1302739281"}} Sep 13 16:30:28.706173 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: exception: Compute host tempest-nonexist_host-1302739281 could not be found. Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1302739281'}}} Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1302739281' is not mapped to any cell Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.706864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 13 16:30:28.707985 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1302739281 could not be found. Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1302739281 could not be found. Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.709032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1302739281 could not be found. Sep 13 16:30:28.712711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.715839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1302739281 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:28.716961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e16ddb9-5fc4-4359-badf-1cd8e3299c85 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.094282 Sep 13 16:30:28.717992 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 45/64] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:28.726980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03b99c8e-52a3-4927-99f1-b54e1f3f4a17 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:28.755744 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7f0c9ef6-f529-43e6-87cb-957d24e74625 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093602 Sep 13 16:30:28.757401 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 20/65] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:28.778063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7fca3f2f-ae4e-479c-9a59-a0e35184401f tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-829102397", "id": 814926085, "os-flavor-access:is_public": "False"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.809318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03b99c8e-52a3-4927-99f1-b54e1f3f4a17 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.085574 Sep 13 16:30:28.811379 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7fca3f2f-ae4e-479c-9a59-a0e35184401f tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.037005 Sep 13 16:30:28.819885 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 46/66] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:28 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:28.828355 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 21/67] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/flavors => generated 411 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.829992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-969d4928-bd77-46df-bd8f-0cec1701fc26 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.840696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d91886c-07a6-449a-bc61-8cfe2a5246d3 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1766239531", "id": 1672604940, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-969d4928-bd77-46df-bd8f-0cec1701fc26 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 283 Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:28.853210 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:28.854640 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:30:28.855197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:28.855863 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.856743 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.857709 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:30:28.857709 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:30:28.857709 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:30:28.857709 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.857709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-969d4928-bd77-46df-bd8f-0cec1701fc26 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:28.859105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-969d4928-bd77-46df-bd8f-0cec1701fc26 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035625 Sep 13 16:30:28.866682 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 47/68] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:28.870919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d91886c-07a6-449a-bc61-8cfe2a5246d3 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033637 Sep 13 16:30:28.872159 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 22/69] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.874157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be5616ec-7aac-4e1c-9965-2806cea10dff tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be5616ec-7aac-4e1c-9965-2806cea10dff tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 27 Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:28.878417 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: {"aggregate": {"name": ""}} Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:28.880625 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi '' Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:28.881778 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:30:28.883857 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.892317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be5616ec-7aac-4e1c-9965-2806cea10dff tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:28.898835 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be5616ec-7aac-4e1c-9965-2806cea10dff tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030573 Sep 13 16:30:28.903263 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 48/70] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:28.903739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bfa1f43-a123-4b65-84cb-308df6b223fd tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:28.930567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc9d14ec-0dab-4795-83ea-4f375ec05657 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1688620268"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.940815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc9d14ec-0dab-4795-83ea-4f375ec05657 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '7d3964f2b37b4c5991e8eb85a111e346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61779f585dd24cbe887ad5531a9755b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc9d14ec-0dab-4795-83ea-4f375ec05657 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Request method failure captured: Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 60 Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAbY5Sfa9ak0VxWNnYu7RKzemO-0vxogEeIezeh7GcoobzGOUdtY8AeLTHdyMydReRMPq0dbYbZApulZhQ1vImOnDqDvkxwAadILlGnGlhje5A_SoX_euJFW2EmfOsWT4YOZkW0DQp-BHYNa_lGFK-Z_t6pVME78Mq--TWaB4qjOrs Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:28.945686 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7d3964f2b37b4c5991e8eb85a111e346 Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: {"aggregate": {"name": "tempest-test_aggregate-1688620268"}} Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:28.947772 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1688620268'}}} Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:28.948552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:28.949580 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 13 16:30:28.952484 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:28.954583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc9d14ec-0dab-4795-83ea-4f375ec05657 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:28.957988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc9d14ec-0dab-4795-83ea-4f375ec05657 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.041400 Sep 13 16:30:28.958787 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bfa1f43-a123-4b65-84cb-308df6b223fd tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.063882 Sep 13 16:30:28.959407 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 49/71] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:28.969843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c64b430-4f56-42d0-be82-2919685f7661 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1037107993"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:28.970180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 23/72] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Sep 13 16:30:28 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:28.981789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-7c64b430-4f56-42d0-be82-2919685f7661 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid fffdc844-ac70-4062-b709-56ba23a0757c for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:28.987068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3803f25a-187c-4516-aa08-e91940ee0abb tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.009328 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3803f25a-187c-4516-aa08-e91940ee0abb tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.034843 Sep 13 16:30:29.020709 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 24/73] 10.222.0.61 () {58 vars in 1177 bytes} [Tue Sep 13 16:30:28 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:29.028615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbe4036a-de2e-4a7e-924b-08ae003ac1af tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.040286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c64b430-4f56-42d0-be82-2919685f7661 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074425 Sep 13 16:30:29.043609 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 50/74] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:29.056136 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbe4036a-de2e-4a7e-924b-08ae003ac1af tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.031606 Sep 13 16:30:29.063488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57abcd70-0ac9-4303-aaff-268c414fc577 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1037107993"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:29.068104 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 25/75] 10.222.0.61 () {58 vars in 1171 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:29.073592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-57abcd70-0ac9-4303-aaff-268c414fc577 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 996dbba9-cb76-43af-8dc9-e5b91b7d5a6e for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:29.082453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b3eac564-9592-4c5b-ae8f-d23b98ae1360 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.093259 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-57abcd70-0ac9-4303-aaff-268c414fc577 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1037107993 already exists. Sep 13 16:30:29.095695 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b3eac564-9592-4c5b-ae8f-d23b98ae1360 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.026422 Sep 13 16:30:29.097011 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 26/76] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57abcd70-0ac9-4303-aaff-268c414fc577 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 60 Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:29.106098 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: {"aggregate": {"name": "tempest-test_aggregate-1037107993"}} Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:29.107362 n-d-857467-1 devstack@n-api.service[122328]: exception: Aggregate tempest-test_aggregate-1037107993 already exists. Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1037107993'}}} Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 13 16:30:29.108197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1037107993 already exists. Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:29.109386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1037107993 already exists. Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1037107993 already exists. Sep 13 16:30:29.110479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.118735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-80328a95-61b5-46bc-9323-cb989260f426 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.122099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57abcd70-0ac9-4303-aaff-268c414fc577 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1037107993 already exists. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:29.127714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57abcd70-0ac9-4303-aaff-268c414fc577 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.075325 Sep 13 16:30:29.129061 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 51/77] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:29 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:30:29.148906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e76d0f8d-5238-4b47-a344-d3223a04a556 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.151918 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-80328a95-61b5-46bc-9323-cb989260f426 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.038157 Sep 13 16:30:29.152821 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 27/78] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:29.195832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a1b5c24-331b-4ff7-a350-1bfced270229 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.229779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e76d0f8d-5238-4b47-a344-d3223a04a556 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.092618 Sep 13 16:30:29.231281 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 52/79] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:29 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 13 16:30:29.259282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-845b0ae4-4a1c-4336-98d2-00f38273692e tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1819731205"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:29.279488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-845b0ae4-4a1c-4336-98d2-00f38273692e tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid d49a73c7-cedf-4759-bf39-535ee3359ad4 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:29.299616 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a1b5c24-331b-4ff7-a350-1bfced270229 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.125829 Sep 13 16:30:29.312766 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 28/80] 10.222.0.61 () {58 vars in 1175 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:29.376834 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-845b0ae4-4a1c-4336-98d2-00f38273692e tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.134872 Sep 13 16:30:29.380233 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 53/81] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:29.399560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42524ea9-b8a7-4c34-a806-4d108fc3e7df tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.458795 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42524ea9-b8a7-4c34-a806-4d108fc3e7df tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.066824 Sep 13 16:30:29.460272 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 54/82] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:29.485714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdb87eb0-af97-4a3c-b437-02d20178fae5 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.492184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdb87eb0-af97-4a3c-b437-02d20178fae5 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '7d3964f2b37b4c5991e8eb85a111e346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61779f585dd24cbe887ad5531a9755b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdb87eb0-af97-4a3c-b437-02d20178fae5 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Request method failure captured: Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAbY5Sfa9ak0VxWNnYu7RKzemO-0vxogEeIezeh7GcoobzGOUdtY8AeLTHdyMydReRMPq0dbYbZApulZhQ1vImOnDqDvkxwAadILlGnGlhje5A_SoX_euJFW2EmfOsWT4YOZkW0DQp-BHYNa_lGFK-Z_t6pVME78Mq--TWaB4qjOrs Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:29.497021 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7d3964f2b37b4c5991e8eb85a111e346 Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 13 16:30:29.498716 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6'} Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:29.499597 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:29.501636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdb87eb0-af97-4a3c-b437-02d20178fae5 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:29.506424 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bdb87eb0-af97-4a3c-b437-02d20178fae5 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.039863 Sep 13 16:30:29.513866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 55/83] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:29.528046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64d8ef21-d9c6-462c-a8b6-1cfc94dd24b1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.569866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64d8ef21-d9c6-462c-a8b6-1cfc94dd24b1 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.053922 Sep 13 16:30:29.571106 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 56/84] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:29.587165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3b41b15-8e04-488c-9f50-022c07f9e7bb tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.725222 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3b41b15-8e04-488c-9f50-022c07f9e7bb tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.149980 Sep 13 16:30:29.737193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 57/85] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:29 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:29.753720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:29.762359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:29.786865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:29.793438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:29.793912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:29.797873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:29.800642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:29.801120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:30.359876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:30.382967 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee096ed9-66a0-48a3-85b4-178da6c7b7e2 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.639732 Sep 13 16:30:30.386988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 58/86] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:29 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:30.397614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-874a5dc2-d486-40d7-b303-059485cad4ca tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.469229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-874a5dc2-d486-40d7-b303-059485cad4ca tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1672604940" status: 202 len: 0 microversion: 2.1 time: 0.080482 Sep 13 16:30:30.474368 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 59/87] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:30:30 2022] DELETE /compute/v2.1/flavors/1672604940 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:30.485137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62f4f2b7-85ed-4a07-a412-2802d6720781 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.519202 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-62f4f2b7-85ed-4a07-a412-2802d6720781 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62f4f2b7-85ed-4a07-a412-2802d6720781 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:30.520990 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: exception: Aggregate -1 could not be found. Sep 13 16:30:30.522119 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '-1'} Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 13 16:30:30.522739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.523690 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62f4f2b7-85ed-4a07-a412-2802d6720781 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:30.524784 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62f4f2b7-85ed-4a07-a412-2802d6720781 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045945 Sep 13 16:30:30.534571 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 60/88] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:30:30 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:30:30.539776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60ec5fb3-2742-4297-9330-070584f8bc37 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.563058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2055500912", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "availability_zone": "tempest-test_az-1795275612"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:30.584706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:30.586766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:30.588441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:30.589571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:30.592915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:30.596197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:30.649358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60ec5fb3-2742-4297-9330-070584f8bc37 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.113540 Sep 13 16:30:30.651003 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 61/89] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:30.675930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-83cef2a3-bf90-4eb1-b5d5-38c5f1cfcf92 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-309601152"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:30.687095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-83cef2a3-bf90-4eb1-b5d5-38c5f1cfcf92 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 7f5dadb7-64be-48ce-8abd-aab9ee2e60b7 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:30:30.731531 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-83cef2a3-bf90-4eb1-b5d5-38c5f1cfcf92 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071665 Sep 13 16:30:30.757783 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 62/90] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:30:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:30.795602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2087f7e8-3b03-4a42-a780-c07157043e65 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.806722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:30:30.859823 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2087f7e8-3b03-4a42-a780-c07157043e65 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/814926085" status: 202 len: 0 microversion: 2.1 time: 0.100756 Sep 13 16:30:30.860413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 63/91] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:30 2022] DELETE /compute/v2.1/flavors/814926085 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:30.872492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c486221-9780-4ec5-a51d-c61bfab18d9d tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.874438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c486221-9780-4ec5-a51d-c61bfab18d9d tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '7d3964f2b37b4c5991e8eb85a111e346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61779f585dd24cbe887ad5531a9755b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c486221-9780-4ec5-a51d-c61bfab18d9d tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Request method failure captured: Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAbY5Sfa9ak0VxWNnYu7RKzemO-0vxogEeIezeh7GcoobzGOUdtY8AeLTHdyMydReRMPq0dbYbZApulZhQ1vImOnDqDvkxwAadILlGnGlhje5A_SoX_euJFW2EmfOsWT4YOZkW0DQp-BHYNa_lGFK-Z_t6pVME78Mq--TWaB4qjOrs Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:30.885439 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7d3964f2b37b4c5991e8eb85a111e346 Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 13 16:30:30.886855 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '7'} Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:30.887564 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:30.888677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c486221-9780-4ec5-a51d-c61bfab18d9d tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:30.889613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c486221-9780-4ec5-a51d-c61bfab18d9d tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] 10.222.0.61 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.025912 Sep 13 16:30:30.897093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 64/92] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:30:30 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:30.912801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-576313f2-b5cf-4c93-a3a1-f6d252da8c5c tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:30.979360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-576313f2-b5cf-4c93-a3a1-f6d252da8c5c tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081107 Sep 13 16:30:30.979961 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 65/93] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:30.996422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87cf107a-2d2c-424d-b389-dcb0c0de5b0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.029797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=15 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:31.054470 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87cf107a-2d2c-424d-b389-dcb0c0de5b0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.070001 Sep 13 16:30:31.055123 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 66/94] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:30:31.079061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c772d660-c414-4cba-b4e6-e7ee98f5fee6 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-280152185", "id": 37494882, "os-flavor-access:is_public": "False"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:31.138442 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c772d660-c414-4cba-b4e6-e7ee98f5fee6 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.078292 Sep 13 16:30:31.144422 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 67/95] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:31.153042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8822fa7-1dd2-4358-83ef-436de3cf0197 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.165457 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-f8822fa7-1dd2-4358-83ef-436de3cf0197 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8822fa7-1dd2-4358-83ef-436de3cf0197 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:31.168011 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: exception: Aggregate -1 could not be found. Sep 13 16:30:31.169483 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '-1'} Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:31.170217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 13 16:30:31.171306 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.188748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8822fa7-1dd2-4358-83ef-436de3cf0197 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:31.190691 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8822fa7-1dd2-4358-83ef-436de3cf0197 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046678 Sep 13 16:30:31.207765 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 68/96] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:30:31.222701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f038981-458e-44be-9c7d-5d70092a076a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.297316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:30:31.298077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:30:31.298741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:30:31.299540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:30:31.299983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f038981-458e-44be-9c7d-5d70092a076a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087965 Sep 13 16:30:31.300527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:30:31.302021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 69/97] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:31.306643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2012c4ec-2a8d-40a0-82e1-05b1593186f7 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.308147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2012c4ec-2a8d-40a0-82e1-05b1593186f7 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '7d3964f2b37b4c5991e8eb85a111e346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61779f585dd24cbe887ad5531a9755b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2012c4ec-2a8d-40a0-82e1-05b1593186f7 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Request method failure captured: Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAbY5Sfa9ak0VxWNnYu7RKzemO-0vxogEeIezeh7GcoobzGOUdtY8AeLTHdyMydReRMPq0dbYbZApulZhQ1vImOnDqDvkxwAadILlGnGlhje5A_SoX_euJFW2EmfOsWT4YOZkW0DQp-BHYNa_lGFK-Z_t6pVME78Mq--TWaB4qjOrs Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:31.309670 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7d3964f2b37b4c5991e8eb85a111e346 Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 13 16:30:31.310808 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:31.311488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 13 16:30:31.312684 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:31.325057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:31.326602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:31.327225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2012c4ec-2a8d-40a0-82e1-05b1593186f7 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:31.327915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:31.328142 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2012c4ec-2a8d-40a0-82e1-05b1593186f7 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025254 Sep 13 16:30:31.329104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:31.329777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:31.330833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:31.344911 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 70/98] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:31.352030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e52b7e6-793c-460c-aee9-5ab5a1cb483c tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.372890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Getting quotas for project 44fc93c5a970488a81c3b2570267d13d. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:30:31.381697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Getting quotas for user 6c00e88a11d54910a2362829a94266ec and project 44fc93c5a970488a81c3b2570267d13d. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:30:31.417988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:30:31.427587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e52b7e6-793c-460c-aee9-5ab5a1cb483c tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081450 Sep 13 16:30:31.428513 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 71/99] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:31.429283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:30:31.433564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.434693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:31.441981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:31.442468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:31.443429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:31.443820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:31.444705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:31.445146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:31.619736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f569b03-677b-4b54-855f-d6d83f9e1d5b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.304543 Sep 13 16:30:31.628128 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 29/100] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:30:31.633926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62061675-822c-4bd2-b36e-1f910ad323ad tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.715634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62061675-822c-4bd2-b36e-1f910ad323ad tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/37494882" status: 202 len: 0 microversion: 2.1 time: 0.086209 Sep 13 16:30:31.719339 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 30/101] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:30:31 2022] DELETE /compute/v2.1/flavors/37494882 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:31.733027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3036527-bf7c-4d70-87f5-32b3aaf9dc00 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:31.733677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c3036527-bf7c-4d70-87f5-32b3aaf9dc00 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:31.978312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c3036527-bf7c-4d70-87f5-32b3aaf9dc00 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:31.999882 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3036527-bf7c-4d70-87f5-32b3aaf9dc00 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1243 microversion: 2.1 time: 0.282053 Sep 13 16:30:32.021221 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 31/102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1243 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:32.031399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63009e8a-f28e-408e-b8c6-3d416920c229 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:32.084080 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63009e8a-f28e-408e-b8c6-3d416920c229 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061427 Sep 13 16:30:32.095946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 32/103] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:32.110954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07e2160b-e400-4a95-8242-f60656696c8f tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1037163599", "id": 1154128078, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:32.144662 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-07e2160b-e400-4a95-8242-f60656696c8f tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035920 Sep 13 16:30:32.146555 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 33/104] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:32.165461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d3fe480-e221-404a-b2fa-cdfdbb061d66 tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:32.238043 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d3fe480-e221-404a-b2fa-cdfdbb061d66 tempest-FlavorsAdminTestJSON-1204647196 tempest-FlavorsAdminTestJSON-1204647196-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.076564 Sep 13 16:30:32.238715 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 34/105] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:32 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:32.278407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4916fc2-44ea-4f18-af76-3b12fc97519a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:32.355399 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4916fc2-44ea-4f18-af76-3b12fc97519a tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1154128078" status: 202 len: 0 microversion: 2.1 time: 0.095343 Sep 13 16:30:32.361179 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 35/106] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:30:32 2022] DELETE /compute/v2.1/flavors/1154128078 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:32.368084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66d744d2-146a-47f5-bec0-79665ca9b3b6 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:32.470785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:32.482191 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b75c8970-7cfc-4dce-8659-7283ccdb6924 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 1.052433 Sep 13 16:30:32.486130 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 72/107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:31 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:32.493146 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66d744d2-146a-47f5-bec0-79665ca9b3b6 tempest-FlavorsAdminTestJSON-1982662751 tempest-FlavorsAdminTestJSON-1982662751-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.128797 Sep 13 16:30:32.493744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 36/108] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:33.042651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed3ea8b0-46cb-44b0-848f-e697ff6a5d56 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:33.042651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed3ea8b0-46cb-44b0-848f-e697ff6a5d56 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:33.241569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed3ea8b0-46cb-44b0-848f-e697ff6a5d56 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:33.249797 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed3ea8b0-46cb-44b0-848f-e697ff6a5d56 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1243 microversion: 2.1 time: 0.224617 Sep 13 16:30:33.252404 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 73/109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:33 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1243 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:33.512813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:33.513731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:33.539916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:33.541545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:33.549513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:33.551848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:33.553859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:33.562007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.085205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abacb16-c2cb-4077-b884-03f67a581d46", "tag": "a8ac9233-60f3-4605-8ab9-ef5a1fe576f1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:34.105545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.106419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.107092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.151441 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Creating event network-changed:a8ac9233-60f3-4605-8ab9-ef5a1fe576f1 for instance 3abacb16-c2cb-4077-b884-03f67a581d46 on n-h1-857467-1 Sep 13 16:30:34.152711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:30:34.153390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-165aa5a4-cb23-4460-9ec0-2fe2ed97a3e5 req-d13b6641-0c14-410a-a7c0-c6033fc65745 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:30:34.154789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.155468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.156123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.157152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.157903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.158609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.173687 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.compute.rpcapi [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 16:30:34.174940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] Releasing lock "compute-rpcapi-router" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:30:34.208942 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5dfbccb5-3ecd-4b97-8ad3-863f2c584538 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350842 Sep 13 16:30:34.210534 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 74/110] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:30:34.274103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:34.274812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:34.284332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.287148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.287610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.288352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:34.289751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:34.290216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:34.456869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:34.466412 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d679fd33-c7f4-4c4e-a6f3-adf48eb4620c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1291 microversion: 2.1 time: 0.196394 Sep 13 16:30:34.466996 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 75/111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:34 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1291 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:34.764081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:34.786733 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa8759e2-e29a-43a5-94ac-0372c3a21824 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 1.275963 Sep 13 16:30:34.792730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 37/112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:33 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:35.492372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:35.493716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:35.510231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:35.511101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:35.513797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:35.518055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:35.522832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:35.523555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:35.698540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:35.713260 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba14cae4-d76a-451e-992c-4bee791b6c76 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1291 microversion: 2.1 time: 0.224753 Sep 13 16:30:35.714171 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 76/113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:35 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1291 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:35.819167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:35.819966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:35.839925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:35.841803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:35.842677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:35.846134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:35.846768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:35.848630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.005272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:37.042664 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a3af038c-e4d1-4414-a9fc-191d5343de14 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 1.201931 Sep 13 16:30:37.042664 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 38/114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:35 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:37.079074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:37.079760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:37.123418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.124403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.124403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.128677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.129264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.129945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.151261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:37.155368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.155861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.156307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.162419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.163206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.163800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.242281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf4e4985-5efc-4036-92f5-364a1e4c6e80 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 1.148068 Sep 13 16:30:37.243418 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 77/115] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:30:36 2022] GET /compute/v2.1/os-services => generated 966 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:37.263003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:37.268231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.271190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.274183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.280718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.284388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.286865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.363407 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-752b5db1-1628-4dc3-96b0-ac1d999cc131 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-857467-1" status: 200 len: 578 microversion: 2.1 time: 0.110684 Sep 13 16:30:37.378216 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 78/116] 10.222.0.61 () {58 vars in 1172 bytes} [Tue Sep 13 16:30:37 2022] GET /compute/v2.1/os-services?host=n-d-857467-1 => generated 578 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:37.395790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:37.401411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.402268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.402892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.403798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.404549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.405630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.459540 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60430f7e-68bd-4a45-9da8-a980c79b5ef1 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.078255 Sep 13 16:30:37.470817 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 79/117] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:30:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:37.485543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:37.492066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.493492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.495256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.501857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:37.503096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:37.503666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:37.503824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:37.511948 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e7428ec-b1a8-487f-bac0-41e88fa33a9a tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1297 microversion: 2.1 time: 0.488023 Sep 13 16:30:37.527522 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 39/118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:37 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1297 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:37.570018 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35250461-117d-4f91-9250-c52ab3e155b9 tempest-ServicesAdminTestJSON-1385910570 tempest-ServicesAdminTestJSON-1385910570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.090078 Sep 13 16:30:37.570018 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 80/119] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:30:37 2022] GET /compute/v2.1/os-services => generated 966 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:38.051489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:38.058811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:38.084214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:38.084717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:38.085162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:38.085913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:38.086872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:38.087457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:38.770629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77ed50ee-ac7b-4e54-aa25-e27b14c21a4e tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-370762929", "id": 76783240, "os-flavor-access:is_public": "False"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:38.811394 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77ed50ee-ac7b-4e54-aa25-e27b14c21a4e tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 1.204546 Sep 13 16:30:38.816048 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 40/120] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:37 2022] POST /compute/v2.1/flavors => generated 432 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:38.852789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:38.853423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:38.879834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:38.884499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:38.885013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:38.885783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:38.891911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:38.892415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:38.954335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:38.965042 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cad0e8dc-5d4c-4175-a1ae-f2032e711a9c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.918978 Sep 13 16:30:38.976482 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 81/121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:38 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:38.990898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c2395f90-2798-477b-b08f-4edba4c05768 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:39.823070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c2395f90-2798-477b-b08f-4edba4c05768 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/76783240/action" status: 200 len: 95 microversion: 2.1 time: 0.843418 Sep 13 16:30:39.827232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 82/122] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:30:38 2022] POST /compute/v2.1/flavors/76783240/action => generated 95 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:40.105032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb6293d30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:40.108693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.109370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.109808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.110726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.111336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.111911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.154906 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4321b972-7410-425f-9c06-bbb6d3ff0472 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.326545 Sep 13 16:30:40.155662 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 83/123] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Sep 13 16:30:39 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:40.162759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1b921e1-5b7d-4c4e-b273-2a643e24edb5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:40.177602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:40.193153 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b78a030b-d6af-4d48-ad20-d8f79b101f1b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 1.354303 Sep 13 16:30:40.194869 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 41/124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:38 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:40.199733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:40.200535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:40.202656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:40.209103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.209820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.210488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.211370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.211983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.212567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.520338 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-f1b921e1-5b7d-4c4e-b273-2a643e24edb5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] HTTP exception thrown: Flavor access already exists for flavor 27 and project 4145290607f94522bb01909ed0cec286 combination. Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1b921e1-5b7d-4c4e-b273-2a643e24edb5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Request method failure captured: Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/flavors/76783240/action HTTP/1.1 Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 67 Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAqqhNyAy7TxF7sQr1hUNcpuPaW0HQ0aq-LdMm6t3kcxjoyXPyD0Xo5YtyoyU_OjI3PEzr_LEzMpAH4cj_dSDteE_5kNq81e0n-uVBAcM8Jm0UdVidwv6bJwK_YqIhDxMhxfFFPVoc8TNAB-0_A44PeG9APN4Nq541w2HL8u7BEGH8 Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ec53ac0850f2496e8bd769862f76b97c Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:40.552600 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ec53ac0850f2496e8bd769862f76b97c Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1d974eb0da274b6899c7e3305b4d8f3b Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: {"addTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} Sep 13 16:30:40.554043 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: exception: Flavor access already exists for flavor 27 and project 4145290607f94522bb01909ed0cec286 combination. Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '76783240', 'body': {'addTenantAccess': {'tenant': '4145290607f94522bb01909ed0cec286'}}} Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result.read() Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 16:30:40.554828 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27-4145290607f94522bb01909ed0cec286' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi session.flush() Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 16:30:40.556129 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 16:30:40.557301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 16:30:40.558370 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result.read() Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27-4145290607f94522bb01909ed0cec286' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 13, 16, 30, 40, 514108), 'updated_at': None, 'flavor_id': 27, 'project_id': '4145290607f94522bb01909ed0cec286'}] Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:40.559653 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 27 and project 4145290607f94522bb01909ed0cec286 combination. Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:40.560738 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 27 and project 4145290607f94522bb01909ed0cec286 combination. Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:40.562037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:40.564816 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 27 and project 4145290607f94522bb01909ed0cec286 combination. Sep 13 16:30:40.564816 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:40.564816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1b921e1-5b7d-4c4e-b273-2a643e24edb5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Returning 409 to user: Flavor access already exists for flavor 27 and project 4145290607f94522bb01909ed0cec286 combination. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:40.564816 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1b921e1-5b7d-4c4e-b273-2a643e24edb5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/76783240/action" status: 409 len: 152 microversion: 2.1 time: 0.398092 Sep 13 16:30:40.564816 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 84/125] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:30:40 2022] POST /compute/v2.1/flavors/76783240/action => generated 152 bytes in 399 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:30:40.570536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb62ce310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:40.581460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.583989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.587477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.588526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.590931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.592082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.638796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:40.648979 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa58a062-ddcc-4cce-bf5d-f994e5dfd1bc tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.452869 Sep 13 16:30:40.650473 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 42/126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:40 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:40.654370 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d4c8a4c4-2ffe-4714-9bb5-af7447273861 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.096824 Sep 13 16:30:40.654991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 85/127] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Sep 13 16:30:40 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:40.655922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb4a539d-2be8-47bd-9d55-3c586f236990 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:40.681673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb606a160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:40.686106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.686842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.687294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.688038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.688502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.688930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.742204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c1771026-6834-4479-93bd-161636ee3914 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.064186 Sep 13 16:30:40.743732 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 86/128] 10.222.0.61 () {58 vars in 1145 bytes} [Tue Sep 13 16:30:40 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:40.876367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1667e4b6-0423-45b7-8f38-a7dc2d09192b req-714a9f0b-e9c3-4dff-97f9-01e59cbb5577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e8d27e-de0b-4db7-b2af-994bfc2f9a76", "tag": "ba98d5e7-91ec-4355-abfe-84e281d89df2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:40.889090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1667e4b6-0423-45b7-8f38-a7dc2d09192b req-714a9f0b-e9c3-4dff-97f9-01e59cbb5577 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:40.890007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1667e4b6-0423-45b7-8f38-a7dc2d09192b req-714a9f0b-e9c3-4dff-97f9-01e59cbb5577 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:40.890477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1667e4b6-0423-45b7-8f38-a7dc2d09192b req-714a9f0b-e9c3-4dff-97f9-01e59cbb5577 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:40.908214 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1667e4b6-0423-45b7-8f38-a7dc2d09192b req-714a9f0b-e9c3-4dff-97f9-01e59cbb5577 service nova] Creating event network-changed:ba98d5e7-91ec-4355-abfe-84e281d89df2 for instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 on n-h1-857467-1 Sep 13 16:30:40.922575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1667e4b6-0423-45b7-8f38-a7dc2d09192b req-714a9f0b-e9c3-4dff-97f9-01e59cbb5577 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047619 Sep 13 16:30:40.923536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 87/129] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:41.008652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb4a539d-2be8-47bd-9d55-3c586f236990 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/76783240/action" status: 200 len: 21 microversion: 2.1 time: 0.356456 Sep 13 16:30:41.010144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 43/130] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:30:40 2022] POST /compute/v2.1/flavors/76783240/action => generated 21 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:41.021883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2eb3008f-8f76-4902-82dc-037d749d21a6 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.051656 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2eb3008f-8f76-4902-82dc-037d749d21a6 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/76783240" status: 202 len: 0 microversion: 2.1 time: 0.034133 Sep 13 16:30:41.057938 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 88/131] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:30:41 2022] DELETE /compute/v2.1/flavors/76783240 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:41.062756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8cbcafb7-0fc7-4b6d-ab71-caecf37dc45d tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.095591 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8cbcafb7-0fc7-4b6d-ab71-caecf37dc45d tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037695 Sep 13 16:30:41.106188 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 44/132] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:41.121442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8347b2a6-5ed0-45d8-8321-6519cff6bbc4 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1293504568", "id": 794763688, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:41.162926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8347b2a6-5ed0-45d8-8321-6519cff6bbc4 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.046512 Sep 13 16:30:41.164495 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 89/133] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:41.176236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6270469-4e38-4de6-a7a4-ed77e541f690 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.190199 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e6270469-4e38-4de6-a7a4-ed77e541f690 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6270469-4e38-4de6-a7a4-ed77e541f690 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Request method failure captured: Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/flavors/794763688/os-flavor-access HTTP/1.1 Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAqqhNyAy7TxF7sQr1hUNcpuPaW0HQ0aq-LdMm6t3kcxjoyXPyD0Xo5YtyoyU_OjI3PEzr_LEzMpAH4cj_dSDteE_5kNq81e0n-uVBAcM8Jm0UdVidwv6bJwK_YqIhDxMhxfFFPVoc8TNAB-0_A44PeG9APN4Nq541w2HL8u7BEGH8 Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ec53ac0850f2496e8bd769862f76b97c Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:41.199225 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ec53ac0850f2496e8bd769862f76b97c Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 1d974eb0da274b6899c7e3305b4d8f3b Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: exception: Access list not available for public flavors. Sep 13 16:30:41.200498 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'flavor_id': '794763688'} Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 13 16:30:41.201174 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:41.202836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6270469-4e38-4de6-a7a4-ed77e541f690 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:41.203817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6270469-4e38-4de6-a7a4-ed77e541f690 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/794763688/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.032016 Sep 13 16:30:41.208986 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 45/134] 10.222.0.61 () {58 vars in 1206 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/flavors/794763688/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:30:41.219257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99895f11-0bd0-4865-b791-9fa64f530f3e tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.232739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.234670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:41.247394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.249727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.250472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.251535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.253577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.254967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.266091 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99895f11-0bd0-4865-b791-9fa64f530f3e tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/794763688" status: 202 len: 0 microversion: 2.1 time: 0.052152 Sep 13 16:30:41.267356 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 90/135] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:41 2022] DELETE /compute/v2.1/flavors/794763688 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:30:41.276636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d7e4b53a-da58-4955-9f2d-d9e30648226a tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.343974 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d7e4b53a-da58-4955-9f2d-d9e30648226a tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065383 Sep 13 16:30:41.346095 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 91/136] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:41.353211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:41.366531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a50c684-6e0e-484d-992b-1616be940c00 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-671789486", "id": 1718394319, "os-flavor-access:is_public": "False"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:41.394060 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a50c684-6e0e-484d-992b-1616be940c00 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.031068 Sep 13 16:30:41.403302 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 92/137] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:41 2022] POST /compute/v2.1/flavors => generated 438 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:30:41.527074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:41.538532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac69c6ac-61ea-4f58-b32e-bd5a0c8ff0f3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.317202 Sep 13 16:30:41.554762 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 46/138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:41.762543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddc18ce2-c4e7-4c6a-a0d6-0344dbd001ee tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:41.767998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddc18ce2-c4e7-4c6a-a0d6-0344dbd001ee tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7c1614a2e001468ea09a6b56146970fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4145290607f94522bb01909ed0cec286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddc18ce2-c4e7-4c6a-a0d6-0344dbd001ee tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Request method failure captured: Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/flavors/1718394319/action HTTP/1.1 Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 67 Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAnUy8J-cPvbejmCjSn6LLK90DtbARsClnWKVv9RAWC-CPI7Xl-82lZ0v0bTNiPepwdgzkinXukmkM2d-uSVIUt9F637_FyGA78HdY05tqQ9oNzIbIztRZmm3mzcGlD2KJ3QJYTDRIWppEdFwF8TL-YyIvohShHQl3aJUlcv1c3IMA Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 4145290607f94522bb01909ed0cec286 Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-541038711 Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:41.771990 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4145290607f94522bb01909ed0cec286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4145290607f94522bb01909ed0cec286"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4145290607f94522bb01909ed0cec286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4145290607f94522bb01909ed0cec286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-541038711 Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 4145290607f94522bb01909ed0cec286 Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-541038711 Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsAccessNegativeTestJSON-541038711-project Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7c1614a2e001468ea09a6b56146970fc Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-541038711-project Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: {"addTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} Sep 13 16:30:41.773787 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1718394319', 'body': {'addTenantAccess': {'tenant': '4145290607f94522bb01909ed0cec286'}}} Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:41.774527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 13 16:30:41.776032 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:41.779618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddc18ce2-c4e7-4c6a-a0d6-0344dbd001ee tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:41.782083 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ddc18ce2-c4e7-4c6a-a0d6-0344dbd001ee tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] 10.222.0.61 "POST /compute/v2.1/flavors/1718394319/action" status: 403 len: 130 microversion: 2.1 time: 0.376295 Sep 13 16:30:41.791338 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 93/139] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Sep 13 16:30:41 2022] POST /compute/v2.1/flavors/1718394319/action => generated 130 bytes in 387 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:41.797392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.808103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:41.815815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Calling method '.version_select at 0x7fbeb5f5bee0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.818720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.819368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.820159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.837589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.838303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.838905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.847108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.847957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.848826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.850023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.852099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.853025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.853622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.857089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.858995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.872893 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-686fc06f-7cac-47dd-bc39-5c99686d3810 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.280164 Sep 13 16:30:41.873991 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 47/140] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:30:41.879987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e5a1e9d-5548-4ce8-afe8-1118c9fc08f2 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.916764 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e5a1e9d-5548-4ce8-afe8-1118c9fc08f2 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1718394319" status: 202 len: 0 microversion: 2.1 time: 0.041317 Sep 13 16:30:41.922145 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 48/141] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:30:41 2022] DELETE /compute/v2.1/flavors/1718394319 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:41.931856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Calling method '.version_select at 0x7fbeb5f5b280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:41.935465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.936406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.937148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.962095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:41.963327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:41.964008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:41.974004 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c860b09-af37-4589-90b6-6e3f071f9eb6 tempest-HypervisorAdminV228Test-18876862 tempest-HypervisorAdminV228Test-18876862-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.050056 Sep 13 16:30:41.976031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 49/142] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:30:41.986393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8486515b-a0ce-4562-b0f0-c36064dd1fa3 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:42.014300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:42.027445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8486515b-a0ce-4562-b0f0-c36064dd1fa3 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049696 Sep 13 16:30:42.046292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 50/143] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:42.051954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a16d2568-0acc-4c16-bbce-5827588e3d96 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1116258270", "id": 1288822320, "os-flavor-access:is_public": "False"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:42.087058 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a16d2568-0acc-4c16-bbce-5827588e3d96 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.039511 Sep 13 16:30:42.095694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 51/144] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:42 2022] POST /compute/v2.1/flavors => generated 439 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:42.103552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c926a5fa-ab4c-4fc0-b0a0-87090ada51b0 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:42.333806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c926a5fa-ab4c-4fc0-b0a0-87090ada51b0 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1288822320/action" status: 200 len: 97 microversion: 2.1 time: 0.234162 Sep 13 16:30:42.339749 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 52/145] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Sep 13 16:30:42 2022] POST /compute/v2.1/flavors/1288822320/action => generated 97 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:42.351528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5168729-9d7e-4764-8f1c-b586dbe2dd54 tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:42.360089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a5168729-9d7e-4764-8f1c-b586dbe2dd54 tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7c1614a2e001468ea09a6b56146970fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4145290607f94522bb01909ed0cec286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5168729-9d7e-4764-8f1c-b586dbe2dd54 tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Request method failure captured: Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/flavors/1288822320/action HTTP/1.1 Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 70 Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAnUy8J-cPvbejmCjSn6LLK90DtbARsClnWKVv9RAWC-CPI7Xl-82lZ0v0bTNiPepwdgzkinXukmkM2d-uSVIUt9F637_FyGA78HdY05tqQ9oNzIbIztRZmm3mzcGlD2KJ3QJYTDRIWppEdFwF8TL-YyIvohShHQl3aJUlcv1c3IMA Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 4145290607f94522bb01909ed0cec286 Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-541038711 Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:30:42.361735 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4145290607f94522bb01909ed0cec286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4145290607f94522bb01909ed0cec286"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4145290607f94522bb01909ed0cec286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4145290607f94522bb01909ed0cec286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-541038711 Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 4145290607f94522bb01909ed0cec286 Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-541038711 Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsAccessNegativeTestJSON-541038711-project Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 7c1614a2e001468ea09a6b56146970fc Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-541038711-project Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: {"removeTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} Sep 13 16:30:42.363016 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1288822320', 'body': {'removeTenantAccess': {'tenant': '4145290607f94522bb01909ed0cec286'}}} Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can( Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:42.364349 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 13 16:30:42.365331 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.367957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5168729-9d7e-4764-8f1c-b586dbe2dd54 tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:42.367957 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5168729-9d7e-4764-8f1c-b586dbe2dd54 tempest-FlavorsAccessNegativeTestJSON-541038711 tempest-FlavorsAccessNegativeTestJSON-541038711-project] 10.222.0.61 "POST /compute/v2.1/flavors/1288822320/action" status: 403 len: 133 microversion: 2.1 time: 0.020398 Sep 13 16:30:42.375913 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 53/146] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Sep 13 16:30:42 2022] POST /compute/v2.1/flavors/1288822320/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:42.385420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f46027c3-66dc-47e4-9870-21da96d3110d tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4145290607f94522bb01909ed0cec286"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:42.405683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:42.421596 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4373b9e0-fb22-49bd-89c5-827d7fd41e0b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.623192 Sep 13 16:30:42.435093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 94/147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:41 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:42.567350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:42.569165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:42.601110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:42.601915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:42.602851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:42.603796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:42.607465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:42.609820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:42.702811 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f46027c3-66dc-47e4-9870-21da96d3110d tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1288822320/action" status: 200 len: 21 microversion: 2.1 time: 0.321937 Sep 13 16:30:42.704107 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 54/148] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Sep 13 16:30:42 2022] POST /compute/v2.1/flavors/1288822320/action => generated 21 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:42.714326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-916454b3-681d-4e60-ba7b-14c42dd305c6 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:42.734693 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-916454b3-681d-4e60-ba7b-14c42dd305c6 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1288822320" status: 202 len: 0 microversion: 2.1 time: 0.024096 Sep 13 16:30:42.735421 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 55/149] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:30:42 2022] DELETE /compute/v2.1/flavors/1288822320 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:42.745025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-618d4842-36dd-4281-8d7b-240db0289818 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:42.770312 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-618d4842-36dd-4281-8d7b-240db0289818 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027630 Sep 13 16:30:42.771277 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 56/150] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:42.798389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d2646ec7-7915-4148-bd6a-b1727057bb29 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-226423196", "id": 633638643, "os-flavor-access:is_public": "False"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:42.829707 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d2646ec7-7915-4148-bd6a-b1727057bb29 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.038531 Sep 13 16:30:42.831285 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 57/151] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:42 2022] POST /compute/v2.1/flavors => generated 435 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:42.845597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4b3591e-f5fb-4f9a-9b25-44cdeeb4c8c5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7834b46df3e74c6fbfbb3fcff403cded"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:42.928693 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f4b3591e-f5fb-4f9a-9b25-44cdeeb4c8c5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] HTTP exception thrown: Flavor access not found for 31 / 7834b46df3e74c6fbfbb3fcff403cded combination. Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4b3591e-f5fb-4f9a-9b25-44cdeeb4c8c5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Request method failure captured: Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/flavors/633638643/action HTTP/1.1 Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 70 Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAqqhNyAy7TxF7sQr1hUNcpuPaW0HQ0aq-LdMm6t3kcxjoyXPyD0Xo5YtyoyU_OjI3PEzr_LEzMpAH4cj_dSDteE_5kNq81e0n-uVBAcM8Jm0UdVidwv6bJwK_YqIhDxMhxfFFPVoc8TNAB-0_A44PeG9APN4Nq541w2HL8u7BEGH8 Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ec53ac0850f2496e8bd769862f76b97c Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:42.931626 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec53ac0850f2496e8bd769862f76b97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ec53ac0850f2496e8bd769862f76b97c Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-313690331 Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 1d974eb0da274b6899c7e3305b4d8f3b Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: {"removeTenantAccess": {"tenant": "7834b46df3e74c6fbfbb3fcff403cded"}} Sep 13 16:30:42.932941 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: exception: Flavor access not found for 31 / 7834b46df3e74c6fbfbb3fcff403cded combination. Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '633638643', 'body': {'removeTenantAccess': {'tenant': '7834b46df3e74c6fbfbb3fcff403cded'}}} Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 13 16:30:42.933634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 7834b46df3e74c6fbfbb3fcff403cded combination. Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 7834b46df3e74c6fbfbb3fcff403cded combination. Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.934712 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:42.935931 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:42.935931 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:42.935931 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:42.935931 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:42.935931 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 7834b46df3e74c6fbfbb3fcff403cded combination. Sep 13 16:30:42.935931 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:42.936987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4b3591e-f5fb-4f9a-9b25-44cdeeb4c8c5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Returning 404 to user: Flavor access not found for 31 / 7834b46df3e74c6fbfbb3fcff403cded combination. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:42.937862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4b3591e-f5fb-4f9a-9b25-44cdeeb4c8c5 tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/633638643/action" status: 404 len: 124 microversion: 2.1 time: 0.096675 Sep 13 16:30:42.942538 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 58/152] 10.222.0.61 () {60 vars in 1197 bytes} [Tue Sep 13 16:30:42 2022] POST /compute/v2.1/flavors/633638643/action => generated 124 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:42.953790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34bbeded-53e9-4c57-b94c-d60d87fb826b tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:42.976235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34bbeded-53e9-4c57-b94c-d60d87fb826b tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/633638643" status: 202 len: 0 microversion: 2.1 time: 0.031768 Sep 13 16:30:42.977480 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 59/153] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:42 2022] DELETE /compute/v2.1/flavors/633638643 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:30:42.989707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b402460a-8e20-471a-aaa1-579823d9796e tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:43.011210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:43.019475 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b402460a-8e20-471a-aaa1-579823d9796e tempest-FlavorsAccessNegativeTestJSON-313690331 tempest-FlavorsAccessNegativeTestJSON-313690331-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037116 Sep 13 16:30:43.021696 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 60/154] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:43.033346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f7c4bbb-f1eb-476c-be17-e838f49a0214 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.471366 Sep 13 16:30:43.033969 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 95/155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:42 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:43.445433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:43.446219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:43.453721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:43.454316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:43.454665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:43.457483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:43.458892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:43.459557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:43.684828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:43.702516 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a64db750-8c31-450d-b949-dc7448ceaa54 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.260380 Sep 13 16:30:43.707376 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 61/156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:43 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:44.068760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:44.069470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:44.071824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:44.072945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:44.092170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:44.099128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:44.099801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:44.100854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:44.101666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:44.102277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:44.732968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:44.735171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:44.738626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:44.747434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d52291f-11a4-4c8a-97d8-b5817ef31e94 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.688090 Sep 13 16:30:44.755452 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 96/157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:44 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:44.793170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:44.796171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:44.796984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:44.800778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:44.801724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:44.804391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:45.267116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:45.295059 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08059885-34b9-4bb0-b303-5aecb7f1881b tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.571952 Sep 13 16:30:45.314815 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 62/158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:44 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:45.796886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:45.797638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:45.807116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:45.813957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:45.814579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:45.815530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:45.817137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:45.818193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:46.195928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:46.215282 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ede96d4c-1ae5-4457-8651-255e6c1f1c07 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.422315 Sep 13 16:30:46.219565 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 97/159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:45 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:46.338122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:46.339363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:46.364291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:46.368806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:46.376088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:46.377160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:46.378720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:46.379375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:46.865701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:46.884998 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-024e68db-850e-4023-901f-028c97c96897 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.554606 Sep 13 16:30:46.889137 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 63/160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:46 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:47.250569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:47.251284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:47.264784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:47.265515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:47.267043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:47.268825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:47.270135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:47.273580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:47.565710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:47.574699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:47.593971 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd428198-db02-42d6-b3a0-32ebbcf9f95b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.358237 Sep 13 16:30:47.603448 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 98/161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:47 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:47.920574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:47.922191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:47.940090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:47.943037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:47.945348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:47.947597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:47.949014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:47.950258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.152374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.159256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.160726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.161405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.165931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.166691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.167549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.222815 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-28b4e7b7-fca4-47f2-ad15-00723e32dd10 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.763428 Sep 13 16:30:48.224303 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 64/162] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:30:47 2022] GET /compute/v2.1/os-services => generated 966 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:30:48.245635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.254543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.255193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.255645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.256818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.257272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.258416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.320843 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-510643e7-bf83-45a3-ba15-9fff74d383cd tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.078851 Sep 13 16:30:48.322444 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 65/163] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 966 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:48.353282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.362685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.363924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.364661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.366099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.366737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.367325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.401730 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-648c466f-a399-49e8-b351-419703191b66 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.069510 Sep 13 16:30:48.403714 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 66/164] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/os-services => generated 966 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:48.416388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.421310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.422127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.422723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.424346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.424956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.426217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.470682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:48.503812 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e9d46bb-bcc4-4839-819e-cd8bf5c8861e tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-857467-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.091371 Sep 13 16:30:48.505265 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 67/165] 10.222.0.61 () {58 vars in 1194 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/os-services?host=n-d-857467-1&binary=xxx => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:48.539528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.548578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.549068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.549987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.551338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.551958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.552578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.573187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:48.580313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:48.590639 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93dfea46-e3d6-4cee-b284-8d57c90abf61 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.682360 Sep 13 16:30:48.591494 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 99/166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:47 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:48.610664 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db89560b-f334-4186-b9e0-6f8be39a87e1 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.086265 Sep 13 16:30:48.615201 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 68/167] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/os-services => generated 966 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:48.630768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.632004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:48.635443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:48.640217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.641186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.642013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.642990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.643447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.643880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.659501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.661242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.663842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.668368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:48.669845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:48.670997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:48.716674 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ac63d90-de2b-49fe-941f-39a217c4da36 tempest-ServicesAdminNegativeTestJSON-289477469 tempest-ServicesAdminNegativeTestJSON-289477469-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.091290 Sep 13 16:30:48.717317 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 69/168] 10.222.0.61 () {58 vars in 1198 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:49.087002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20c0bede-843c-4cb2-b45a-b5cf6d304b6b tempest-ServicesAdminNegativeTestJSON-1510419448 tempest-ServicesAdminNegativeTestJSON-1510419448-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:49.095671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20c0bede-843c-4cb2-b45a-b5cf6d304b6b tempest-ServicesAdminNegativeTestJSON-1510419448 tempest-ServicesAdminNegativeTestJSON-1510419448-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b7aa74e4db89410097d9b588f4f2bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95877167cef14021bcdbcd85ed040f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20c0bede-843c-4cb2-b45a-b5cf6d304b6b tempest-ServicesAdminNegativeTestJSON-1510419448 tempest-ServicesAdminNegativeTestJSON-1510419448-project] Request method failure captured: Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA0g2BUXhstwKg-8GnJZUZuEAU6OuaYBfuvLM_3W2HlSxrM5rMAGkzerCf2r1ZvNsyGyTcuICmkeniW2WY5_7JIQfMJRm3L83fETmt8_qh0GM2bfA3cY-DTJ-lCyaRzzcnWyFicd9iiqXvgSLt2ZIPHDtTu1kHjJKWplat0Fyihk3c Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 95877167cef14021bcdbcd85ed040f69 Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1510419448 Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:30:49.099271 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95877167cef14021bcdbcd85ed040f69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_95877167cef14021bcdbcd85ed040f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95877167cef14021bcdbcd85ed040f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/95877167cef14021bcdbcd85ed040f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1510419448 Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 95877167cef14021bcdbcd85ed040f69 Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1510419448 Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServicesAdminNegativeTestJSON-1510419448-project Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b7aa74e4db89410097d9b588f4f2bf5f Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1510419448-project Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 13 16:30:49.100611 n-d-857467-1 devstack@n-api.service[122327]: action_args: {} Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:49.101384 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 13 16:30:49.102431 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:49.104882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20c0bede-843c-4cb2-b45a-b5cf6d304b6b tempest-ServicesAdminNegativeTestJSON-1510419448 tempest-ServicesAdminNegativeTestJSON-1510419448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:49.106635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20c0bede-843c-4cb2-b45a-b5cf6d304b6b tempest-ServicesAdminNegativeTestJSON-1510419448 tempest-ServicesAdminNegativeTestJSON-1510419448-project] 10.222.0.61 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.379536 Sep 13 16:30:49.108116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 70/169] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:49.179748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:49.189673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fdffb80f-e26c-4c43-a76c-8ca230a73303 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.574453 Sep 13 16:30:49.192819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 100/170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:48 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:49.621670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:49.623007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:49.639830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:49.644305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:49.647221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:49.648281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:49.658795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:49.659172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:50.089231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:50.100860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40015e4c-ae76-4290-95a6-68b960e85f27 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.483691 Sep 13 16:30:50.101457 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 71/171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:49 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:50.219188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:50.221957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:50.256705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:50.259711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:50.260334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:50.263194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:50.265065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:50.271513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:50.654456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:50.664548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d9c36f4-4b61-4bdc-a948-2f5120a65c24 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.455303 Sep 13 16:30:50.667341 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 101/172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:50 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:51.133531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:51.134816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:51.156664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:51.157398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:51.162626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:51.164191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:51.165719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:51.192098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:51.574694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:51.586774 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c5f68b9-bfd4-4521-82a0-29ec249ef406 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.460943 Sep 13 16:30:51.606674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 72/173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:51 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:51.690699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:51.691353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:51.693585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=22 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:30:51.707682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:51.711373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:51.712629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:51.714765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:51.721518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:51.722537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:52.042294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:52.054311 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb3b3834-9fcb-47a2-b7e1-3570f78d0a9f tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.367378 Sep 13 16:30:52.060446 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 102/174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:51 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:52.317116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ae77182-8e5c-4e69-bc14-1aab3d4b2614 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1140860677", "ram": 512, "vcpus": 1, "disk": 10, "id": 224412149, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:52.357429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ae77182-8e5c-4e69-bc14-1aab3d4b2614 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.373746 Sep 13 16:30:52.372150 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 73/175] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:30:51 2022] POST /compute/v2.1/flavors => generated 413 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:52.614320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:52.615386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:52.624860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:52.628062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:52.629376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:52.635481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:52.636021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:52.636481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:52.828070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4e124b8-f925-49ed-b44e-a54dfddb40a2 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:52.843862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a4e124b8-f925-49ed-b44e-a54dfddb40a2 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] HTTP exception thrown: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4e124b8-f925-49ed-b44e-a54dfddb40a2 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Request method failure captured: Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/flavors/224412149/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA6XlTqsANQWKt1-lwTJJ6CYPSEVijExa9WYpJKprYT0U7IfGK5_zwk1GoDEiKL2Q4mc1aFwge4HAsau_iljxHTbQ37iJGrHZQpsqUy_Udxxc_rEfFCYKtm1kzTaEoKP4MQvU2wGhGvJhJs6ivQ7gPKRLMdGUbtHwgUBsK0WTUy9kQ Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:52.844738 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b059efb7f923406c91b0d242628d738b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: b10c42e204744b4db3fa621558c3900a Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:52.846082 n-d-857467-1 devstack@n-api.service[122328]: exception: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'flavor_id': '224412149', 'id': 'hw:cpu_thread_policy'} Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:52.847013 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.849927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4e124b8-f925-49ed-b44e-a54dfddb40a2 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Returning 404 to user: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:52.851540 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4e124b8-f925-49ed-b44e-a54dfddb40a2 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] 10.222.0.61 "GET /compute/v2.1/flavors/224412149/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.472301 Sep 13 16:30:52.852179 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 103/176] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:30:52 2022] GET /compute/v2.1/flavors/224412149/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:52.867142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a3db456-e87a-4a95-b16c-88f6afe58b42 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:52.870761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6a3db456-e87a-4a95-b16c-88f6afe58b42 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b10c42e204744b4db3fa621558c3900a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059efb7f923406c91b0d242628d738b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a3db456-e87a-4a95-b16c-88f6afe58b42 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Request method failure captured: Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/flavors/224412149/os-extra_specs HTTP/1.1 Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 66 Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA6XlTqsANQWKt1-lwTJJ6CYPSEVijExa9WYpJKprYT0U7IfGK5_zwk1GoDEiKL2Q4mc1aFwge4HAsau_iljxHTbQ37iJGrHZQpsqUy_Udxxc_rEfFCYKtm1kzTaEoKP4MQvU2wGhGvJhJs6ivQ7gPKRLMdGUbtHwgUBsK0WTUy9kQ Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:52.873899 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b059efb7f923406c91b0d242628d738b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: b10c42e204744b4db3fa621558c3900a Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 13 16:30:52.875449 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'flavor_id': '224412149', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:52.876417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 13 16:30:52.878436 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.880177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a3db456-e87a-4a95-b16c-88f6afe58b42 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:52.894963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a3db456-e87a-4a95-b16c-88f6afe58b42 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] 10.222.0.61 "POST /compute/v2.1/flavors/224412149/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.034285 Sep 13 16:30:52.897655 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 104/177] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Sep 13 16:30:52 2022] POST /compute/v2.1/flavors/224412149/os-extra_specs => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:52.911557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6290f3a1-66b3-4676-b25c-ff5d7bf50d8b tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:52.963067 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6290f3a1-66b3-4676-b25c-ff5d7bf50d8b tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/224412149/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059452 Sep 13 16:30:52.978241 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 105/178] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Sep 13 16:30:52 2022] POST /compute/v2.1/flavors/224412149/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:30:52.983794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85d02ce6-ed74-4dc0-ae71-c08bd20f94a0 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:52.985512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85d02ce6-ed74-4dc0-ae71-c08bd20f94a0 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b10c42e204744b4db3fa621558c3900a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059efb7f923406c91b0d242628d738b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85d02ce6-ed74-4dc0-ae71-c08bd20f94a0 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Request method failure captured: Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA6XlTqsANQWKt1-lwTJJ6CYPSEVijExa9WYpJKprYT0U7IfGK5_zwk1GoDEiKL2Q4mc1aFwge4HAsau_iljxHTbQ37iJGrHZQpsqUy_Udxxc_rEfFCYKtm1kzTaEoKP4MQvU2wGhGvJhJs6ivQ7gPKRLMdGUbtHwgUBsK0WTUy9kQ Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:52.987089 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b059efb7f923406c91b0d242628d738b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: b10c42e204744b4db3fa621558c3900a Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:52.988765 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'flavor_id': '224412149', 'id': 'hw:numa_nodes'} Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:52.989504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 13 16:30:52.990604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.002403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85d02ce6-ed74-4dc0-ae71-c08bd20f94a0 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:53.003613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85d02ce6-ed74-4dc0-ae71-c08bd20f94a0 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] 10.222.0.61 "DELETE /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023825 Sep 13 16:30:53.004518 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 106/179] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:30:52 2022] DELETE /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:53.017723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-845cceea-4914-448a-b364-3842d072aea7 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:53.078186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-845cceea-4914-448a-b364-3842d072aea7 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/224412149/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065985 Sep 13 16:30:53.078366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:53.078798 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 107/180] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Sep 13 16:30:53 2022] POST /compute/v2.1/flavors/224412149/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:30:53.101955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e88c1b5-ccaa-46c2-95bc-201c4f84fed6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.490703 Sep 13 16:30:53.105582 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 74/181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:52 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:53.107934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:53.110694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:53.117012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa67330a-133a-45a3-8a42-20617878485e tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:53.123714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa67330a-133a-45a3-8a42-20617878485e tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b10c42e204744b4db3fa621558c3900a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059efb7f923406c91b0d242628d738b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa67330a-133a-45a3-8a42-20617878485e tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Request method failure captured: Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 22 Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA6XlTqsANQWKt1-lwTJJ6CYPSEVijExa9WYpJKprYT0U7IfGK5_zwk1GoDEiKL2Q4mc1aFwge4HAsau_iljxHTbQ37iJGrHZQpsqUy_Udxxc_rEfFCYKtm1kzTaEoKP4MQvU2wGhGvJhJs6ivQ7gPKRLMdGUbtHwgUBsK0WTUy9kQ Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:30:53.127729 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b059efb7f923406c91b0d242628d738b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b059efb7f923406c91b0d242628d738b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b059efb7f923406c91b0d242628d738b Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b10c42e204744b4db3fa621558c3900a Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: {"hw:numa_nodes": "1"} Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:53.129499 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'flavor_id': '224412149', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:53.130229 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 13 16:30:53.131447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.136445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:53.136445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:53.136445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:53.138243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa67330a-133a-45a3-8a42-20617878485e tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:53.139333 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa67330a-133a-45a3-8a42-20617878485e tempest-FlavorsExtraSpecsNegativeTestJSON-673913564 tempest-FlavorsExtraSpecsNegativeTestJSON-673913564-project] 10.222.0.61 "PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032449 Sep 13 16:30:53.141442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 75/182] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:30:53 2022] PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:53.144718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:53.146957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:53.146957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:53.155167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03014180-ab76-43f9-80ee-f7bd4af939a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:53.172483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-03014180-ab76-43f9-80ee-f7bd4af939a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] HTTP exception thrown: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03014180-ab76-43f9-80ee-f7bd4af939a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Request method failure captured: Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/flavors/224412149/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA7t2o5evuAVH0Uh4MpEoqCHss-GJ7ivJzQ-9QNv4ELkPA0J4CRuQDAzIews6m5X6DN8VaZv6Bfugg2mRymaHniEsMkAbJkDCQ4RutG2G-w1Qcp_8cO41y-zWijwF4NU1jbErEJ4pxGKGbnqJyiX9hVmonksTMrsEegj9ys0YHATO0 Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7941d0ca05134a838a3ceb60b10b578e Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:53.174293 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7941d0ca05134a838a3ceb60b10b578e Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: eca6b0c603fc4ae9937845e0736e885a Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:53.175994 n-d-857467-1 devstack@n-api.service[122327]: exception: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'flavor_id': '224412149', 'id': 'hw:cpu_thread_policy'} Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:53.176587 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. Sep 13 16:30:53.177892 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.181537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03014180-ab76-43f9-80ee-f7bd4af939a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Returning 404 to user: Flavor 224412149 has no extra specs with key hw:cpu_thread_policy. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:53.182926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03014180-ab76-43f9-80ee-f7bd4af939a2 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/224412149/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.033638 Sep 13 16:30:53.184030 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 76/183] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:30:53 2022] DELETE /compute/v2.1/flavors/224412149/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:30:53.202233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d23aaf3b-c48a-41e1-b1b7-e6407fc7863e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:53.210198 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d23aaf3b-c48a-41e1-b1b7-e6407fc7863e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d23aaf3b-c48a-41e1-b1b7-e6407fc7863e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Request method failure captured: Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 27 Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA7t2o5evuAVH0Uh4MpEoqCHss-GJ7ivJzQ-9QNv4ELkPA0J4CRuQDAzIews6m5X6DN8VaZv6Bfugg2mRymaHniEsMkAbJkDCQ4RutG2G-w1Qcp_8cO41y-zWijwF4NU1jbErEJ4pxGKGbnqJyiX9hVmonksTMrsEegj9ys0YHATO0 Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7941d0ca05134a838a3ceb60b10b578e Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:53.214912 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7941d0ca05134a838a3ceb60b10b578e Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: eca6b0c603fc4ae9937845e0736e885a Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: {"hw:cpu_policy": "shared"} Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:53.217206 n-d-857467-1 devstack@n-api.service[122327]: exception: Request body and URI mismatch Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'flavor_id': '224412149', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.218146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.219429 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:53.219429 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:53.219429 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 13 16:30:53.219429 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.220888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d23aaf3b-c48a-41e1-b1b7-e6407fc7863e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:53.226171 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d23aaf3b-c48a-41e1-b1b7-e6407fc7863e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028564 Sep 13 16:30:53.231098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 77/184] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:30:53 2022] PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes => generated 73 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:30:53.236352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e777dc08-af7e-4d43-948d-d7a41d4e48f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e777dc08-af7e-4d43-948d-d7a41d4e48f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Request method failure captured: Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 49 Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA7t2o5evuAVH0Uh4MpEoqCHss-GJ7ivJzQ-9QNv4ELkPA0J4CRuQDAzIews6m5X6DN8VaZv6Bfugg2mRymaHniEsMkAbJkDCQ4RutG2G-w1Qcp_8cO41y-zWijwF4NU1jbErEJ4pxGKGbnqJyiX9hVmonksTMrsEegj9ys0YHATO0 Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7941d0ca05134a838a3ceb60b10b578e Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:53.247133 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7941d0ca05134a838a3ceb60b10b578e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7941d0ca05134a838a3ceb60b10b578e Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: eca6b0c603fc4ae9937845e0736e885a Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 13 16:30:53.248458 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'flavor_id': '224412149', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance: Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 13 16:30:53.249219 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.250690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:53.252058 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:53.252058 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:53.252058 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:30:53.252058 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:30:53.252058 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 13 16:30:53.252058 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:53.254163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e777dc08-af7e-4d43-948d-d7a41d4e48f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:53.259208 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e777dc08-af7e-4d43-948d-d7a41d4e48f9 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026748 Sep 13 16:30:53.263936 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 78/185] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:30:53 2022] PUT /compute/v2.1/flavors/224412149/os-extra_specs/hw:numa_nodes => generated 117 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:53.271845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-364ca5d3-0c31-488b-9bf2-dadef02fa77a tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:53.306524 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-364ca5d3-0c31-488b-9bf2-dadef02fa77a tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/224412149" status: 202 len: 0 microversion: 2.1 time: 0.038004 Sep 13 16:30:53.308913 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 79/186] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:30:53 2022] DELETE /compute/v2.1/flavors/224412149 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:30:53.324093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d39663a3-2d6e-4396-8eeb-5ab964acbb0e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:53.360473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d39663a3-2d6e-4396-8eeb-5ab964acbb0e tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243 tempest-FlavorsExtraSpecsNegativeTestJSON-1210391243-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047005 Sep 13 16:30:53.361682 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 80/187] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:30:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:53.734406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:53.754247 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b438e8c3-0199-4751-b4f0-6a0f248e5796 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.662715 Sep 13 16:30:53.782958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 108/188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:53 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:30:54.129399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:54.130379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:54.142859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.143379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.143875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.146105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.146796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.147420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.735444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:54.745700 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f54c6f11-4df3-4532-8d10-1c4a02b483a0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.618614 Sep 13 16:30:54.747983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 81/189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:54 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:54.785900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:54.786971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:54.802371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.806169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.808164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.811411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.812369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.818594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3d45001d-4320-4b21-ad7e-57c328189ae7 req-6a6dac41-73f5-42e6-84a9-941ebc23dd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abacb16-c2cb-4077-b884-03f67a581d46", "name": "network-vif-plugged", "status": "completed", "tag": "a8ac9233-60f3-4605-8ab9-ef5a1fe576f1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:54.819660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.845321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3d45001d-4320-4b21-ad7e-57c328189ae7 req-6a6dac41-73f5-42e6-84a9-941ebc23dd34 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:54.846138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3d45001d-4320-4b21-ad7e-57c328189ae7 req-6a6dac41-73f5-42e6-84a9-941ebc23dd34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:54.851005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3d45001d-4320-4b21-ad7e-57c328189ae7 req-6a6dac41-73f5-42e6-84a9-941ebc23dd34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:54.902079 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3d45001d-4320-4b21-ad7e-57c328189ae7 req-6a6dac41-73f5-42e6-84a9-941ebc23dd34 service nova] Creating event network-vif-plugged:a8ac9233-60f3-4605-8ab9-ef5a1fe576f1 for instance 3abacb16-c2cb-4077-b884-03f67a581d46 on n-h1-857467-1 Sep 13 16:30:54.931032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3d45001d-4320-4b21-ad7e-57c328189ae7 req-6a6dac41-73f5-42e6-84a9-941ebc23dd34 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283470 Sep 13 16:30:54.933095 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 109/190] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:30:55.317816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:55.343857 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b041973e-4276-4bdd-84dd-c8eb59f2822b tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.559609 Sep 13 16:30:55.344502 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 82/191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:54 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:55.774322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:55.775476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:55.788969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:55.790685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:55.793167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:55.795895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:55.796892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:55.798488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:56.383102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:56.384375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:56.415949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:56.417957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:56.418765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:56.421514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:56.426024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:56.434118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:56.934048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:56.980742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c36041dd-90db-4f4c-9d69-3bfcdaae4b6c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 1.187401 Sep 13 16:30:57.003633 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 110/192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:55 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:57.326122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:57.343849 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63975663-6283-4eb9-9ce7-5316719bc48e tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.960204 Sep 13 16:30:57.344498 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 83/193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:56 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:57.769505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb60a91f0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:57.793810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:57.798310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:57.799856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:57.877014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:57.878197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:57.879651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:57.889676 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] HTTP exception thrown: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Request method failure captured: Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4 HTTP/1.1 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 56 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILBApp_LrCdU48ebl_E2gohWOZLBRWQ1drqw_AKejpb6Jj2yccio3c72gEoJlnfHf3cD9lgir5nRuWZhIYx_fFr-4QlS5Jgz7lEFgdt0jdAmkaPDzxkvWNdoZsPm0TueTr0BN0u0jpgaLL_zbelPXyxvizThaT7f4wtiQvSOlWZEugI Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.53 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f4a057ba6e4c4f068f016a8846956090 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:30:57.892992 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f4a057ba6e4c4f068f016a8846956090 Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 3d16d0412587418c821282504fd5ee8b Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:30:57.894512 n-d-857467-1 devstack@n-api.service[122328]: exception: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'edd16095-2be6-4e94-809a-28d11a552ad4', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.895372 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:57.896622 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:57.898461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:57.898461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:57.898461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:57.901123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Returning 404 to user: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:57.902299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c04d822e-d265-4499-bffd-5b4100b36c40 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4" status: 404 len: 110 microversion: 2.53 time: 0.889702 Sep 13 16:30:57.904248 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 111/194] 10.222.0.61 () {62 vars in 1309 bytes} [Tue Sep 13 16:30:57 2022] PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4 => generated 110 bytes in 900 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:57.913675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb5f24790>, body: {"status": "disabled"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:57.917247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:57.926888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:57.927704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:57.957241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:57.964561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:57.965042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:57.991281 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] HTTP exception thrown: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Request method failure captured: Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4 HTTP/1.1 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 22 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBApp_LrCdU48ebl_E2gohWOZLBRWQ1drqw_AKejpb6Jj2yccio3c72gEoJlnfHf3cD9lgir5nRuWZhIYx_fFr-4QlS5Jgz7lEFgdt0jdAmkaPDzxkvWNdoZsPm0TueTr0BN0u0jpgaLL_zbelPXyxvizThaT7f4wtiQvSOlWZEugI Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.53 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f4a057ba6e4c4f068f016a8846956090 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:58.003729 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f4a057ba6e4c4f068f016a8846956090 Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3d16d0412587418c821282504fd5ee8b Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: {"status": "disabled"} Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: exception: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.005322 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'edd16095-2be6-4e94-809a-28d11a552ad4', 'body': {'status': 'disabled'}} Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.006373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:58.007444 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:58.008455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.008455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.011037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:58.011711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:58.021157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Returning 404 to user: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:58.026740 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5cd2c45e-c85d-4050-ad32-c81c751268fa tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4" status: 404 len: 110 microversion: 2.53 time: 0.117756 Sep 13 16:30:58.029192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.033423 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 84/195] 10.222.0.61 () {62 vars in 1309 bytes} [Tue Sep 13 16:30:57 2022] PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4 => generated 110 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:58.042106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.042890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.046748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.054360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.054752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.065342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb5f5b310>, body: {"status": "enabled"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:58.077583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.101012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.101504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.123616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.124112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.130915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.153281 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] HTTP exception thrown: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Request method failure captured: Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4 HTTP/1.1 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 21 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBApp_LrCdU48ebl_E2gohWOZLBRWQ1drqw_AKejpb6Jj2yccio3c72gEoJlnfHf3cD9lgir5nRuWZhIYx_fFr-4QlS5Jgz7lEFgdt0jdAmkaPDzxkvWNdoZsPm0TueTr0BN0u0jpgaLL_zbelPXyxvizThaT7f4wtiQvSOlWZEugI Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.53 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f4a057ba6e4c4f068f016a8846956090 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:30:58.155568 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4a057ba6e4c4f068f016a8846956090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f4a057ba6e4c4f068f016a8846956090 Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379 Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3d16d0412587418c821282504fd5ee8b Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: {"status": "enabled"} Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: exception: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.156855 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'edd16095-2be6-4e94-809a-28d11a552ad4', 'body': {'status': 'enabled'}} Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.157611 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:30:58.158691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:30:58.160336 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. Sep 13 16:30:58.160336 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:30:58.160336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Returning 404 to user: Service edd16095-2be6-4e94-809a-28d11a552ad4 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:58.160336 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef159e67-4e56-4bba-8f9c-7ab67cad410f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4" status: 404 len: 110 microversion: 2.53 time: 0.118016 Sep 13 16:30:58.160336 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 85/196] 10.222.0.61 () {62 vars in 1309 bytes} [Tue Sep 13 16:30:58 2022] PUT /compute/v2.1/os-services/edd16095-2be6-4e94-809a-28d11a552ad4 => generated 110 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:58.196159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:58.228278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.228790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.229238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.230036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.233239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.250294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.328021 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3148daa5-15c2-4491-b3b3-4b70a04958d0 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.152894 Sep 13 16:30:58.331068 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 86/197] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Sep 13 16:30:58 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:30:58.341474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:58.345554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.356202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.356616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.357434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.357942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.358351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.416948 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d86cbd36-802a-4bf6-b7ac-a086a46d26ca tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.079082 Sep 13 16:30:58.426330 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 87/198] 10.222.0.61 () {60 vars in 1211 bytes} [Tue Sep 13 16:30:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:30:58.431692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:58.444503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:58.467500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.468029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.468534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.469256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.469716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.470172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.778861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:58.792037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5788ef2c-0551-4fd2-a597-a4f5b17aa66f tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1342 microversion: 2.1 time: 0.785848 Sep 13 16:30:58.796929 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 112/199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:58 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1342 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:58.805761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:58.811285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.820842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.821651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.822733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.824800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.826316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.904474 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe2fc8a6-0459-4e02-94f5-fafd16893656 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.106143 Sep 13 16:30:58.907266 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 113/200] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Sep 13 16:30:58 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:30:58.924856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-29d1a661-5841-45bb-a948-4e5677b9b4cb req-9ae39ae6-1a51-4a58-b729-2e51926b2349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e8d27e-de0b-4db7-b2af-994bfc2f9a76", "name": "network-vif-plugged", "status": "completed", "tag": "ba98d5e7-91ec-4355-abfe-84e281d89df2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:30:58.958018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-29d1a661-5841-45bb-a948-4e5677b9b4cb req-9ae39ae6-1a51-4a58-b729-2e51926b2349 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:58.958784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-29d1a661-5841-45bb-a948-4e5677b9b4cb req-9ae39ae6-1a51-4a58-b729-2e51926b2349 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:58.959275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-29d1a661-5841-45bb-a948-4e5677b9b4cb req-9ae39ae6-1a51-4a58-b729-2e51926b2349 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:58.985810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-29d1a661-5841-45bb-a948-4e5677b9b4cb req-9ae39ae6-1a51-4a58-b729-2e51926b2349 service nova] Creating event network-vif-plugged:ba98d5e7-91ec-4355-abfe-84e281d89df2 for instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 on n-h1-857467-1 Sep 13 16:30:58.999847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-29d1a661-5841-45bb-a948-4e5677b9b4cb req-9ae39ae6-1a51-4a58-b729-2e51926b2349 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091339 Sep 13 16:30:59.000697 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 114/201] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:30:59.015676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:59.029470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.031099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.031785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.032831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.036818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.037622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.099315 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44bc412b-d3c3-4dec-a704-2ec23473f617 tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-857467-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.097151 Sep 13 16:30:59.100762 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 115/202] 10.222.0.61 () {60 vars in 1235 bytes} [Tue Sep 13 16:30:59 2022] GET /compute/v2.1/os-services?host=n-d-857467-1&binary=xxx => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:59.112715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:59.116264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.116690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.117126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.122903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.124211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.125386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.154382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-210201ff-f0ee-447d-95c2-e5b7cee65c0f tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.045453 Sep 13 16:30:59.155544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 116/203] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Sep 13 16:30:59 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:30:59.175102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:59.179190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.179910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.180510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.182913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.183561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.192975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.219584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bebd19e5-bbfb-479d-8e9e-546ff5e7977a tempest-ServicesAdminNegativeV253TestJSON-830331379 tempest-ServicesAdminNegativeV253TestJSON-830331379-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.048470 Sep 13 16:30:59.220205 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 117/204] 10.222.0.61 () {60 vars in 1239 bytes} [Tue Sep 13 16:30:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:59.270542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:59.285625 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b756cc3a-9260-47a6-bb91-ff7b10544c3c tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.857648 Sep 13 16:30:59.291595 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 88/205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:58 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:30:59.734618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d771f08d-d1b7-45f2-b58d-5aad3b70402f tempest-ServicesAdminNegativeV253TestJSON-1372975446 tempest-ServicesAdminNegativeV253TestJSON-1372975446-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:59.746009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d771f08d-d1b7-45f2-b58d-5aad3b70402f tempest-ServicesAdminNegativeV253TestJSON-1372975446 tempest-ServicesAdminNegativeV253TestJSON-1372975446-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '861be48601f34af39a34599a8639e94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db90b3f013946bbbff3f915c218b8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d771f08d-d1b7-45f2-b58d-5aad3b70402f tempest-ServicesAdminNegativeV253TestJSON-1372975446 tempest-ServicesAdminNegativeV253TestJSON-1372975446-project] Request method failure captured: Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA-XxGr3GSojQgOIHwRGLsgf4K_jN33wC7QyR2yHPhjkn7JAWroacLLRlQ3qEYJHNRpB6i8QAEhqcJK8fdRO4Os_Ofv1k2I5ZOaian7SR_3zV1Nm6ig8Jxd-tL89bWnuZqbTOw_r_aqiQWy5DtKb5yPs4IjD3UiLvRJDMAcyydJkxA Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.53 Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9db90b3f013946bbbff3f915c218b8bf Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1372975446 Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:30:59.750670 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9db90b3f013946bbbff3f915c218b8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9db90b3f013946bbbff3f915c218b8bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9db90b3f013946bbbff3f915c218b8bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9db90b3f013946bbbff3f915c218b8bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1372975446 Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9db90b3f013946bbbff3f915c218b8bf Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1372975446 Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1372975446-project Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 861be48601f34af39a34599a8639e94a Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1372975446-project Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 13 16:30:59.752110 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:30:59.752912 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 13 16:30:59.754787 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:30:59.761033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d771f08d-d1b7-45f2-b58d-5aad3b70402f tempest-ServicesAdminNegativeV253TestJSON-1372975446 tempest-ServicesAdminNegativeV253TestJSON-1372975446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:30:59.765200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d771f08d-d1b7-45f2-b58d-5aad3b70402f tempest-ServicesAdminNegativeV253TestJSON-1372975446 tempest-ServicesAdminNegativeV253TestJSON-1372975446-project] 10.222.0.61 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.536291 Sep 13 16:30:59.767658 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 118/206] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Sep 13 16:30:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 539 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:30:59.816941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:30:59.817987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:30:59.829490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.833121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.833465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:30:59.837015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:30:59.837675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:30:59.838439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.187204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:00.201338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0cd72ca8-6f87-48e2-800b-0f3cc108d666 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1492 microversion: 2.1 time: 0.388090 Sep 13 16:31:00.203868 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 89/207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:30:59 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1492 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:00.462735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8fe49185-1409-4207-9267-a5b729f2506c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:00.480139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8fe49185-1409-4207-9267-a5b729f2506c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.411432 Sep 13 16:31:00.481101 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 119/208] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:00.494453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:00.495856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:00.516473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.517263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.517897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.519142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.519603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.520029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.674926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:00.675485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:00.689434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.689557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.690395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.692235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.694333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.697326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.733383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:00.742897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-380bb8b2-e0bc-4b58-b2fd-39012c9e09b8 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1339 microversion: 2.1 time: 0.260096 Sep 13 16:31:00.750855 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 120/209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:00 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:00.820601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:31:00.986750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:31:00.987274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aca00199-793b-4f74-b326-435e52e921bf tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:31:00.989150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.990000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.990711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:00.992961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:00.993700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:00.995672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:01.021039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.rpcapi [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 16:31:01.024868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] Releasing lock "compute-rpcapi-router" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:31:01.104601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ab62025-71a2-43ff-89ec-1d2d0aab80bc None None] 10.222.0.61 "DELETE /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 204 len: 0 microversion: 2.1 time: 0.876160 Sep 13 16:31:01.105927 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 90/210] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:31:00 2022] DELETE /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:31:01.115218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:01.116303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:01.124928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:01.125578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:01.126220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:01.127242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:01.128114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:01.128903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:01.401429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:01.417223 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e23ffd5-c09e-4c16-9d84-6794d9715559 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1498 microversion: 2.1 time: 0.307042 Sep 13 16:31:01.418361 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 91/211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:01 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1498 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:01.492828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0fae693e-2656-4879-a57b-b757e3854c4f tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1853079548", "id": 1694019408, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:01.529913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0fae693e-2656-4879-a57b-b757e3854c4f tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.777577 Sep 13 16:31:01.544167 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 121/212] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:00 2022] POST /compute/v2.1/flavors => generated 425 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:01.556809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72bfcf92-cd10-4dcf-85d8-7c3524b910c4 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:01.574526 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72bfcf92-cd10-4dcf-85d8-7c3524b910c4 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017939 Sep 13 16:31:01.577139 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 92/213] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Sep 13 16:31:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:31:01.590247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6071c78-4cb2-4663-8f3e-aa977a02a234 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-614196747", "id": 320586413, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:01.622563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6071c78-4cb2-4663-8f3e-aa977a02a234 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.038779 Sep 13 16:31:01.623446 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 122/214] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:01 2022] POST /compute/v2.1/flavors => generated 421 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:01.640441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9d9454e-05c3-4edc-9c3b-d6c8a08b161a tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:01.653426 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9d9454e-05c3-4edc-9c3b-d6c8a08b161a tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017571 Sep 13 16:31:01.670503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 93/215] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Sep 13 16:31:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:31:01.673284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff74081f-d139-4eff-a4e0-8492780af81a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Action: 'create', calling method: .version_select at 0x7fbeb5e35160>, body: {"keypair": {"name": "tempest-keypair-1864724555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlWf8vAySasJSx/jTdv1NEdQJZZgD/WwayFZYnpiVXysAOAUiHpU4NZ/8fa9HUCk5MlgOD7P342E1zYzF3EcpPSdo9Ucv7RrRUArDiJ3kREqbjTT9q966mCMzqyHD2+zA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:01.716459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ff74081f-d139-4eff-a4e0-8492780af81a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Getting quotas for project 2a858bc8ce4e413daa756d969d53a093. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:01.732270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ff74081f-d139-4eff-a4e0-8492780af81a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Getting quotas for user 5bfa5c9e4b2b47dfb53c471554382f2d and project 2a858bc8ce4e413daa756d969d53a093. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:01.774897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:01.776348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:01.786142 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff74081f-d139-4eff-a4e0-8492780af81a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116789 Sep 13 16:31:01.789985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 123/216] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:01.801855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:01.804717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:01.808224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:01.810414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:01.811557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:01.812441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:02.168960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:02.178271 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d1f78b8-a02f-4317-a920-f7ff90f7c825 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1489 microversion: 2.1 time: 0.407434 Sep 13 16:31:02.206070 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 94/217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:01 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1489 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:02.212139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:02.212771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:02.254006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:02.254568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:02.255003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:02.268749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:02.271984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:02.275181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:02.441488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:02.442850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:02.458626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:02.463494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:02.467742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:02.471057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:02.475436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:02.476171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.193490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:03.208044 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-07a7c577-d13a-46b7-8adb-65088ee02cdb tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1498 microversion: 2.1 time: 0.771280 Sep 13 16:31:03.209089 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 95/218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:02 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1498 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:03.691965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8547f157-ca9e-4879-af96-3df5d64d31c3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1640 microversion: 2.1 time: 1.484115 Sep 13 16:31:03.695215 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 124/219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:02 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1640 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:03.720796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:03.721355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:03.723687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Calling method '.version_select at 0x7fbeb69b4040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:03.727293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.727799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.734400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.744181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.750609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.751957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.753295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.754365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.755037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.779571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.781081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.785289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.791938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:31:03.801035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.801804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.802416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.806103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:03.810698 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb3c228c-fde1-45ea-8748-fb72119f6732 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.293454 Sep 13 16:31:03.811652 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 96/220] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:03.823034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Calling method '.version_select at 0x7fbeb5e0c790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:03.825307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.825808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.826332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.853860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.854986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.855641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.923646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.924300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.930447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.951783 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58c0d53e-a3bf-446c-a570-5829405e86c1 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-857467-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.132579 Sep 13 16:31:03.952390 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 97/221] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Sep 13 16:31:03 2022] GET /compute/v2.1/os-hypervisors/n-h1-857467-1/servers => generated 275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:03.966679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Calling method '.version_select at 0x7fbeb5e0c9d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:03.969106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.969652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.970298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:03.988852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:03.989193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:03.990370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.016497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.017206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.017793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.020630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:04.031602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f777863-9850-427e-8d2f-5584d20fbb10 tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066803 Sep 13 16:31:04.032614 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 98/222] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:04.045917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Calling method '.version_select at 0x7fbeb5e914c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:04.056804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.056804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.056804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.066663 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f044b43b-88c2-4ac4-91b2-8c6a0f1634e1 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "DELETE /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 204 len: 0 microversion: 2.1 time: 0.349821 Sep 13 16:31:04.069364 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 125/223] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:31:03 2022] DELETE /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:31:04.086538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:04.087687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:04.094591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.095087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.095527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.118241 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9cc586d8-30a5-4150-994e-779070763e0f tempest-HypervisorAdminUnderV252Test-1905747771 tempest-HypervisorAdminUnderV252Test-1905747771-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-857467-1/search" status: 200 len: 104 microversion: 2.1 time: 0.076978 Sep 13 16:31:04.122928 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 99/224] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Sep 13 16:31:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-857467-1/search => generated 104 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:31:04.243045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:04.243668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:04.276391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.276904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.277345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.281300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.282155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.282641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.455981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.456498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.456939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.457658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.458314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.458903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.489172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:04.504808 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4475d907-9658-48e2-a660-238e175345f0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1456 microversion: 2.1 time: 0.269430 Sep 13 16:31:04.505623 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 100/225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:04 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1456 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:04.516258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7918ebe1-9313-49fd-b17e-b31a71ff631c req-963ab956-5fa7-46fc-9f0d-abf81e5f57f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abacb16-c2cb-4077-b884-03f67a581d46", "name": "network-vif-deleted", "tag": "a8ac9233-60f3-4605-8ab9-ef5a1fe576f1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:04.547766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7918ebe1-9313-49fd-b17e-b31a71ff631c req-963ab956-5fa7-46fc-9f0d-abf81e5f57f9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:04.547766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7918ebe1-9313-49fd-b17e-b31a71ff631c req-963ab956-5fa7-46fc-9f0d-abf81e5f57f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:04.548284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7918ebe1-9313-49fd-b17e-b31a71ff631c req-963ab956-5fa7-46fc-9f0d-abf81e5f57f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:04.588195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7918ebe1-9313-49fd-b17e-b31a71ff631c req-963ab956-5fa7-46fc-9f0d-abf81e5f57f9 service nova] Creating event network-vif-deleted:a8ac9233-60f3-4605-8ab9-ef5a1fe576f1 for instance 3abacb16-c2cb-4077-b884-03f67a581d46 on n-h1-857467-1 Sep 13 16:31:04.597955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7918ebe1-9313-49fd-b17e-b31a71ff631c req-963ab956-5fa7-46fc-9f0d-abf81e5f57f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089668 Sep 13 16:31:04.598880 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 101/226] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:04.695391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:04.710880 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8165dfc6-8c04-44c1-8d38-613bdad27d19 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1495 microversion: 2.1 time: 0.635102 Sep 13 16:31:04.728327 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 126/227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:04 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1495 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:05.538001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:05.540509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:05.559027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:05.562335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.563890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.564594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.565861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.566752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.567419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.637564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.640672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.645317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.646308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lazy-loading 'fault' on Instance uuid 3abacb16-c2cb-4077-b884-03f67a581d46 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:31:05.739209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:05.740145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:05.753138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.755999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.757678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.759912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:05.761708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:05.763797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:05.830503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:05.854656 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2014f633-32b4-429d-9370-662f2cf3dee6 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 200 len: 1332 microversion: 2.1 time: 0.322275 Sep 13 16:31:05.871205 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 102/228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:05 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 1332 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:06.470350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-784935058", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "320586413", "adminPass": "***", "networks": [{"uuid": "5d428c01-42ae-4ea7-9f4b-06da697d06f8"}], "security_groups": [{"name": "tempest-securitygroup--1630000524"}], "key_name": "tempest-keypair-1864724555", "user_data": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:06.529035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:06.539513 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d2a1440-367b-487d-b986-77ec6b4bcfc5 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1495 microversion: 2.1 time: 0.807483 Sep 13 16:31:06.540107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 127/229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:05 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1495 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:06.705460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] validate_networks() for [('5d428c01-42ae-4ea7-9f4b-06da697d06f8', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:06.887223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:06.888480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:06.895702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:06.896405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:06.897013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:06.897904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:06.898601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:06.899312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:06.914377 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] HTTP exception thrown: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Request method failure captured: Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 HTTP/1.1 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAahJkGGzDeLxvEfC-kJs-qntnrEZCnanwJVPM0mz12C9ThTP8f-0ZEmXZ1MjxwEjZaDiV2dJoizwFZtESNq4bfIJrpIX0E31I6HCrmd0JVBByyuajXSD8EkqTFlA4UTBtShAPkLUNfiVdgltOoJAmKegoOCvaMOwiGoTb_phJywT4 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:31:06.927232 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_524aaaf44c2844aba44b186af0447f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 937e91d31b0e40528917884dcd038387 Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:06.928614 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3abacb16-c2cb-4077-b884-03f67a581d46'} Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:06.929423 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:06.930756 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:06.933900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Returning 404 to user: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:06.935556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-04799299-c1e0-417f-9924-6661591c751c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 404 len: 111 microversion: 2.1 time: 0.051693 Sep 13 16:31:06.942475 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 128/230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:06 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:07.099432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1805011430", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:07.179424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:07.765548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:31:07.766048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:31:07.766527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:31:07.766937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:31:07.767348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:31:07.805274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:07.805788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:07.806293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:07.807075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:07.811434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:07.815483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:07.843671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:07.904578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Getting quotas for project 524aaaf44c2844aba44b186af0447f92. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:07.921414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Getting quotas for user 937e91d31b0e40528917884dcd038387 and project 524aaaf44c2844aba44b186af0447f92. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:07.968147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:31:07.978271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:31:08.121390 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b296d170-185f-4029-b9f7-74aa3b505a62 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028609 Sep 13 16:31:08.133265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 129/231] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:31:08.145706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:08.151675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:08.173805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:08.179083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:08.179981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:08.180911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:08.181543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:08.184042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:08.291069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:08.291797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:08.296140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:08.296860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lazy-loading 'fault' on Instance uuid 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:31:08.855435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c00e88a11d54910a2362829a94266ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fc93c5a970488a81c3b2570267d13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:08.872033 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b256edc-d7a7-460b-a779-67efd4137908 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 200 len: 1329 microversion: 2.1 time: 0.737001 Sep 13 16:31:08.894125 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 130/232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:08 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 1329 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:08.910896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c44ed3dc-273b-4015-9507-9aa95046162c req-cf764e68-a3f1-46d1-85b4-ce005c655d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e8d27e-de0b-4db7-b2af-994bfc2f9a76", "name": "network-vif-deleted", "tag": "ba98d5e7-91ec-4355-abfe-84e281d89df2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:08.955077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c44ed3dc-273b-4015-9507-9aa95046162c req-cf764e68-a3f1-46d1-85b4-ce005c655d21 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:08.962981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c44ed3dc-273b-4015-9507-9aa95046162c req-cf764e68-a3f1-46d1-85b4-ce005c655d21 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:08.963563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c44ed3dc-273b-4015-9507-9aa95046162c req-cf764e68-a3f1-46d1-85b4-ce005c655d21 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:08.983867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:31:08.985197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:31:08.985889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:31:08.987848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:31:08.988710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:31:08.993895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c44ed3dc-273b-4015-9507-9aa95046162c req-cf764e68-a3f1-46d1-85b4-ce005c655d21 service nova] Creating event network-vif-deleted:ba98d5e7-91ec-4355-abfe-84e281d89df2 for instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 on n-h1-857467-1 Sep 13 16:31:09.008148 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c44ed3dc-273b-4015-9507-9aa95046162c req-cf764e68-a3f1-46d1-85b4-ce005c655d21 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103604 Sep 13 16:31:09.012968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:09.014972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:09.015834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:09.017241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:09.020622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:09.021282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:09.036229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 131/233] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:09.046210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d06b512e-f776-4917-9f16-2fcbe509f95c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:09.050955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d06b512e-f776-4917-9f16-2fcbe509f95c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:09.072303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Getting quotas for project 2a858bc8ce4e413daa756d969d53a093. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:09.081965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Getting quotas for user 5bfa5c9e4b2b47dfb53c471554382f2d and project 2a858bc8ce4e413daa756d969d53a093. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:09.132593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:31:09.135396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:31:09.244428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2eee3447-c236-4ca9-908f-50a86cda1947 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.778295 Sep 13 16:31:09.252534 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 103/234] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:31:09.259537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00489d2b-d2f0-4461-a3d2-508065f70026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:09.260904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00489d2b-d2f0-4461-a3d2-508065f70026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:09.261525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d06b512e-f776-4917-9f16-2fcbe509f95c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:09.272334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d06b512e-f776-4917-9f16-2fcbe509f95c tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1220 microversion: 2.1 time: 0.234292 Sep 13 16:31:09.272938 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 132/235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:09 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:09.513439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00489d2b-d2f0-4461-a3d2-508065f70026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:09.824031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00489d2b-d2f0-4461-a3d2-508065f70026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1262 microversion: 2.1 time: 0.569582 Sep 13 16:31:09.824889 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 104/236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:09 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1262 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:09.906672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:09.910041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:09.926336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:09.927708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:09.928312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:09.929392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:09.930768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:09.931953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:09.964844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] HTTP exception thrown: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Request method failure captured: Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 HTTP/1.1 Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAc8ME3aGkPl2oXbgsdxFnd7F9rGdBwRH3ILKIBG6AsyHQVmZoztTB2zDN6UHhtaBMA-TrL39CcGUysenC5-cTp6x3ZD_m4_ck4FZEfscwpoJR5pyvyP9SDRb2DH0jzPceAqijyQf0-La8pCbpU0kfgJChoMd5UbszcT6kdfuhmyEo Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 44fc93c5a970488a81c3b2570267d13d Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:31:09.975116 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 44fc93c5a970488a81c3b2570267d13d Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminTestJSON-810778613-project Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c00e88a11d54910a2362829a94266ec Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminTestJSON-810778613-project Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:09.976441 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '02e8d27e-de0b-4db7-b2af-994bfc2f9a76'} Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:09.977223 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:09.978512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:09.995050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Returning 404 to user: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:09.996385 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c458412-2a2b-49ab-ac53-9a4fd9cf1ce3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 404 len: 111 microversion: 2.1 time: 0.093451 Sep 13 16:31:10.000034 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 133/237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:09 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:10.009184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7e83ceb-9b2c-42c2-808a-25c230691e96 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:10.033184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7e83ceb-9b2c-42c2-808a-25c230691e96 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:10.034190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7e83ceb-9b2c-42c2-808a-25c230691e96 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:10.037427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7e83ceb-9b2c-42c2-808a-25c230691e96 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:10.306689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:10.308665 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7e83ceb-9b2c-42c2-808a-25c230691e96 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.303683 Sep 13 16:31:10.310193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:10.311194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 105/238] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:31:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:10.323938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-071879ec-f65d-4f99-b9ab-dc73824033f7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:10.333360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:10.336219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:10.337778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:10.340495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:10.341312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:10.345041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:10.402185 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-071879ec-f65d-4f99-b9ab-dc73824033f7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.080763 Sep 13 16:31:10.404166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 106/239] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:10 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 13 16:31:10.423065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ce51a3a-8b3f-49f3-b131-523767822c48 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-591707256"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:10.432370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.aggregate [None req-4ce51a3a-8b3f-49f3-b131-523767822c48 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid ef449d2c-4aa4-4c1e-ada5-78e8ec95473a for aggregate {{(pid=122327) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:10.501793 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ce51a3a-8b3f-49f3-b131-523767822c48 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.088774 Sep 13 16:31:10.502537 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 107/240] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:10.723362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:10.741469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b49671aa-8981-4140-9490-4f283b643f93 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1280 microversion: 2.1 time: 0.440284 Sep 13 16:31:10.754728 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 134/241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:10 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1280 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:10.777502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-91eca58d-00b3-4197-92d7-0fb5a4887ab3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:10.809654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91eca58d-00b3-4197-92d7-0fb5a4887ab3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:10.810200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91eca58d-00b3-4197-92d7-0fb5a4887ab3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:10.810651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91eca58d-00b3-4197-92d7-0fb5a4887ab3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:10.828382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f71a292-a6d0-469e-adb0-75462f3607e6 tempest-NetworksTest-14211486 tempest-NetworksTest-14211486-project-admin] Calling method '.version_select at 0x7fbeb5d498b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.160925 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-91eca58d-00b3-4197-92d7-0fb5a4887ab3 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.404830 Sep 13 16:31:11.168096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 135/242] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:31:10 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:11.179730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.180363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:11.192393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.193135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.193770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.198974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.200250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.200861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.240790 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f71a292-a6d0-469e-adb0-75462f3607e6 tempest-NetworksTest-14211486 tempest-NetworksTest-14211486-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks" status: 200 len: 5397 microversion: 2.1 time: 0.736281 Sep 13 16:31:11.241995 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 108/243] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:10 2022] GET /compute/v2.1/os-networks => generated 5397 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:11.246971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-511a71f3-15e6-4156-af96-79c7126a15ea tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.261090 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-511a71f3-15e6-4156-af96-79c7126a15ea tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.017864 Sep 13 16:31:11.265608 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 109/244] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:31:11 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:11.273316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3470875b-95fe-4f57-9bff-801acce946c4 tempest-NetworksTest-14211486 tempest-NetworksTest-14211486-project-admin] Calling method '.version_select at 0x7fbeb7436940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.393121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:11.404607 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-88048d70-f7a1-4037-927b-ff3010acc60c tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1314 microversion: 2.1 time: 0.234396 Sep 13 16:31:11.407091 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 136/245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:11 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:11.416241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6d80ed11-fc62-4313-8270-53deed79c37e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:11.446551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d80ed11-fc62-4313-8270-53deed79c37e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.447056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d80ed11-fc62-4313-8270-53deed79c37e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.447497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d80ed11-fc62-4313-8270-53deed79c37e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.721189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6d80ed11-fc62-4313-8270-53deed79c37e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.310458 Sep 13 16:31:11.722514 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 137/246] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:31:11 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:11.734716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b70cdaba-c52b-42a0-b745-f8da5b06b5db tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.762369 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3470875b-95fe-4f57-9bff-801acce946c4 tempest-NetworksTest-14211486 tempest-NetworksTest-14211486-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks/6128d85e-277c-4324-80a2-b0bf61ced0e7" status: 200 len: 652 microversion: 2.1 time: 0.495297 Sep 13 16:31:11.762972 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 110/247] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:31:11 2022] GET /compute/v2.1/os-networks/6128d85e-277c-4324-80a2-b0bf61ced0e7 => generated 652 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:11.777557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01a7ffd7-6683-4f4c-b5ae-0ae752724036 tempest-NetworksTest-14211486 tempest-NetworksTest-14211486-project-admin] Calling method '.version_select at 0x7fbeb738aca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.782641 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b70cdaba-c52b-42a0-b745-f8da5b06b5db tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.051951 Sep 13 16:31:11.783496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 138/248] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 13 16:31:11.790858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:11.794652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:11.809252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.810173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.810843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.812377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:11.814506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:11.814960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:11.987866 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01a7ffd7-6683-4f4c-b5ae-0ae752724036 tempest-NetworksTest-14211486 tempest-NetworksTest-14211486-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks" status: 200 len: 5397 microversion: 2.1 time: 0.218482 Sep 13 16:31:11.988599 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 111/249] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:11 2022] GET /compute/v2.1/os-networks => generated 5397 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:12.007109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cba57216-99e3-49fd-a87f-4c8c23d1b260 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2057101139"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:12.018024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.aggregate [None req-cba57216-99e3-49fd-a87f-4c8c23d1b260 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid f3476dcd-872d-4f54-95f7-d291c15be4ca for aggregate {{(pid=122327) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:12.087194 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cba57216-99e3-49fd-a87f-4c8c23d1b260 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.096390 Sep 13 16:31:12.089030 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 112/250] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:12.102409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75c5883a-c013-44fc-9479-b81e3785720e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:12.137988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75c5883a-c013-44fc-9479-b81e3785720e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:12.140953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75c5883a-c013-44fc-9479-b81e3785720e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:12.143697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75c5883a-c013-44fc-9479-b81e3785720e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:12.457431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75c5883a-c013-44fc-9479-b81e3785720e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.360845 Sep 13 16:31:12.458643 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 113/251] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:31:12 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:12.475468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:12.476293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:12.500906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:12.506691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:12.507330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:12.514169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:12.520575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:12.521376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:12.560351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:12.595171 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75a08442-6670-4779-bd06-b80951162362 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1278 microversion: 2.1 time: 0.810210 Sep 13 16:31:12.615290 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 139/252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:11 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1278 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:12.622498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfa24576-955d-4cef-ac83-5856f02aec1e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:12.643018 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfa24576-955d-4cef-ac83-5856f02aec1e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.026133 Sep 13 16:31:12.647412 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 140/253] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:31:12 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:12.660786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97ce70d2-e5ea-4a4e-bd20-6c3eec2008bd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:12.691059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97ce70d2-e5ea-4a4e-bd20-6c3eec2008bd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:12.693269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97ce70d2-e5ea-4a4e-bd20-6c3eec2008bd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:12.694436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97ce70d2-e5ea-4a4e-bd20-6c3eec2008bd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:12.884995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:12.900832 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e4bc6a65-0e6e-4a0e-a2b4-31a49ae1f968 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1320 microversion: 2.1 time: 0.440982 Sep 13 16:31:12.901565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 114/254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:12 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:13.001219 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97ce70d2-e5ea-4a4e-bd20-6c3eec2008bd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.346152 Sep 13 16:31:13.002898 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 141/255] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Sep 13 16:31:12 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:13.017183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99a06f8f-f651-4b8c-bff5-bb0e3a9ccd72 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.070083 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99a06f8f-f651-4b8c-bff5-bb0e3a9ccd72 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.058813 Sep 13 16:31:13.071940 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 115/256] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:13 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:13.084895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93667b97-cceb-4a26-a910-f44df6c1b215 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1593351971"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:13.094756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-93667b97-cceb-4a26-a910-f44df6c1b215 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid b700cafa-ec60-420b-814b-18fcee2d8b8c for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:13.146997 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93667b97-cceb-4a26-a910-f44df6c1b215 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068317 Sep 13 16:31:13.148929 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 142/257] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:13.168358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bb8128b-196a-43e7-9f29-21fbbe2cbeb8 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:13.194663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb8128b-196a-43e7-9f29-21fbbe2cbeb8 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.195412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb8128b-196a-43e7-9f29-21fbbe2cbeb8 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.196024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb8128b-196a-43e7-9f29-21fbbe2cbeb8 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.379877 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bb8128b-196a-43e7-9f29-21fbbe2cbeb8 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.223382 Sep 13 16:31:13.381502 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 116/258] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:13 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:13.394628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e12e6726-ee3b-41f6-bc98-679209775d30 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:13.416463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e12e6726-ee3b-41f6-bc98-679209775d30 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.418074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e12e6726-ee3b-41f6-bc98-679209775d30 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.420212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e12e6726-ee3b-41f6-bc98-679209775d30 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.630875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.632084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:13.638035 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e12e6726-ee3b-41f6-bc98-679209775d30 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.247659 Sep 13 16:31:13.639020 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 143/259] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:13 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:13.640028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.640527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.640965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.641670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.642204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.642635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.653679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99337105-7651-4a8f-9f48-79649f0a2cf0 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.704794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99337105-7651-4a8f-9f48-79649f0a2cf0 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.056947 Sep 13 16:31:13.706546 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 144/260] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:13 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:13.731740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53040526-42be-4950-8b2d-5bc6a9c3d152 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-89785338"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:13.745952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-53040526-42be-4950-8b2d-5bc6a9c3d152 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid 468baf95-f3bc-40eb-b755-c167ea8b8646 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:13.812693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53040526-42be-4950-8b2d-5bc6a9c3d152 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.097284 Sep 13 16:31:13.813882 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 145/261] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:13.829106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb5e7d670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.839589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.842657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.843313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.846965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.847805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.848400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.881589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:13.898477 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-869e67c8-2495-453b-92ed-4a7911e0fd3d tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.081026 Sep 13 16:31:13.902355 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 146/262] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Sep 13 16:31:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:13.911809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ab6da77-96c0-472a-9987-c533fa3310db tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.961885 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ab6da77-96c0-472a-9987-c533fa3310db tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.055512 Sep 13 16:31:13.963287 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 147/263] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:13.971697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb5e7d040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:13.976898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.977527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.978221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:13.979485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:13.980424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:13.980971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.020714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3ce1df3-52af-4ec7-9b63-10ad60c6f269 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.053077 Sep 13 16:31:14.022951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 148/264] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:13 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:14.029561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.032423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:14.050142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.050789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.051408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.052457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.053457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.054099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.235487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:14.255532 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1aec572-80ac-4b07-97f4-d25455019463 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1320 microversion: 2.1 time: 0.231176 Sep 13 16:31:14.256711 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 149/265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:14 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:14.278804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc4b4479-b222-4d90-8734-b39632a1329d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.319103 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-fc4b4479-b222-4d90-8734-b39632a1329d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc4b4479-b222-4d90-8734-b39632a1329d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Request method failure captured: Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAebCBEpz_NYZnoRbXQvaVKoJFGLjVxV5OpBfNUNa8de5PXKC8Y1aA39LDW0ddpzzTe-vSrKc0OKCbJVN7K0y51ksBcJleXw4lAm9st9gwMN_musouJ3v9VUGy5z1bZUeVNWO7K-Xd-nSMnVETRVKo9kbwhaRXyw30dT0_q5IGclUc Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:31:14.322308 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 19c36245bca047779af1d282c854e03f Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: exception: Aggregate 11 could not be found. Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '11'} Sep 13 16:31:14.323726 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.324657 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 13 16:31:14.326678 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.329433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc4b4479-b222-4d90-8734-b39632a1329d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:14.330519 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc4b4479-b222-4d90-8734-b39632a1329d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.073205 Sep 13 16:31:14.331960 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 150/266] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:14 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:14.339687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb5e35160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.345319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.346383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.347039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.348079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.349778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.350706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.420962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7655feff-c1b0-40fb-8bcb-91d72f0bebd5 tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.087544 Sep 13 16:31:14.421980 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 151/267] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Sep 13 16:31:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:14.427200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ddbb970-668b-4a55-9af5-310959fa8e7f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-295719607"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:14.434712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-3ddbb970-668b-4a55-9af5-310959fa8e7f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 06ac4678-a26b-4423-8e6d-02b9c01079ae for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:14.468177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ddbb970-668b-4a55-9af5-310959fa8e7f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044879 Sep 13 16:31:14.469189 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 152/268] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:14.474564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd3ab3a8-4f7a-4235-9ce8-814cc93a7d73 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.491434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-dd3ab3a8-4f7a-4235-9ce8-814cc93a7d73 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd3ab3a8-4f7a-4235-9ce8-814cc93a7d73 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Request method failure captured: Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAebCBEpz_NYZnoRbXQvaVKoJFGLjVxV5OpBfNUNa8de5PXKC8Y1aA39LDW0ddpzzTe-vSrKc0OKCbJVN7K0y51ksBcJleXw4lAm9st9gwMN_musouJ3v9VUGy5z1bZUeVNWO7K-Xd-nSMnVETRVKo9kbwhaRXyw30dT0_q5IGclUc Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:31:14.494164 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 19c36245bca047779af1d282c854e03f Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: exception: Aggregate 11 could not be found. Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '11'} Sep 13 16:31:14.495343 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:31:14.496042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.497041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:14.501752 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:14.501752 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:14.501752 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:14.501752 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 13 16:31:14.501752 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.504605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd3ab3a8-4f7a-4235-9ce8-814cc93a7d73 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:14.505724 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd3ab3a8-4f7a-4235-9ce8-814cc93a7d73 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.035305 Sep 13 16:31:14.507757 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 153/269] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:14 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:14.513016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb5da0f70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.523765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.524644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.525154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.541920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.547130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.547862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.590310 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b21b0ab-c289-4e59-8010-f1950cfeda6a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-h1-857467-1" status: 200 len: 598 microversion: 2.1 time: 0.079836 Sep 13 16:31:14.595143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 154/270] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 16:31:14 2022] GET /compute/v2.1/os-hosts/n-h1-857467-1 => generated 598 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:14.597098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f6f28f3-8816-45dd-9c67-bfcd1d3fe089 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:14.610371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f6f28f3-8816-45dd-9c67-bfcd1d3fe089 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.611556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f6f28f3-8816-45dd-9c67-bfcd1d3fe089 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.613023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f6f28f3-8816-45dd-9c67-bfcd1d3fe089 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.789995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f6f28f3-8816-45dd-9c67-bfcd1d3fe089 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.197714 Sep 13 16:31:14.792102 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 155/271] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:14 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:14.799271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-213d2cac-12e6-40f1-841c-f617c5bb376e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1969840705", "name": "tempest-test_aggregate-1295910264"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:14.806916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-213d2cac-12e6-40f1-841c-f617c5bb376e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid e90fce98-f166-439d-8a13-f634b3fffa23 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:14.890254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-213d2cac-12e6-40f1-841c-f617c5bb376e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.095964 Sep 13 16:31:14.903328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:14.906783 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 156/272] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Sep 13 16:31:14 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:14.912369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Calling method '.version_select at 0x7fbeb5da0af0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:14.922932 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6322f59e-16a2-42ee-947a-b77468dbe0c4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 1.303323 Sep 13 16:31:14.930215 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 117/273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:13 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:14.941462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.942061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.942501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.950285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5afc66d8-e7c5-440f-960d-0c3e9e45ee09 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:14.953877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5afc66d8-e7c5-440f-960d-0c3e9e45ee09 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '7d3964f2b37b4c5991e8eb85a111e346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61779f585dd24cbe887ad5531a9755b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5afc66d8-e7c5-440f-960d-0c3e9e45ee09 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Request method failure captured: Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 42 Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAbY5Sfa9ak0VxWNnYu7RKzemO-0vxogEeIezeh7GcoobzGOUdtY8AeLTHdyMydReRMPq0dbYbZApulZhQ1vImOnDqDvkxwAadILlGnGlhje5A_SoX_euJFW2EmfOsWT4YOZkW0DQp-BHYNa_lGFK-Z_t6pVME78Mq--TWaB4qjOrs Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:14.975803 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61779f585dd24cbe887ad5531a9755b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 61779f585dd24cbe887ad5531a9755b0 Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108 Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 7d3964f2b37b4c5991e8eb85a111e346 Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1317926108-project Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: {"remove_host": {"host": "n-h1-857467-1"}} Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:14.977279 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h1-857467-1'}}} Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:31:14.978144 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 13 16:31:14.979338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:14.980805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5afc66d8-e7c5-440f-960d-0c3e9e45ee09 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:14.980805 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5afc66d8-e7c5-440f-960d-0c3e9e45ee09 tempest-AggregatesAdminNegativeTestJSON-1317926108 tempest-AggregatesAdminNegativeTestJSON-1317926108-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.045950 Sep 13 16:31:14.980805 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 118/274] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:14 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:14.993727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:14.994261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:14.994708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:14.998941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eab8c12b-4da4-4df9-869c-bd157a0cfe89 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.019321 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-125433f6-88d8-4dfa-a3b5-a9933712703a tempest-HostsAdminTestJSON-659874875 tempest-HostsAdminTestJSON-659874875-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-h2-857467-1" status: 200 len: 332 microversion: 2.1 time: 0.111217 Sep 13 16:31:15.029200 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 157/275] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 16:31:14 2022] GET /compute/v2.1/os-hosts/n-h2-857467-1 => generated 332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:15.044862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4bcab4c6-1312-4661-8fe5-02978295dd0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:15.085820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eab8c12b-4da4-4df9-869c-bd157a0cfe89 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.105417 Sep 13 16:31:15.086455 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 119/276] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:15.094485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6d16f22-8bb0-435d-a41a-7a0c31950750 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.104901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bcab4c6-1312-4661-8fe5-02978295dd0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.105404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bcab4c6-1312-4661-8fe5-02978295dd0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.105864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bcab4c6-1312-4661-8fe5-02978295dd0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.143765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d6d16f22-8bb0-435d-a41a-7a0c31950750 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6d16f22-8bb0-435d-a41a-7a0c31950750 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Request method failure captured: Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAebCBEpz_NYZnoRbXQvaVKoJFGLjVxV5OpBfNUNa8de5PXKC8Y1aA39LDW0ddpzzTe-vSrKc0OKCbJVN7K0y51ksBcJleXw4lAm9st9gwMN_musouJ3v9VUGy5z1bZUeVNWO7K-Xd-nSMnVETRVKo9kbwhaRXyw30dT0_q5IGclUc Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:31:15.145374 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 19c36245bca047779af1d282c854e03f Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: exception: Aggregate 13 could not be found. Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '13'} Sep 13 16:31:15.146783 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:15.147816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 13 16:31:15.149001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.162846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6d16f22-8bb0-435d-a41a-7a0c31950750 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:15.163736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6d16f22-8bb0-435d-a41a-7a0c31950750 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.072987 Sep 13 16:31:15.164311 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 120/277] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:15 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:15.175200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-398fabb0-d48c-43d8-8f81-41e9340b986e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.262160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-398fabb0-d48c-43d8-8f81-41e9340b986e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-398fabb0-d48c-43d8-8f81-41e9340b986e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Request method failure captured: Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAebCBEpz_NYZnoRbXQvaVKoJFGLjVxV5OpBfNUNa8de5PXKC8Y1aA39LDW0ddpzzTe-vSrKc0OKCbJVN7K0y51ksBcJleXw4lAm9st9gwMN_musouJ3v9VUGy5z1bZUeVNWO7K-Xd-nSMnVETRVKo9kbwhaRXyw30dT0_q5IGclUc Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:31:15.266729 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6e3ad3feb1aa48f88a00e007a91396f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6e3ad3feb1aa48f88a00e007a91396f7 Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1460375726 Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 19c36245bca047779af1d282c854e03f Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AggregatesAdminTestJSON-1460375726-project-admin Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: exception: Aggregate 13 could not be found. Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '13'} Sep 13 16:31:15.269087 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:31:15.270401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:15.271542 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:15.272734 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:15.272734 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:15.272734 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:15.272734 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 13 16:31:15.272734 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:15.272734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-398fabb0-d48c-43d8-8f81-41e9340b986e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:15.273145 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-398fabb0-d48c-43d8-8f81-41e9340b986e tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.102452 Sep 13 16:31:15.282988 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 121/278] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:15 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:15.288448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.289116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:15.299968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.300805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.301496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.302428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.303212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.303801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.429480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4bcab4c6-1312-4661-8fe5-02978295dd0f tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.399137 Sep 13 16:31:15.430165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 158/279] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:15 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:15.440718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-171f4e13-5690-49cf-86a0-777f8d4ea74b tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-187414669"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:15.460739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-171f4e13-5690-49cf-86a0-777f8d4ea74b tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid 3f627d40-861e-4779-b19f-dcd8cf88f02b for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:15.508616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-171f4e13-5690-49cf-86a0-777f8d4ea74b tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077391 Sep 13 16:31:15.509770 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 159/280] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:15.514379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a5969b3-00b3-40fd-9c3f-84b602d367d2 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.591132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a5969b3-00b3-40fd-9c3f-84b602d367d2 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.080126 Sep 13 16:31:15.598180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 160/281] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:15.612326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d4ba561-b8c5-4b72-a8e9-2d2c53309749 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.642309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d4ba561-b8c5-4b72-a8e9-2d2c53309749 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.042241 Sep 13 16:31:15.647372 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 161/282] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:15 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:15.658947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-245fc5cd-a6b0-4c81-ae82-d71d0ce04208 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1249797347"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:15.670010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.aggregate [None req-245fc5cd-a6b0-4c81-ae82-d71d0ce04208 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Generated uuid 6660f602-c862-4b30-b1f8-c04d56d04c04 for aggregate {{(pid=122328) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:15.735934 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-245fc5cd-a6b0-4c81-ae82-d71d0ce04208 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087155 Sep 13 16:31:15.744827 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 162/283] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:15.770090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92de5f07-2606-482e-97b3-90b976367c7c tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:15.866481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92de5f07-2606-482e-97b3-90b976367c7c tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.120041 Sep 13 16:31:15.869595 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 163/284] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:15 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:15.887114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:15.934024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.934678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.934907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.947278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:15.947900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:15.951645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:15.964808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:15.980192 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf8bf4d0-3306-4b18-8725-dd0a84ed6b86 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.701492 Sep 13 16:31:15.981069 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.compute.aggregates [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 13 16:31:15.981990 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 122/285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:15 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:15.989865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1712cc8b-31f4-4818-8159-bbf6b0064bf7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:15.999998 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Sep 13 16:31:16.003988 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1712cc8b-31f4-4818-8159-bbf6b0064bf7 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.019457 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Request method failure captured: Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 42 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAdtdMKsV7s25BoxlogB1VbHP-OXUsq2aP3Yr_pKa-Oxk0vvjlKJI1SNeStfTeOMdPkd4meKEvmiyAkJi-sZbmPhhLUcqpjC62Kf4cxk7hII-8zJQSZ5njxRIPHbBjOQkVv3SN6U1CxF9A5VME0ckVcON6-GtXtTqWvY9tKqVFq2Sg Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:31:16.004412 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/264fdc0f3b964a30b19a90a506e43203"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 264fdc0f3b964a30b19a90a506e43203 Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097 Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5654c7446e26494784202bfaa8d2b4f3 Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: {"remove_host": {"host": "nonexist_host"}} Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:31:16.005645 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot remove host nonexist_host in aggregate 15 Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 13 16:31:16.006711 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 13 16:31:16.007867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.008966 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a47c1fe3-0a9d-4ed8-8c00-52400313f2c3 tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.137172 Sep 13 16:31:16.010233 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 164/286] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 16:31:15 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:16.021281 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 123/287] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:31:15 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:16.024864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.025488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:16.027957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63dfd2ef-75ca-4d60-9951-1f6eef1c9faf tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.039075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.041263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.041736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.043522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:16.045047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.045466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.046637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.059516 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63dfd2ef-75ca-4d60-9951-1f6eef1c9faf tempest-AggregatesAdminNegativeTestJSON-1724204097 tempest-AggregatesAdminNegativeTestJSON-1724204097-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.036735 Sep 13 16:31:16.060891 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 124/288] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:16 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:16.076174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b5e0ff4-d80f-43dd-8f37-811335f26ab0 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.116420 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b5e0ff4-d80f-43dd-8f37-811335f26ab0 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.054060 Sep 13 16:31:16.123757 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 125/289] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:16.142418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8625741f-de8e-41a5-97d0-23ccfa6ff6ee tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1998946489", "availability_zone": "tempest-test_az-1017309065"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:16.185109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.aggregate [None req-8625741f-de8e-41a5-97d0-23ccfa6ff6ee tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid 50f09f41-6baa-47ea-9d05-bf2fb23c0d67 for aggregate {{(pid=122327) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:16.239929 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8625741f-de8e-41a5-97d0-23ccfa6ff6ee tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.103555 Sep 13 16:31:16.242497 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 126/290] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Sep 13 16:31:16 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:16.258367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-727421d4-ee55-402c-9446-e63901e8a920 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1998946489_new", "availability_zone": "tempest-test_az-1017309065_new"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:16.450839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-727421d4-ee55-402c-9446-e63901e8a920 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.452690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-727421d4-ee55-402c-9446-e63901e8a920 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.453455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-727421d4-ee55-402c-9446-e63901e8a920 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.523532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-727421d4-ee55-402c-9446-e63901e8a920 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.272700 Sep 13 16:31:16.525045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 127/291] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Sep 13 16:31:16 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:31:16.542881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5c38ab6-1765-4713-a7f0-f9148be43321 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.554055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:16.562882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7b9d3c3-cf68-4620-b844-64a8cde28457 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.553176 Sep 13 16:31:16.563471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 165/292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:16 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:16.584602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5c38ab6-1765-4713-a7f0-f9148be43321 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.051419 Sep 13 16:31:16.587190 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 128/293] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:31:16 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:16.602724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e863c98-bbb2-495f-9806-cbf258c3c2dd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.658315 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e863c98-bbb2-495f-9806-cbf258c3c2dd tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.059075 Sep 13 16:31:16.669186 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 166/294] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:16 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:16.675020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad07c43f-c724-4680-aa2d-19451c41522f tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-776773620"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:16.684946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.aggregate [None req-ad07c43f-c724-4680-aa2d-19451c41522f tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Generated uuid e8f73215-ab50-4069-8994-77b594eb8059 for aggregate {{(pid=122327) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:16.741951 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad07c43f-c724-4680-aa2d-19451c41522f tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073993 Sep 13 16:31:16.749665 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 129/295] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 16:31:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:31:16.758450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07edf140-54a7-4234-bdf0-b37e0a70906d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.776562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07edf140-54a7-4234-bdf0-b37e0a70906d tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.024909 Sep 13 16:31:16.788635 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 167/296] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:31:16 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:16.795354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ffedc346-fd70-409a-ae0c-6b81d5eb4137 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.861082 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ffedc346-fd70-409a-ae0c-6b81d5eb4137 tempest-AggregatesAdminTestJSON-1460375726 tempest-AggregatesAdminTestJSON-1460375726-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.072007 Sep 13 16:31:16.866791 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 130/297] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 16:31:16 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 16:31:16.881604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.882756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:16.897883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.898472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.900963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.901935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.903135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.903585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.934853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] HTTP exception thrown: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Request method failure captured: Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 HTTP/1.1 Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILAc8ME3aGkPl2oXbgsdxFnd7F9rGdBwRH3ILKIBG6AsyHQVmZoztTB2zDN6UHhtaBMA-TrL39CcGUysenC5-cTp6x3ZD_m4_ck4FZEfscwpoJR5pyvyP9SDRb2DH0jzPceAqijyQf0-La8pCbpU0kfgJChoMd5UbszcT6kdfuhmyEo Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 44fc93c5a970488a81c3b2570267d13d Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:31:16.936624 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 44fc93c5a970488a81c3b2570267d13d Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AggregatesAdminTestJSON-810778613-project Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c00e88a11d54910a2362829a94266ec Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AggregatesAdminTestJSON-810778613-project Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:16.938147 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '02e8d27e-de0b-4db7-b2af-994bfc2f9a76'} Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:16.942699 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:16.943922 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:16.945006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Returning 404 to user: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:16.945006 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c9541e76-566f-4ae7-b184-287117b55dd0 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "DELETE /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 404 len: 111 microversion: 2.1 time: 0.070015 Sep 13 16:31:16.945006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 168/298] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:31:16 2022] DELETE /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:16.950431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:16.952000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] [instance: 02e8d27e-de0b-4db7-b2af-994bfc2f9a76] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:16.959556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.960069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.966190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:16.968617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:16.969883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:16.973865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.008243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:17.008955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:17.024076 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] HTTP exception thrown: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:17.025549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.025751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.029231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.032777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.032777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Request method failure captured: Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 HTTP/1.1 Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAc8ME3aGkPl2oXbgsdxFnd7F9rGdBwRH3ILKIBG6AsyHQVmZoztTB2zDN6UHhtaBMA-TrL39CcGUysenC5-cTp6x3ZD_m4_ck4FZEfscwpoJR5pyvyP9SDRb2DH0jzPceAqijyQf0-La8pCbpU0kfgJChoMd5UbszcT6kdfuhmyEo Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 44fc93c5a970488a81c3b2570267d13d Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:17.032935 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44fc93c5a970488a81c3b2570267d13d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 44fc93c5a970488a81c3b2570267d13d Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-810778613 Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AggregatesAdminTestJSON-810778613-project Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 6c00e88a11d54910a2362829a94266ec Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AggregatesAdminTestJSON-810778613-project Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:17.034734 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '02e8d27e-de0b-4db7-b2af-994bfc2f9a76'} Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:17.035362 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. Sep 13 16:31:17.036388 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:17.037326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] Returning 404 to user: Instance 02e8d27e-de0b-4db7-b2af-994bfc2f9a76 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:17.037326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8281c009-14ec-48cc-996e-7a1dc0fcd2c3 tempest-AggregatesAdminTestJSON-810778613 tempest-AggregatesAdminTestJSON-810778613-project] 10.222.0.61 "GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76" status: 404 len: 111 microversion: 2.1 time: 0.092605 Sep 13 16:31:17.037787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.041483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 131/299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:16 2022] GET /compute/v2.1/servers/02e8d27e-de0b-4db7-b2af-994bfc2f9a76 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:17.118113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:17.527896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d84f6be5-56c7-4ced-9d49-cc5de2259b13 req-6a59237a-543c-4734-b408-76075c80bd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0887191-a8f3-420f-be9c-173c3129becd", "tag": "edd69241-797e-4856-aa5c-1105c0a562ae"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:17.551979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d84f6be5-56c7-4ced-9d49-cc5de2259b13 req-6a59237a-543c-4734-b408-76075c80bd34 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.552942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d84f6be5-56c7-4ced-9d49-cc5de2259b13 req-6a59237a-543c-4734-b408-76075c80bd34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.553532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d84f6be5-56c7-4ced-9d49-cc5de2259b13 req-6a59237a-543c-4734-b408-76075c80bd34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.578818 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d84f6be5-56c7-4ced-9d49-cc5de2259b13 req-6a59237a-543c-4734-b408-76075c80bd34 service nova] Creating event network-changed:edd69241-797e-4856-aa5c-1105c0a562ae for instance c0887191-a8f3-420f-be9c-173c3129becd on n-h1-857467-1 Sep 13 16:31:17.591431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d84f6be5-56c7-4ced-9d49-cc5de2259b13 req-6a59237a-543c-4734-b408-76075c80bd34 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070040 Sep 13 16:31:17.592557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 132/300] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:17.604630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:17.606256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:17.619665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.620985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.621610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:17.622596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:17.623211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:17.623815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:18.132310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:18.153015 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-276478d1-c865-4b05-a5c5-624a411b9495 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.558093 Sep 13 16:31:18.153185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:18.155488 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 133/301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:17 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:18.175834 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d5309e2-5776-46fe-9854-38cde924bba6 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 1.171668 Sep 13 16:31:18.190899 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 169/302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:17 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:19.034192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=24 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:19.184416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:19.186824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:19.203811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:19.205010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:19.208131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:19.209946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:19.210750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:19.214221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:19.268297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:19.325571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-88c1ab70-c6b6-4b81-9601-af02d5b7ea83 req-f10361e3-35df-40cb-b739-c6b88cfebbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a647c7-7b9d-4873-bfb2-006e147ec404", "tag": "30a7014a-5536-4aed-81bd-a67758ed1172"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:19.350901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88c1ab70-c6b6-4b81-9601-af02d5b7ea83 req-f10361e3-35df-40cb-b739-c6b88cfebbae service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:19.354236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88c1ab70-c6b6-4b81-9601-af02d5b7ea83 req-f10361e3-35df-40cb-b739-c6b88cfebbae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:19.354953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88c1ab70-c6b6-4b81-9601-af02d5b7ea83 req-f10361e3-35df-40cb-b739-c6b88cfebbae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:19.383952 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-88c1ab70-c6b6-4b81-9601-af02d5b7ea83 req-f10361e3-35df-40cb-b739-c6b88cfebbae service nova] Creating event network-changed:30a7014a-5536-4aed-81bd-a67758ed1172 for instance 58a647c7-7b9d-4873-bfb2-006e147ec404 on n-h1-857467-1 Sep 13 16:31:19.400526 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-88c1ab70-c6b6-4b81-9601-af02d5b7ea83 req-f10361e3-35df-40cb-b739-c6b88cfebbae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.615367 Sep 13 16:31:19.401636 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 134/303] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:19.429715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:19.430605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:19.445912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:19.446425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:19.446873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:19.447595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:19.448131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:19.448476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:19.543810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:19.564089 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eaed832b-d563-47e1-bb9b-2cd1336481c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.384480 Sep 13 16:31:19.567225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 170/304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:19 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:19.820294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:20.594072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:20.595678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:20.620187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:20.622467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:20.626748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:20.633160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:20.634903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:20.637125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:20.657522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:20.842259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:20.861115 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e0dcb5a-2d86-47eb-a972-9dc0c0dca1e4 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 1.456386 Sep 13 16:31:20.889605 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 135/305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:19 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:21.299878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:21.313280 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00d5b506-783e-4d3b-9ef2-d921f218c06a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.720901 Sep 13 16:31:21.315321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 171/306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:20 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:21.891959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:21.892572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:21.907463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:21.908034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:21.909007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:21.909769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:21.910264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:21.916877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:22.339471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:22.340170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:22.349849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:22.352001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:22.354513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:22.355452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:22.356260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:22.362838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:22.859710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:22.868808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:22.881317 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58238015-1307-4860-92f3-20178b6d4a70 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.544279 Sep 13 16:31:22.882474 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 172/307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:22 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:22.884058 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa97d6b5-9648-4096-b0e9-12f3c5116da9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.995900 Sep 13 16:31:22.904576 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 136/308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:21 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:23.913124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:23.914890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:23.923797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:23.925377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:23.926095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:23.927065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:23.927683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:23.928282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.304738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:24.317115 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5801aa7f-1f2a-4868-bc9e-61f07e462f26 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.413659 Sep 13 16:31:24.320166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 137/309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:23 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:24.333100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:24.342650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:24.360841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.361353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.369893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.370845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.372191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.373298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.390430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:24.572291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Calling method '.version_select at 0x7fbeb6338a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:24.576192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.576685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.577122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.615204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.615702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.619815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.653089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:24.653458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:24.654334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:24.667501 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17d36f35-09ba-41d2-8f01-5b4e51339285 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1424 microversion: 2.41 time: 0.809496 Sep 13 16:31:24.687527 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 173/310] 10.222.0.61 () {60 vars in 1208 bytes} [Tue Sep 13 16:31:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1424 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:31:24.763163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:24.777032 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06f88cc8-dff5-4409-865f-2f0db714d20f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.449149 Sep 13 16:31:24.778736 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 138/311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:24 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:24.998817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e853117-e3f1-4019-8ca2-c4916c803a8c tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Action: 'create', calling method: .version_select at 0x7fbeb5e70820>, body: {"pool": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:25.090841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b316138f-98ed-4d35-8ede-cda919b1d379 tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] Calling method '.version_select at 0x7fbeb5ceda60>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:25.121622 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b316138f-98ed-4d35-8ede-cda919b1d379 tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.340930 Sep 13 16:31:25.122229 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 139/312] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:31:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:25.128313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a2f32d7-04da-4c01-8d3c-63d5c167cddc tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-537340168"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:25.135257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.aggregate [None req-8a2f32d7-04da-4c01-8d3c-63d5c167cddc tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Generated uuid a9a7f3fb-f448-4cbf-853b-3523292a2fb9 for aggregate {{(pid=122327) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 16:31:25.199936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a2f32d7-04da-4c01-8d3c-63d5c167cddc tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.076221 Sep 13 16:31:25.212854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 140/313] 10.222.0.61 () {62 vars in 1205 bytes} [Tue Sep 13 16:31:25 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:25.217666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-903a2330-56a9-474c-88f7-e7e10d80f441 tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb5c87dc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:25.469795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=4,nova_api:INSERT=9,nova_api:UPDATE=10 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:25.645286 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-903a2330-56a9-474c-88f7-e7e10d80f441 tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.437085 Sep 13 16:31:25.648273 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 141/314] 10.222.0.61 () {60 vars in 1206 bytes} [Tue Sep 13 16:31:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:25.660928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-043ee9ea-ae0d-44be-b057-8a24623d6322 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1456088075"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:25.728864 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-043ee9ea-ae0d-44be-b057-8a24623d6322 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.079537 Sep 13 16:31:25.730035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 142/315] 10.222.0.61 () {62 vars in 1213 bytes} [Tue Sep 13 16:31:25 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:25.745819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:25.746840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:25.756758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:25.757603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:25.763363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:25.764541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:25.765237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:25.765921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:25.941011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:26.101649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:26.117620 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be4c8356-15ab-465e-af41-4b43bec51ab8 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.386033 Sep 13 16:31:26.118993 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 143/316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:25 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:26.134967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c71b8171-6825-4ce5-a461-28350811bdf6 tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] Calling method '.version_select at 0x7fbeb5c88940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:26.163296 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c71b8171-6825-4ce5-a461-28350811bdf6 tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.038756 Sep 13 16:31:26.165376 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 144/317] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:31:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:26.180982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-053ad31c-1c18-4e00-933d-d42bdf78aeb3 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:26.202188 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-053ad31c-1c18-4e00-933d-d42bdf78aeb3 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.029562 Sep 13 16:31:26.210403 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 145/318] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:31:26 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:26.218539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:26.222250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:26.236649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:26.237150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:26.237699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:26.242607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:26.243141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:26.243583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:26.513741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:26.524031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72081d3f-374f-433d-85fc-8eb9fb0e6026 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.316152 Sep 13 16:31:26.525090 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 146/319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:26 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:26.775155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b986c4b-5e5f-4687-9f4d-46651f90cb37 tempest-InstanceUsageAuditLogTestJSON-1391433890 tempest-InstanceUsageAuditLogTestJSON-1391433890-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:26.814141 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b986c4b-5e5f-4687-9f4d-46651f90cb37 tempest-InstanceUsageAuditLogTestJSON-1391433890 tempest-InstanceUsageAuditLogTestJSON-1391433890-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-13 16:31:25" status: 200 len: 318 microversion: 2.1 time: 0.287794 Sep 13 16:31:26.816303 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 147/320] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 16:31:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-13%2016%3A31%3A25 => generated 318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:26.821185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aa678bb-68ea-47ff-acb3-37f1f959ce0e tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb6000a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:26.958069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aa678bb-68ea-47ff-acb3-37f1f959ce0e tempest-QuotaClassesAdminTestJSON-1046335657 tempest-QuotaClassesAdminTestJSON-1046335657-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.139087 Sep 13 16:31:26.961232 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 148/321] 10.222.0.61 () {60 vars in 1206 bytes} [Tue Sep 13 16:31:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:26.967182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d5ec051-df7f-476d-a8b8-79afe0a51e9f tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:26.981628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5ec051-df7f-476d-a8b8-79afe0a51e9f tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:26.982165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5ec051-df7f-476d-a8b8-79afe0a51e9f tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:26.982609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5ec051-df7f-476d-a8b8-79afe0a51e9f tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:27.147403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d5ec051-df7f-476d-a8b8-79afe0a51e9f tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.184643 Sep 13 16:31:27.166039 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 149/322] 10.222.0.61 () {62 vars in 1235 bytes} [Tue Sep 13 16:31:26 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:27.182114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3b4ca548-ee4a-4b20-8962-8136b74ab89d req-d6898aed-4ea1-49ba-af51-821183792430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0887191-a8f3-420f-be9c-173c3129becd", "name": "network-vif-plugged", "status": "completed", "tag": "edd69241-797e-4856-aa5c-1105c0a562ae"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:27.194548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3b4ca548-ee4a-4b20-8962-8136b74ab89d req-d6898aed-4ea1-49ba-af51-821183792430 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:27.195036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3b4ca548-ee4a-4b20-8962-8136b74ab89d req-d6898aed-4ea1-49ba-af51-821183792430 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:27.195478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3b4ca548-ee4a-4b20-8962-8136b74ab89d req-d6898aed-4ea1-49ba-af51-821183792430 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:27.208852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3b4ca548-ee4a-4b20-8962-8136b74ab89d req-d6898aed-4ea1-49ba-af51-821183792430 service nova] Creating event network-vif-plugged:edd69241-797e-4856-aa5c-1105c0a562ae for instance c0887191-a8f3-420f-be9c-173c3129becd on n-h1-857467-1 Sep 13 16:31:27.214467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3b4ca548-ee4a-4b20-8962-8136b74ab89d req-d6898aed-4ea1-49ba-af51-821183792430 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046866 Sep 13 16:31:27.215584 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 150/323] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:27.332567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9530f1f-5514-49bb-a239-66c6d4292e57 tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1433486805", "id": 1682545167, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:27.383124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9530f1f-5514-49bb-a239-66c6d4292e57 tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.165170 Sep 13 16:31:27.386746 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 151/324] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:31:27 2022] POST /compute/v2.1/flavors => generated 468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:27.398456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9b952bd-3066-471b-aedd-c6a13f90063d tempest-InstanceUsageAuditLogTestJSON-1391433890 tempest-InstanceUsageAuditLogTestJSON-1391433890-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:27.432128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9b952bd-3066-471b-aedd-c6a13f90063d tempest-InstanceUsageAuditLogTestJSON-1391433890 tempest-InstanceUsageAuditLogTestJSON-1391433890-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.043920 Sep 13 16:31:27.434092 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 152/325] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:31:27 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:27.439201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:27.440747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:27.449149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:27.449798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:27.450668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:27.451554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:27.452176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:27.453338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:28.208641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:28.228152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4456b94d-a05d-4e3e-a55d-eb4242be5617 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.792404 Sep 13 16:31:28.230183 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 153/326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:27 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:28.242285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e5b6c99-fee0-4a6b-b2c9-abb0bfa39609 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:28.256356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5b6c99-fee0-4a6b-b2c9-abb0bfa39609 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:28.256897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5b6c99-fee0-4a6b-b2c9-abb0bfa39609 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:28.257858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5b6c99-fee0-4a6b-b2c9-abb0bfa39609 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:28.419618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e5b6c99-fee0-4a6b-b2c9-abb0bfa39609 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.187018 Sep 13 16:31:28.422672 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 154/327] 10.222.0.61 () {62 vars in 1235 bytes} [Tue Sep 13 16:31:28 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:28.451203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e853117-e3f1-4019-8ca2-c4916c803a8c tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.761389 Sep 13 16:31:28.451816 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 174/328] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:31:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:28.457083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:28.457694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:28.476266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:28.476775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:28.477416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:28.478341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:28.478954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:28.479546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:28.740432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:28.757024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e89282a8-3cb8-4a42-8bb5-eccf0dbfcc05 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.304065 Sep 13 16:31:28.757640 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 175/329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:28 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:28.779938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b9362ec7-931e-4fc2-9b1d-7a4bd3255172 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:28.835348 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b9362ec7-931e-4fc2-9b1d-7a4bd3255172 tempest-AggregatesAdminTestV241-901324714 tempest-AggregatesAdminTestV241-901324714-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.063612 Sep 13 16:31:28.836532 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 176/330] 10.222.0.61 () {60 vars in 1196 bytes} [Tue Sep 13 16:31:28 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:28.859339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d3ff5d3-30b8-42b7-93a8-52eb2a411c36 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Calling method '.version_select at 0x7fbeb5d6a790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:28.910787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce048199-602f-4dfd-be19-bf65079cce41 tempest-FlavorsV261TestJSON-2077240505 tempest-FlavorsV261TestJSON-2077240505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:28.939439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce048199-602f-4dfd-be19-bf65079cce41 tempest-FlavorsV261TestJSON-2077240505 tempest-FlavorsV261TestJSON-2077240505-project] 10.222.0.61 "GET /compute/v2.1/flavors/1682545167" status: 200 len: 468 microversion: 2.61 time: 0.515323 Sep 13 16:31:28.942380 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 155/331] 10.222.0.61 () {60 vars in 1199 bytes} [Tue Sep 13 16:31:28 2022] GET /compute/v2.1/flavors/1682545167 => generated 468 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:28.959744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0136e0ef-ca14-405c-98eb-af789c646ed0 tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb7299af0>, body: {"flavor": {"description": "new"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:29.101443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0136e0ef-ca14-405c-98eb-af789c646ed0 tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1682545167" status: 200 len: 469 microversion: 2.61 time: 0.143764 Sep 13 16:31:29.103647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 156/332] 10.222.0.61 () {62 vars in 1219 bytes} [Tue Sep 13 16:31:28 2022] PUT /compute/v2.1/flavors/1682545167 => generated 469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:31:29.117775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb8afd4f-6ee6-4282-b5a6-391ca221db3c tempest-FlavorsV261TestJSON-2077240505 tempest-FlavorsV261TestJSON-2077240505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:29.199726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb8afd4f-6ee6-4282-b5a6-391ca221db3c tempest-FlavorsV261TestJSON-2077240505 tempest-FlavorsV261TestJSON-2077240505-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.088284 Sep 13 16:31:29.210999 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 157/333] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:31:29 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:31:29.235753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-042cc11a-3faa-462c-b94c-600ab4691155 tempest-FlavorsV261TestJSON-2077240505 tempest-FlavorsV261TestJSON-2077240505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:29.315169 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-042cc11a-3faa-462c-b94c-600ab4691155 tempest-FlavorsV261TestJSON-2077240505 tempest-FlavorsV261TestJSON-2077240505-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.084811 Sep 13 16:31:29.333968 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 158/334] 10.222.0.61 () {60 vars in 1166 bytes} [Tue Sep 13 16:31:29 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:31:29.348645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:29.349269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:29.367281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:29.367782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:29.373185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:29.374069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:29.375864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:29.376527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:29.480842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=18,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:29.491444 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d3ff5d3-30b8-42b7-93a8-52eb2a411c36 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/61d30ce8-8721-4cbb-9430-4cee54be6314" status: 200 len: 141 microversion: 2.1 time: 0.653654 Sep 13 16:31:29.499210 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 177/335] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:31:28 2022] GET /compute/v2.1/os-floating-ips/61d30ce8-8721-4cbb-9430-4cee54be6314 => generated 141 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:29.499210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac402890-5184-4ced-ac66-79dfe3b3b85b tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:29.546699 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac402890-5184-4ced-ac66-79dfe3b3b85b tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1682545167" status: 202 len: 0 microversion: 2.61 time: 0.053123 Sep 13 16:31:29.547258 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 178/336] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Sep 13 16:31:29 2022] DELETE /compute/v2.1/flavors/1682545167 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:31:29.561937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a65ccfb8-3565-4796-9dd0-be0aefc58d8f tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Calling method '.version_select at 0x7fbeb5e70940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:30.007087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:30.022475 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3041fbfc-2e0a-4cc9-9edf-df517c776e57 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1320 microversion: 2.1 time: 0.686464 Sep 13 16:31:30.023095 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 159/337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:29 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1320 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:30.027843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5607d78-c3ec-4cad-8ed3-dbe39fac0d4f tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:30.078682 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5607d78-c3ec-4cad-8ed3-dbe39fac0d4f tempest-FlavorsV261TestJSON-2104960438 tempest-FlavorsV261TestJSON-2104960438-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.054042 Sep 13 16:31:30.079462 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 160/338] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:31:30 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:31:30.085656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:30.094871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:30.110019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:30.111157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:30.113712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:30.115568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:30.117398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:30.119500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:30.323008 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a65ccfb8-3565-4796-9dd0-be0aefc58d8f tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.768137 Sep 13 16:31:30.324504 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 179/339] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:31:29 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:30.335724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-af2ea517-2ea4-40b9-b845-45627c7797cf req-f307cb9b-37e4-4715-8234-bc3e740bde66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a647c7-7b9d-4873-bfb2-006e147ec404", "name": "network-vif-plugged", "status": "completed", "tag": "30a7014a-5536-4aed-81bd-a67758ed1172"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:30.357547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af2ea517-2ea4-40b9-b845-45627c7797cf req-f307cb9b-37e4-4715-8234-bc3e740bde66 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:30.358629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af2ea517-2ea4-40b9-b845-45627c7797cf req-f307cb9b-37e4-4715-8234-bc3e740bde66 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:30.359079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af2ea517-2ea4-40b9-b845-45627c7797cf req-f307cb9b-37e4-4715-8234-bc3e740bde66 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:30.382817 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-af2ea517-2ea4-40b9-b845-45627c7797cf req-f307cb9b-37e4-4715-8234-bc3e740bde66 service nova] Creating event network-vif-plugged:30a7014a-5536-4aed-81bd-a67758ed1172 for instance 58a647c7-7b9d-4873-bfb2-006e147ec404 on n-h1-857467-1 Sep 13 16:31:30.390722 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-af2ea517-2ea4-40b9-b845-45627c7797cf req-f307cb9b-37e4-4715-8234-bc3e740bde66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061385 Sep 13 16:31:30.390722 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 180/340] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:30.394512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9cbcca3-05ca-4e04-9ace-551ba356a79c tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Calling method '.version_select at 0x7fbeb5da03a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:30.756383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:30.766147 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e939ab8e-efba-42b7-934d-691b4b9f7bbb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.684007 Sep 13 16:31:30.767092 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 161/341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:30 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:31.045381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:31.046038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:31.060466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.060466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.061055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.063604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.064232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.066909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.419479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:31.429304 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c79b172a-a176-4968-879a-92a5360fb062 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1469 microversion: 2.1 time: 0.388638 Sep 13 16:31:31.429923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 162/342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:31 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1469 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:31.452363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:31.454582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:31.465851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.467831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.468710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.474534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.475197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.475807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.663056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dccf718a-4a90-432f-a558-4c49804d01f1 tempest-DeleteServersAdminTestJSON-1033890955 tempest-DeleteServersAdminTestJSON-1033890955-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd/action" status: 202 len: 0 microversion: 2.1 time: 0.215294 Sep 13 16:31:31.664013 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 163/343] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:31:31 2022] POST /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:31.672154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:31.672774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:31.683427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.683928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.684371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.685080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.689154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.690297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.766416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:31.769797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:31.770537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:31.771263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lazy-loading 'fault' on Instance uuid c0887191-a8f3-420f-be9c-173c3129becd {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:31:31.981288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9cbcca3-05ca-4e04-9ace-551ba356a79c tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/61d30ce8-8721-4cbb-9430-4cee54be6314" status: 202 len: 0 microversion: 2.1 time: 1.591416 Sep 13 16:31:31.981971 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 181/344] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:31:30 2022] DELETE /compute/v2.1/os-floating-ips/61d30ce8-8721-4cbb-9430-4cee54be6314 => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:31.988848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:31.990344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:32.001432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.003777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.004472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.005289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.005859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.007057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.063548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:32.072335 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca03bf1a-98e1-49ce-b430-e7cea87f6a19 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1452 microversion: 2.1 time: 0.404426 Sep 13 16:31:32.076708 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 164/345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:31 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1452 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:32.088409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-57b181b1-6c2c-4164-9a0c-d43eaa2f89aa tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Action: 'create', calling method: .version_select at 0x7fbeb5c06f70>, body: {"pool": null} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:32.255417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:32.306548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-332ef6f0-40ca-43f6-b24e-31183e6608f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1388 microversion: 2.1 time: 0.323320 Sep 13 16:31:32.315990 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 182/346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:31 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:32.333342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:32.333895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:32.348768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.349198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.349654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.350641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.384121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.385820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.476484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:31:32.729299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7fcf7cf-29bb-44bc-bbbe-c0ce143b2fff tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 204 len: 0 microversion: 2.1 time: 0.410144 Sep 13 16:31:32.730391 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 183/347] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:31:32 2022] DELETE /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:31:32.742463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:32.743619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:32.753418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.754829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.755606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.757258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.759663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.760723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.805327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:32.806089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:32.806684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:32.807688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lazy-loading 'fault' on Instance uuid c0887191-a8f3-420f-be9c-173c3129becd {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:31:33.018800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:33.030542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f0247cd6-a1aa-4588-b5d3-f6497418adf4 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1458 microversion: 2.1 time: 0.295148 Sep 13 16:31:33.031533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 184/348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:32 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1458 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:33.352465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:33.353545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:33.375287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:33.378179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:33.380273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:33.381784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:33.383835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:33.385693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:33.643461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:33.651756 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b284298-ca90-4cdb-84a2-04d6221adceb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1587 microversion: 2.1 time: 0.314372 Sep 13 16:31:33.667073 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 185/349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:33 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1587 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:33.679012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:33.679699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:33.686954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:33.687616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:33.688061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:33.688829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:33.689974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:33.690367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:33.783498 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-451e0655-ba42-448a-b007-e0dc7985dd5f tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109679 Sep 13 16:31:33.792268 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 186/350] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:31:33 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:31:34.056268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:34.057091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:34.070875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:34.071387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:34.071917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:34.072646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:34.073108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:34.073538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:34.178104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:34.180476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:34.183956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:34.185886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lazy-loading 'fault' on Instance uuid c0887191-a8f3-420f-be9c-173c3129becd {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:31:35.117453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:35.129715 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fda92c93-f31d-4054-bdaa-14edf1e32273 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1458 microversion: 2.1 time: 1.077649 Sep 13 16:31:35.130667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 187/351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:34 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1458 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:36.303812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb60a1a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:37.023207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.024712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.027451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.029356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.030105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.034391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.190963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4fda0679-34fc-46d0-b909-801e596415ed tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e" status: 200 len: 148 microversion: 2.57 time: 1.383986 Sep 13 16:31:37.194505 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 188/352] 10.222.0.61 () {62 vars in 1303 bytes} [Tue Sep 13 16:31:35 2022] PUT /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e => generated 148 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:37.208761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:37.209443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:37.216238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.216732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.217365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.218263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.219169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.219889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.308021 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-57b181b1-6c2c-4164-9a0c-d43eaa2f89aa tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.229842 Sep 13 16:31:37.313920 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 165/353] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:31:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:37.324336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-943e2d6a-c74a-4711-83ec-68c305720965 req-116a22c1-71d1-48e4-9db6-dee02c2d0d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a647c7-7b9d-4873-bfb2-006e147ec404", "tag": "30a7014a-5536-4aed-81bd-a67758ed1172"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:37.357820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-943e2d6a-c74a-4711-83ec-68c305720965 req-116a22c1-71d1-48e4-9db6-dee02c2d0d2f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.358353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-943e2d6a-c74a-4711-83ec-68c305720965 req-116a22c1-71d1-48e4-9db6-dee02c2d0d2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.358802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-943e2d6a-c74a-4711-83ec-68c305720965 req-116a22c1-71d1-48e4-9db6-dee02c2d0d2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.389989 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-943e2d6a-c74a-4711-83ec-68c305720965 req-116a22c1-71d1-48e4-9db6-dee02c2d0d2f service nova] Creating event network-changed:30a7014a-5536-4aed-81bd-a67758ed1172 for instance 58a647c7-7b9d-4873-bfb2-006e147ec404 on n-h1-857467-1 Sep 13 16:31:37.412527 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-943e2d6a-c74a-4711-83ec-68c305720965 req-116a22c1-71d1-48e4-9db6-dee02c2d0d2f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094968 Sep 13 16:31:37.414981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 166/354] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:37.430218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:37.432509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:37.441798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:37.444927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.446905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.447755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.448655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.449341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.450104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.503084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.504030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.504667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.505350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lazy-loading 'fault' on Instance uuid c0887191-a8f3-420f-be9c-173c3129becd {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:31:37.681748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937e91d31b0e40528917884dcd038387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524aaaf44c2844aba44b186af0447f92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:37.690696 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 200 len: 1310 microversion: 2.1 time: 0.271386 Sep 13 16:31:37.691490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 167/355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:37 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:37.693229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:37.695012 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d5ff943-9f3e-42f7-af70-e359521e0298 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001957 Sep 13 16:31:37.699585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 168/356] 10.222.0.61 () {56 vars in 886 bytes} [Tue Sep 13 16:31:37 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 13 16:31:37.713314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6c231672-a344-4a08-a1df-a661bcc3334f req-91974c2d-18ed-40a2-bc0c-358610a8e6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0887191-a8f3-420f-be9c-173c3129becd", "name": "network-vif-deleted", "tag": "edd69241-797e-4856-aa5c-1105c0a562ae"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:37.739777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c231672-a344-4a08-a1df-a661bcc3334f req-91974c2d-18ed-40a2-bc0c-358610a8e6b6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:37.742600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c231672-a344-4a08-a1df-a661bcc3334f req-91974c2d-18ed-40a2-bc0c-358610a8e6b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:37.743232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c231672-a344-4a08-a1df-a661bcc3334f req-91974c2d-18ed-40a2-bc0c-358610a8e6b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:37.773056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6c231672-a344-4a08-a1df-a661bcc3334f req-91974c2d-18ed-40a2-bc0c-358610a8e6b6 service nova] Creating event network-vif-deleted:edd69241-797e-4856-aa5c-1105c0a562ae for instance c0887191-a8f3-420f-be9c-173c3129becd on n-h1-857467-1 Sep 13 16:31:37.785225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6c231672-a344-4a08-a1df-a661bcc3334f req-91974c2d-18ed-40a2-bc0c-358610a8e6b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081746 Sep 13 16:31:37.786210 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 169/357] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:37.798203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Calling method '.version_select at 0x7fbeb5c06430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:38.013145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:38.022412 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d75775a7-6d4d-49cc-8511-0ffbb77a8daf tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 200 len: 1587 microversion: 2.1 time: 0.821535 Sep 13 16:31:38.023021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 189/358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:37 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 1587 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:38.044046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2429378a-e911-48b8-ae9a-7d237009948a tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Calling method '.version_select at 0x7fbeb5d19dc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:38.314074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.315761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.316220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.316971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.317670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.318328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.370327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6f7c8636-748e-494a-9123-68800de4f502 tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e/detail" status: 200 len: 463 microversion: 2.57 time: 0.577861 Sep 13 16:31:38.371316 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 170/359] 10.222.0.61 () {60 vars in 1304 bytes} [Tue Sep 13 16:31:37 2022] GET /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e/detail => generated 463 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:38.775777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Calling method '.version_select at 0x7fbeb5c87dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:38.777764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.778306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.778883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.810345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.811496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.812317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.837152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.838062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.838610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.848939 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1db0e423-4b89-49b3-b54c-fe0dc4f28ceb tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.476142 Sep 13 16:31:38.850550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 171/360] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:38.856789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb5c88040>, body: {"quota_set": {"ram": "2048"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:38.952109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.957768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.958401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:38.959312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:38.959863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:38.960377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.035184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.035591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.036036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.036835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.037309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.037743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.135994 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51f66973-5b56-4bb4-8a19-88cae445536b tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e?user_id=17034ced0c1942daaa4a15d57b9e5e3a" status: 200 len: 148 microversion: 2.57 time: 0.283750 Sep 13 16:31:39.142405 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 172/361] 10.222.0.61 () {62 vars in 1384 bytes} [Tue Sep 13 16:31:38 2022] PUT /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e?user_id=17034ced0c1942daaa4a15d57b9e5e3a => generated 148 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:39.142405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.142405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:39.149252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.149740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.150815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.151262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.152570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.153315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.177268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:39.179027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] HTTP exception thrown: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Request method failure captured: Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd HTTP/1.1 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAahJkGGzDeLxvEfC-kJs-qntnrEZCnanwJVPM0mz12C9ThTP8f-0ZEmXZ1MjxwEjZaDiV2dJoizwFZtESNq4bfIJrpIX0E31I6HCrmd0JVBByyuajXSD8EkqTFlA4UTBtShAPkLUNfiVdgltOoJAmKegoOCvaMOwiGoTb_phJywT4 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.180832 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_524aaaf44c2844aba44b186af0447f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 937e91d31b0e40528917884dcd038387 Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.182435 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c0887191-a8f3-420f-be9c-173c3129becd'} Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.183399 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.184974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.186458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Returning 404 to user: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.186458 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e17c6946-fd4a-4a09-9888-ee02847ddb04 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 404 len: 111 microversion: 2.1 time: 0.044962 Sep 13 16:31:39.186458 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 173/362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.369116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01153436-1eba-4d3e-baba-d38dfb1a3702 tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Calling method '.version_select at 0x7fbeb5c0a040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.371740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-01153436-1eba-4d3e-baba-d38dfb1a3702 tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '4e8b7cae7bea4e088befedb6a08dfe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf1d8e48af942cb94cf5c7ce6807d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01153436-1eba-4d3e-baba-d38dfb1a3702 tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Request method failure captured: Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hypervisors/n-h1-857467-1/search HTTP/1.1 Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBnJb2w3d2QmTrcxZpsh1lA8lQgv1t-RcLx2KI6TYHHWEM0ts_CNlTBevm3QYBCLWiVKCmYUEmSzv07TXy0s_lHviUD2RVa1BxIBxbv3UrH_gQ9HQ7_Xg8ffERZLrWPSP6U60cbQUB5Q1fSvAzT3XIU43nOcQiVUmL5GCBa5Kutz9E Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 8cf1d8e48af942cb94cf5c7ce6807d51 Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-775814840 Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.374150 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-775814840 Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 8cf1d8e48af942cb94cf5c7ce6807d51 Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-775814840 Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-775814840-project Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4e8b7cae7bea4e088befedb6a08dfe03 Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-775814840-project Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 13 16:31:39.375567 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-h1-857467-1'} Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:31:39.376422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 13 16:31:39.378733 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.381121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01153436-1eba-4d3e-baba-d38dfb1a3702 tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.382002 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01153436-1eba-4d3e-baba-d38dfb1a3702 tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-857467-1/search" status: 403 len: 117 microversion: 2.1 time: 0.197923 Sep 13 16:31:39.382692 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 174/363] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-857467-1/search => generated 117 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.388899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af59388c-cbf5-4bcf-9f21-3dec47beeeab tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] Calling method '.version_select at 0x7fbeb5c06280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.498600 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af59388c-cbf5-4bcf-9f21-3dec47beeeab tempest-QuotasAdminTestV257-397570799 tempest-QuotasAdminTestV257-397570799-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e?user_id=17034ced0c1942daaa4a15d57b9e5e3a" status: 200 len: 190 microversion: 2.57 time: 0.114670 Sep 13 16:31:39.499729 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 175/364] 10.222.0.61 () {60 vars in 1364 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/os-quota-sets/82c19c2eb4b746609d20f7bd2c7b659e?user_id=17034ced0c1942daaa4a15d57b9e5e3a => generated 190 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:31:39.511221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.516184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:39.524956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.525769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.526527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.528204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.528874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.529535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.551463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] HTTP exception thrown: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Request method failure captured: Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd HTTP/1.1 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAahJkGGzDeLxvEfC-kJs-qntnrEZCnanwJVPM0mz12C9ThTP8f-0ZEmXZ1MjxwEjZaDiV2dJoizwFZtESNq4bfIJrpIX0E31I6HCrmd0JVBByyuajXSD8EkqTFlA4UTBtShAPkLUNfiVdgltOoJAmKegoOCvaMOwiGoTb_phJywT4 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.553295 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_524aaaf44c2844aba44b186af0447f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 937e91d31b0e40528917884dcd038387 Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.554503 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c0887191-a8f3-420f-be9c-173c3129becd'} Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.555139 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.556218 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.559124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Returning 404 to user: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.562221 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-463595cf-d4c8-463e-9c68-dd388f1813ae tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 404 len: 111 microversion: 2.1 time: 0.057573 Sep 13 16:31:39.563939 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 176/365] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:31:39 2022] DELETE /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.577840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Calling method '.version_select at 0x7fbeb5c39d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.588308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.589090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.590136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.608767 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Request method failure captured: Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBp0hh8o9HJE8iNx4IYia0dNiKayHyHp9Q4zpwhhAldfHRAbMPeR8V3VYL7I_r7i1VXu0DkDfQtxd6rlH9i3S93JbJow2R5HHcwQE5QUAjg-fzdGg37GmHpwFLLl8gaGQFJEj8mHOpt7_VTUMskKnIVHxBYVCemQccqNO6X6kxmxyk Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1d962b3599aa4c7ebb4cbc4c2b484a56 Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1798574021 Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:31:39.615326 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1798574021 Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1d962b3599aa4c7ebb4cbc4c2b484a56 Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1798574021 Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 6519df9eda4143cb83a9eee5d28aafa7 Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 13 16:31:39.616740 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.617415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.619422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.619422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:39.619422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:39.619422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 13 16:31:39.619422 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.621753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.625351 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48d26570-2402-447b-bfea-8e9afc2a4d3c tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.059395 Sep 13 16:31:39.627741 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 177/366] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.642464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.644511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: c0887191-a8f3-420f-be9c-173c3129becd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:39.663726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.666364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.670644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.671721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.672363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.672916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.719363 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] HTTP exception thrown: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Request method failure captured: Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd HTTP/1.1 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAahJkGGzDeLxvEfC-kJs-qntnrEZCnanwJVPM0mz12C9ThTP8f-0ZEmXZ1MjxwEjZaDiV2dJoizwFZtESNq4bfIJrpIX0E31I6HCrmd0JVBByyuajXSD8EkqTFlA4UTBtShAPkLUNfiVdgltOoJAmKegoOCvaMOwiGoTb_phJywT4 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.735805 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_524aaaf44c2844aba44b186af0447f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 937e91d31b0e40528917884dcd038387 Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.738216 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c0887191-a8f3-420f-be9c-173c3129becd'} Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.738853 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. Sep 13 16:31:39.739969 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.745687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Returning 404 to user: Instance c0887191-a8f3-420f-be9c-173c3129becd could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.747595 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-272940b2-c9ab-447e-a5f7-2a3cc08025c0 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd" status: 404 len: 111 microversion: 2.1 time: 0.118609 Sep 13 16:31:39.749199 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 178/367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/servers/c0887191-a8f3-420f-be9c-173c3129becd => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.757510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Calling method '.version_select at 0x7fbeb5cedca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.760196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.760981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.761915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.782036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.782779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.784181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.797921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.799527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.800572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.809717 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4df8d873-83ea-4851-b146-4b3c54af5400 tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058428 Sep 13 16:31:39.811449 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 179/368] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:39.819771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.820366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:39.831716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.832874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.833732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.835607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.836404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.838384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.867599 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] HTTP exception thrown: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Request method failure captured: Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 HTTP/1.1 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAahJkGGzDeLxvEfC-kJs-qntnrEZCnanwJVPM0mz12C9ThTP8f-0ZEmXZ1MjxwEjZaDiV2dJoizwFZtESNq4bfIJrpIX0E31I6HCrmd0JVBByyuajXSD8EkqTFlA4UTBtShAPkLUNfiVdgltOoJAmKegoOCvaMOwiGoTb_phJywT4 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.869494 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_524aaaf44c2844aba44b186af0447f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 937e91d31b0e40528917884dcd038387 Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.870737 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3abacb16-c2cb-4077-b884-03f67a581d46'} Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.871404 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.873084 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.874208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Returning 404 to user: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.874208 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b4c1d3f9-9376-4e72-a224-9349e400709a tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 404 len: 111 microversion: 2.1 time: 0.057673 Sep 13 16:31:39.874208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 180/369] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:31:39 2022] DELETE /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.887569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b02288cb-f06e-427b-890d-76dc40ce754b tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Calling method '.version_select at 0x7fbeb5c06af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.889687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b02288cb-f06e-427b-890d-76dc40ce754b tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '4e8b7cae7bea4e088befedb6a08dfe03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf1d8e48af942cb94cf5c7ce6807d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b02288cb-f06e-427b-890d-76dc40ce754b tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Request method failure captured: Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBnJb2w3d2QmTrcxZpsh1lA8lQgv1t-RcLx2KI6TYHHWEM0ts_CNlTBevm3QYBCLWiVKCmYUEmSzv07TXy0s_lHviUD2RVa1BxIBxbv3UrH_gQ9HQ7_Xg8ffERZLrWPSP6U60cbQUB5Q1fSvAzT3XIU43nOcQiVUmL5GCBa5Kutz9E Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 8cf1d8e48af942cb94cf5c7ce6807d51 Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-775814840 Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.891291 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8cf1d8e48af942cb94cf5c7ce6807d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-775814840 Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 8cf1d8e48af942cb94cf5c7ce6807d51 Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-775814840 Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-775814840-project Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4e8b7cae7bea4e088befedb6a08dfe03 Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-775814840-project Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 13 16:31:39.894027 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1'} Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:31:39.894872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 13 16:31:39.895904 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.898799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b02288cb-f06e-427b-890d-76dc40ce754b tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.898799 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b02288cb-f06e-427b-890d-76dc40ce754b tempest-HypervisorAdminNegativeUnderV252Test-775814840 tempest-HypervisorAdminNegativeUnderV252Test-775814840-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022701 Sep 13 16:31:39.898799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 181/370] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.910249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:39.914507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] [instance: 3abacb16-c2cb-4077-b884-03f67a581d46] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:39.932686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.933357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.933775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.934534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:39.935007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:39.935486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:39.962813 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] HTTP exception thrown: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Request method failure captured: Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 HTTP/1.1 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILAahJkGGzDeLxvEfC-kJs-qntnrEZCnanwJVPM0mz12C9ThTP8f-0ZEmXZ1MjxwEjZaDiV2dJoizwFZtESNq4bfIJrpIX0E31I6HCrmd0JVBByyuajXSD8EkqTFlA4UTBtShAPkLUNfiVdgltOoJAmKegoOCvaMOwiGoTb_phJywT4 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:39.964425 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_524aaaf44c2844aba44b186af0447f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/524aaaf44c2844aba44b186af0447f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 524aaaf44c2844aba44b186af0447f92 Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-851908780 Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 937e91d31b0e40528917884dcd038387 Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersAdminTestJSON-851908780-project Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.965592 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3abacb16-c2cb-4077-b884-03f67a581d46'} Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:39.966312 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. Sep 13 16:31:39.968042 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:39.969012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] Returning 404 to user: Instance 3abacb16-c2cb-4077-b884-03f67a581d46 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:39.969012 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cee9aaf6-3c63-4c73-8979-048d3ccaa4d5 tempest-DeleteServersAdminTestJSON-851908780 tempest-DeleteServersAdminTestJSON-851908780-project] 10.222.0.61 "GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46" status: 404 len: 111 microversion: 2.1 time: 0.067788 Sep 13 16:31:39.969012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 182/371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/servers/3abacb16-c2cb-4077-b884-03f67a581d46 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:39.986778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Calling method '.version_select at 0x7fbeb5e91430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:40.010733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:40.011195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:40.011741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:40.023170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] HTTP exception thrown: No hypervisor matching '6546807a-0052-4585-847e-9116a3106487' could be found. Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Request method failure captured: Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hypervisors/6546807a-0052-4585-847e-9116a3106487/servers HTTP/1.1 Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBp0hh8o9HJE8iNx4IYia0dNiKayHyHp9Q4zpwhhAldfHRAbMPeR8V3VYL7I_r7i1VXu0DkDfQtxd6rlH9i3S93JbJow2R5HHcwQE5QUAjg-fzdGg37GmHpwFLLl8gaGQFJEj8mHOpt7_VTUMskKnIVHxBYVCemQccqNO6X6kxmxyk Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1d962b3599aa4c7ebb4cbc4c2b484a56 Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1798574021 Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:31:40.024548 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d962b3599aa4c7ebb4cbc4c2b484a56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1798574021 Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1d962b3599aa4c7ebb4cbc4c2b484a56 Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1798574021 Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 6519df9eda4143cb83a9eee5d28aafa7 Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: exception: No hypervisor matching '6546807a-0052-4585-847e-9116a3106487' could be found. Sep 13 16:31:40.025729 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6546807a-0052-4585-847e-9116a3106487'} Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6546807a-0052-4585-847e-9116a3106487' could be found. Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.026401 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.027395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:40.027395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:40.027395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:40.027395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:40.027395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6546807a-0052-4585-847e-9116a3106487' could be found. Sep 13 16:31:40.027395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.033483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] Returning 404 to user: No hypervisor matching '6546807a-0052-4585-847e-9116a3106487' could be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:40.040975 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e3d9c69-1878-4cba-91f7-e98e2c488aac tempest-HypervisorAdminNegativeUnderV252Test-1798574021 tempest-HypervisorAdminNegativeUnderV252Test-1798574021-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/6546807a-0052-4585-847e-9116a3106487/servers" status: 404 len: 123 microversion: 2.1 time: 0.067055 Sep 13 16:31:40.041523 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 183/372] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Sep 13 16:31:39 2022] GET /compute/v2.1/os-hypervisors/6546807a-0052-4585-847e-9116a3106487/servers => generated 123 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:40.216869 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2429378a-e911-48b8-ae9a-7d237009948a tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe" status: 202 len: 0 microversion: 2.1 time: 2.177705 Sep 13 16:31:40.227188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24a2c9de-0fca-48de-a1d8-036f9441c04d tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Calling method '.version_select at 0x7fbeb5c06550>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:40.227806 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 190/373] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:31:38 2022] DELETE /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe => generated 0 bytes in 2189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:40.380686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-24a2c9de-0fca-48de-a1d8-036f9441c04d tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2287835d-9723-4321-b4ce-6853123fafbe could not be found", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:31:40.382456 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-24a2c9de-0fca-48de-a1d8-036f9441c04d tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] HTTP exception thrown: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24a2c9de-0fca-48de-a1d8-036f9441c04d tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Request method failure captured: Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe HTTP/1.1 Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBb0MVN6h-UX8JkmE1l_SvUOiBytqSck4OTca03YSF_TI_Dv1PYZAjxNkKsb3nenRUA_x6u29KhRjwF-wsg88gRKOWw0w10zDv0xV82RfYSeVGfSy8onYMAXgn1NNMbw0X6NMEjFfcDyn78hiZk2uOZ8dYO8QJoJPIrSPT3H62DJFI Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 14ba33c364f5436f99b72d4b13ea59c0 Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FloatingIPsTestJSON-1566227536 Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:40.395098 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FloatingIPsTestJSON-1566227536 Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 14ba33c364f5436f99b72d4b13ea59c0 Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1566227536 Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FloatingIPsTestJSON-1566227536-project Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a5a3f22f6b494e5fb72de171e73b9223 Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FloatingIPsTestJSON-1566227536-project Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: exception: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '2287835d-9723-4321-b4ce-6853123fafbe'} Sep 13 16:31:40.397143 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:31:40.398158 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2287835d-9723-4321-b4ce-6853123fafbe could not be found Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-817c4685-1dc6-4e94-ad86-5840e793e48d'] Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe. Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.399419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:40.400837 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:40.402183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.402183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.403517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24a2c9de-0fca-48de-a1d8-036f9441c04d tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Returning 404 to user: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:40.406240 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24a2c9de-0fca-48de-a1d8-036f9441c04d tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe" status: 404 len: 111 microversion: 2.1 time: 0.182665 Sep 13 16:31:40.409716 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 184/374] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:31:40 2022] GET /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:31:40.419129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc5bf952-8d10-4b27-a3ed-0d36733df6a3 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Calling method '.version_select at 0x7fbeb5da0820>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:40.527997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-fc5bf952-8d10-4b27-a3ed-0d36733df6a3 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2287835d-9723-4321-b4ce-6853123fafbe could not be found", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:31:40.529037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-fc5bf952-8d10-4b27-a3ed-0d36733df6a3 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] HTTP exception thrown: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc5bf952-8d10-4b27-a3ed-0d36733df6a3 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Request method failure captured: Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe HTTP/1.1 Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILBb0MVN6h-UX8JkmE1l_SvUOiBytqSck4OTca03YSF_TI_Dv1PYZAjxNkKsb3nenRUA_x6u29KhRjwF-wsg88gRKOWw0w10zDv0xV82RfYSeVGfSy8onYMAXgn1NNMbw0X6NMEjFfcDyn78hiZk2uOZ8dYO8QJoJPIrSPT3H62DJFI Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 14ba33c364f5436f99b72d4b13ea59c0 Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsTestJSON-1566227536 Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:31:40.537148 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/14ba33c364f5436f99b72d4b13ea59c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsTestJSON-1566227536 Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 14ba33c364f5436f99b72d4b13ea59c0 Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1566227536 Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsTestJSON-1566227536-project Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5a3f22f6b494e5fb72de171e73b9223 Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsTestJSON-1566227536-project Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: exception: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '2287835d-9723-4321-b4ce-6853123fafbe'} Sep 13 16:31:40.539350 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:31:40.540448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2287835d-9723-4321-b4ce-6853123fafbe could not be found Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1018eaf1-6b31-447f-b4ee-2c6fa607f07b'] Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe. Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.541495 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:40.542599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:40.543650 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe Sep 13 16:31:40.543650 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:40.547018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc5bf952-8d10-4b27-a3ed-0d36733df6a3 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] Returning 404 to user: Floating IP not found for ID 2287835d-9723-4321-b4ce-6853123fafbe {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:40.549792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc5bf952-8d10-4b27-a3ed-0d36733df6a3 tempest-FloatingIPsTestJSON-1566227536 tempest-FloatingIPsTestJSON-1566227536-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe" status: 404 len: 111 microversion: 2.1 time: 0.134532 Sep 13 16:31:40.551297 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 191/375] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:31:40 2022] DELETE /compute/v2.1/os-floating-ips/2287835d-9723-4321-b4ce-6853123fafbe => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:31:49.699967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:49.700926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=18 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:49.919180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:50.020110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=18 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:50.255291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d2b659f-06ab-44b1-b434-4a39d9c9f78b tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.274866 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d2b659f-06ab-44b1-b434-4a39d9c9f78b tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.575599 Sep 13 16:31:50.276810 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 185/376] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.290159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f41920b0-bc8d-4692-aaba-ae91cff6468f tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.316370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:50.318353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:50.320205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:50.321485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:50.353514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f41920b0-bc8d-4692-aaba-ae91cff6468f tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.067023 Sep 13 16:31:50.367014 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 192/377] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:50.375352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d1f7825-1ca6-4fe3-9f24-a55cf6c2cbd5 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.387988 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d1f7825-1ca6-4fe3-9f24-a55cf6c2cbd5 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019551 Sep 13 16:31:50.396390 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 186/378] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.405390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d3e317f-342c-453b-bfa9-3ae1c85ab4c0 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.431393 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d3e317f-342c-453b-bfa9-3ae1c85ab4c0 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029578 Sep 13 16:31:50.438200 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 193/379] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.445288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aafc71d5-061a-4086-97be-960a8b94f27d tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.513986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aafc71d5-061a-4086-97be-960a8b94f27d tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.072328 Sep 13 16:31:50.525275 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 187/380] 10.222.0.61 () {58 vars in 1165 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:50.537413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f60f805-2457-4b04-bef0-e23c3f3e376b tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.563207 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f60f805-2457-4b04-bef0-e23c3f3e376b tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033139 Sep 13 16:31:50.564877 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 194/381] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.583019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-617ac036-c9de-40b3-a303-6eeee1a9053a tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.613388 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-617ac036-c9de-40b3-a303-6eeee1a9053a tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.037854 Sep 13 16:31:50.614313 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 188/382] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:50.633852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53bfdf34-ab8e-419d-aaf6-158b281be402 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.660499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53bfdf34-ab8e-419d-aaf6-158b281be402 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032241 Sep 13 16:31:50.663968 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 195/383] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.678360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27b6c20e-8007-4910-9413-1115b34bb047 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.693729 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27b6c20e-8007-4910-9413-1115b34bb047 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020134 Sep 13 16:31:50.695013 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 189/384] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.708224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2293facf-5601-45d8-a1ae-e3fa78ff6c9e tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.764753 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2293facf-5601-45d8-a1ae-e3fa78ff6c9e tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.061702 Sep 13 16:31:50.765917 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 196/385] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:50.785853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-28236fae-5e1f-44e9-884e-b810d65d7ed9 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.796204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-28236fae-5e1f-44e9-884e-b810d65d7ed9 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016190 Sep 13 16:31:50.797293 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 190/386] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.809674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d0b8b0b-4f5c-40a5-ac10-e8d1b0c1a18e tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.844142 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d0b8b0b-4f5c-40a5-ac10-e8d1b0c1a18e tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038427 Sep 13 16:31:50.855263 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 197/387] 10.222.0.61 () {58 vars in 1144 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:50.873528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-564e283c-ad85-4fcb-996a-0456882017b5 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.888403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-564e283c-ad85-4fcb-996a-0456882017b5 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021113 Sep 13 16:31:50.890086 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 191/388] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.902943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3bc0cc2-dbcb-4782-9bf1-4afd20bcb00e tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.940879 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3bc0cc2-dbcb-4782-9bf1-4afd20bcb00e tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.042843 Sep 13 16:31:50.941479 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 198/389] 10.222.0.61 () {58 vars in 1148 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:50.956655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89af0d6a-538b-4630-88ca-aad07b364733 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:50.977067 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89af0d6a-538b-4630-88ca-aad07b364733 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025533 Sep 13 16:31:50.985929 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 192/390] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:50.994913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb6feecf-bd3d-4353-8f58-51be4be8c7bc tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:51.008839 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb6feecf-bd3d-4353-8f58-51be4be8c7bc tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017327 Sep 13 16:31:51.011895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 199/391] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:51.025039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5629969f-d1de-4028-b3d0-f94d7035cb27 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:51.084631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5629969f-d1de-4028-b3d0-f94d7035cb27 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.063154 Sep 13 16:31:51.085347 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 193/392] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:51 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:51.099541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31b356e1-598b-4cac-a6ef-5353d3d61636 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:51.139496 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31b356e1-598b-4cac-a6ef-5353d3d61636 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.043752 Sep 13 16:31:51.143670 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 200/393] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:51 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:31:51.169286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6662db0c-2a2c-43cd-8032-13838bf89f14 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:51.180231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6662db0c-2a2c-43cd-8032-13838bf89f14 tempest-FlavorsV2TestJSON-565228987 tempest-FlavorsV2TestJSON-565228987-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018636 Sep 13 16:31:51.190626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 194/394] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:52.641410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4884489-07e9-417c-a781-6e5b8b318467 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2042595874", "id": 419515541, "os-flavor-access:is_public": "False"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:52.673870 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4884489-07e9-417c-a781-6e5b8b318467 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.746353 Sep 13 16:31:52.678461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 201/395] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:51 2022] POST /compute/v2.1/flavors => generated 428 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:52.687127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd132929-951f-48af-a8e1-d4c991f74db7 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "219715707ed946bbb4e47ad3753fc3d4"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:53.577234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-304542314", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:53.688548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:53.880655 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd132929-951f-48af-a8e1-d4c991f74db7 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/419515541/action" status: 200 len: 96 microversion: 2.1 time: 1.197459 Sep 13 16:31:53.881793 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 195/396] 10.222.0.61 () {60 vars in 1197 bytes} [Tue Sep 13 16:31:52 2022] POST /compute/v2.1/flavors/419515541/action => generated 96 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:31:54.104314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a6c759c1-f737-4a3f-b249-6a93c70fd0d1 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Action: 'create', calling method: .version_select at 0x7fbeb5b11ee0>, body: {"keypair": {"name": "tempest-keypair-689468088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7VbACt4vFTpi4ZDub6UIBINWV0om59bQ+FIBr46RPFLhSAtLvtmKL+bPsOk1ipvBpzx8fi8CH4irNOMmRkTQNRDiiwHyDrHvuJDFNSFr6G1BYOW5AsYGzgpyuNmBY5FQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:54.140698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a6c759c1-f737-4a3f-b249-6a93c70fd0d1 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:54.154853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a6c759c1-f737-4a3f-b249-6a93c70fd0d1 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for user f68596210ebb4a72929bc0430f7e944c and project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:54.201851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a6c759c1-f737-4a3f-b249-6a93c70fd0d1 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.318773 Sep 13 16:31:54.202731 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 196/397] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:54.393929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:31:54.394745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:31:54.395489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:31:54.396078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:31:54.396642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:31:54.411496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:54.412282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:54.412715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:54.413469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:54.414108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:54.414529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:54.437349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:54.447111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for user 80714f77e8904565bde7dc8e7dce1063 and project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:54.464488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:31:54.466838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:31:54.531968 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b7096d7-6c22-4781-b580-a8e7839f183a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631661 Sep 13 16:31:54.541121 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 202/398] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:31:54.802413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1665090967", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:54.885344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:55.006707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59670b18-8965-4810-81c8-dcd2b6e15956 tempest-FlavorsAccessTestJSON-32288922 tempest-FlavorsAccessTestJSON-32288922-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:55.034964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59670b18-8965-4810-81c8-dcd2b6e15956 tempest-FlavorsAccessTestJSON-32288922 tempest-FlavorsAccessTestJSON-32288922-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.498588 Sep 13 16:31:55.035751 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 203/399] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:54 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:55.048700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d2ba29c-c8c3-47d3-baa1-1078588b5726 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5bc0ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:55.078138 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d2ba29c-c8c3-47d3-baa1-1078588b5726 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-689468088" status: 200 len: 496 microversion: 2.1 time: 0.038885 Sep 13 16:31:55.087531 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 204/400] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Sep 13 16:31:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-689468088 => generated 496 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:55.094169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6534eb09-fc6f-4bf2-9265-28bef0bbc5db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:55.095811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6534eb09-fc6f-4bf2-9265-28bef0bbc5db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:55.163840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6534eb09-fc6f-4bf2-9265-28bef0bbc5db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:55.175894 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6534eb09-fc6f-4bf2-9265-28bef0bbc5db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1212 microversion: 2.1 time: 0.086676 Sep 13 16:31:55.177085 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 205/401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:55 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:55.274771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:31:55.275373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:31:55.276204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:31:55.276915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:31:55.277666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:31:55.288799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:55.289531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:55.290153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:55.291064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:55.291560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:55.291976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:55.299738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1031093206", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "e0e29954-773d-492f-aa39-e96119d607b1"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:55.310876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:55.325768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:55.397381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:31:55.408100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:31:55.426296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] validate_networks() for [('e0e29954-773d-492f-aa39-e96119d607b1', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:55.524208 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69f902e3-e8c5-47f1-8df4-0ddb2f3dc856 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.320182 Sep 13 16:31:55.525115 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 197/402] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:31:55.541814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d497c106-355a-4890-ac1f-d8832da96eb9 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "219715707ed946bbb4e47ad3753fc3d4"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:56.061497 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d497c106-355a-4890-ac1f-d8832da96eb9 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/419515541/action" status: 200 len: 21 microversion: 2.1 time: 0.527892 Sep 13 16:31:56.067854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 198/403] 10.222.0.61 () {60 vars in 1197 bytes} [Tue Sep 13 16:31:55 2022] POST /compute/v2.1/flavors/419515541/action => generated 21 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:31:56.074063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb932f00-58d1-4bd3-b2c5-5ce8ab62750d tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5b11790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:56.101314 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb932f00-58d1-4bd3-b2c5-5ce8ab62750d tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689468088" status: 202 len: 0 microversion: 2.1 time: 0.032086 Sep 13 16:31:56.104565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 199/404] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:31:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689468088 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:56.112976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a87cedb-e5a4-4233-b815-0295a43cf636 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:56.117696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a87cedb-e5a4-4233-b815-0295a43cf636 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:56.220952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a87cedb-e5a4-4233-b815-0295a43cf636 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:56.233774 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a87cedb-e5a4-4233-b815-0295a43cf636 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1217 microversion: 2.1 time: 0.126864 Sep 13 16:31:56.235727 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 200/405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:56 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:56.260271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64a784c0-628d-48df-bc3e-63608b5dd012 tempest-FlavorsAccessTestJSON-32288922 tempest-FlavorsAccessTestJSON-32288922-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:56.323839 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64a784c0-628d-48df-bc3e-63608b5dd012 tempest-FlavorsAccessTestJSON-32288922 tempest-FlavorsAccessTestJSON-32288922-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.086918 Sep 13 16:31:56.348647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 201/406] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:56 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:56.366284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f87d0cd1-a473-49e8-8171-cf2a21b69bd5 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Action: 'create', calling method: .version_select at 0x7fbeb5af0040>, body: {"keypair": {"name": "tempest-keypair-244887434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMCmF8SAr/YPSe3Fk79gJqDZ54iN25BFe6GYLBa6VuyoE0uxXFu76auhuAtUfWxfdgKoQyWugTDA4wXc3HsSW8Fz86Fvhj4iGnX9tS+ssU+p8oqifPDwUar1nioTghSqw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:56.414335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f87d0cd1-a473-49e8-8171-cf2a21b69bd5 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:56.420497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f87d0cd1-a473-49e8-8171-cf2a21b69bd5 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for user f68596210ebb4a72929bc0430f7e944c and project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:56.490166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f87d0cd1-a473-49e8-8171-cf2a21b69bd5 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140116 Sep 13 16:31:56.494517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 202/407] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:56.763743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:31:56.764881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:31:56.765551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:31:56.770543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:31:56.771221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:31:56.800908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:56.815281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:56.822422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:56.826156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:56.826885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:56.828845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:56.861093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:56.867836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for user 792d76dbc4394c77bee09f600364cb74 and project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:56.885598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:31:56.888642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:31:57.015203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b9de612-385e-43a3-9ef2-6699564cbe96 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.836407 Sep 13 16:31:57.027875 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 206/408] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:31:57.046350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.047327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:57.047781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89209ab6-aecf-42d5-9525-85d9ce99f79c tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Calling method '.version_select at 0x7fbeb5b11d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.090878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:57.091774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:57.092626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:57.093517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:57.095768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:57.096740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:57.105458 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-89209ab6-aecf-42d5-9525-85d9ce99f79c tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] HTTP exception thrown: Image not found. Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89209ab6-aecf-42d5-9525-85d9ce99f79c tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Request method failure captured: Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/images/a32a6b47-d1e2-47c7-9e0f-4520339b77d4/metadata/os_distro HTTP/1.1 Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8L_e15-6oi4HSowqgbCb42_6HGpJ3XB6F5TOUFI_bDbh2gdOXpREQy8VGsy3AYMYg-ZFlkBhwKf5jwqAjRWRYMhYEtPZmkkv1NzcnGbKT-GbhzpdLLkZkNCoMGIRDUIxGfcZiEZGSgMx7meYIL0ZMcaqRZcWV5MuARCXq6bnrZxY Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:57.122917 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3628c662f5e7472a9f990e604d5e1b41 Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'image_id': 'a32a6b47-d1e2-47c7-9e0f-4520339b77d4', 'id': 'os_distro'} Sep 13 16:31:57.124546 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.125327 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a32a6b47-d1e2-47c7-9e0f-4520339b77d4 Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.126985 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a32a6b47-d1e2-47c7-9e0f-4520339b77d4 could not be found. Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:57.128301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.130301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89209ab6-aecf-42d5-9525-85d9ce99f79c tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:57.134319 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89209ab6-aecf-42d5-9525-85d9ce99f79c tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] 10.222.0.61 "DELETE /compute/v2.1/images/a32a6b47-d1e2-47c7-9e0f-4520339b77d4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.628977 Sep 13 16:31:57.134319 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 203/409] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Sep 13 16:31:56 2022] DELETE /compute/v2.1/images/a32a6b47-d1e2-47c7-9e0f-4520339b77d4/metadata/os_distro => generated 62 bytes in 635 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:57.156350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71a4aca2-d6e5-4772-9605-70619f3a6a61 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.193411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:57.204889 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22aa21d0-757e-470d-94be-05b519d77618 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1270 microversion: 2.1 time: 0.174845 Sep 13 16:31:57.207339 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 207/410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:57.209926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71a4aca2-d6e5-4772-9605-70619f3a6a61 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/419515541" status: 202 len: 0 microversion: 2.1 time: 0.078163 Sep 13 16:31:57.210981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 204/411] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:31:57 2022] DELETE /compute/v2.1/flavors/419515541 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:57.224101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ad24fbc-2615-4a37-b7bf-1c3c9533f05f tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5b113a0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.225925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c3f2205-9b92-48a2-bfc5-f6bd87c33c9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.231431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c3f2205-9b92-48a2-bfc5-f6bd87c33c9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:57.297028 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ad24fbc-2615-4a37-b7bf-1c3c9533f05f tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-244887434" status: 202 len: 0 microversion: 2.1 time: 0.084718 Sep 13 16:31:57.297625 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-244887434 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:57.311469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-822e7b63-9dcf-4498-97b4-a330bfd737e7 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Calling method '.version_select at 0x7fbeb5af03a0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.358629 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-822e7b63-9dcf-4498-97b4-a330bfd737e7 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] HTTP exception thrown: Image not found. Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-822e7b63-9dcf-4498-97b4-a330bfd737e7 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Request method failure captured: Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/images/53f02a29-9abd-4fde-a2eb-b9d1ee954a4b/metadata/os_version HTTP/1.1 Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8L_e15-6oi4HSowqgbCb42_6HGpJ3XB6F5TOUFI_bDbh2gdOXpREQy8VGsy3AYMYg-ZFlkBhwKf5jwqAjRWRYMhYEtPZmkkv1NzcnGbKT-GbhzpdLLkZkNCoMGIRDUIxGfcZiEZGSgMx7meYIL0ZMcaqRZcWV5MuARCXq6bnrZxY Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:57.363116 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3628c662f5e7472a9f990e604d5e1b41 Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'image_id': '53f02a29-9abd-4fde-a2eb-b9d1ee954a4b', 'id': 'os_version'} Sep 13 16:31:57.364655 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.365555 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 53f02a29-9abd-4fde-a2eb-b9d1ee954a4b Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.366816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53f02a29-9abd-4fde-a2eb-b9d1ee954a4b could not be found. Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:57.368248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:31:57.369932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.382114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-822e7b63-9dcf-4498-97b4-a330bfd737e7 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:57.384112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-822e7b63-9dcf-4498-97b4-a330bfd737e7 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] 10.222.0.61 "GET /compute/v2.1/images/53f02a29-9abd-4fde-a2eb-b9d1ee954a4b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.085251 Sep 13 16:31:57.385364 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 206/413] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/images/53f02a29-9abd-4fde-a2eb-b9d1ee954a4b/metadata/os_version => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:57.391590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d087f3b-5e5c-49c4-8629-bc1aeec35094 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.426793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c3f2205-9b92-48a2-bfc5-f6bd87c33c9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:57.434360 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d087f3b-5e5c-49c4-8629-bc1aeec35094 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.047261 Sep 13 16:31:57.435456 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 207/414] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:57.448409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c3f2205-9b92-48a2-bfc5-f6bd87c33c9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:57.449873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c3f2205-9b92-48a2-bfc5-f6bd87c33c9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:57.451276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c3f2205-9b92-48a2-bfc5-f6bd87c33c9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1262 microversion: 2.25 time: 0.237825 Sep 13 16:31:57.451453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.453203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:57.461622 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 208/415] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1262 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:31:57.474628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14c47369-652f-4771-be41-4bcbbc462c9b tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Action: 'create', calling method: .version_select at 0x7fbeb5da0550>, body: {"keypair": {"name": "tempest-keypair-1634609388", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:57.492834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:57.495841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:57.497949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:57.500025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:57.500593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:57.502717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:57.541181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-14c47369-652f-4771-be41-4bcbbc462c9b tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:57.572278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-14c47369-652f-4771-be41-4bcbbc462c9b tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for user f68596210ebb4a72929bc0430f7e944c and project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:57.645256 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14c47369-652f-4771-be41-4bcbbc462c9b tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.181811 Sep 13 16:31:57.646332 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 209/416] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:57 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:57.679520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-239dbb15-7901-4874-89a9-d14da73bf954 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Calling method '.version_select at 0x7fbeb5b793a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.700626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:57.722912 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-043ef35f-035c-4171-a83b-fa084dabe6f4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1277 microversion: 2.1 time: 0.286025 Sep 13 16:31:57.724248 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 208/417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:57.735320 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-239dbb15-7901-4874-89a9-d14da73bf954 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] HTTP exception thrown: Image not found. Sep 13 16:31:57.746025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-409b2069-e4b9-42ce-9f76-3d6f607a5a5e tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1544836650", "id": 1120413605, "os-flavor-access:is_public": "False"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-239dbb15-7901-4874-89a9-d14da73bf954 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Request method failure captured: Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/images/277a200e-6297-43cb-9cf6-1ed0041f51d5/metadata HTTP/1.1 Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB8L_e15-6oi4HSowqgbCb42_6HGpJ3XB6F5TOUFI_bDbh2gdOXpREQy8VGsy3AYMYg-ZFlkBhwKf5jwqAjRWRYMhYEtPZmkkv1NzcnGbKT-GbhzpdLLkZkNCoMGIRDUIxGfcZiEZGSgMx7meYIL0ZMcaqRZcWV5MuARCXq6bnrZxY Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:31:57.749598 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 3628c662f5e7472a9f990e604d5e1b41 Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'image_id': '277a200e-6297-43cb-9cf6-1ed0041f51d5'} Sep 13 16:31:57.751101 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.752386 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 277a200e-6297-43cb-9cf6-1ed0041f51d5 Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.756168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 277a200e-6297-43cb-9cf6-1ed0041f51d5 could not be found. Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:57.757507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:31:57.758842 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.761261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-239dbb15-7901-4874-89a9-d14da73bf954 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:57.762555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-239dbb15-7901-4874-89a9-d14da73bf954 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] 10.222.0.61 "GET /compute/v2.1/images/277a200e-6297-43cb-9cf6-1ed0041f51d5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.115152 Sep 13 16:31:57.765335 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 210/418] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/images/277a200e-6297-43cb-9cf6-1ed0041f51d5/metadata => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:57.773104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:57.775624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1a0ebb2-1c18-4e5f-80be-acf474aa3930 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5bf9a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.799191 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-409b2069-e4b9-42ce-9f76-3d6f607a5a5e tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.073326 Sep 13 16:31:57.799807 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 209/419] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:57 2022] POST /compute/v2.1/flavors => generated 431 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:57.809076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9f47f3d-83b2-4150-8fe8-066a6814e6a8 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Action: 'update_all', calling method: .version_select at 0x7fbeb5a6a1f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:57.819848 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1a0ebb2-1c18-4e5f-80be-acf474aa3930 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634609388" status: 202 len: 0 microversion: 2.1 time: 0.053355 Sep 13 16:31:57.821593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 211/420] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634609388 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:57.831852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60b0355b-bbad-41a1-a75f-f1545f7423e1 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.852020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60b0355b-bbad-41a1-a75f-f1545f7423e1 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/1120413605/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.029149 Sep 13 16:31:57.852928 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 212/421] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/flavors/1120413605/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:31:57.862290 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e9f47f3d-83b2-4150-8fe8-066a6814e6a8 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] HTTP exception thrown: Image not found. Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9f47f3d-83b2-4150-8fe8-066a6814e6a8 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Request method failure captured: Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/images/581aac83-b672-4970-acec-dd8dbbe04648/metadata HTTP/1.1 Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 57 Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8L_e15-6oi4HSowqgbCb42_6HGpJ3XB6F5TOUFI_bDbh2gdOXpREQy8VGsy3AYMYg-ZFlkBhwKf5jwqAjRWRYMhYEtPZmkkv1NzcnGbKT-GbhzpdLLkZkNCoMGIRDUIxGfcZiEZGSgMx7meYIL0ZMcaqRZcWV5MuARCXq6bnrZxY Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:57.864473 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3628c662f5e7472a9f990e604d5e1b41 Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:57.865709 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'image_id': '581aac83-b672-4970-acec-dd8dbbe04648', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.866502 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 581aac83-b672-4970-acec-dd8dbbe04648 Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.867490 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 581aac83-b672-4970-acec-dd8dbbe04648 could not be found. Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:57.868579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:31:57.869598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.870787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9f47f3d-83b2-4150-8fe8-066a6814e6a8 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:57.870787 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9f47f3d-83b2-4150-8fe8-066a6814e6a8 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] 10.222.0.61 "PUT /compute/v2.1/images/581aac83-b672-4970-acec-dd8dbbe04648/metadata" status: 404 len: 62 microversion: 2.1 time: 0.060797 Sep 13 16:31:57.870787 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 210/422] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:31:57 2022] PUT /compute/v2.1/images/581aac83-b672-4970-acec-dd8dbbe04648/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:57.874684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f38caac-1198-497d-9622-781b3aba7f00 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Action: 'create', calling method: .version_select at 0x7fbeb5bf9430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1719037980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLTda05fGTG9x9cGwjIXratBKHasAyh3HlVGMTbm+d/32M9kpVKA3i7d/eRxtyZgJWcALyIX51lHOo/d9zFc6Rm5abCf4DIymsKMDsZXqs2j10A9I7hiQ4u/1ay5ZZGZA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:57.876816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-05dbbb25-b422-4100-9785-300d8dfee084 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.913354 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-05dbbb25-b422-4100-9785-300d8dfee084 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1120413605" status: 202 len: 0 microversion: 2.1 time: 0.045337 Sep 13 16:31:57.918207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 211/423] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:31:57 2022] DELETE /compute/v2.1/flavors/1120413605 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:57.918380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f38caac-1198-497d-9622-781b3aba7f00 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:57.932355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d8d11d-4bd6-4170-a8d4-0ae1ab72a9c3 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Action: 'update', calling method: .version_select at 0x7fbeb5a6a4c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:57.938886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f38caac-1198-497d-9622-781b3aba7f00 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for user f68596210ebb4a72929bc0430f7e944c and project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:57.968051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-33d8d11d-4bd6-4170-a8d4-0ae1ab72a9c3 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] HTTP exception thrown: Image not found. Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d8d11d-4bd6-4170-a8d4-0ae1ab72a9c3 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Request method failure captured: Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/images/bc6f7912-351d-4010-b3dc-2dc563e8ae84/metadata/os_distro HTTP/1.1 Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 30 Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8L_e15-6oi4HSowqgbCb42_6HGpJ3XB6F5TOUFI_bDbh2gdOXpREQy8VGsy3AYMYg-ZFlkBhwKf5jwqAjRWRYMhYEtPZmkkv1NzcnGbKT-GbhzpdLLkZkNCoMGIRDUIxGfcZiEZGSgMx7meYIL0ZMcaqRZcWV5MuARCXq6bnrZxY Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:57.970730 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3628c662f5e7472a9f990e604d5e1b41 Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: {"meta": {"os_distro": "alt"}} Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:31:57.972289 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'image_id': 'bc6f7912-351d-4010-b3dc-2dc563e8ae84', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.973240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bc6f7912-351d-4010-b3dc-2dc563e8ae84 Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:57.974869 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bc6f7912-351d-4010-b3dc-2dc563e8ae84 could not be found. Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:57.977936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:31:57.979049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:57.980294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d8d11d-4bd6-4170-a8d4-0ae1ab72a9c3 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:57.980294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33d8d11d-4bd6-4170-a8d4-0ae1ab72a9c3 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] 10.222.0.61 "PUT /compute/v2.1/images/bc6f7912-351d-4010-b3dc-2dc563e8ae84/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.052313 Sep 13 16:31:57.980294 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 212/424] 10.222.0.61 () {60 vars in 1310 bytes} [Tue Sep 13 16:31:57 2022] PUT /compute/v2.1/images/bc6f7912-351d-4010-b3dc-2dc563e8ae84/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:57.980294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0fc33d0f-3871-4156-9bda-21acd900bf15 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:57.987602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:31:57.999773 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f38caac-1198-497d-9622-781b3aba7f00 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.145730 Sep 13 16:31:58.000736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 213/425] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:58.027638 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0fc33d0f-3871-4156-9bda-21acd900bf15 tempest-FlavorsAccessTestJSON-1432302351 tempest-FlavorsAccessTestJSON-1432302351-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.044646 Sep 13 16:31:58.028337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 213/426] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:31:57 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:58.075737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53b07b77-5580-44e5-9e7e-9e411bd99061 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Action: 'create', calling method: .version_select at 0x7fbeb5a9c5e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:58.128254 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-53b07b77-5580-44e5-9e7e-9e411bd99061 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] HTTP exception thrown: Image not found. Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53b07b77-5580-44e5-9e7e-9e411bd99061 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Request method failure captured: Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/images/efa1cef2-22d1-481e-9214-94d25e327fd4/metadata HTTP/1.1 Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 57 Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8L_e15-6oi4HSowqgbCb42_6HGpJ3XB6F5TOUFI_bDbh2gdOXpREQy8VGsy3AYMYg-ZFlkBhwKf5jwqAjRWRYMhYEtPZmkkv1NzcnGbKT-GbhzpdLLkZkNCoMGIRDUIxGfcZiEZGSgMx7meYIL0ZMcaqRZcWV5MuARCXq6bnrZxY Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:31:58.132462 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3dd6494b67684fbb8dee34ac9156dd7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 3dd6494b67684fbb8dee34ac9156dd7a Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689 Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3628c662f5e7472a9f990e604d5e1b41 Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2133436689-project Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:31:58.134030 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'image_id': 'efa1cef2-22d1-481e-9214-94d25e327fd4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:58.134997 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID efa1cef2-22d1-481e-9214-94d25e327fd4 Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:31:58.136202 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image efa1cef2-22d1-481e-9214-94d25e327fd4 could not be found. Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:31:58.138305 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:31:58.139794 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:31:58.144602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53b07b77-5580-44e5-9e7e-9e411bd99061 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:31:58.152031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-53b07b77-5580-44e5-9e7e-9e411bd99061 tempest-ImagesMetadataNegativeTestJSON-2133436689 tempest-ImagesMetadataNegativeTestJSON-2133436689-project] 10.222.0.61 "POST /compute/v2.1/images/efa1cef2-22d1-481e-9214-94d25e327fd4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.120062 Sep 13 16:31:58.159116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 214/427] 10.222.0.61 () {60 vars in 1281 bytes} [Tue Sep 13 16:31:58 2022] POST /compute/v2.1/images/efa1cef2-22d1-481e-9214-94d25e327fd4/metadata => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:31:58.166160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12e65028-0b3f-409c-9a91-9c3808038672 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Action: 'create', calling method: .version_select at 0x7fbeb5a6aee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-594394059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0BmUe2BzpAVdymx1Nr+nWpzaE3XGMnO84VCjVBMx20+qyOi7wdqnFXwCZHxymLjH8y5xfHysujrzJdiEAwnrg/kbqq+HBhSBe4p350PRMPPvOH88tZKLfmZiXWZI9GcQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:58.201775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-12e65028-0b3f-409c-9a91-9c3808038672 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:58.207639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-12e65028-0b3f-409c-9a91-9c3808038672 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for user f68596210ebb4a72929bc0430f7e944c and project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:58.272116 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12e65028-0b3f-409c-9a91-9c3808038672 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.111749 Sep 13 16:31:58.282297 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 215/428] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:58.294180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1942399833", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:58.307433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:58.308070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:58.327174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:58.328175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:58.329049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:58.330414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:58.331066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:58.334497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:58.419787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:58.784022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:31:58.785105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:31:58.785811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:31:58.786617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:31:58.787235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:31:58.802946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:58.803791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:58.805636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:58.807505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:58.808882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:58.810774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:58.868560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Getting quotas for project fd7b2634429c46c1ac366579351c3389. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:58.887200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Getting quotas for user 76067e188d0047d8939862b78f0abea9 and project fd7b2634429c46c1ac366579351c3389. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:58.910498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:31:58.913802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:31:58.944146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:58.953705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1eb3e155-6bf1-4315-98f7-e36af174d84c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.669414 Sep 13 16:31:58.954865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 216/429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:58 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:58.971680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dcbeb5ae-bc0d-4b76-b8c7-18f1f580ef66 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Action: 'create', calling method: .version_select at 0x7fbeb5a73d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-745721185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFc9O1VMXBPo/W8HdvtQ3VjGEd4AH3FEBaBgPHmPMIisRdmp0QhNejVCQlo+UYztxs/u6hA9yQwAYPmLOwgroJkIQXXm7AP34ZZZjNz25cq1IVXjll/ARVgxUjWt7vEMw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:59.018412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-dcbeb5ae-bc0d-4b76-b8c7-18f1f580ef66 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:31:59.020723 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e62496cd-e6e1-4918-b034-23e681288047 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009512 Sep 13 16:31:59.022385 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 214/430] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:31:59.027039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.037276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:59.050783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:59.053955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:59.054428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:59.055179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:59.056225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-dcbeb5ae-bc0d-4b76-b8c7-18f1f580ef66 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Getting quotas for user f68596210ebb4a72929bc0430f7e944c and project dcc7a565254c400e8c87ca0c3f5d8171. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:31:59.060010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:59.060893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:59.175401 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dcbeb5ae-bc0d-4b76-b8c7-18f1f580ef66 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.215915 Sep 13 16:31:59.177286 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 217/431] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:31:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:31:59.193446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.200078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:59.225738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:59.227577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:59.230373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:59.234226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:31:59.234720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:31:59.250437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:31:59.322088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:59.334949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:59.336421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:59.337591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf71cbe1-61ae-43c3-9dbb-2944c2e54815 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1266 microversion: 2.25 time: 0.314202 Sep 13 16:31:59.366176 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 215/432] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:31:59 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:31:59.372686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d3265a5-fdb6-4aa3-a404-e9b8acf6322a tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5b79e50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.395202 n-d-857467-1 devstack@n-api.service[122328]: WARNING oslo_db.sqlalchemy.utils [None req-3d3265a5-fdb6-4aa3-a404-e9b8acf6322a tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 13 16:31:59.417462 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d3265a5-fdb6-4aa3-a404-e9b8acf6322a tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.055157 Sep 13 16:31:59.418107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 216/433] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:31:59 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:59.425002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:31:59.431517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-209741091", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:31:59.435038 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d47a798f-4160-463f-b1fe-0c4d19733a86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1275 microversion: 2.1 time: 0.256660 Sep 13 16:31:59.439959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 218/434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:59 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1275 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:31:59.449977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a7b36f6-b2cf-4163-b714-cd9e5ff35b8d tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5a00820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.488131 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a7b36f6-b2cf-4163-b714-cd9e5ff35b8d tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-745721185" status: 202 len: 0 microversion: 2.1 time: 0.046966 Sep 13 16:31:59.492298 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 219/435] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:31:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-745721185 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:59.512229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e49a0c15-7849-4a92-8618-3ebde4c94fa6 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5a73ca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.566590 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e49a0c15-7849-4a92-8618-3ebde4c94fa6 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-594394059" status: 202 len: 0 microversion: 2.1 time: 0.072976 Sep 13 16:31:59.567960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:31:59.570537 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 220/436] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:31:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-594394059 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:59.589472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5174774-682a-491c-82ae-c57633c46258 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] Calling method '.version_select at 0x7fbeb5a9c1f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.660197 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e5174774-682a-491c-82ae-c57633c46258 tempest-KeyPairsV2TestJSON-718086146 tempest-KeyPairsV2TestJSON-718086146-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1719037980" status: 202 len: 0 microversion: 2.1 time: 0.088543 Sep 13 16:31:59.661055 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 221/437] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Sep 13 16:31:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1719037980 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:31:59.981803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:31:59.982990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:31:59.999652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.003561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.009355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.010530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.011243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.011929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.395110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:00.413363 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54e8a4a0-5647-416d-acd2-9437ffa8c038 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.434563 Sep 13 16:32:00.414962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 222/438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:31:59 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:00.425649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:00.430353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:00.448338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.448850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.449486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.450526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.454357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.455352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.465661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:32:00.466254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:32:00.466790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:32:00.467225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:32:00.467853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:32:00.510402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.510402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.510402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.510402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.510998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.510998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.619074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Getting quotas for project fd7b2634429c46c1ac366579351c3389. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:00.639709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Getting quotas for user 76067e188d0047d8939862b78f0abea9 and project fd7b2634429c46c1ac366579351c3389. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:00.685391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:32:00.690203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:00.729444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:00.754720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:00.756427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:00.757574 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fe533c4-39e0-4d28-8ab3-94a40158d5da tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1266 microversion: 2.25 time: 0.341319 Sep 13 16:32:00.771174 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 223/439] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:00 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:00.788841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:00.793769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:00.812639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.815904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebe181a4-65c5-4aec-a892-197f4282855d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396680 Sep 13 16:32:00.823412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.824146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.824950 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 217/440] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:32:00.827189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:00.829017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:00.830883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:00.837162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c8c4d01e-1a33-4b46-babe-67f33da91deb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:00.837785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c8c4d01e-1a33-4b46-babe-67f33da91deb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:01.014977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c8c4d01e-1a33-4b46-babe-67f33da91deb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:01.025632 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c8c4d01e-1a33-4b46-babe-67f33da91deb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1213 microversion: 2.1 time: 0.193628 Sep 13 16:32:01.044531 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 218/441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:00 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:01.446894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:01.447511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:01.467292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:01.467852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:01.468238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:01.468966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:01.469425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:01.470894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:01.570554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:01.582557 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-716180dd-8ea9-49bb-bf43-61d34bb1d465 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.818989 Sep 13 16:32:01.584623 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 224/442] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:00 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:01.746453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:01.760979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-54dd75ad-51e1-4024-8683-02021a7c2839 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.319214 Sep 13 16:32:01.762878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 219/443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:01 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:01.788535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:01.789647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:01.802065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:01.802862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:01.803639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:01.804587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:01.805431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:01.806051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:01.999739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:02.031267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:02.038200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:02.040154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ab5ce3da-af88-439c-bd23-fd56f2b5ba30 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1266 microversion: 2.25 time: 0.255907 Sep 13 16:32:02.055047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:02.056404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:02.061621 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 225/444] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:01 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:02.073443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.086643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.089440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.091141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.091576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.094230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.102263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ae916a9d-fa02-4913-b249-ce5d4e8a65a1 req-fa7d242f-4eda-4be3-8c11-82d98c57efc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea94c7be-d3dc-477b-8d97-6968a0f8e79b", "tag": "197dd283-c3f7-48a0-a880-f8d4ee9b6982"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:02.140427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ae916a9d-fa02-4913-b249-ce5d4e8a65a1 req-fa7d242f-4eda-4be3-8c11-82d98c57efc5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.142248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ae916a9d-fa02-4913-b249-ce5d4e8a65a1 req-fa7d242f-4eda-4be3-8c11-82d98c57efc5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.145295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ae916a9d-fa02-4913-b249-ce5d4e8a65a1 req-fa7d242f-4eda-4be3-8c11-82d98c57efc5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.184764 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ae916a9d-fa02-4913-b249-ce5d4e8a65a1 req-fa7d242f-4eda-4be3-8c11-82d98c57efc5 service nova] Creating event network-changed:197dd283-c3f7-48a0-a880-f8d4ee9b6982 for instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b on n-h1-857467-1 Sep 13 16:32:02.212321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ae916a9d-fa02-4913-b249-ce5d4e8a65a1 req-fa7d242f-4eda-4be3-8c11-82d98c57efc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110121 Sep 13 16:32:02.214849 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 226/445] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:32:02.256717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:02.268891 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e071926-180b-4dde-9e9f-f98a290bb7a2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1217 microversion: 2.1 time: 0.217426 Sep 13 16:32:02.280722 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 220/446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:02 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:02.613618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:02.615056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:02.624375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.625460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.625949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.627689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.628373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.629099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.844020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:02.855789 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48a2f02d-ba50-4304-9775-44190112e65a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.247916 Sep 13 16:32:02.856371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 227/447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:02 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:02.865215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:02.865869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:02.881166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.881675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.882136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.883167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:02.883634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:02.884065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:02.973951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b05bb1ab-1a0e-451d-84c1-8fcd67fca4df tempest-ListImageFiltersNegativeTestJSON-2074889134 tempest-ListImageFiltersNegativeTestJSON-2074889134-project] Calling method '.version_select at 0x7fbeb61c7940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:03.002394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b05bb1ab-1a0e-451d-84c1-8fcd67fca4df tempest-ListImageFiltersNegativeTestJSON-2074889134 tempest-ListImageFiltersNegativeTestJSON-2074889134-project] HTTP exception thrown: Image not found. Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b05bb1ab-1a0e-451d-84c1-8fcd67fca4df tempest-ListImageFiltersNegativeTestJSON-2074889134 tempest-ListImageFiltersNegativeTestJSON-2074889134-project] Request method failure captured: Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/images/fd321950-16f5-4c2b-9eb3-5a9ef74d7243 HTTP/1.1 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCCepfQuAfBvdko3ma0ELjuJqKoeovfR_7d5_bAC6GvkrTFQqGJbIDVRxLZOHYz_h6WC90N5RnlIRxHcOY7JAwhBebunQFVYcu8lg0CpEqo56bRMhX9rWLoCB1MgC76ofRBJW8QMPeDJQ-IBOBrODpgzWMy3W-Nb9hC2COMJxcU6c8 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 273ab40c70ff4110b3b7dff79cd357c3 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2074889134 Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:03.005416 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/273ab40c70ff4110b3b7dff79cd357c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_273ab40c70ff4110b3b7dff79cd357c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/273ab40c70ff4110b3b7dff79cd357c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/273ab40c70ff4110b3b7dff79cd357c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2074889134 Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 273ab40c70ff4110b3b7dff79cd357c3 Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2074889134 Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListImageFiltersNegativeTestJSON-2074889134-project Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 8bdb9a7cf71a40598be33da8326fbe99 Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2074889134-project Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'fd321950-16f5-4c2b-9eb3-5a9ef74d7243'} Sep 13 16:32:03.007251 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:32:03.008218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fd321950-16f5-4c2b-9eb3-5a9ef74d7243 Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:32:03.009661 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd321950-16f5-4c2b-9eb3-5a9ef74d7243 could not be found. Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:03.011079 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:32:03.012521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:03.014393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b05bb1ab-1a0e-451d-84c1-8fcd67fca4df tempest-ListImageFiltersNegativeTestJSON-2074889134 tempest-ListImageFiltersNegativeTestJSON-2074889134-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:03.015469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b05bb1ab-1a0e-451d-84c1-8fcd67fca4df tempest-ListImageFiltersNegativeTestJSON-2074889134 tempest-ListImageFiltersNegativeTestJSON-2074889134-project] 10.222.0.61 "GET /compute/v2.1/images/fd321950-16f5-4c2b-9eb3-5a9ef74d7243" status: 404 len: 62 microversion: 2.1 time: 0.336154 Sep 13 16:32:03.016030 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 221/448] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:32:02 2022] GET /compute/v2.1/images/fd321950-16f5-4c2b-9eb3-5a9ef74d7243 => generated 62 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:32:03.070127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:03.070725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:03.077044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:03.077448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.077978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.078415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.079697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.080264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.080783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.090949 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bffd236-249f-491b-87f0-7e1a4dd5675e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.232997 Sep 13 16:32:03.105877 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 228/449] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:02 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:03.156629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:03.168911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:03.170613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:03.172090 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3960b90c-c382-4520-94dd-4f1a9a1917d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1266 microversion: 2.25 time: 0.105891 Sep 13 16:32:03.174154 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 222/450] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:03 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:03.305090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:03.305708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:03.312082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.312654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.313003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.314028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.314788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.315226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.387136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:03.396470 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac410157-c8fb-47e5-8d25-dd2a37fbab20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1217 microversion: 2.1 time: 0.095137 Sep 13 16:32:03.397144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 229/451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:03 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:03.851885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Calling method '.version_select at 0x7fbeb5d19c10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:03.868714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.869161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.869481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.870830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.871865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.872949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.881913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:03.882602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:03.893958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.895216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.895668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.896387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:03.896846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:03.897266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:03.900026 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1994f601-abe1-4212-b920-fc370fa838fc tempest-AbsoluteLimitsTestJSON-1850587514 tempest-AbsoluteLimitsTestJSON-1850587514-project] 10.222.0.61 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.310215 Sep 13 16:32:03.911613 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 223/452] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Sep 13 16:32:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:04.118377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:04.119971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:04.129983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.131582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.132536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.133572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.134365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.135005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.329623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.339413 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a35f5a1-b30a-477d-a086-8040f8f65a23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.463444 Sep 13 16:32:04.341211 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 230/453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:03 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:04.351658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.358367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:04.358986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:04.361405 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2617088-2ef5-4847-a425-997ae53f608a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.248333 Sep 13 16:32:04.362438 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 224/454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:04 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:04.371419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.372521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.373132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.374077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.374694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.375276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.419637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:04.420712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:04.430804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.431958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.432552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.433423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:04.434062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:04.434982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:04.452875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.462946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.465413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.466554 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f1095fb-a353-47fd-9ed7-74e117ccc725 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1266 microversion: 2.25 time: 0.123977 Sep 13 16:32:04.477860 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 231/455] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:04 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:04.525654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:04.536950 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-313b826a-ad9a-4820-a63a-276412e78ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1217 microversion: 2.1 time: 0.120763 Sep 13 16:32:04.561016 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 225/456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:04 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:05.017038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89525b13-ba87-4376-9bb3-3b12332f41e1 tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-616149860", "id": 809230792, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:05.057925 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89525b13-ba87-4376-9bb3-3b12332f41e1 tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.256127 Sep 13 16:32:05.059934 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 232/457] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:32:04 2022] POST /compute/v2.1/flavors => generated 467 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:32:05.084639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-028bc05f-7efb-40c8-988a-759d89d31954 tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:05.292582 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-028bc05f-7efb-40c8-988a-759d89d31954 tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/809230792/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.215245 Sep 13 16:32:05.298658 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 226/458] 10.222.0.61 () {62 vars in 1262 bytes} [Tue Sep 13 16:32:05 2022] POST /compute/v2.1/flavors/809230792/os-extra_specs => generated 62 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:05.300829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:05.305285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4644ec93-02a6-47cc-adf4-a5011d85abd5 tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.330159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4644ec93-02a6-47cc-adf4-a5011d85abd5 tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/809230792" status: 202 len: 0 microversion: 2.86 time: 0.027848 Sep 13 16:32:05.330628 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 227/459] 10.222.0.61 () {60 vars in 1199 bytes} [Tue Sep 13 16:32:05 2022] DELETE /compute/v2.1/flavors/809230792 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:32:05.339995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45bdb6b6-e65a-4360-a2c4-aa04396c033a tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.368020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45bdb6b6-e65a-4360-a2c4-aa04396c033a tempest-FlavorMetadataValidation-2042922100 tempest-FlavorMetadataValidation-2042922100-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.032643 Sep 13 16:32:05.369013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 228/460] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:05.373685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.374492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:05.382033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.382535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.382981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.384340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.384977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.385564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.523626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd507d87-ce50-4c9e-8153-8d631e581a50 tempest-ListImagesTestJSON-1733024347 tempest-ListImagesTestJSON-1733024347-project] Calling method '.version_select at 0x7fbeb5a71ee0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.614251 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd507d87-ce50-4c9e-8153-8d631e581a50 tempest-ListImagesTestJSON-1733024347 tempest-ListImagesTestJSON-1733024347-project] 10.222.0.61 "GET /compute/v2.1/images/5853c870-0393-4bca-bd0a-d3ea26765a2c" status: 200 len: 784 microversion: 2.1 time: 0.357414 Sep 13 16:32:05.615176 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 233/461] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/images/5853c870-0393-4bca-bd0a-d3ea26765a2c => generated 784 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:05.623444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.624622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:05.633663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.634848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.635505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.636375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.637278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.638097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.648188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:05.675406 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e353d855-f372-4fcf-bc0a-e160fcd12c38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.304919 Sep 13 16:32:05.676271 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 229/462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:05.693991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.695944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:05.716364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.717390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.717782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.719147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.731011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.733539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.819911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:05.830175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:05.832560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:05.834205 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e95b54c3-11a3-42de-9159-9c238f33a15d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1322 microversion: 2.25 time: 0.156527 Sep 13 16:32:05.835041 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 230/463] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:05.840595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:05.842702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:05.851087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.851752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.852370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.853404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:05.854065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:05.854658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:05.941507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:05.955070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf66c3b8-3798-4f59-9b42-fac93d9b787e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1209 microversion: 2.1 time: 0.118568 Sep 13 16:32:05.955991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 231/464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:05.960874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ae220f56-d2ba-4dc7-9df0-de670a6c572c tempest-ListImagesTestJSON-1733024347 tempest-ListImagesTestJSON-1733024347-project] Calling method '.version_select at 0x7fbeb5d19430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:06.062939 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ae220f56-d2ba-4dc7-9df0-de670a6c572c tempest-ListImagesTestJSON-1733024347 tempest-ListImagesTestJSON-1733024347-project] 10.222.0.61 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.105503 Sep 13 16:32:06.072966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 232/465] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/images => generated 445 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:06.079815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69bc1028-4620-4d43-9302-27c1cfbb3282 tempest-ListImagesTestJSON-1733024347 tempest-ListImagesTestJSON-1733024347-project] Calling method '.version_select at 0x7fbeb5bf94c0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:06.150996 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69bc1028-4620-4d43-9302-27c1cfbb3282 tempest-ListImagesTestJSON-1733024347 tempest-ListImagesTestJSON-1733024347-project] 10.222.0.61 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.076329 Sep 13 16:32:06.151901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 233/466] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:32:06 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:06.484471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:06.497676 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca11122e-0557-43a8-baaa-68b016d8b591 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.879872 Sep 13 16:32:06.498407 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 234/467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:05 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:06.698707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:06.699338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:06.710881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:06.711391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:06.711828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:06.714456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:06.716733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:06.717383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:06.864699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:06.865511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:06.880269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:06.882212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:06.883221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:06.884413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:06.885207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:06.886124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.042790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:07.056648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:07.060133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:07.061618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc127e8e-fc17-4f94-aa3a-7bc782cefa76 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1320 microversion: 2.25 time: 0.203770 Sep 13 16:32:07.063700 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 235/468] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:06 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:07.070937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:07.072709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:07.083374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.085079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.089894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.091847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.092603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.093289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.157547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:07.166939 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-369501f0-9968-4bb3-ab44-9c5105bd85d0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.472233 Sep 13 16:32:07.182915 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 234/469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:06 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:07.227157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:07.239005 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-87661fda-9c2c-42ef-98f0-f7f683cf8ee5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1265 microversion: 2.1 time: 0.173704 Sep 13 16:32:07.239663 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 236/470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:07 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:07.390481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-49b3de68-b0b1-4e04-b5a2-96f059f6d0c2 req-faebdca1-0942-451b-bc64-e0333a232e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0272cbd-8228-4707-9a6b-8781acb6cde6", "tag": "3e05a151-0e1f-45e9-b3a0-919f9626ba5c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:07.418680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49b3de68-b0b1-4e04-b5a2-96f059f6d0c2 req-faebdca1-0942-451b-bc64-e0333a232e96 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.419177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49b3de68-b0b1-4e04-b5a2-96f059f6d0c2 req-faebdca1-0942-451b-bc64-e0333a232e96 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.427222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49b3de68-b0b1-4e04-b5a2-96f059f6d0c2 req-faebdca1-0942-451b-bc64-e0333a232e96 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.465917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-49b3de68-b0b1-4e04-b5a2-96f059f6d0c2 req-faebdca1-0942-451b-bc64-e0333a232e96 service nova] Creating event network-changed:3e05a151-0e1f-45e9-b3a0-919f9626ba5c for instance f0272cbd-8228-4707-9a6b-8781acb6cde6 on n-h2-857467-1 Sep 13 16:32:07.473135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-49b3de68-b0b1-4e04-b5a2-96f059f6d0c2 req-faebdca1-0942-451b-bc64-e0333a232e96 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086416 Sep 13 16:32:07.474305 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 235/471] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:07.527105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:07.529128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:07.538111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.539156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.540387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:07.541353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:07.542058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:07.542779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.092001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:08.093316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:08.100455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.100870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.101313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.102433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.103065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.103800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.227065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.239735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.262347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.266042 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ddf53646-4f12-4c9a-a00a-806125b28bd9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1320 microversion: 2.25 time: 0.177175 Sep 13 16:32:08.268736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 236/472] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:08 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:08.288396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:08.289599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:08.310345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.312777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.315761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.321235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.325844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.326496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.414675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.418107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:08.423580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a878b88-d407-4862-b678-36ae53c18180 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.900689 Sep 13 16:32:08.435509 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 237/473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:07 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:08.442316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:08.450930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:08.458235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.458876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.459148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.459855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:08.470699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:08.471195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:08.715731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.735302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e27aa971-ea33-4200-86ef-8e52c4526db6 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1271 microversion: 2.1 time: 0.296302 Sep 13 16:32:08.742459 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 238/474] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:08 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:08.954399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:08.971302 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-afccfa32-cb83-40f7-a9ca-b865ce54e14c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.700632 Sep 13 16:32:08.973492 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 237/475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:08 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:09.292733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:09.293696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:09.301741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=24 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:09.307530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.309046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.310362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.313660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.314347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.314823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.451501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:09.452253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:09.464628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.465351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.466982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.467823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.476621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.477451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.738647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:09.764514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-84af135b-5d98-4c62-abe3-d931c9be4f55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.317130 Sep 13 16:32:09.780648 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 238/476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:09 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:09.795197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:09.796138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:09.804810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.805609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.807020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.808246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:09.809173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:09.809798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:09.843945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:09.926340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:09.943902 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4524b322-fc0b-4dc6-946c-60beba715810 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1271 microversion: 2.1 time: 0.155389 Sep 13 16:32:09.944593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 239/477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:09 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:10.231541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:10.247453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:10.252520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:10.255559 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-915abc7c-ebbd-4ebd-bd97-12921774d7f9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.966174 Sep 13 16:32:10.257222 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 239/478] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:09 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:10.265321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:10.266396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:10.276709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:10.278004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:10.278725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:10.280540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:10.281309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:10.282381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:10.370324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Calling method '.version_select at 0x7fbeb5b79820>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:10.404191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:10.405138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:10.406574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:10.408167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:10.408844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:10.409535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:10.428869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=84,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:10.439779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e44d8bb-8caa-414e-a307-b8c71915f382 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] 10.222.0.61 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.493587 Sep 13 16:32:10.446097 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 240/479] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Sep 13 16:32:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:10.448052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b9d85c97-73d6-49e3-81a3-57dc84c07666 req-437f43c5-d822-4ba0-92b9-febe2f77dabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea94c7be-d3dc-477b-8d97-6968a0f8e79b", "name": "network-vif-plugged", "status": "completed", "tag": "197dd283-c3f7-48a0-a880-f8d4ee9b6982"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:10.493717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b9d85c97-73d6-49e3-81a3-57dc84c07666 req-437f43c5-d822-4ba0-92b9-febe2f77dabd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:10.498072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b9d85c97-73d6-49e3-81a3-57dc84c07666 req-437f43c5-d822-4ba0-92b9-febe2f77dabd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:10.498743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b9d85c97-73d6-49e3-81a3-57dc84c07666 req-437f43c5-d822-4ba0-92b9-febe2f77dabd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:10.521900 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b9d85c97-73d6-49e3-81a3-57dc84c07666 req-437f43c5-d822-4ba0-92b9-febe2f77dabd service nova] Creating event network-vif-plugged:197dd283-c3f7-48a0-a880-f8d4ee9b6982 for instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b on n-h1-857467-1 Sep 13 16:32:10.530420 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b9d85c97-73d6-49e3-81a3-57dc84c07666 req-437f43c5-d822-4ba0-92b9-febe2f77dabd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088261 Sep 13 16:32:10.531394 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 241/480] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:10.712206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-852447543", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:10.856953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:32:11.226539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:11.238910 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39ac7705-2517-44bc-b58a-152f39f5aa01 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.978477 Sep 13 16:32:11.239944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 240/481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:10 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:11.246975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:11.249959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:11.271607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.272366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.273819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.280308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.281352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.281975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.358137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Getting quotas for project 4a0aea6c6a164df6baa6ebc5e272d58b. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:11.363848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Getting quotas for user 36566b353f8e48058565346e4585debd and project 4a0aea6c6a164df6baa6ebc5e272d58b. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:11.378463 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Request method failure captured: Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 1751 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCJF0yPpBpetd-FOfz4DwBYbzzukJac0cxhbE0AsFufZ_tay0PkLxxHoqFwGndMMTV0Q9fedXIV8PfXDf2Sx2sAl8EAcbJDFrtXNiXbLAfdImrlS-xbUitcypkkJoGmBH3eDF5e1xMkCfluWOSZnVlppdGj_QJB7BcF6_cff-ZuzBM Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 4a0aea6c6a164df6baa6ebc5e272d58b Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-97947542 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4a0aea6c6a164df6baa6ebc5e272d58b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4a0aea6c6a164df6baa6ebc5e272d58b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4a0aea6c6a164df6baa6ebc5e272d58b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4a0aea6c6a164df6baa6ebc5e272d58b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-97947542 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 4a0aea6c6a164df6baa6ebc5e272d58b Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-97947542 Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-97947542-project Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 36566b353f8e48058565346e4585debd Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-97947542-project Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-852447543", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:32:11.382035 n-d-857467-1 devstack@n-api.service[122328]: exception: Maximum number of metadata items exceeds 128 Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-852447543', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:32:11.384091 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d123b9dd-d585-4d63-b478-a49f329d0990 tempest-AbsoluteLimitsNegativeTestJSON-97947542 tempest-AbsoluteLimitsNegativeTestJSON-97947542-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.680036 Sep 13 16:32:11.387626 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 242/482] 10.222.0.61 () {60 vars in 1148 bytes} [Tue Sep 13 16:32:10 2022] POST /compute/v2.1/servers => generated 87 bytes in 682 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:32:11.395866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:11.396624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:11.403950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.404452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.404896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.405609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.406104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.406538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.633942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:11.648440 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68f02d00-6c17-40a1-bf47-aa6c1bab5a0e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.262974 Sep 13 16:32:11.649035 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 243/483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:11 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:11.897159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97c8778a-49fb-40de-97de-f8a8f9cc9f01 tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-381835343", "id": 754989950, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:11.924969 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97c8778a-49fb-40de-97de-f8a8f9cc9f01 tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.274664 Sep 13 16:32:11.934513 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 244/484] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:32:11 2022] POST /compute/v2.1/flavors => generated 445 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:32:11.940190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:11.940810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:11.947427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.947932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.948541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.949288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:11.950104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:11.950755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:11.983387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:11.992894 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ce5573b-378a-46e3-905f-e988413f7f82 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.751896 Sep 13 16:32:11.997085 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 241/485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:11 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:12.002654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b78d5740-24fd-4a73-b602-10c0d9ff22c7 req-76102556-e0b1-42d8-946b-8615877f6f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:12.014409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b78d5740-24fd-4a73-b602-10c0d9ff22c7 req-76102556-e0b1-42d8-946b-8615877f6f7b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.014913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b78d5740-24fd-4a73-b602-10c0d9ff22c7 req-76102556-e0b1-42d8-946b-8615877f6f7b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.015357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b78d5740-24fd-4a73-b602-10c0d9ff22c7 req-76102556-e0b1-42d8-946b-8615877f6f7b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.031038 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b78d5740-24fd-4a73-b602-10c0d9ff22c7 req-76102556-e0b1-42d8-946b-8615877f6f7b service nova] Creating event network-changed:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:32:12.037687 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b78d5740-24fd-4a73-b602-10c0d9ff22c7 req-76102556-e0b1-42d8-946b-8615877f6f7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038775 Sep 13 16:32:12.038703 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 242/486] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:12.205505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7c2f5ae-8b97-4734-94c7-dce644256044 tempest-FlavorsV255TestJSON-1013349242 tempest-FlavorsV255TestJSON-1013349242-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.216008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7c2f5ae-8b97-4734-94c7-dce644256044 tempest-FlavorsV255TestJSON-1013349242 tempest-FlavorsV255TestJSON-1013349242-project] 10.222.0.61 "GET /compute/v2.1/flavors/754989950" status: 200 len: 445 microversion: 2.55 time: 0.175315 Sep 13 16:32:12.216907 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 243/487] 10.222.0.61 () {60 vars in 1196 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/flavors/754989950 => generated 445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:32:12.232927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5cc5a22-374a-4e81-90e1-08d7503a16c8 tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:12.248456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:12.252587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:12.263490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:12.264483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5cc5a22-374a-4e81-90e1-08d7503a16c8 tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/754989950" status: 200 len: 446 microversion: 2.55 time: 0.037371 Sep 13 16:32:12.265308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 244/488] 10.222.0.61 () {62 vars in 1216 bytes} [Tue Sep 13 16:32:12 2022] PUT /compute/v2.1/flavors/754989950 => generated 446 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:32:12.269545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:12.273373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.274420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:12.274978 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-157a09c5-d2b6-4ca2-afcf-5c3111467268 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.339250 Sep 13 16:32:12.275693 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 245/489] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:11 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:12.298477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0cbd8613-5162-4dad-a545-f3ee099a3d03 tempest-FlavorsV255TestJSON-1013349242 tempest-FlavorsV255TestJSON-1013349242-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.302444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.302929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.305974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.308791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.309238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.309694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.375152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0cbd8613-5162-4dad-a545-f3ee099a3d03 tempest-FlavorsV255TestJSON-1013349242 tempest-FlavorsV255TestJSON-1013349242-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.097487 Sep 13 16:32:12.380640 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 246/490] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:12.394080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e871a0f4-7807-4aa3-bcfe-ba691b68aa91 req-81e445e6-03eb-487f-a885-154c77847534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378220d4-c1e6-4b23-984a-f0151aa19039", "tag": "3f72e4f3-3cf0-4a5b-972a-e784bddb2960"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:12.432745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e871a0f4-7807-4aa3-bcfe-ba691b68aa91 req-81e445e6-03eb-487f-a885-154c77847534 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.444178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e871a0f4-7807-4aa3-bcfe-ba691b68aa91 req-81e445e6-03eb-487f-a885-154c77847534 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.444872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e871a0f4-7807-4aa3-bcfe-ba691b68aa91 req-81e445e6-03eb-487f-a885-154c77847534 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.472486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e871a0f4-7807-4aa3-bcfe-ba691b68aa91 req-81e445e6-03eb-487f-a885-154c77847534 service nova] Creating event network-changed:3f72e4f3-3cf0-4a5b-972a-e784bddb2960 for instance 378220d4-c1e6-4b23-984a-f0151aa19039 on n-h2-857467-1 Sep 13 16:32:12.492899 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e871a0f4-7807-4aa3-bcfe-ba691b68aa91 req-81e445e6-03eb-487f-a885-154c77847534 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107018 Sep 13 16:32:12.493895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 247/491] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:12.527772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b003dc0-eb06-4cdb-8876-c6a85d1929a0 tempest-FlavorsV255TestJSON-1013349242 tempest-FlavorsV255TestJSON-1013349242-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.570835 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b003dc0-eb06-4cdb-8876-c6a85d1929a0 tempest-FlavorsV255TestJSON-1013349242 tempest-FlavorsV255TestJSON-1013349242-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.071519 Sep 13 16:32:12.572024 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 248/492] 10.222.0.61 () {60 vars in 1166 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:12.595484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97411f18-a219-43c3-b832-f66ac2771aa8 tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.634438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97411f18-a219-43c3-b832-f66ac2771aa8 tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/754989950" status: 202 len: 0 microversion: 2.55 time: 0.048435 Sep 13 16:32:12.636983 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 249/493] 10.222.0.61 () {60 vars in 1199 bytes} [Tue Sep 13 16:32:12 2022] DELETE /compute/v2.1/flavors/754989950 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:32:12.644624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03eecfd1-989a-4379-8b1e-2a5fb7eccc0f tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.668199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03eecfd1-989a-4379-8b1e-2a5fb7eccc0f tempest-FlavorsV255TestJSON-2051498148 tempest-FlavorsV255TestJSON-2051498148-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.027709 Sep 13 16:32:12.683623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 250/494] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:12.693469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:12.694486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:12.702224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.703037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.703812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:12.704907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:12.705707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:12.706372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.092520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.101392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9003eb8b-f51d-4732-9557-e52a95986b31 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.416474 Sep 13 16:32:13.103716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 251/495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:13.112822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:13.115317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:13.129802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:13.130358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:13.131056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.135944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:13.136622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:13.138839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.222733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.239144 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-61a848e5-9029-4c37-b61f-02524355f0bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1317 microversion: 2.1 time: 0.972595 Sep 13 16:32:13.239741 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 245/496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:12 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:13.301390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:13.302060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:13.317447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:13.318284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:13.318442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.319185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:13.319544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:13.319967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:13.406076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.416631 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fad95fc0-8259-40a1-849a-3d6f080c1e4f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.306439 Sep 13 16:32:13.417489 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 252/497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:13 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:13.899476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.939344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.944397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:13.946894 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5923a92f-c8cb-4c18-8174-43c2520df764 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.649862 Sep 13 16:32:13.950218 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 246/498] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:13 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:14.132416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:14.133047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:14.142716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.143066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.143516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.146124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.146776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.147397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.264278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:14.265908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:14.281450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.282427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.283135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.285451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.286353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.287491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.359599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:14.370316 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9afd7ea6-de73-4059-8d4b-301eefcb9e9d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.242795 Sep 13 16:32:14.371426 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 253/499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:14 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:14.441924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:14.442777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:14.449114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.450334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.451002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.451931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.452595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.453407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.872560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:14.884061 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0920d703-af4d-41bc-8789-b57eaed9dcf8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.448318 Sep 13 16:32:14.899527 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 254/500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:14 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:14.913800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:14.923045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d7f8a3e3-03f5-485b-8fbe-15f677b1171f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1467 microversion: 2.1 time: 0.663301 Sep 13 16:32:14.923874 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 247/501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:14 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1467 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:14.976330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:14.976939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:14.983310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.983972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.984588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:14.985495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:14.985972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:14.986578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.326403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:15.343026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:15.344504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:15.345985 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-437434b7-2a31-4651-8423-7a82604e4ceb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.373506 Sep 13 16:32:15.346970 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 248/502] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:14 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:15.350437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:15.351841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:15.362243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.362745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.363182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.363900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.364354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.364779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.397201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:15.397936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:15.407063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.407655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.407970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.411446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.412166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.412819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.738302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:15.750203 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a648961-e402-42f7-beb1-8b20164b0300 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.354868 Sep 13 16:32:15.751516 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 249/503] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:15 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:15.761751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-79de93d4-7d4d-4803-8625-708828a3c9e3 req-1b2e8041-1c30-4feb-a7c4-d6c5d5273ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0df885-185c-4351-bd0e-c3c13774f815", "tag": "0cf241fd-8101-4e4e-9dbe-3fd46afa5365"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:15.786034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-79de93d4-7d4d-4803-8625-708828a3c9e3 req-1b2e8041-1c30-4feb-a7c4-d6c5d5273ed0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.788125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-79de93d4-7d4d-4803-8625-708828a3c9e3 req-1b2e8041-1c30-4feb-a7c4-d6c5d5273ed0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.788745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-79de93d4-7d4d-4803-8625-708828a3c9e3 req-1b2e8041-1c30-4feb-a7c4-d6c5d5273ed0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.817432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-79de93d4-7d4d-4803-8625-708828a3c9e3 req-1b2e8041-1c30-4feb-a7c4-d6c5d5273ed0 service nova] Creating event network-changed:0cf241fd-8101-4e4e-9dbe-3fd46afa5365 for instance 5b0df885-185c-4351-bd0e-c3c13774f815 on n-h2-857467-1 Sep 13 16:32:15.831908 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-79de93d4-7d4d-4803-8625-708828a3c9e3 req-1b2e8041-1c30-4feb-a7c4-d6c5d5273ed0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078524 Sep 13 16:32:15.832809 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 250/504] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:15.909782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:15.910808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:15.920891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.924813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.925257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:15.926181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:15.928272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:15.928872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.010437 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-648bc6fb-f621-456d-88db-9c4a1429e5c7 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1618 microversion: 2.1 time: 1.063972 Sep 13 16:32:16.014484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 255/505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:14 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1618 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:16.048610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3417885b-845f-422f-891c-7bd0f6f51e9d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: .version_select at 0x7fbeb5d19310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-347910639", "policies": ["affinity"]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:16.086628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-3417885b-845f-422f-891c-7bd0f6f51e9d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:16.105462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-3417885b-845f-422f-891c-7bd0f6f51e9d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:16.191087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-3417885b-845f-422f-891c-7bd0f6f51e9d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:16.204958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-3417885b-845f-422f-891c-7bd0f6f51e9d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:16.232022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3417885b-845f-422f-891c-7bd0f6f51e9d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.192099 Sep 13 16:32:16.245137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:16.247645 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 256/506] 10.222.0.61 () {60 vars in 1174 bytes} [Tue Sep 13 16:32:16 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 13 16:32:16.255566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-141bba79-7e9a-4863-882f-097902b3299c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 0.350411 Sep 13 16:32:16.257796 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 251/507] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:15 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:16.328700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-260ae2e1-cd09-4d41-8199-c14f5ebaabb0 req-ac07b9b1-6b79-4ce4-a475-5f766b067ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0272cbd-8228-4707-9a6b-8781acb6cde6", "name": "network-vif-plugged", "status": "completed", "tag": "3e05a151-0e1f-45e9-b3a0-919f9626ba5c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:16.346614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-260ae2e1-cd09-4d41-8199-c14f5ebaabb0 req-ac07b9b1-6b79-4ce4-a475-5f766b067ad1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.347739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-260ae2e1-cd09-4d41-8199-c14f5ebaabb0 req-ac07b9b1-6b79-4ce4-a475-5f766b067ad1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.348448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-260ae2e1-cd09-4d41-8199-c14f5ebaabb0 req-ac07b9b1-6b79-4ce4-a475-5f766b067ad1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.389489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:16.390685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:16.414675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.415725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.415876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.416759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.417412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.418088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.430087 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-260ae2e1-cd09-4d41-8199-c14f5ebaabb0 req-ac07b9b1-6b79-4ce4-a475-5f766b067ad1 service nova] Creating event network-vif-plugged:3e05a151-0e1f-45e9-b3a0-919f9626ba5c for instance f0272cbd-8228-4707-9a6b-8781acb6cde6 on n-h2-857467-1 Sep 13 16:32:16.442709 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-260ae2e1-cd09-4d41-8199-c14f5ebaabb0 req-ac07b9b1-6b79-4ce4-a475-5f766b067ad1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117910 Sep 13 16:32:16.446569 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 257/508] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:16.463768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-305740566", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "673962af-7385-446a-8995-effa05af0d17"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:16.557838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:32:16.797669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:16.808493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:16.815146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:16.819464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9fc5f6e9-1052-43be-8cb1-d0a58a9ce8bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.448308 Sep 13 16:32:16.821052 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 252/509] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:16 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:16.827242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:16.832385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:16.862876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.863812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.865606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:16.866793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:16.870043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:16.871929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.332231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:17.347321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f690180a-541e-4cd2-94ba-9e6cf46cc7e7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.524945 Sep 13 16:32:17.348054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 253/510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:16 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:17.353153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:17.357543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:17.372987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:17.378900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:17.379596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.381340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:17.383112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:17.383644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.409288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:32:17.412249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:32:17.413109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:32:17.414162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:32:17.414594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:32:17.482302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:17.482950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:17.483205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.483937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:17.484394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:17.484854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:17.505442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:17.511720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:17.525972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Going to run 2 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:32:17.529179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:17.574292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122328) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 13 16:32:17.596068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:17.602544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:17.610930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:17.682345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:17.689700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:17.718049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=b984a09d-0655-47e7-9ede-734c8f6c11d2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:17.799893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:17.813649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:17.878113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:17.885728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:17.944406 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8c6b9ae-7371-4481-9b6e-d23fcec9b5a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.495457 Sep 13 16:32:17.948896 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 258/511] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:32:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1502 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:32:18.327354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9c80a50-94f5-4892-b3ed-2660afd13e63 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Calling method '.version_select at 0x7fbeb5ac9e50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:18.329773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d9c80a50-94f5-4892-b3ed-2660afd13e63 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '787a0a4f827c41b491b7dcfcc959ab18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6278e6b137e84a90912622ab0e113d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9c80a50-94f5-4892-b3ed-2660afd13e63 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Request method failure captured: Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCQUyQe23twDiw7jL31nFUSmXth3jRhIiamLtFxofde1R1oQ_TGqIDUOnJ4VD669t6o_rRm-RmgOcyD6atZxs-x7rDujoFGPoSehGW2nMIJRl4x8ema0tWTo3s4JnTx4__voxh8MIvr6s7Bp9PpY4iWBNfq6wnz7_xXZ5nyAczQ6OM Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 787a0a4f827c41b491b7dcfcc959ab18 Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 13 16:32:18.332848 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 13 16:32:18.337644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:18.341437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9c80a50-94f5-4892-b3ed-2660afd13e63 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:18.344156 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d9c80a50-94f5-4892-b3ed-2660afd13e63 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.392870 Sep 13 16:32:18.345388 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 259/512] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 16:32:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 396 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:18.355183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:18.355884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:18.365147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.365881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.366586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.367722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.368272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.368887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.484295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.495029 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0bb25b86-8a67-4ade-b1be-d9adb2e746a1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 1.145692 Sep 13 16:32:18.495713 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 254/513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:17 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:18.512297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:18.543259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.546787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Searching by: {'deleted': False, 'project_id': 'ade763eb224a494f86d28a38ca26c17a'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:32:18.598612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.601268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.602094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.604013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.605509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.606413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.759328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.787331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.795635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.818782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d05859b-1909-4505-b2b6-34b74116ed72 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.468847 Sep 13 16:32:18.834093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 260/514] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:18 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:18.850361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f90ee9b-ab79-43df-a8e0-4b4afbebc185 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Calling method '.version_select at 0x7fbeb5ac9700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:18.856801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f90ee9b-ab79-43df-a8e0-4b4afbebc185 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '787a0a4f827c41b491b7dcfcc959ab18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6278e6b137e84a90912622ab0e113d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f90ee9b-ab79-43df-a8e0-4b4afbebc185 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Request method failure captured: Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCQUyQe23twDiw7jL31nFUSmXth3jRhIiamLtFxofde1R1oQ_TGqIDUOnJ4VD669t6o_rRm-RmgOcyD6atZxs-x7rDujoFGPoSehGW2nMIJRl4x8ema0tWTo3s4JnTx4__voxh8MIvr6s7Bp9PpY4iWBNfq6wnz7_xXZ5nyAczQ6OM Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 787a0a4f827c41b491b7dcfcc959ab18 Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 13 16:32:18.864814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 13 16:32:18.869411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:18.871371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f90ee9b-ab79-43df-a8e0-4b4afbebc185 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:18.878110 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f90ee9b-ab79-43df-a8e0-4b4afbebc185 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.049277 Sep 13 16:32:18.880291 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 261/515] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:32:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:18.896071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:18.896701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:18.912814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.915691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.916125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.916875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:18.918600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:18.919582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:18.935878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:32:19.097367 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1203cf5f-6810-4a95-830f-58901f013c60 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.597008 Sep 13 16:32:19.098050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 255/516] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:32:18 2022] GET /compute/v2.1/servers => generated 1002 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:19.109154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c798a0e4-b843-4d82-b9f2-f315bf101046 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Calling method '.version_select at 0x7fbeb5a73940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.113649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c798a0e4-b843-4d82-b9f2-f315bf101046 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '787a0a4f827c41b491b7dcfcc959ab18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6278e6b137e84a90912622ab0e113d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c798a0e4-b843-4d82-b9f2-f315bf101046 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Request method failure captured: Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILCQUyQe23twDiw7jL31nFUSmXth3jRhIiamLtFxofde1R1oQ_TGqIDUOnJ4VD669t6o_rRm-RmgOcyD6atZxs-x7rDujoFGPoSehGW2nMIJRl4x8ema0tWTo3s4JnTx4__voxh8MIvr6s7Bp9PpY4iWBNfq6wnz7_xXZ5nyAczQ6OM Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 787a0a4f827c41b491b7dcfcc959ab18 Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: action_args: {} Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.117333 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.122108 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.122108 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.122108 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:32:19.122108 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:32:19.122108 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 13 16:32:19.122108 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.127415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c798a0e4-b843-4d82-b9f2-f315bf101046 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:19.134589 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c798a0e4-b843-4d82-b9f2-f315bf101046 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.029418 Sep 13 16:32:19.137093 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 256/517] 10.222.0.61 () {58 vars in 1179 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:19.150457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a195f3c-6343-407e-b237-cd972277ea52 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.151536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a195f3c-6343-407e-b237-cd972277ea52 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:19.229527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:19.240435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-699fdace-8c66-45a2-930c-2f0079a0d670 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.356433 Sep 13 16:32:19.247392 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 262/518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:18 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:19.401326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Calling method '.version_select at 0x7fbeb5a04ca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.407691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.408662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.408797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.451881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.452381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.452813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.477397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.477919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.478359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.487304 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97313c0e-1d82-43c9-a963-48485461f3a0 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.236306 Sep 13 16:32:19.493888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 263/519] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:19.506181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b3b1e00-d8ed-4169-ae0d-c83d026d9079 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Calling method '.version_select at 0x7fbeb5a049d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.506433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a195f3c-6343-407e-b237-cd972277ea52 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:19.507977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b3b1e00-d8ed-4169-ae0d-c83d026d9079 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '787a0a4f827c41b491b7dcfcc959ab18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6278e6b137e84a90912622ab0e113d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b3b1e00-d8ed-4169-ae0d-c83d026d9079 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Request method failure captured: Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCQUyQe23twDiw7jL31nFUSmXth3jRhIiamLtFxofde1R1oQ_TGqIDUOnJ4VD669t6o_rRm-RmgOcyD6atZxs-x7rDujoFGPoSehGW2nMIJRl4x8ema0tWTo3s4JnTx4__voxh8MIvr6s7Bp9PpY4iWBNfq6wnz7_xXZ5nyAczQ6OM Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 787a0a4f827c41b491b7dcfcc959ab18 Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1'} Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.512305 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b3b1e00-d8ed-4169-ae0d-c83d026d9079 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:19.519022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b3b1e00-d8ed-4169-ae0d-c83d026d9079 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018688 Sep 13 16:32:19.520353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a195f3c-6343-407e-b237-cd972277ea52 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1218 microversion: 2.1 time: 0.379869 Sep 13 16:32:19.520353 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 257/520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1218 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:19.535547 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 264/521] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:19.540153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.540778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:19.552679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca5337f9-7c5e-4b9d-a091-86c94792db73 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Calling method '.version_select at 0x7fbeb59f6b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.554601 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ca5337f9-7c5e-4b9d-a091-86c94792db73 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] HTTP exception thrown: Hypervisor with ID '4b7b84dd-b004-455e-a14a-65bf6e456bad' could not be found. Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca5337f9-7c5e-4b9d-a091-86c94792db73 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Request method failure captured: Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hypervisors/4b7b84dd-b004-455e-a14a-65bf6e456bad/uptime HTTP/1.1 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCRnlzN1kxvDmhSSPhG6-kF4gsiGchxP_DUtd6TwjLVpPcJ9lC0kRt7XyKpDLIPCGGgMhYGL-7Ego2s0PskhejKnqulPv0vcFrkf3h97FrNgWg7H9eK5A4DCmRWNQvCKR3zgQLdwd7njn4p_7S82AUiV0dv-gW5rPmtnnk8kOaL0fg Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 0c790a21428043e59f88dcdae9f41243 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-544677140 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c790a21428043e59f88dcdae9f41243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c790a21428043e59f88dcdae9f41243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c790a21428043e59f88dcdae9f41243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c790a21428043e59f88dcdae9f41243"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-544677140 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 0c790a21428043e59f88dcdae9f41243 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-544677140 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c2cf909bebb48d3a0b72fc66531ae84 Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: exception: Hypervisor with ID '4b7b84dd-b004-455e-a14a-65bf6e456bad' could not be found. Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4b7b84dd-b004-455e-a14a-65bf6e456bad'} Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4b7b84dd-b004-455e-a14a-65bf6e456bad' Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:19.567041 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4b7b84dd-b004-455e-a14a-65bf6e456bad' could not be found. Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4b7b84dd-b004-455e-a14a-65bf6e456bad' could not be found. Sep 13 16:32:19.571548 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.572601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.572601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.572601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.572601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.572601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.573024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.573893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca5337f9-7c5e-4b9d-a091-86c94792db73 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Returning 404 to user: Hypervisor with ID '4b7b84dd-b004-455e-a14a-65bf6e456bad' could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:19.574952 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca5337f9-7c5e-4b9d-a091-86c94792db73 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/4b7b84dd-b004-455e-a14a-65bf6e456bad/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038295 Sep 13 16:32:19.576540 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 265/522] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors/4b7b84dd-b004-455e-a14a-65bf6e456bad/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:19.587367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Calling method '.version_select at 0x7fbeb62fd670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.589247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.589942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.590315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.605545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.606359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.607050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.621589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.622318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.622911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.652772 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28935c23-d2da-468d-b4fe-ecb195d9cb96 tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066572 Sep 13 16:32:19.653812 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 266/523] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:32:19.665467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba3966cf-db10-4126-b1ca-7660a5d29ab9 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Calling method '.version_select at 0x7fbeb59f6280>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.667597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba3966cf-db10-4126-b1ca-7660a5d29ab9 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '787a0a4f827c41b491b7dcfcc959ab18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6278e6b137e84a90912622ab0e113d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba3966cf-db10-4126-b1ca-7660a5d29ab9 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Request method failure captured: Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCQUyQe23twDiw7jL31nFUSmXth3jRhIiamLtFxofde1R1oQ_TGqIDUOnJ4VD669t6o_rRm-RmgOcyD6atZxs-x7rDujoFGPoSehGW2nMIJRl4x8ema0tWTo3s4JnTx4__voxh8MIvr6s7Bp9PpY4iWBNfq6wnz7_xXZ5nyAczQ6OM Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6278e6b137e84a90912622ab0e113d4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6278e6b137e84a90912622ab0e113d4e Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 787a0a4f827c41b491b7dcfcc959ab18 Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1374899971-project Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1'} Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 13 16:32:19.669521 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 13 16:32:19.674198 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.675691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba3966cf-db10-4126-b1ca-7660a5d29ab9 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:19.676731 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba3966cf-db10-4126-b1ca-7660a5d29ab9 tempest-HypervisorAdminNegativeTestJSON-1374899971 tempest-HypervisorAdminNegativeTestJSON-1374899971-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015671 Sep 13 16:32:19.677444 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 267/524] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:19.706947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43bee73a-1a36-4dd2-b5c9-4427f173cb6f tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Calling method '.version_select at 0x7fbeb5ac9040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.712609 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-43bee73a-1a36-4dd2-b5c9-4427f173cb6f tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] HTTP exception thrown: Hypervisor with ID '70d5c6c3-9dd5-448f-8e46-5e002119df6b' could not be found. Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43bee73a-1a36-4dd2-b5c9-4427f173cb6f tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Request method failure captured: Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hypervisors/70d5c6c3-9dd5-448f-8e46-5e002119df6b HTTP/1.1 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCRnlzN1kxvDmhSSPhG6-kF4gsiGchxP_DUtd6TwjLVpPcJ9lC0kRt7XyKpDLIPCGGgMhYGL-7Ego2s0PskhejKnqulPv0vcFrkf3h97FrNgWg7H9eK5A4DCmRWNQvCKR3zgQLdwd7njn4p_7S82AUiV0dv-gW5rPmtnnk8kOaL0fg Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 0c790a21428043e59f88dcdae9f41243 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-544677140 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c790a21428043e59f88dcdae9f41243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c790a21428043e59f88dcdae9f41243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c790a21428043e59f88dcdae9f41243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c790a21428043e59f88dcdae9f41243"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-544677140 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 0c790a21428043e59f88dcdae9f41243 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-544677140 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c2cf909bebb48d3a0b72fc66531ae84 Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: exception: Hypervisor with ID '70d5c6c3-9dd5-448f-8e46-5e002119df6b' could not be found. Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '70d5c6c3-9dd5-448f-8e46-5e002119df6b'} Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '70d5c6c3-9dd5-448f-8e46-5e002119df6b' Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:19.717545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '70d5c6c3-9dd5-448f-8e46-5e002119df6b' could not be found. Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '70d5c6c3-9dd5-448f-8e46-5e002119df6b' could not be found. Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:19.722492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43bee73a-1a36-4dd2-b5c9-4427f173cb6f tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] Returning 404 to user: Hypervisor with ID '70d5c6c3-9dd5-448f-8e46-5e002119df6b' could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:19.723844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43bee73a-1a36-4dd2-b5c9-4427f173cb6f tempest-HypervisorAdminNegativeTestJSON-544677140 tempest-HypervisorAdminNegativeTestJSON-544677140-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/70d5c6c3-9dd5-448f-8e46-5e002119df6b" status: 404 len: 123 microversion: 2.1 time: 0.024721 Sep 13 16:32:19.724245 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 268/525] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/os-hypervisors/70d5c6c3-9dd5-448f-8e46-5e002119df6b => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:19.849710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:19.850449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:19.862738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.863253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.863802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:19.864433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:19.864898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:19.865322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:20.205441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:20.243417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:20.254055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:20.255572 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-422b5bf7-4e5b-4e97-9cda-acc86d15b782 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.409823 Sep 13 16:32:20.256428 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 269/526] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:32:20.275267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:20.275990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:20.292044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:20.292841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:20.293561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:20.294044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:20.294506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:20.294935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:20.610405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:20.621871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f0359b3c-17c9-4239-b965-cdd12a8d50df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.350456 Sep 13 16:32:20.622466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 270/527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:20 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:20.629734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:20.639853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:20.672801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:20.675297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:20.676033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:20.679100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:20.679610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:20.680051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:20.865414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:20.893274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b4c1841e-e79d-4e8e-9fae-35d5a642bdff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1312 microversion: 2.1 time: 1.367606 Sep 13 16:32:20.901390 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 258/528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:19 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1312 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:20.920108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:20.934411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4390df14-a6c2-4636-b25b-5557f33f4908 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1214 microversion: 2.1 time: 0.306486 Sep 13 16:32:20.935713 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 271/529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:20 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:21.285867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:21.286443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:21.312073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:21.313989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:21.317177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:21.320282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:21.327425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:21.331059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:21.373613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:21.646616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:21.647354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:21.660087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:21.660674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:21.661010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:21.663786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:21.664281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:21.664718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:21.709146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:22.233236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:22.242342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0e93443-ab07-46a9-a7f7-cd7639ce08df tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.601511 Sep 13 16:32:22.252403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 272/530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:21 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:22.263131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:22.263919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:22.277344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:22.286197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:22.286952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:22.289518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:22.290663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:22.291333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:22.647650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:22.658397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:22.660285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:22.661443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f590b6a2-c643-4ce9-a7c4-6690e3c43aa2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 1.382502 Sep 13 16:32:22.670490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 259/531] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:21 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:22.676851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:22.684374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:22.692300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:22.693025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:22.693488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:22.694779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:22.695437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:22.696024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:22.930099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:22.946516 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9452a03e-e7c9-4888-b99e-d739941627a9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1276 microversion: 2.1 time: 0.274423 Sep 13 16:32:22.947278 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 260/532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:22 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:23.076257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:23.091691 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6141fa2-7a1e-48b3-813e-30bf96a40c71 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1462 microversion: 2.1 time: 0.837945 Sep 13 16:32:23.096743 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 273/533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:22 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1462 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:23.278579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:23.280072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:23.291746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.292539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.293145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.297093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.298230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.298905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.635598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:23.637092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:23.656105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.668867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.669517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.675936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.676246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.680165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.845271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:23.860188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6ec48d1-4e4b-4241-bef0-d940f2369a5d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.585123 Sep 13 16:32:23.861745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 274/534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:23 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:23.869850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:23.872027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:23.914604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.917773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.920771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:23.923085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:23.924965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:23.929801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.361513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:24.383098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:24.385164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:24.387373 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c42e72a-8dcc-4c7d-8ab0-4bce18b2afd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.523260 Sep 13 16:32:24.404214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 275/535] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:23 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:24.417760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:24.418501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:24.427349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.428099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.432428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.433530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.434252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.435223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.455206 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69fd49aa-ad85-4d71-9d15-92f8978f35e0 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1613 microversion: 2.1 time: 1.324515 Sep 13 16:32:24.461218 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 261/536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:23 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1613 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:24.483354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d7518413-e7ed-488a-9b52-9e7a3cafae01 req-923388a6-ad47-45c5-a415-c86b6bcaf88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378220d4-c1e6-4b23-984a-f0151aa19039", "name": "network-vif-plugged", "status": "completed", "tag": "3f72e4f3-3cf0-4a5b-972a-e784bddb2960"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:24.517057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d7518413-e7ed-488a-9b52-9e7a3cafae01 req-923388a6-ad47-45c5-a415-c86b6bcaf88e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.517680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d7518413-e7ed-488a-9b52-9e7a3cafae01 req-923388a6-ad47-45c5-a415-c86b6bcaf88e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.518850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d7518413-e7ed-488a-9b52-9e7a3cafae01 req-923388a6-ad47-45c5-a415-c86b6bcaf88e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.548285 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d7518413-e7ed-488a-9b52-9e7a3cafae01 req-923388a6-ad47-45c5-a415-c86b6bcaf88e service nova] Creating event network-vif-plugged:3f72e4f3-3cf0-4a5b-972a-e784bddb2960 for instance 378220d4-c1e6-4b23-984a-f0151aa19039 on n-h2-857467-1 Sep 13 16:32:24.554264 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d7518413-e7ed-488a-9b52-9e7a3cafae01 req-923388a6-ad47-45c5-a415-c86b6bcaf88e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089407 Sep 13 16:32:24.555543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 262/537] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:24.573917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:24.577541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:24.601465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.602261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.605706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.607651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:24.613296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:24.616320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:24.820717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e740dd9be55842948d15fd5b6460267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fa112a5ca49d299e9467bd7d41f63', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:24.821768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] flavor_id is None. Assuming migration. {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 13 16:32:24.823262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 16:32:25.241439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3911f79a-bab3-4f73-8e74-49922386827f tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6/action" status: 202 len: 0 microversion: 2.1 time: 0.683946 Sep 13 16:32:25.242166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 263/538] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:32:24 2022] POST /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:25.247984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:25.248924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:25.258775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.260040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.261046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.262337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.263182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.263980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.404945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:25.427938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cbc94984-4632-4af0-846b-668dea6f7cb2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 1.022186 Sep 13 16:32:25.435930 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 276/539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:24 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:25.457737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:25.458411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:25.479421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.482597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.486306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.487090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.487575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.488017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.938353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:25.949106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e268fa14-383b-410d-97eb-e11586852799 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1471 microversion: 2.1 time: 0.507164 Sep 13 16:32:25.965650 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 277/540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:25 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:25.975764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:25.976834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:25.984212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.986097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.986778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:25.987745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:25.988416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:25.989090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:26.143155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:26.156021 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24954b06-bc0c-496d-b08d-fe16855985da tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.912658 Sep 13 16:32:26.157400 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 264/541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:25 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:26.381438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:26.394986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:26.399560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:26.400395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-432560a3-2072-43a0-adb8-9841cbd4a2c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.429547 Sep 13 16:32:26.418487 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 278/542] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:25 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:26.459115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:26.461017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:26.478619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:26.479203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:26.482253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:26.485615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:26.486491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:26.492417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:26.838273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Calling method '.version_select at 0x7fbeb5a9c4c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:26.886762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:32:26.887414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Neutron security group 62350291-5a1c-4a03-bcc7-670bb9539d8a not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:32:26.887950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] HTTP exception thrown: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.887950 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Request method failure captured: Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/62350291-5a1c-4a03-bcc7-670bb9539d8a HTTP/1.1 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILCZOA_iaKJlHN0s3BTFmAYfKQn-7KMBBrUDzWdEhgwLvT9Sr8-42OH8sBAsmJ0AQ5pjZmgG9NsUwY2G2NczD9-4Abnzj8yz94ND8wykCPSVbT6C2XVURXDZo8a2Zowh6y-jnI9jJqbKhHWo-LucfcDJCZc33QLbagkXQA1i9OZmDr8 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 7db6d4cdfcd04707a29a9fca4540f03e Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '62350291-5a1c-4a03-bcc7-670bb9539d8a'} Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:32:26.891975 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Returning 404 to user: Security group 62350291-5a1c-4a03-bcc7-670bb9539d8a does not exist Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-8c680168-fb87-41c4-a09f-8215d6550fc1'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f27b6934-5b6a-4161-8e7e-81f336d1c3f7 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/62350291-5a1c-4a03-bcc7-670bb9539d8a" status: 404 len: 194 microversion: 2.1 time: 0.721273 Sep 13 16:32:26.895873 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 265/543] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:26 2022] DELETE /compute/v2.1/os-security-groups/62350291-5a1c-4a03-bcc7-670bb9539d8a => generated 194 bytes in 722 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:26.903467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1339b88b-b772-4db0-bc04-32520223a769 req-2aeaa2b9-16c4-470a-ab1b-6ed81dcaeb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b984a09d-0655-47e7-9ede-734c8f6c11d2", "tag": "3ac3e3aa-04f0-4793-a8b6-006ae37a4a69"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:26.928073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1339b88b-b772-4db0-bc04-32520223a769 req-2aeaa2b9-16c4-470a-ab1b-6ed81dcaeb89 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:26.928571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1339b88b-b772-4db0-bc04-32520223a769 req-2aeaa2b9-16c4-470a-ab1b-6ed81dcaeb89 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:26.929009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1339b88b-b772-4db0-bc04-32520223a769 req-2aeaa2b9-16c4-470a-ab1b-6ed81dcaeb89 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:26.981082 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1339b88b-b772-4db0-bc04-32520223a769 req-2aeaa2b9-16c4-470a-ab1b-6ed81dcaeb89 service nova] Creating event network-changed:3ac3e3aa-04f0-4793-a8b6-006ae37a4a69 for instance b984a09d-0655-47e7-9ede-734c8f6c11d2 on n-h1-857467-1 Sep 13 16:32:26.996796 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1339b88b-b772-4db0-bc04-32520223a769 req-2aeaa2b9-16c4-470a-ab1b-6ed81dcaeb89 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097364 Sep 13 16:32:26.997434 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 266/544] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:27.010615 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ea9219c-e674-4fdc-9c13-838bb788af89 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008069 Sep 13 16:32:27.023184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 267/545] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Sep 13 16:32:26 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 16:32:27.040072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:27.040745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:27.070252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.070748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.071185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.071895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.072547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.072988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.341336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:27.377563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-198e8e19-3b3f-4f51-9f0a-556ae32cb03c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.906008 Sep 13 16:32:27.377563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 279/546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:26 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:27.385901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d22a4da7-cead-464e-acff-41358323502d tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Calling method '.version_select at 0x7fbeb59f6040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:27.421108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:27.430073 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3972fee6-e7f6-469a-9309-dd557b0473e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1471 microversion: 2.1 time: 0.405724 Sep 13 16:32:27.436243 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 268/547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:27 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1471 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:27.455969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:27.456857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:27.467558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.470184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.472706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.473572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.484821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.485427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.495422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:27.748344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:27.757325 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-071afdd7-c5d0-499e-bdeb-28c304d55f1d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.319785 Sep 13 16:32:27.765570 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 269/548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:27 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:27.777102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:27.778056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:27.789756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.790627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.791775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.794616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:27.795449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:27.796430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:27.905453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=76 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:28.078638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:28.093093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:28.095761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:28.097313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f42cba18-910a-475e-b212-c95c786a65b4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1362 microversion: 2.25 time: 0.330196 Sep 13 16:32:28.098531 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 270/549] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:27 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:28.195006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a71579a6-7f41-4871-945b-d3823718271c tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb5832280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1321086946", "description": "tempest-description-125129564"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:28.414758 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d22a4da7-cead-464e-acff-41358323502d tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.042896 Sep 13 16:32:28.415636 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 280/550] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:32:27 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:28.421373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:28.422791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:28.437022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:28.445717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:28.446442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:28.448563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:28.449317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:28.450014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:28.711678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:28.855685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:28.875138 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d9dea379-975f-45b7-bba7-40a5b2c70f76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.458049 Sep 13 16:32:28.878425 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 281/551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:28 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:28.895101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3a9de03-f1d6-4ca0-88e6-00f8b0a08ad9 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Calling method '.version_select at 0x7fbeb59f6c10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.102753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a71579a6-7f41-4871-945b-d3823718271c tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.002277 Sep 13 16:32:29.104115 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 271/552] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:32:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:29.109495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.110327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:29.131831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-a3a9de03-f1d6-4ca0-88e6-00f8b0a08ad9 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:32:29.135669 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a3a9de03-f1d6-4ca0-88e6-00f8b0a08ad9 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 13 16:32:29.135669 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3a9de03-f1d6-4ca0-88e6-00f8b0a08ad9 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Request method failure captured: Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-security-groups/7f1dd952-a4b5-41ce-93f4-6bf7c15dcde2 HTTP/1.1 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCZOA_iaKJlHN0s3BTFmAYfKQn-7KMBBrUDzWdEhgwLvT9Sr8-42OH8sBAsmJ0AQ5pjZmgG9NsUwY2G2NczD9-4Abnzj8yz94ND8wykCPSVbT6C2XVURXDZo8a2Zowh6y-jnI9jJqbKhHWo-LucfcDJCZc33QLbagkXQA1i9OZmDr8 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7db6d4cdfcd04707a29a9fca4540f03e Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: exception: Insufficient rights for removing default security group. Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '7f1dd952-a4b5-41ce-93f4-6bf7c15dcde2'} Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:32:29.143050 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] Sep 13 16:32:29.147309 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.149614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.150079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.150745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.153175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3a9de03-f1d6-4ca0-88e6-00f8b0a08ad9 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 13 16:32:29.153175 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-31382ea1-2a51-42b1-a756-768286ec8356'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:29.153640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.154304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.157927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3a9de03-f1d6-4ca0-88e6-00f8b0a08ad9 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/7f1dd952-a4b5-41ce-93f4-6bf7c15dcde2" status: 400 len: 182 microversion: 2.1 time: 0.272602 Sep 13 16:32:29.158311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.158576 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 282/553] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:28 2022] DELETE /compute/v2.1/os-security-groups/7f1dd952-a4b5-41ce-93f4-6bf7c15dcde2 => generated 182 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:32:29.173297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-19f6ea4e-4e92-4eaa-b09f-0356c149edb8 req-bad7d1ab-9ffd-492e-9f6a-da7a556144d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "name": "network-vif-plugged", "status": "completed", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:29.205693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-19f6ea4e-4e92-4eaa-b09f-0356c149edb8 req-bad7d1ab-9ffd-492e-9f6a-da7a556144d3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.208265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-19f6ea4e-4e92-4eaa-b09f-0356c149edb8 req-bad7d1ab-9ffd-492e-9f6a-da7a556144d3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.208886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-19f6ea4e-4e92-4eaa-b09f-0356c149edb8 req-bad7d1ab-9ffd-492e-9f6a-da7a556144d3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.224183 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-19f6ea4e-4e92-4eaa-b09f-0356c149edb8 req-bad7d1ab-9ffd-492e-9f6a-da7a556144d3 service nova] Creating event network-vif-plugged:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:32:29.231542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-19f6ea4e-4e92-4eaa-b09f-0356c149edb8 req-bad7d1ab-9ffd-492e-9f6a-da7a556144d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071450 Sep 13 16:32:29.232919 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 283/554] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:29.240290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.241343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:29.248767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.249599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.251366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.252671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.253360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.254053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.446826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:29.458066 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d45645f3-8cdc-4947-8e02-85ba61f26267 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.223116 Sep 13 16:32:29.458916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 284/555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:29 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:29.464154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e1a2b5b2-39ca-4f73-bf18-1f95bd5da3a2 req-9099de18-66cd-47a7-ad15-918bb6628e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8955426a-c06a-42e1-9082-fabd1426e8ed", "tag": "2774dfb9-4912-4236-a39f-05bd4425a594"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:29.475282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e1a2b5b2-39ca-4f73-bf18-1f95bd5da3a2 req-9099de18-66cd-47a7-ad15-918bb6628e60 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.476265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e1a2b5b2-39ca-4f73-bf18-1f95bd5da3a2 req-9099de18-66cd-47a7-ad15-918bb6628e60 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.477282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e1a2b5b2-39ca-4f73-bf18-1f95bd5da3a2 req-9099de18-66cd-47a7-ad15-918bb6628e60 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.493160 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e1a2b5b2-39ca-4f73-bf18-1f95bd5da3a2 req-9099de18-66cd-47a7-ad15-918bb6628e60 service nova] Creating event network-changed:2774dfb9-4912-4236-a39f-05bd4425a594 for instance 8955426a-c06a-42e1-9082-fabd1426e8ed on n-h1-857467-1 Sep 13 16:32:29.499475 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e1a2b5b2-39ca-4f73-bf18-1f95bd5da3a2 req-9099de18-66cd-47a7-ad15-918bb6628e60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038760 Sep 13 16:32:29.507325 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 285/556] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:29.510954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:29.516196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3633cc8-cf61-48f9-88dd-cf5f365e2241 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb59e43a0>, body: {"security_group_rule": {"parent_group_id": "12b370fd-39cb-40b5-96af-c5b626352282", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:29.712056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:29.727781 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b549f175-d04f-4dfe-a692-44d1ef0aa525 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1471 microversion: 2.1 time: 0.622352 Sep 13 16:32:29.731613 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 272/557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:29 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:29.755128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.757747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:29.769526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.770573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.771217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.772167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.772848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.773478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.918887 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3633cc8-cf61-48f9-88dd-cf5f365e2241 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.409334 Sep 13 16:32:29.919500 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 286/558] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:29.932724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Calling method '.version_select at 0x7fbeb5ac9b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.957468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:32:29.958304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.security_group_api [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Neutron security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 not found {{(pid=122328) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:32:29.958998 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] HTTP exception thrown: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.958998 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Request method failure captured: Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-security-groups/53d9e23a-36d4-4a29-8417-79fa07fc30d6 HTTP/1.1 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCZOA_iaKJlHN0s3BTFmAYfKQn-7KMBBrUDzWdEhgwLvT9Sr8-42OH8sBAsmJ0AQ5pjZmgG9NsUwY2G2NczD9-4Abnzj8yz94ND8wykCPSVbT6C2XVURXDZo8a2Zowh6y-jnI9jJqbKhHWo-LucfcDJCZc33QLbagkXQA1i9OZmDr8 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7db6d4cdfcd04707a29a9fca4540f03e Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: exception: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '53d9e23a-36d4-4a29-8417-79fa07fc30d6'} Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:32:29.961202 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] Sep 13 16:32:29.965464 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:29.971783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Returning 404 to user: Security group 53d9e23a-36d4-4a29-8417-79fa07fc30d6 does not exist Sep 13 16:32:29.971783 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-d9dfdd93-a221-45f3-9e75-043988df441a'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:29.971783 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-537dccb0-99cc-4c2c-a500-fba11a156b5e tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/53d9e23a-36d4-4a29-8417-79fa07fc30d6" status: 404 len: 194 microversion: 2.1 time: 0.049878 Sep 13 16:32:29.973140 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 287/559] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:32:29 2022] GET /compute/v2.1/os-security-groups/53d9e23a-36d4-4a29-8417-79fa07fc30d6 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:29.979865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:29.980887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:29.995793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:29.996640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:29.997281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:29.998336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:30.000971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:30.001654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:30.247641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:30.263188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea745f3f-3b0a-4789-9143-1c44cb4a0d3a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.288671 Sep 13 16:32:30.264069 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 288/560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:29 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:30.282442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6900bec4-7a7c-49d9-aee3-b6a5691c1a9f tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb5ac95e0>, body: {"security_group_rule": {"parent_group_id": "12b370fd-39cb-40b5-96af-c5b626352282", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:30.347159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-6900bec4-7a7c-49d9-aee3-b6a5691c1a9f tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: This rule already exists in group 12b370fd-39cb-40b5-96af-c5b626352282 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6900bec4-7a7c-49d9-aee3-b6a5691c1a9f tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 138 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: {"security_group_rule": {"parent_group_id": "12b370fd-39cb-40b5-96af-c5b626352282", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: exception: This rule already exists in group 12b370fd-39cb-40b5-96af-c5b626352282 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'security_group_rule': {'parent_group_id': '12b370fd-39cb-40b5-96af-c5b626352282', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 12b370fd-39cb-40b5-96af-c5b626352282 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 12b370fd-39cb-40b5-96af-c5b626352282 Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:30.348692 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 12b370fd-39cb-40b5-96af-c5b626352282 Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6900bec4-7a7c-49d9-aee3-b6a5691c1a9f tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 400 to user: This rule already exists in group 12b370fd-39cb-40b5-96af-c5b626352282 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6900bec4-7a7c-49d9-aee3-b6a5691c1a9f tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.084776 Sep 13 16:32:30.352905 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 289/561] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:30 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:32:30.356108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Action: 'update', calling method: .version_select at 0x7fbeb59e4040>, body: {"security_group": {"name": "tempest-sg-2046095528", "description": "tempest-description-650712708"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:30.403321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:32:30.404073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.security_group_api [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Neutron security group 97f1f2f3-b211-4f30-b13a-984799758062 not found {{(pid=122328) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:32:30.404706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] HTTP exception thrown: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.404706 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Request method failure captured: Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/os-security-groups/97f1f2f3-b211-4f30-b13a-984799758062 HTTP/1.1 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 101 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCZOA_iaKJlHN0s3BTFmAYfKQn-7KMBBrUDzWdEhgwLvT9Sr8-42OH8sBAsmJ0AQ5pjZmgG9NsUwY2G2NczD9-4Abnzj8yz94ND8wykCPSVbT6C2XVURXDZo8a2Zowh6y-jnI9jJqbKhHWo-LucfcDJCZc33QLbagkXQA1i9OZmDr8 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/633d4185ec214b38bff836c0ec88e96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 633d4185ec214b38bff836c0ec88e96e Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-114611341 Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7db6d4cdfcd04707a29a9fca4540f03e Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-114611341-project Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: {"security_group": {"name": "tempest-sg-2046095528", "description": "tempest-description-650712708"}} Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: exception: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '97f1f2f3-b211-4f30-b13a-984799758062', 'body': {'security_group': {'name': 'tempest-sg-2046095528', 'description': 'tempest-description-650712708'}}} Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:32:30.408235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] Returning 404 to user: Security group 97f1f2f3-b211-4f30-b13a-984799758062 does not exist Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-eee06972-727d-4915-a5cc-143ecaf33392'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69b6fbc9-f8d7-4e61-bd9b-069be9d56ec0 tempest-SecurityGroupsNegativeTestJSON-114611341 tempest-SecurityGroupsNegativeTestJSON-114611341-project] 10.222.0.61 "PUT /compute/v2.1/os-security-groups/97f1f2f3-b211-4f30-b13a-984799758062" status: 404 len: 194 microversion: 2.1 time: 0.058996 Sep 13 16:32:30.412279 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 290/562] 10.222.0.61 () {60 vars in 1290 bytes} [Tue Sep 13 16:32:30 2022] PUT /compute/v2.1/os-security-groups/97f1f2f3-b211-4f30-b13a-984799758062 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:30.431628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1225793-e920-4034-989c-5bd71203722e tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb59e4160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:30.455325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:30.467469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:30.474122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:30.477537 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-292440de-0cf9-4153-b6e0-c2c8752d95a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1558 microversion: 2.25 time: 0.727397 Sep 13 16:32:30.480060 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 273/563] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:29 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1558 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:30.507790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:30.514739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:30.536011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:30.538125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:30.554404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:30.559606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:30.560100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:30.561313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:31.030051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:31.045808 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2365f65a-f4b0-4dc3-9e99-4b32e6dd4ce5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.564212 Sep 13 16:32:31.047785 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 274/564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:30 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:31.309518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:31.310700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:31.332713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:31.333661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:31.334543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:31.342029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:31.342853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:31.344824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:31.799260 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1225793-e920-4034-989c-5bd71203722e tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/1fccdb28-ffd7-42d3-8bfe-6d2ef0d1622e" status: 202 len: 0 microversion: 2.1 time: 1.386070 Sep 13 16:32:31.800413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 291/565] 10.222.0.61 () {58 vars in 1287 bytes} [Tue Sep 13 16:32:30 2022] DELETE /compute/v2.1/os-security-group-rules/1fccdb28-ffd7-42d3-8bfe-6d2ef0d1622e => generated 0 bytes in 1388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:31.810690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:31.811571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:31.820623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:31.821486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:31.822248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:31.823363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:31.824089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:31.843365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:31.846771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 378220d4-c1e6-4b23-984a-f0151aa19039 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:32:31.978513 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0582a166-d0cd-44d4-a646-2cbc9a01630b tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 2051 microversion: 2.25 time: 0.925891 Sep 13 16:32:31.980697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 275/566] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:31 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 2051 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:32.006190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:32.007056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:32.030114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.033487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.034226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:32.035147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.035624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.036053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:32.677842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:32.692204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad5fee0a-de9a-4bb9-90f5-c9c2cf16b33e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1471 microversion: 2.1 time: 0.884401 Sep 13 16:32:32.693753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 292/567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:31 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1471 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:32.699235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cdcdfb2b-3a1e-4047-b57b-02b31f6a9a49 req-47246331-6511-41c0-a5cc-35ad07a542d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0df885-185c-4351-bd0e-c3c13774f815", "name": "network-vif-plugged", "status": "completed", "tag": "0cf241fd-8101-4e4e-9dbe-3fd46afa5365"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:32.727813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cdcdfb2b-3a1e-4047-b57b-02b31f6a9a49 req-47246331-6511-41c0-a5cc-35ad07a542d6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.729015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cdcdfb2b-3a1e-4047-b57b-02b31f6a9a49 req-47246331-6511-41c0-a5cc-35ad07a542d6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.730226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cdcdfb2b-3a1e-4047-b57b-02b31f6a9a49 req-47246331-6511-41c0-a5cc-35ad07a542d6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:32.778378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:32.782530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cdcdfb2b-3a1e-4047-b57b-02b31f6a9a49 req-47246331-6511-41c0-a5cc-35ad07a542d6 service nova] Creating event network-vif-plugged:0cf241fd-8101-4e4e-9dbe-3fd46afa5365 for instance 5b0df885-185c-4351-bd0e-c3c13774f815 on n-h2-857467-1 Sep 13 16:32:32.790264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cdcdfb2b-3a1e-4047-b57b-02b31f6a9a49 req-47246331-6511-41c0-a5cc-35ad07a542d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094155 Sep 13 16:32:32.791406 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 293/568] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:32.791834 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-edd9256d-8ce3-4a2f-a697-5020e424fc1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.809564 Sep 13 16:32:32.792404 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 276/569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:31 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:32.803183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-235f3719-9b09-4f11-8170-52722e2cc961 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb59f6700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-380280058", "description": "tempest-description-2145835654"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:32.804088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:32.804698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:32.835529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.836025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.836466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:32.837462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:32.838311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:32.839369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.370369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 378220d4-c1e6-4b23-984a-f0151aa19039 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:32:33.387767 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a6d68dc7-8e05-4452-a04a-b47d9d0ff573 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 2051 microversion: 2.25 time: 0.587217 Sep 13 16:32:33.388980 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 277/570] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:32 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 2051 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:33.394386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:33.395394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:33.403954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.404887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.405545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.406755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.407636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.408290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.413791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:33.687727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:33.699751 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6b1c9258-6f4c-4e6c-ba51-a58072df8e4a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1313 microversion: 2.1 time: 0.309449 Sep 13 16:32:33.704362 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 278/571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:33 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:33.716431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:33.726563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.731258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.732161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.736343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.737680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.738354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.793130 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b29db3ee-e617-4541-99c5-054d193cb2f5 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.086867 Sep 13 16:32:33.803099 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 279/572] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Sep 13 16:32:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:32:33.809629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:33.810637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:33.818631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.819113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.819836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.820564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.821024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.821453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.884594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-235f3719-9b09-4f11-8170-52722e2cc961 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.091876 Sep 13 16:32:33.894742 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 294/573] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:32:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:33.896747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": "auto"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:33.899712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:33.916240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.917676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.918344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:33.919462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:33.920241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:33.920850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:34.021793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'flavor' on Instance uuid 378220d4-c1e6-4b23-984a-f0151aa19039 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:32:34.111253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Going to try to live migrate instance to n-h1-857467-1 {{(pid=122328) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:32:34.133633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:34.145407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:34.153198 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-230427e7-44ee-4bd2-98dc-f7062cdedd1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1471 microversion: 2.1 time: 0.350410 Sep 13 16:32:34.165076 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 280/574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:33 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:34.170245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:34.171023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:34.179724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:34.186861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:34.187589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:34.190573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:34.191074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:34.191858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:34.662070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:34.678832 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8738af38-dafc-4795-8e88-c453720220d4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.512370 Sep 13 16:32:34.699787 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 281/575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:34 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:34.728706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7224c730-62bd-4400-864a-ac45259d3225 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb57e21f0>, body: {"security_group_rule": {"parent_group_id": "93b0e9b7-0d92-407c-9a7a-de87e1aaed99", "ip_protocol": "tcp", "from_port": 1850670035, "to_port": 22}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:34.864233 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-7224c730-62bd-4400-864a-ac45259d3225 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Invalid port range 1850670035:22. Former value cannot be greater than the later Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7224c730-62bd-4400-864a-ac45259d3225 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 146 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: {"security_group_rule": {"parent_group_id": "93b0e9b7-0d92-407c-9a7a-de87e1aaed99", "ip_protocol": "tcp", "from_port": 1850670035, "to_port": 22}} Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid port range 1850670035:22. Former value cannot be greater than the later Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'security_group_rule': {'parent_group_id': '93b0e9b7-0d92-407c-9a7a-de87e1aaed99', 'ip_protocol': 'tcp', 'from_port': 1850670035, 'to_port': 22}}} Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1850670035:22. Former value cannot be greater than the later Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1850670035:22. Former value cannot be greater than the later Sep 13 16:32:34.866825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1850670035:22. Former value cannot be greater than the later Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7224c730-62bd-4400-864a-ac45259d3225 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 400 to user: Invalid port range 1850670035:22. Former value cannot be greater than the later {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:34.872642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7224c730-62bd-4400-864a-ac45259d3225 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.167401 Sep 13 16:32:34.873491 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 282/576] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:34 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:32:34.884349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:34.885880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:34.913263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:34.914146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:34.916010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:34.918068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:34.919302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:34.921142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:35.203790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:35.222096 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-829c3e5f-26cb-415a-a628-7310df2c4381 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1463 microversion: 2.1 time: 0.344086 Sep 13 16:32:35.223026 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 283/577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:34 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1463 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:35.240634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15c2b3fb-b065-48d9-a60c-178ba042fb25 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb5809940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-305517524", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:35.248704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-15c2b3fb-b065-48d9-a60c-178ba042fb25 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Security group id should be uuid Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15c2b3fb-b065-48d9-a60c-178ba042fb25 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 130 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-305517524", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group id should be uuid Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-305517524', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:35.254392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:35.259317 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 13 16:32:35.259317 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:35.259317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15c2b3fb-b065-48d9-a60c-178ba042fb25 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 400 to user: Security group id should be uuid {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:35.259317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15c2b3fb-b065-48d9-a60c-178ba042fb25 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.031773 Sep 13 16:32:35.270453 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 284/578] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:35 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:32:35.288447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:35.292857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:35.316518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:35.324905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:35.325902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:35.326784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:35.328612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:35.332584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:35.708642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:35.722837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea654171-ba54-4a6d-87c2-038412a29bc4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.449333 Sep 13 16:32:35.739234 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 285/579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:35 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:35.754892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:35.755792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:35.775040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:35.775549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:35.775995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:35.776716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:35.777202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:35.777621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:36.083111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:36.091955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29143124-2e3d-4b6a-8280-7c962c9664ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1463 microversion: 2.1 time: 0.351664 Sep 13 16:32:36.093971 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 286/580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:35 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:36.099610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00104ddd-ebf3-4910-b288-a1c3f81cb787 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb5832b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-110433211", "description": "tempest-description-676662863"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:36.943039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00104ddd-ebf3-4910-b288-a1c3f81cb787 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.847609 Sep 13 16:32:36.943615 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 287/581] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:32:36 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:36.948628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d24ca21f-2076-492b-95f1-377cdf441900 req-84bfcc61-de67-44e8-9330-803788427bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b984a09d-0655-47e7-9ede-734c8f6c11d2", "name": "network-vif-plugged", "status": "completed", "tag": "3ac3e3aa-04f0-4793-a8b6-006ae37a4a69"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:36.965197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d24ca21f-2076-492b-95f1-377cdf441900 req-84bfcc61-de67-44e8-9330-803788427bab service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:36.965958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d24ca21f-2076-492b-95f1-377cdf441900 req-84bfcc61-de67-44e8-9330-803788427bab service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:36.966665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d24ca21f-2076-492b-95f1-377cdf441900 req-84bfcc61-de67-44e8-9330-803788427bab service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:37.020327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d24ca21f-2076-492b-95f1-377cdf441900 req-84bfcc61-de67-44e8-9330-803788427bab service nova] Creating event network-vif-plugged:3ac3e3aa-04f0-4793-a8b6-006ae37a4a69 for instance b984a09d-0655-47e7-9ede-734c8f6c11d2 on n-h1-857467-1 Sep 13 16:32:37.032363 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d24ca21f-2076-492b-95f1-377cdf441900 req-84bfcc61-de67-44e8-9330-803788427bab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087039 Sep 13 16:32:37.033708 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 288/582] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:37.053371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:37.056382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:37.116332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:37.116837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:37.121451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:37.122502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:37.123671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:37.124634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:37.628723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:37.639978 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e678b0f0-c58f-4738-823a-3017551ba321 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.604933 Sep 13 16:32:37.658078 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 289/583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:37 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:37.663503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-438505314", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:37.737577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:32:37.932608 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6bc331c4-ed6e-400a-9878-802d5f9461e9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039/action" status: 202 len: 0 microversion: 2.25 time: 4.039857 Sep 13 16:32:37.933720 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 295/584] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:32:33 2022] POST /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039/action => generated 0 bytes in 4042 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:32:37.939375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:37.940141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:37.955381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:37.955889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:37.956336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:37.957768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:37.970694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:37.971474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.166134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:38.177790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0c8294b6-3149-4e0a-b7fb-40151431a5dc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.242511 Sep 13 16:32:38.191544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 296/585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:37 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:38.201505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40d5c710-270e-4fe8-937d-5f3ecba23639 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb584aaf0>, body: {"security_group_rule": {"parent_group_id": "76d16715-3424-421c-a1b9-b0723d07f09d", "ip_protocol": "tempest-999-1237133217", "from_port": 22, "to_port": 22}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:38.262113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:32:38.263083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:32:38.263213 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-40d5c710-270e-4fe8-937d-5f3ecba23639 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Invalid IP protocol tempest-999-1237133217. Sep 13 16:32:38.264425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40d5c710-270e-4fe8-937d-5f3ecba23639 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 157 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: {"security_group_rule": {"parent_group_id": "76d16715-3424-421c-a1b9-b0723d07f09d", "ip_protocol": "tempest-999-1237133217", "from_port": 22, "to_port": 22}} Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid IP protocol tempest-999-1237133217. Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'security_group_rule': {'parent_group_id': '76d16715-3424-421c-a1b9-b0723d07f09d', 'ip_protocol': 'tempest-999-1237133217', 'from_port': 22, 'to_port': 22}}} Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1237133217. Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1237133217. Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.264833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1237133217. Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.268768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40d5c710-270e-4fe8-937d-5f3ecba23639 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 400 to user: Invalid IP protocol tempest-999-1237133217. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:38.270513 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40d5c710-270e-4fe8-937d-5f3ecba23639 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.076629 Sep 13 16:32:38.273902 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 297/586] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:38 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:32:38.274667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:32:38.275404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:32:38.281323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:38.282841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:38.291849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.292554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.292688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.293184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.293316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.293770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.293945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.294456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.294749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.294995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.296045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.304534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:38.305974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.333649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Getting quotas for project fd7b2634429c46c1ac366579351c3389. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:38.350473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Getting quotas for user 76067e188d0047d8939862b78f0abea9 and project fd7b2634429c46c1ac366579351c3389. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:38.408785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:32:38.413025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:38.483296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:38.501468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:38.514629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:38.519252 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-16cde61d-d652-49be-9d6b-3747f4aaff60 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859595 Sep 13 16:32:38.522719 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 290/587] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:32:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:32:38.533689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a863ba7-eaae-4c7c-9cf5-884947a2a13c tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb5809c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1966301805", "description": "tempest-description-233056645"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:38.535798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:38.543049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e13c9e28-2d56-46f6-a3f7-acf2b78e9186 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.269325 Sep 13 16:32:38.543941 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 298/588] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:38 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:38.554939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73198b64-587d-4b71-b90a-9a813c4d277a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:38.555869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73198b64-587d-4b71-b90a-9a813c4d277a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:38.640992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73198b64-587d-4b71-b90a-9a813c4d277a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:38.650862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73198b64-587d-4b71-b90a-9a813c4d277a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1213 microversion: 2.1 time: 0.104827 Sep 13 16:32:38.665853 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 299/589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:38 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:38.677469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:38.678135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:38.727942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.731992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.732846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.737212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:38.739882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:38.746054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:38.805021 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a863ba7-eaae-4c7c-9cf5-884947a2a13c tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.276029 Sep 13 16:32:38.805771 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 291/590] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:32:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:38.825160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36a5dd62-32d7-4d3f-bc9b-70a48990bca7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb58c0160>, body: {"security_group_rule": {"parent_group_id": "f297a94c-2ea1-4a05-a95a-bc7cb1144db8", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:38.986826 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-36a5dd62-32d7-4d3f-bc9b-70a48990bca7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36a5dd62-32d7-4d3f-bc9b-70a48990bca7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 138 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: {"security_group_rule": {"parent_group_id": "f297a94c-2ea1-4a05-a95a-bc7cb1144db8", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f297a94c-2ea1-4a05-a95a-bc7cb1144db8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 13 16:32:38.989777 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36a5dd62-32d7-4d3f-bc9b-70a48990bca7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36a5dd62-32d7-4d3f-bc9b-70a48990bca7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.170381 Sep 13 16:32:38.994001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 292/591] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:38 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:32:39.017581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cfec8e9e-2755-4aca-b46d-d40b64104047 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb58c01f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-663271267", "description": "tempest-description-1433682331"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:39.152878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:39.162229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3fc42cd-32f2-454d-8bcc-0733f064e214 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.494502 Sep 13 16:32:39.175468 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 300/592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:38 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:39.209163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:39.210287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:39.225220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.227509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.230159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.231932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.236841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.239280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.592020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cfec8e9e-2755-4aca-b46d-d40b64104047 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.591431 Sep 13 16:32:39.598440 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 293/593] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:32:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:39.610084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1c99772e-8ede-45ee-904d-489cf6ba4efd req-f00365cc-852e-4e12-8ae6-a51969ffee5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8955426a-c06a-42e1-9082-fabd1426e8ed", "name": "network-vif-plugged", "status": "completed", "tag": "2774dfb9-4912-4236-a39f-05bd4425a594"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:39.637167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1c99772e-8ede-45ee-904d-489cf6ba4efd req-f00365cc-852e-4e12-8ae6-a51969ffee5d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.639111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1c99772e-8ede-45ee-904d-489cf6ba4efd req-f00365cc-852e-4e12-8ae6-a51969ffee5d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.640898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1c99772e-8ede-45ee-904d-489cf6ba4efd req-f00365cc-852e-4e12-8ae6-a51969ffee5d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.669152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1c99772e-8ede-45ee-904d-489cf6ba4efd req-f00365cc-852e-4e12-8ae6-a51969ffee5d service nova] Creating event network-vif-plugged:2774dfb9-4912-4236-a39f-05bd4425a594 for instance 8955426a-c06a-42e1-9082-fabd1426e8ed on n-h1-857467-1 Sep 13 16:32:39.675994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:39.680651 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1c99772e-8ede-45ee-904d-489cf6ba4efd req-f00365cc-852e-4e12-8ae6-a51969ffee5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080905 Sep 13 16:32:39.682657 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 294/594] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:39.688179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:39.688890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:39.691839 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-480678ed-07ba-4295-a908-293fc561b10c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.490683 Sep 13 16:32:39.694168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 301/595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:39 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:39.697976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.698679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.699068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d378ffe8-0583-4a18-a884-ede94602f696 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb596d4c0>, body: {"security_group_rule": {"parent_group_id": "e9311dd8-89d5-4708-9ff7-c15f10bcbd0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 658868639}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:39.699470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.700337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.700994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.701615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.922300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:39.949175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:39.952263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:39.955839 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a94c8681-003d-441e-aa6d-c5d1e34eae73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.271759 Sep 13 16:32:39.971941 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 295/596] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:39 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:39.971941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:39.971941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:39.974793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.975672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.976460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:39.977810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:39.978478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:39.978955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:40.095711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:40.106086 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1efcc4b1-dbaa-4c72-b1c6-79bc37ff438e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1265 microversion: 2.1 time: 0.147328 Sep 13 16:32:40.119483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 296/597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:39 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:40.192286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:40.194510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:40.201722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:40.202991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:40.204160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:40.204994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:40.205630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:40.206383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:40.359588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:40.369450 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21406c2a-27a9-4e84-9777-50b8516cb096 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.184906 Sep 13 16:32:40.375530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d378ffe8-0583-4a18-a884-ede94602f696 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Invalid port range 22:658868639. Valid TCP ports should be between 1-65535 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d378ffe8-0583-4a18-a884-ede94602f696 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 145 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: {"security_group_rule": {"parent_group_id": "e9311dd8-89d5-4708-9ff7-c15f10bcbd0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 658868639}} Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid port range 22:658868639. Valid TCP ports should be between 1-65535 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e9311dd8-89d5-4708-9ff7-c15f10bcbd0f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 658868639}}} Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:658868639. Valid TCP ports should be between 1-65535 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:658868639. Valid TCP ports should be between 1-65535 Sep 13 16:32:40.377664 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:658868639. Valid TCP ports should be between 1-65535 Sep 13 16:32:40.381572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.382725 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 297/598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:40 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:40.388766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d378ffe8-0583-4a18-a884-ede94602f696 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 400 to user: Invalid port range 22:658868639. Valid TCP ports should be between 1-65535 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:40.390395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d378ffe8-0583-4a18-a884-ede94602f696 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.694914 Sep 13 16:32:40.392603 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 302/599] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:39 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 698 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:32:40.402947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Action: 'create', calling method: .version_select at 0x7fbeb5a735e0>, body: {"security_group_rule": {"parent_group_id": "95060433-f2ad-478a-bcb9-35b5dd3200d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:40.433473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:32:40.434331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Neutron security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:32:40.435152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.435152 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 138 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: {"security_group_rule": {"parent_group_id": "95060433-f2ad-478a-bcb9-35b5dd3200d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'security_group_rule': {'parent_group_id': '95060433-f2ad-478a-bcb9-35b5dd3200d3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:32:40.437273 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 404 to user: Security group 95060433-f2ad-478a-bcb9-35b5dd3200d3 does not exist Sep 13 16:32:40.441479 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f66287f1-2988-4f0f-9e60-3a7f27951941'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:40.444223 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64fc24ad-3176-4308-828c-1a1965da2d7b tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.042435 Sep 13 16:32:40.444223 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 298/600] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:32:40 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:40.452959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb586c9d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:40.538058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:32:40.538058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.security_group_api [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Neutron security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 not found {{(pid=122328) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 13 16:32:40.538058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] HTTP exception thrown: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.538058 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Request method failure captured: Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-security-group-rules/20f75a36-a5c9-4add-afd4-6b1ca66d3834 HTTP/1.1 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILCbPESgdnCJCJydS8bIeZ9RTTSzDaEtHRML7CVk9Ep0pZTatLpdLBzQ59Q-B7_4LFdvlcPEOGN-7uDeoThk9X5-qg_axSn-0D1U-lmsgR-KLkeGdzNK8uDkdMRPHWxDhKTIV435EiS11hhsg58yVRMESxTNv8nA-EXK5CEjwy-pb8A Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63dc026f7655410ba156fe3086abd811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63dc026f7655410ba156fe3086abd811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 63dc026f7655410ba156fe3086abd811 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a1d68068708f43e4b8c2844769a9e5b7 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: exception: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '20f75a36-a5c9-4add-afd4-6b1ca66d3834'} Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:32:40.542188 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Returning 404 to user: Security group rule 20f75a36-a5c9-4add-afd4-6b1ca66d3834 does not exist Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-45681829-d856-42d7-a2c8-b1fc8663acda'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:32:40.548254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e944d929-af64-4943-b770-df34309c4ab7 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/20f75a36-a5c9-4add-afd4-6b1ca66d3834" status: 404 len: 199 microversion: 2.1 time: 0.094828 Sep 13 16:32:40.553865 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 303/601] 10.222.0.61 () {58 vars in 1287 bytes} [Tue Sep 13 16:32:40 2022] DELETE /compute/v2.1/os-security-group-rules/20f75a36-a5c9-4add-afd4-6b1ca66d3834 => generated 199 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:32:40.563117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-710e5e54-be17-4fda-91db-b12366a696b1 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb5b11dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:40.714821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:40.715840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:40.723349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:40.728120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:40.730671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:40.731614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:40.735069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:40.736165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.079394 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-710e5e54-be17-4fda-91db-b12366a696b1 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e9311dd8-89d5-4708-9ff7-c15f10bcbd0f" status: 202 len: 0 microversion: 2.1 time: 0.522815 Sep 13 16:32:41.080958 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 299/602] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:40 2022] DELETE /compute/v2.1/os-security-groups/e9311dd8-89d5-4708-9ff7-c15f10bcbd0f => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:41.089817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:41.091957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:41.104323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:41.105348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:41.106309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.107966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:41.108752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:41.110973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.170164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:41.179204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef36646d-9581-4276-bbda-1a7a6d6e760d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.468418 Sep 13 16:32:41.180339 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 304/603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:40 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:41.193753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16b6a48e-899e-4f9b-bfe5-b5b3b6f990ba tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb5956dc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:41.507544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:41.521745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:41.525876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:41.527340 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7ec77219-ec4a-41eb-b625-3d95a99582db tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.444818 Sep 13 16:32:41.534513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 300/604] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:41 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:41.555957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:41.556869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:41.565351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:41.566113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:41.566913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.568604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:41.569468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:41.570292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.719154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:41.729549 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df3d85d3-1688-47ef-b38e-b25befb39392 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1271 microversion: 2.1 time: 0.188575 Sep 13 16:32:41.731550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 301/605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:41 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:41.737269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:41.738381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:41.745193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:41.750469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:41.752322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.754686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:41.757142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:41.757652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:41.896097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-16b6a48e-899e-4f9b-bfe5-b5b3b6f990ba tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f297a94c-2ea1-4a05-a95a-bc7cb1144db8" status: 202 len: 0 microversion: 2.1 time: 0.713454 Sep 13 16:32:41.899836 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 305/606] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:41 2022] DELETE /compute/v2.1/os-security-groups/f297a94c-2ea1-4a05-a95a-bc7cb1144db8 => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:41.904957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6d8d86c7-416c-42ea-93bb-5740ee118b2e tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb5812310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:42.046168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:42.070529 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14c40d5e-9b51-4218-877a-53cc3e7dcc99 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1318 microversion: 2.1 time: 0.337619 Sep 13 16:32:42.071399 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 302/607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:41 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:42.204639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:42.206363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:42.220182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.221348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.224190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.224970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.225424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.228009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.688974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:42.707403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b10b365f-7122-401c-b965-93af8e84da55 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.507569 Sep 13 16:32:42.708002 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 303/608] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:42 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:42.716158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:42.716848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:42.740624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.742521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.742994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.745859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.750532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.751588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.955354 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6d8d86c7-416c-42ea-93bb-5740ee118b2e tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/76d16715-3424-421c-a1b9-b0723d07f09d" status: 202 len: 0 microversion: 2.1 time: 1.054109 Sep 13 16:32:42.959773 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 306/609] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:41 2022] DELETE /compute/v2.1/os-security-groups/76d16715-3424-421c-a1b9-b0723d07f09d => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:42.963940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:42.964957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:42.990385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.990913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.991510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:42.992089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:42.997538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:42.998102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:43.618715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:43.629293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:43.639400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:43.643918 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d14e49cf-27a8-4df0-9bc1-99f27f0ad9f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.931687 Sep 13 16:32:43.644915 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 304/610] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:42 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:43.650579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c5251c48-79cb-49da-90e8-789be4d2cd8b req-dd5066df-d072-4472-a04d-dd0610318fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378220d4-c1e6-4b23-984a-f0151aa19039", "name": "network-vif-unplugged", "status": "completed", "tag": "3f72e4f3-3cf0-4a5b-972a-e784bddb2960"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:43.666085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c5251c48-79cb-49da-90e8-789be4d2cd8b req-dd5066df-d072-4472-a04d-dd0610318fe1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:43.666804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c5251c48-79cb-49da-90e8-789be4d2cd8b req-dd5066df-d072-4472-a04d-dd0610318fe1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:43.667342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c5251c48-79cb-49da-90e8-789be4d2cd8b req-dd5066df-d072-4472-a04d-dd0610318fe1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:43.667814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:43.677049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f0c6b02-8baf-467f-b47b-3cb4de2efe8c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.718850 Sep 13 16:32:43.678336 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 307/611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:42 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:43.687128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c5251c48-79cb-49da-90e8-789be4d2cd8b req-dd5066df-d072-4472-a04d-dd0610318fe1 service nova] Creating event network-vif-unplugged:3f72e4f3-3cf0-4a5b-972a-e784bddb2960 for instance 378220d4-c1e6-4b23-984a-f0151aa19039 on n-h2-857467-1 Sep 13 16:32:43.694589 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c5251c48-79cb-49da-90e8-789be4d2cd8b req-dd5066df-d072-4472-a04d-dd0610318fe1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047667 Sep 13 16:32:43.695202 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 305/612] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:43.698467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ce255c7-9b13-4b1f-ae3f-89921b28dbea tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb58120d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:43.703677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:43.704523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:43.711267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:43.711751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:43.712183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:43.713846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:43.714569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:43.715159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:43.753988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:44.091989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:44.116271 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-362af589-4c8b-4bb3-b231-851addf6d4da tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1468 microversion: 2.1 time: 0.417322 Sep 13 16:32:44.118970 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 306/613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:43 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1468 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:44.146376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:44.147283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:44.164337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.164911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.165464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:44.166495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.167987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.169513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:44.692886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ce255c7-9b13-4b1f-ae3f-89921b28dbea tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/93b0e9b7-0d92-407c-9a7a-de87e1aaed99" status: 202 len: 0 microversion: 2.1 time: 1.003692 Sep 13 16:32:44.693490 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 308/614] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:43 2022] DELETE /compute/v2.1/os-security-groups/93b0e9b7-0d92-407c-9a7a-de87e1aaed99 => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:44.700412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cb4aefaa-3791-4e13-b514-ce37dcdc2eee req-d18832a7-e9a4-493d-b7d5-f0f0b3e2f566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd125db0-334a-4f83-a30f-878f41c4e688", "tag": "5ee2ceed-907c-4d70-993e-f0ac285a032f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:44.725996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cb4aefaa-3791-4e13-b514-ce37dcdc2eee req-d18832a7-e9a4-493d-b7d5-f0f0b3e2f566 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.726484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cb4aefaa-3791-4e13-b514-ce37dcdc2eee req-d18832a7-e9a4-493d-b7d5-f0f0b3e2f566 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.726920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cb4aefaa-3791-4e13-b514-ce37dcdc2eee req-d18832a7-e9a4-493d-b7d5-f0f0b3e2f566 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:44.759131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cb4aefaa-3791-4e13-b514-ce37dcdc2eee req-d18832a7-e9a4-493d-b7d5-f0f0b3e2f566 service nova] Creating event network-changed:5ee2ceed-907c-4d70-993e-f0ac285a032f for instance fd125db0-334a-4f83-a30f-878f41c4e688 on n-h2-857467-1 Sep 13 16:32:44.768342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cb4aefaa-3791-4e13-b514-ce37dcdc2eee req-d18832a7-e9a4-493d-b7d5-f0f0b3e2f566 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072011 Sep 13 16:32:44.770311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 309/615] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:44.783525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:44.785898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:44.802210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.805379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.805952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:44.806762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:44.810167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:44.810633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.147325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.162479 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-249ebc4e-ead1-490d-a8f0-8be68b66307d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 1.041397 Sep 13 16:32:45.173899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 307/616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:44 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:45.180232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:45.182831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:45.201608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.203753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.205937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.207066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.207550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.210151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.472699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.485266 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4808a14b-0db5-4219-9469-7802faaef5a0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1467 microversion: 2.1 time: 0.711377 Sep 13 16:32:45.487675 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 310/617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:44 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1467 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:45.498805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:45.503054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:45.518400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.519989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.521173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.521945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.522417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.522856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.664118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.676823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.678617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.679792 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e75300ed-420c-496f-9b59-c4f94c0293e4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.514713 Sep 13 16:32:45.680691 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 308/618] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:45 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:45.685106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32cea713-99bc-4704-8093-e66678225863 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] Calling method '.version_select at 0x7fbeb58325e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:45.887098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.905342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00e48f10-f913-41d0-9f30-3cdca2a07e30 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.415926 Sep 13 16:32:45.906082 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 311/619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:45 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:45.913301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:45.918326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:45.919379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Searching by: {'reservation_id': 'r-amulqehv', 'deleted': False, 'project_id': 'ade763eb224a494f86d28a38ca26c17a'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:32:45.930130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.930620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.931057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:45.932880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:45.933344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:45.934134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.124956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:32:46.279822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:46.291510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.292019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.292520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.622146 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32cea713-99bc-4704-8093-e66678225863 tempest-SecurityGroupRulesNegativeTestJSON-1989012196 tempest-SecurityGroupRulesNegativeTestJSON-1989012196-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/12b370fd-39cb-40b5-96af-c5b626352282" status: 202 len: 0 microversion: 2.1 time: 0.940337 Sep 13 16:32:46.624937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 309/620] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:32:45 2022] DELETE /compute/v2.1/os-security-groups/12b370fd-39cb-40b5-96af-c5b626352282 => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:32:46.631276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8764c08e-3343-4987-8356-35f867c3ed57 req-9add04bb-7b75-4858-a9c2-81765b0e5157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378220d4-c1e6-4b23-984a-f0151aa19039", "tag": "3f72e4f3-3cf0-4a5b-972a-e784bddb2960"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:46.649074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8764c08e-3343-4987-8356-35f867c3ed57 req-9add04bb-7b75-4858-a9c2-81765b0e5157 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.650413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8764c08e-3343-4987-8356-35f867c3ed57 req-9add04bb-7b75-4858-a9c2-81765b0e5157 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.653637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8764c08e-3343-4987-8356-35f867c3ed57 req-9add04bb-7b75-4858-a9c2-81765b0e5157 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.665366 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3103d26f-278e-420c-84f5-146f922152c7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?reservation_id=r-amulqehv" status: 200 len: 2928 microversion: 2.1 time: 0.757293 Sep 13 16:32:46.666205 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 312/621] 10.222.0.61 () {58 vars in 1197 bytes} [Tue Sep 13 16:32:45 2022] GET /compute/v2.1/servers/detail?reservation_id=r-amulqehv => generated 2928 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:46.685028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:46.685891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:46.697565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.700205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.700904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.701810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.706131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.707516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.714190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8764c08e-3343-4987-8356-35f867c3ed57 req-9add04bb-7b75-4858-a9c2-81765b0e5157 service nova] Creating event network-changed:3f72e4f3-3cf0-4a5b-972a-e784bddb2960 for instance 378220d4-c1e6-4b23-984a-f0151aa19039 on n-h2-857467-1 Sep 13 16:32:46.726840 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8764c08e-3343-4987-8356-35f867c3ed57 req-9add04bb-7b75-4858-a9c2-81765b0e5157 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099901 Sep 13 16:32:46.728631 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 310/622] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:46.747895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cda4c6f9-6dec-413c-8902-a9adfa1589b5 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:46.811470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.server_groups [None req-cda4c6f9-6dec-413c-8902-a9adfa1589b5 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Querying cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) for 2 instances {{(pid=122327) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 13 16:32:46.818928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cda4c6f9-6dec-413c-8902-a9adfa1589b5 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.819685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cda4c6f9-6dec-413c-8902-a9adfa1589b5 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.820478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cda4c6f9-6dec-413c-8902-a9adfa1589b5 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.876936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cda4c6f9-6dec-413c-8902-a9adfa1589b5 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/673962af-7385-446a-8995-effa05af0d17" status: 200 len: 265 microversion: 2.1 time: 0.144739 Sep 13 16:32:46.883799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 311/623] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:32:46 2022] GET /compute/v2.1/os-server-groups/673962af-7385-446a-8995-effa05af0d17 => generated 265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:46.898071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:46.899091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:46.915298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.916140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.916771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:46.917640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:46.918279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:46.919305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.074060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:47.092130 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0dbbd9e8-0b4f-4bfe-a740-bf05b4a3d6da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.419958 Sep 13 16:32:47.094564 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 313/624] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:46 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:47.106862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:47.110843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:47.128502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.129819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.130709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.135185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.138657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.139419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.385683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:47.402064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:47.408756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:47.411753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3dc96d06-be9b-4435-a43e-aefe822c2063 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.518799 Sep 13 16:32:47.412819 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 312/625] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:46 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:47.428014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:47.428869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:47.441820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.444209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.444832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.446218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.447649 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-937d89d2-0647-48eb-8793-808942892419 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 200 len: 1619 microversion: 2.1 time: 0.351582 Sep 13 16:32:47.448203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.461988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 314/626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:47 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 1619 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:47.462308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.473245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:47.474110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:47.480838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.481549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.482267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.483382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:47.484058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:47.484635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:47.734872 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70ec0490-43d2-4aad-a11c-0f3919ccea81 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1618 microversion: 2.1 time: 0.266705 Sep 13 16:32:47.741409 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 315/627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:47 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1618 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:32:47.768046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b442b639-30ab-42ab-b1d1-5a78998df267 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: .version_select at 0x7fbeb5843f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1111612268", "policies": ["anti-affinity"]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:47.798625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b442b639-30ab-42ab-b1d1-5a78998df267 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:47.806081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b442b639-30ab-42ab-b1d1-5a78998df267 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:47.872979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b442b639-30ab-42ab-b1d1-5a78998df267 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:47.880294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b442b639-30ab-42ab-b1d1-5a78998df267 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:47.897053 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b442b639-30ab-42ab-b1d1-5a78998df267 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.133039 Sep 13 16:32:47.898098 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 316/628] 10.222.0.61 () {60 vars in 1174 bytes} [Tue Sep 13 16:32:47 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:32:48.117521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:48.124775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:48.143326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:48.149580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:48.150168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:48.150940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:48.151411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:48.151851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:48.288299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:48.301092 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-955752c6-9368-497f-b5ed-0a4a507f998f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.883280 Sep 13 16:32:48.303475 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 313/629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:47 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:48.314349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1311312401", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cfb868d3-0846-4b93-bb1d-82fc0706cfd7"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:48.363970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:48.369084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:48.409191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:32:48.577143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:48.591983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-938fb133-c21e-4a88-ae50-85a82568b046 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.478996 Sep 13 16:32:48.606789 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 317/630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:48 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:48.615129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:48.616016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:48.622465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:48.634232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:48.637340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:48.641290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:48.642985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:48.643592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:48.933283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:48.957040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:48.972861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:48.974471 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-83e150f5-70bd-4480-91ae-0e211dd2acd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.366583 Sep 13 16:32:48.979191 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 318/631] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:48 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:49.324529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:49.325984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:49.356629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.357067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.357511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.360702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.362294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.362937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.555124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:49.565636 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cf1fe75-561d-489b-988f-8bce14debc1c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.244784 Sep 13 16:32:49.567611 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 319/632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:49 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:49.632589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:49.633869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:49.644216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.644881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.645453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.646411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.647065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.647666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:32:49.648126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:32:49.648558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:32:49.648808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.648967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:32:49.650213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:32:49.676282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.677352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.678354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.680146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:49.681953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:49.683164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:49.712074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:49.721744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:49.752662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Going to run 2 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:32:49.755400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:49.835723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:49.848239 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1b04620-eacc-4f3e-8a01-a3c96660e6c0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.227995 Sep 13 16:32:49.849491 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 320/633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:49 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:49.860517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122327) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 13 16:32:49.885037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:49.898334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:49.968702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:49.976305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:49.998578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=3f713f51-2900-40e9-982b-5a9b17a5729e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:50.044942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-825592279", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "8a9524ad-1d46-4f6a-be0d-1f61259b0753"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:50.083575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:50.091826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:50.136002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] validate_networks() for [('8a9524ad-1d46-4f6a-be0d-1f61259b0753', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:32:50.152356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:50.176308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:50.184617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'server_group_members'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:50.236382 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-53bf489a-8941-405d-9688-2f733ac4bfd8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.927703 Sep 13 16:32:50.237023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 314/634] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:32:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 1931 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:32:50.248677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:50.249413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:50.257848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.258757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.259260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.260012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.260938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.261387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.766812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:32:50.767994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:32:50.768481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:32:50.769087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:32:50.769510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:32:50.779935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.781602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.782233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.783180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.783864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.784476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.804953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:50.813785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for user 1fdc6602945c46fa98eebf50ea85a86e and project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:50.832580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:32:50.835011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:50.843487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:50.875676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:50.881185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:50.893131 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aacd96e7-27cb-45fe-a027-6802be8a6cac tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.644535 Sep 13 16:32:50.897303 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 315/635] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:50 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:50.914671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:50.927716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d6e6e44-25b6-41a2-8e1b-138bc6198f5f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076455 Sep 13 16:32:50.929028 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 321/636] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:32:50.934093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:50.935170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:50.943288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.944035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.944628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:50.944802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.945537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Searching by: {'deleted': False, 'project_id': 'ade763eb224a494f86d28a38ca26c17a'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:32:50.946052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.946667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.947248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.982045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:50.993014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:50.993554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:50.994104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:50.994859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:51.002281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:51.002902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:51.068356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:32:51.142403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9214e9e2-6761-413e-b05f-5191f0eb0894 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.242601 Sep 13 16:32:51.148384 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 316/637] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:32:50 2022] GET /compute/v2.1/servers => generated 1664 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:51.154230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:51.158170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:51.180362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:51.180979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:51.181546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:51.182466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:51.182970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:51.189663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:51.277323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:51.287913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5bd48f3f-a122-45bd-a539-8b509d29de36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.357450 Sep 13 16:32:51.288709 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 322/638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:50 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:51.293643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b586a7f7-4ca7-4fcf-94f4-1ceeece58c3c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:51.294631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b586a7f7-4ca7-4fcf-94f4-1ceeece58c3c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:51.381401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b586a7f7-4ca7-4fcf-94f4-1ceeece58c3c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:51.392512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b586a7f7-4ca7-4fcf-94f4-1ceeece58c3c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1210 microversion: 2.1 time: 0.100917 Sep 13 16:32:51.393805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 323/639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:51 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:51.399376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56c09bd7-42c5-4fd3-ae54-0115ab90f3b8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:51.400725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-56c09bd7-42c5-4fd3-ae54-0115ab90f3b8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:51.492076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56c09bd7-42c5-4fd3-ae54-0115ab90f3b8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:51.505084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-56c09bd7-42c5-4fd3-ae54-0115ab90f3b8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1219 microversion: 2.1 time: 0.106301 Sep 13 16:32:51.507077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 324/640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:51 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:51.930121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:51.931954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:51.947523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:51.952662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:51.953415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:51.954126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:51.954662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:51.956224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.453351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:52.465596 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a540a755-60a5-4904-afd9-66501dd55f58 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 1.314677 Sep 13 16:32:52.466745 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 317/641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:51 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:52.482805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-41dce76d-6bb0-4ec1-858e-552b1df8c253 req-abd3ecb9-fcf9-433a-87ad-616f37fc678b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd125db0-334a-4f83-a30f-878f41c4e688", "name": "network-vif-plugged", "status": "completed", "tag": "5ee2ceed-907c-4d70-993e-f0ac285a032f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:52.510479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-41dce76d-6bb0-4ec1-858e-552b1df8c253 req-abd3ecb9-fcf9-433a-87ad-616f37fc678b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.513508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-41dce76d-6bb0-4ec1-858e-552b1df8c253 req-abd3ecb9-fcf9-433a-87ad-616f37fc678b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.515153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-41dce76d-6bb0-4ec1-858e-552b1df8c253 req-abd3ecb9-fcf9-433a-87ad-616f37fc678b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.539060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-41dce76d-6bb0-4ec1-858e-552b1df8c253 req-abd3ecb9-fcf9-433a-87ad-616f37fc678b service nova] Creating event network-vif-plugged:5ee2ceed-907c-4d70-993e-f0ac285a032f for instance fd125db0-334a-4f83-a30f-878f41c4e688 on n-h2-857467-1 Sep 13 16:32:52.550999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-41dce76d-6bb0-4ec1-858e-552b1df8c253 req-abd3ecb9-fcf9-433a-87ad-616f37fc678b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080670 Sep 13 16:32:52.567393 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 318/642] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:32:52.581249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:52.583302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:52.593422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.594224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.594862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.595761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.596393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.598315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.821003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:52.831305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:52.833434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:52.836514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc472395-d277-4b41-82ee-437bf3a0a9a1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.910206 Sep 13 16:32:52.838221 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 325/643] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:51 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:52.844410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:52.845896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:52.853532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.854286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.855440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.856844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:52.857719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:52.858904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:52.992942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:53.015136 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-262f8fb8-d110-4ae3-b135-4e3c24856d62 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1206 microversion: 2.1 time: 0.175423 Sep 13 16:32:53.037265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 326/644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:52 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1206 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:53.050545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:53.070516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:53.083474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.087500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.088121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.090244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.091491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.097522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.262217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:53.297224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7cf77006-b88c-43fe-9991-ed455f80ce4e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1271 microversion: 2.1 time: 0.235841 Sep 13 16:32:53.300077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 327/645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:53 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:53.318885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:53.318885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:53.329221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:53.340323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.340847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.341300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.342072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.342542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.348586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.407436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:53.419448 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-635a74dd-c801-4595-a16a-fc91dc2a9b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.850086 Sep 13 16:32:53.432548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:32:53.434082 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 319/646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:52 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:53.497202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:53.498087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:53.513527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.516342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.525305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.526622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:53.529016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:53.529564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:53.596724 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd13a848-926d-42cf-9ab9-0d5a2e8557e9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 204 len: 0 microversion: 2.1 time: 0.287374 Sep 13 16:32:53.598060 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 328/647] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:32:53 2022] DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:32:53.793331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1738092621", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "1694019408", "adminPass": "***", "networks": [{"uuid": "5d428c01-42ae-4ea7-9f4b-06da697d06f8"}], "security_groups": [{"name": "tempest-securitygroup--1630000524"}], "key_name": "tempest-keypair-1864724555", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:32:53.967052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] validate_networks() for [('5d428c01-42ae-4ea7-9f4b-06da697d06f8', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:32:54.339889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:54.357706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2327ffc-ea73-4b53-a634-13582f209e15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.865338 Sep 13 16:32:54.358939 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 320/648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:53 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:54.363887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:54.366982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:54.378903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.390086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.390962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.391733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.392209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.392658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.557576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:32:54.558143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:32:54.558745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:32:54.559294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:32:54.559790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:32:54.573540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.574482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.574993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.576175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.576909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.577850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.619003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Getting quotas for project 2a858bc8ce4e413daa756d969d53a093. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:32:54.626560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Getting quotas for user 5bfa5c9e4b2b47dfb53c471554382f2d and project 2a858bc8ce4e413daa756d969d53a093. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:32:54.644587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:32:54.647291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:32:54.721395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a7e56419-5067-45da-9113-3d853b1f10be tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.935217 Sep 13 16:32:54.722502 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 329/649] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:32:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:32:54.735580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:54.736204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:54.743677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.744184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.744745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.745486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.746016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.746865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.863388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:54.876151 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-21bdc568-0287-4bc3-a860-5d8f647cf87b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1262 microversion: 2.1 time: 0.145807 Sep 13 16:32:54.877350 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 330/650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:54 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:54.886076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:54.887445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:54.916802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.917599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.918190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:54.919041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:54.919895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:54.920604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.123460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.138092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a8c0e71-3b5a-4bad-a67b-9ccc06e2464d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1277 microversion: 2.1 time: 0.253385 Sep 13 16:32:55.141923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 331/651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:54 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:55.153309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:55.155955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:55.172700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.175975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.176992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.178139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.178819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.180333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.517089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.539291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.550042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.552378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.558768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc0285b1-f6a7-44ea-b410-c142e3d6585f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 1.195051 Sep 13 16:32:55.559427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 321/652] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:54 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:55.578105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcf2cc30-4d33-449a-8a09-0d3facee2664 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1313 microversion: 2.1 time: 0.431839 Sep 13 16:32:55.588676 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 332/653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:55 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:55.592595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:55.593436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:55.603912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:55.614427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:55.623201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.629461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.631615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.632615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.638013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.638881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.641119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.641526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.647510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.648486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.649121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.649901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.784679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:55.798188 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93c54595-4690-4f66-a90b-34afb16387e5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1269 microversion: 2.1 time: 0.235009 Sep 13 16:32:55.800220 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 322/654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:55 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:55.901967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:55.903596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:55.913559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.915178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.915831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:55.916820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:55.920229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:55.922422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.035190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:56.074679 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f34cf68-1581-4079-a284-b671c5fd6fe3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.484380 Sep 13 16:32:56.082005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:56.090693 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9bebf5d-f4a7-4283-b8ac-9c2bb22b4900 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1262 microversion: 2.1 time: 0.193475 Sep 13 16:32:56.095228 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 323/655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:55 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:56.096667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 333/656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:55 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:56.164791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:56.166899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:56.181639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.182077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.190093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.191035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.191541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.191997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.457111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:56.472685 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7ffd00f-5a4c-4648-a59a-cc62402f3676 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1277 microversion: 2.1 time: 0.311620 Sep 13 16:32:56.488350 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 324/657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:56 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:56.586738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:56.587404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:56.603025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.603932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.604919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.606270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.620028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:56.620798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:56.622183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.622686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.636830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.637353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.637804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:56.638538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:56.638997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:56.639429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.204085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.204599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.208799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:32:57.214230 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55847c67-b938-46a4-9c84-3d40d6746db2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1463 microversion: 2.1 time: 0.602573 Sep 13 16:32:57.228581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.228581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.229777 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 325/658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:56 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1463 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:57.234358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8eba9531-93b5-4273-b639-e92669db2367 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 0.639289 Sep 13 16:32:57.238641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 334/659] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:56 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:57.243655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:57.244466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:57.247755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:57.257085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:57.259693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.260395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.261223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.263218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.264049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.265207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.267365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.268194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.268823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.269750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.270399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.271093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.634814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.644181 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd994af7-7968-4749-b65a-9e2f5352d579 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1317 microversion: 2.1 time: 0.412839 Sep 13 16:32:57.645331 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 326/660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:57 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:57.650333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:57.651177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:57.665813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.666653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.667336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.668573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.669686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.670438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.704994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:57.719587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bbfc9e0e-b406-42f4-8159-02cab5e85318 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1476 microversion: 2.1 time: 0.479555 Sep 13 16:32:57.731541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 335/661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:57 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1476 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:57.910208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:57.916181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'deleted': False, 'project_id': '837c7eecf3ec4004a5abb1e579b9a74c'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:32:57.935422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.935913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.937013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:57.938309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:57.938962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:57.939396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.004130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:58.023083 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9d937e8-28ee-4188-ae16-9747bda6321f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1268 microversion: 2.1 time: 0.375971 Sep 13 16:32:58.026307 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 327/662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:57 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1268 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:58.038101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:58.038971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:58.059916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.061275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.063797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.065067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.065549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.068215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.079350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35a396a5-62de-43c0-a610-ab189769bb48 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.345996 Sep 13 16:32:58.080782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 336/663] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:32:57 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:32:58.104271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:58.112066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'deleted': False} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:32:58.123013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.124370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.125091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.126705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.127539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.129087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.270553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:32:58.301860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:58.320934 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20c30c8e-b105-4c36-8e1e-5aa707bc94dc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1277 microversion: 2.1 time: 0.291104 Sep 13 16:32:58.321519 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 328/664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:58 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:58.359136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:58.359350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:58.366318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.366983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.367629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.368512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.369901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.370528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:58.385545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:58.386123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:58.386643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:59.436799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:59.472237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:59.472237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:59.476858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0b85b3a-ec63-40d4-8832-f07c6a2f385a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1568 microversion: 2.25 time: 1.133677 Sep 13 16:32:59.476858 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 329/665] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:32:58 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1568 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:32:59.495593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:59.500373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:59.522803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:59.523334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:59.525633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:59.527611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:59.529650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:59.532450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:59.928540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:32:59.941077 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b16a856-f60f-4ab2-b43a-1dd0431ee185 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1323 microversion: 2.1 time: 0.460059 Sep 13 16:32:59.958430 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 330/666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:59 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:32:59.962907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9b47368-23c0-408d-9799-ba2e89291b82 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20541 microversion: 2.1 time: 1.861195 Sep 13 16:32:59.963430 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 337/667] 10.222.0.61 () {58 vars in 1171 bytes} [Tue Sep 13 16:32:58 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20541 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:32:59.967375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:59.968292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:59.974759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:59.975569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:59.976235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:32:59.977183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:32:59.987236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:32:59.987737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:32:59.988554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:32:59.988680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:00.003063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:00.003853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:00.010569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:00.017391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:00.019538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:00.021704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:00.197794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=22 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:00.828415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:00.865657 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8afa24b5-e98e-4554-ba43-cd2e18781858 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1475 microversion: 2.1 time: 0.905772 Sep 13 16:33:00.867959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 331/668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:59 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1475 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:00.885633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:00.886363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:00.909847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:00.915633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:00.917094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:00.918419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:00.923335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:00.924731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.025665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:01.092614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:01.106322 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69086a75-012d-4525-a1a6-6175d5fc4421 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 1.139608 Sep 13 16:33:01.107461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 338/669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:32:59 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:01.120131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:01.133394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'deleted': False, 'project_id': '837c7eecf3ec4004a5abb1e579b9a74c'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:01.150997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.151776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.153012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.154037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.154716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.155716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.214980 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b379c94-da5c-42bb-9388-7601c5f342e2 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?tenant_id=fd7b2634429c46c1ac366579351c3389" status: 200 len: 15 microversion: 2.1 time: 0.103045 Sep 13 16:33:01.226980 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 339/670] 10.222.0.61 () {58 vars in 1231 bytes} [Tue Sep 13 16:33:01 2022] GET /compute/v2.1/servers/detail?tenant_id=fd7b2634429c46c1ac366579351c3389 => generated 15 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:33:01.245854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6ddb8d4d-f5c2-4a7c-98a9-8799e3cc84ad req-67272c83-b55c-42be-8c3e-c268ad7bea7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a647c7-7b9d-4873-bfb2-006e147ec404", "name": "network-vif-deleted", "tag": "30a7014a-5536-4aed-81bd-a67758ed1172"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:01.264875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6ddb8d4d-f5c2-4a7c-98a9-8799e3cc84ad req-67272c83-b55c-42be-8c3e-c268ad7bea7c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.265912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6ddb8d4d-f5c2-4a7c-98a9-8799e3cc84ad req-67272c83-b55c-42be-8c3e-c268ad7bea7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.270439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6ddb8d4d-f5c2-4a7c-98a9-8799e3cc84ad req-67272c83-b55c-42be-8c3e-c268ad7bea7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.295189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6ddb8d4d-f5c2-4a7c-98a9-8799e3cc84ad req-67272c83-b55c-42be-8c3e-c268ad7bea7c service nova] Creating event network-vif-deleted:30a7014a-5536-4aed-81bd-a67758ed1172 for instance 58a647c7-7b9d-4873-bfb2-006e147ec404 on n-h1-857467-1 Sep 13 16:33:01.303677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6ddb8d4d-f5c2-4a7c-98a9-8799e3cc84ad req-67272c83-b55c-42be-8c3e-c268ad7bea7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075033 Sep 13 16:33:01.304967 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 340/671] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:01.316378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:01.320722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:01.336875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.337719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.344959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.346355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.347207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.347860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.387946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:01.894447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:01.903684 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e374dd0-0675-487a-bd69-2a17cf788c76 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 1.034323 Sep 13 16:33:01.914335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 332/672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:00 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:01.927625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:01.939294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:01.947487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.955614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.956312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:01.957401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:01.958142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:01.958808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:02.373608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:02.383722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:02.389219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:02.396582 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-486ed789-d48e-4cc0-9796-c7bbb628f778 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1558 microversion: 2.25 time: 1.088855 Sep 13 16:33:02.397740 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 341/673] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:01 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1558 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:02.408219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:02.422821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'tenant_id': 'fd7b2634429c46c1ac366579351c3389', 'deleted': False} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:02.437461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:02.437986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:02.438434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:02.439251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:02.439751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:02.440222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:02.503956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:33:02.730558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:02.732350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:02.734323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.302380 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d4f9cdb7-49a7-4241-88e5-dcab5fc751e0 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fd7b2634429c46c1ac366579351c3389" status: 200 len: 4825 microversion: 2.1 time: 0.903272 Sep 13 16:33:03.303299 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 342/674] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Sep 13 16:33:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fd7b2634429c46c1ac366579351c3389 => generated 4825 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:03.307957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0272cbd-8228-4707-9a6b-8781acb6cde6", "name": "network-vif-unplugged", "status": "completed", "tag": "3e05a151-0e1f-45e9-b3a0-919f9626ba5c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:03.328657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.341840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.342762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.345650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:03.357679 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] Creating event network-vif-unplugged:3e05a151-0e1f-45e9-b3a0-919f9626ba5c for instance f0272cbd-8228-4707-9a6b-8781acb6cde6 on n-h1-857467-1 Sep 13 16:33:03.369710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-619c0ce6-c0b4-4b82-99b0-4d2e6961e6c1 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 1.453783 Sep 13 16:33:03.370952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 333/675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:01 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:03.384787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:03.386526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:03.395926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:33:03.455255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.460874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.488425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.489393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.489926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.490386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.506654 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a7dee6b1-af63-4602-9a13-d39092fa17c8 req-53550909-c74c-4ff9-a82f-d62c9f8fda03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201261 Sep 13 16:33:03.507937 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 343/676] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:03.521411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:03.522543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:03.541059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.543729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.546832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.548666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:03.549773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:03.550529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:03.976115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:03.985039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b65d3bfa-9d27-4bc1-8cee-757eb7ec250c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1475 microversion: 2.1 time: 0.612343 Sep 13 16:33:03.999168 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 334/677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:03 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1475 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:04.014030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e98fa110-fad1-4aa6-aebf-88e95a557430 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '.version_select at 0x7fbeb57308b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.018272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e98fa110-fad1-4aa6-aebf-88e95a557430 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.020749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e98fa110-fad1-4aa6-aebf-88e95a557430 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.021204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e98fa110-fad1-4aa6-aebf-88e95a557430 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.041499 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e98fa110-fad1-4aa6-aebf-88e95a557430 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 865 microversion: 2.25 time: 0.040759 Sep 13 16:33:04.042518 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 335/678] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Sep 13 16:33:03 2022] GET /compute/v2.1/os-migrations => generated 865 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:33:04.047733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.048346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:04.057337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.058435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.058882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.059645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.060526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.060526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.289423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:04.298097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35046c7f-9092-4a66-a945-53f947603f30 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.787161 Sep 13 16:33:04.298695 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 344/679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:03 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:04.310217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.319695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'tenant_id': '837c7eecf3ec4004a5abb1e579b9a74c', 'deleted': False} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:04.325041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.325786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.326423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.327650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.328399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.328988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.364962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2ff948d0-a8d8-4b2d-96a9-b8012cd6a9b5 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=837c7eecf3ec4004a5abb1e579b9a74c" status: 200 len: 15 microversion: 2.1 time: 0.058221 Sep 13 16:33:04.366424 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 345/680] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Sep 13 16:33:04 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=837c7eecf3ec4004a5abb1e579b9a74c => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:33:04.372009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-89523e55-2db6-4aae-a6d4-cfc7bb58eed2 req-5323de3f-3b7c-49bb-b0a8-a6bc9fb97dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f713f51-2900-40e9-982b-5a9b17a5729e", "tag": "239148a0-6245-4c20-8507-36285e1996c2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:04.384187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89523e55-2db6-4aae-a6d4-cfc7bb58eed2 req-5323de3f-3b7c-49bb-b0a8-a6bc9fb97dd9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.384737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89523e55-2db6-4aae-a6d4-cfc7bb58eed2 req-5323de3f-3b7c-49bb-b0a8-a6bc9fb97dd9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.385179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89523e55-2db6-4aae-a6d4-cfc7bb58eed2 req-5323de3f-3b7c-49bb-b0a8-a6bc9fb97dd9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.398083 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-89523e55-2db6-4aae-a6d4-cfc7bb58eed2 req-5323de3f-3b7c-49bb-b0a8-a6bc9fb97dd9 service nova] Creating event network-changed:239148a0-6245-4c20-8507-36285e1996c2 for instance 3f713f51-2900-40e9-982b-5a9b17a5729e on n-h1-857467-1 Sep 13 16:33:04.404197 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-89523e55-2db6-4aae-a6d4-cfc7bb58eed2 req-5323de3f-3b7c-49bb-b0a8-a6bc9fb97dd9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035854 Sep 13 16:33:04.406066 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 346/681] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:04.411457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.412475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:04.419753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.421167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.422177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.423177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.423802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.424589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.815784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:04.830650 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c791407e-4973-4159-87bb-49b70efaee6c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 0.786973 Sep 13 16:33:04.846287 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 336/682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:04 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:04.853266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 378220d4-c1e6-4b23-984a-f0151aa19039 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:04.855408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.856646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:04.864035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.864692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.865245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.866739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:04.867452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:04.868353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:04.956847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-16501c0d-c654-4b25-b1e3-eb13598116d9 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 2051 microversion: 2.25 time: 0.548897 Sep 13 16:33:04.958015 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 347/683] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:04 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 2051 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:04.963537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22af64ce-3e35-4618-8d37-21aeb9b8dd4f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:04.971360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22af64ce-3e35-4618-8d37-21aeb9b8dd4f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011691 Sep 13 16:33:04.972292 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 348/684] 10.222.0.61 () {58 vars in 1189 bytes} [Tue Sep 13 16:33:04 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:33:05.024944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:05.031214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:05.058922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:05.059431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:05.059875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:05.060605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:05.061695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:05.065102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:05.245345 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f7ad0f0-26e5-4390-b300-dc91dcdc161a tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 0 microversion: 2.1 time: 0.227326 Sep 13 16:33:05.251105 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 349/685] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:05 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:33:05.261870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:05.262501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:05.269760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:05.270310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:05.270742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:05.271449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:05.271901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:05.272324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:05.357422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:05.382186 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4021c5bb-e58f-48d1-8fa2-0aed4de7916e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.531399 Sep 13 16:33:05.385306 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 337/686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:04 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:05.402319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1884303562", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "e0e29954-773d-492f-aa39-e96119d607b1"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:05.494960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] validate_networks() for [('e0e29954-773d-492f-aa39-e96119d607b1', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:06.072923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:06.093878 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40026f17-3d4c-403b-b509-8aa3a1f50fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1475 microversion: 2.1 time: 0.841173 Sep 13 16:33:06.094935 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 350/687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:05 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1475 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:06.100483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:06.106488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:06.107600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'fd7b2634429c46c1ac366579351c3389'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:06.114805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.115609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.116282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.117259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.117972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.118645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.225407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:33:06.333988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-09c2ccaf-09b5-400f-b701-2f060d337a02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.237370 Sep 13 16:33:06.340235 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 351/688] 10.222.0.61 () {58 vars in 1150 bytes} [Tue Sep 13 16:33:06 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:06.350274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:06.350795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:06.350901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:06.351049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:06.351194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:06.351778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:06.352211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:06.360150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.360914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.362281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.363195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.364105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.364990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.369784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.370365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.370824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.371542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.372001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.374845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.396110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:06.411277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for user 792d76dbc4394c77bee09f600364cb74 and project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:06.443033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:06.445770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:06.525277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c54e619-125c-4367-bdbc-469367edcfd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.133803 Sep 13 16:33:06.525277 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 338/689] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:33:06.534743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0272cbd-8228-4707-9a6b-8781acb6cde6", "tag": "3e05a151-0e1f-45e9-b3a0-919f9626ba5c"}, {"name": "network-changed", "server_uuid": "fb790b17-b5c3-484b-81de-574c0f11fc05", "tag": "19c1bc2a-b0a8-4c1b-b2b3-b4aa6fc503be"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:06.558383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.558756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.559444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.576180 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Creating event network-changed:3e05a151-0e1f-45e9-b3a0-919f9626ba5c for instance f0272cbd-8228-4707-9a6b-8781acb6cde6 on n-h1-857467-1 Sep 13 16:33:06.576890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Creating event network-changed:19c1bc2a-b0a8-4c1b-b2b3-b4aa6fc503be for instance fb790b17-b5c3-484b-81de-574c0f11fc05 on n-h2-857467-1 Sep 13 16:33:06.600290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:33:06.610778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:06.622279 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-fd2cd6ef-0fe1-4a8b-a52c-82e8bda2b1bd req-67efe02b-a3fc-4f53-8b24-40090a688ea6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.097108 Sep 13 16:33:06.622900 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 339/690] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:06.624784 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef72249b-85ce-4a50-b9bf-2414370bdd85 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.276187 Sep 13 16:33:06.626394 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 352/691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:06 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:06.635658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:06.649967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:06.650687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:06.657693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:06.667817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.669516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.669922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.674762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.675267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.675807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.676283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.676912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.678129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.680527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.682617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.683155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.899670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6df661e7-9963-40eb-a5b7-eae7a152232b tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 0 microversion: 2.1 time: 0.271251 Sep 13 16:33:06.901109 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 353/692] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:06 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:33:06.909590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:06.910847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:06.933065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.935799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.937749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:06.941217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:06.941978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:06.943041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.001807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.017460 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d01c017b-e687-47d7-9f3d-c4d3b478f781 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 0.393285 Sep 13 16:33:07.022694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 340/693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:06 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:07.027704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba427499-3971-463a-9fd1-065bbdee6476", "tag": "6f3c2223-a389-4adf-bbd7-8727cc9d53a9"}, {"name": "network-changed", "server_uuid": "11da3338-8829-45f4-83ef-80f4f8245aa0", "tag": "5dc80120-1f41-47b6-9362-e47f868e1fe8"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:07.083770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.089061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.090855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.131899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] Creating event network-changed:6f3c2223-a389-4adf-bbd7-8727cc9d53a9 for instance ba427499-3971-463a-9fd1-065bbdee6476 on n-h1-857467-1 Sep 13 16:33:07.135215 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] Creating event network-changed:5dc80120-1f41-47b6-9362-e47f868e1fe8 for instance 11da3338-8829-45f4-83ef-80f4f8245aa0 on n-h1-857467-1 Sep 13 16:33:07.156461 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-802845f6-5d3d-41fc-9b56-7f64dc9b3f4b req-e98fdee1-3af8-4bf6-86ef-08d48eb3b1ae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.132018 Sep 13 16:33:07.159647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 341/694] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:07.177717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f41ef88-3486-4ec0-9d54-ba5489d815de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:07.181261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f41ef88-3486-4ec0-9d54-ba5489d815de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:07.185427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.196466 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e9cd84e-389d-4891-90fd-95cb1f77dfdc tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.293923 Sep 13 16:33:07.197558 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 354/695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:06 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:07.203343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:07.204153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:07.210817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.211516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.212419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.216641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.217461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.218486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.307086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f41ef88-3486-4ec0-9d54-ba5489d815de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.321208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f41ef88-3486-4ec0-9d54-ba5489d815de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.324979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f41ef88-3486-4ec0-9d54-ba5489d815de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.326824 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f41ef88-3486-4ec0-9d54-ba5489d815de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1262 microversion: 2.25 time: 0.163671 Sep 13 16:33:07.328578 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 342/696] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:07 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:07.345627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:07.347133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:07.369380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.370996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.370996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.371182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.371594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.372204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.392941 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ded8cf7f-ef07-4cb9-b644-c048ee219d21 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1614 microversion: 2.1 time: 0.194118 Sep 13 16:33:07.393990 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 355/697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:07 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1614 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:07.399053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1440540153", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "7352fc00-7db8-47f7-89c7-535960409b8f"}, {"uuid": "0ce43416-c412-4d4f-8e5a-265c2325e967"}, {"uuid": "7352fc00-7db8-47f7-89c7-535960409b8f"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:07.497458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] validate_networks() for [('7352fc00-7db8-47f7-89c7-535960409b8f', None, None, None, None, None), ('0ce43416-c412-4d4f-8e5a-265c2325e967', None, None, None, None, None), ('7352fc00-7db8-47f7-89c7-535960409b8f', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:07.672766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:07.684530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0272523f-1a42-4776-abc5-349a9327b160 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1475 microversion: 2.1 time: 0.354412 Sep 13 16:33:07.688784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 343/698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:07 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1475 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:07.712069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:07.713122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:07.731004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.732421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.733771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:07.737008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:07.738046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:07.740146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:08.470195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5cbcfa3-2fa1-43ba-a7c9-f747cfd828d6 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1614 microversion: 2.1 time: 0.778968 Sep 13 16:33:08.479422 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 344/699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:07 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1614 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:08.485882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:08.486831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:08.506617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:08.507230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:08.507777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:08.508603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:08.509701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:08.515962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:08.929902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:08.938806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:08.952866 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19726e51-aa2b-4bca-a597-08434f4c6682 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.472032 Sep 13 16:33:08.953481 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 345/700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:08 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:08.981693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:08.986728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:09.004660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.006586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.010327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.012703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.015131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.020190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.563234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:09.580400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:09.580400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:09.580400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:09.580987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:09.581386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:09.586803 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5929af76-882d-486a-8596-5349c7967c82 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 0.618211 Sep 13 16:33:09.587978 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 346/701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:08 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:09.603663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=33 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:09.605261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:09.610208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.611172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:09.617219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.618753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.621388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.622544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.626347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.628151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.630647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.632492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.633444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.636024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.636713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.648138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=19 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:09.697233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Getting quotas for project a0136fccf2da48be91b87cc0e501a571. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:09.712302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Getting quotas for user a87575b0c830464695e168873145ba5b and project a0136fccf2da48be91b87cc0e501a571. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:09.728911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:09.731891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:09.746395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:09.786206 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42c6c225-6316-466d-b08c-df51afad2272 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390593 Sep 13 16:33:09.787609 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 356/702] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:33:09.792541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:09.793329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:09.801614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.802361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.802861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.803577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.804210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.804790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.832395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:09.890646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:09.901389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:09.903199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:09.904674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-50d69dff-44db-499f-aa50-fd889b463ee0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1320 microversion: 2.25 time: 0.115745 Sep 13 16:33:09.905951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 357/703] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:09 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1320 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:09.927386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:09.933585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'host': 'n-h2-857467-1', 'deleted': False} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:09.944835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.945330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.945966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:09.946999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:09.947612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:09.948217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.091309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:33:10.134337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:10.162744 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3a5c647-d67a-4de2-9304-f7b78b83a47f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers?host=n-h2-857467-1&all_tenants=1" status: 200 len: 1656 microversion: 2.1 time: 0.255534 Sep 13 16:33:10.164339 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 358/704] 10.222.0.61 () {58 vars in 1190 bytes} [Tue Sep 13 16:33:09 2022] GET /compute/v2.1/servers?host=n-h2-857467-1&all_tenants=1 => generated 1656 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:10.171769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:10.173524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.173645 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77478e1a-2f4c-4a4f-b068-b7830c8d74d5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.570157 Sep 13 16:33:10.175674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 347/705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:09 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:10.180713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.181440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.182118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.183018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.183687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.184530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.197508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-16f4ff5b-f09e-476b-9a8a-ca0146599022 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:10.198146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16f4ff5b-f09e-476b-9a8a-ca0146599022 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.381186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:10.389794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82feb91b-7356-4c4e-ba13-d9bcf891212a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1475 microversion: 2.1 time: 0.223437 Sep 13 16:33:10.391103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 359/706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:10 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1475 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:10.402797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:10.403951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.405080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16f4ff5b-f09e-476b-9a8a-ca0146599022 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:10.414753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-16f4ff5b-f09e-476b-9a8a-ca0146599022 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1213 microversion: 2.1 time: 0.238018 Sep 13 16:33:10.417530 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 348/707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:10 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:10.421752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.422292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.422731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.423443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.423900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.424327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.437409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:10.446821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:10.479599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.480095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.481323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.484086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.487084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.490423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.611367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:10.620291 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6aa8502-da02-4b5b-8a67-5b8c4938ec24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.227886 Sep 13 16:33:10.621683 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 360/708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:10 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:10.638199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:10.639617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.643753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9aab8517-6de9-414d-9783-b31151a74698 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.224108 Sep 13 16:33:10.644751 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 349/709] 10.222.0.61 () {58 vars in 1196 bytes} [Tue Sep 13 16:33:10 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:33:10.647879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.648416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.649022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.652184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.652874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.653664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.658635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:10.663219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.670982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.671516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.672171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.672939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.673402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.673853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.809273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76382469-9a09-48b3-bf50-5405b5df398f tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 0 microversion: 2.1 time: 0.156217 Sep 13 16:33:10.810281 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 350/710] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:10 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:33:10.826001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:10.835848 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b1e04f5-6c60-4838-97e8-383fb75ad248 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 0.212517 Sep 13 16:33:10.837178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 361/711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:10 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:10.841914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:10.846507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.861061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.861567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.862234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.862959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.863612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.866177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.931806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:10.932942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:10.942224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.943165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.944000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.944947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:10.945624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:10.946309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:10.983556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:10.990528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:10.991566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:10.992530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:10.993211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:10.993887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:11.146933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:11.159255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:11.164140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:11.168743 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d798f77a-9746-4567-a65f-488c5699b6b7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1320 microversion: 2.25 time: 0.242085 Sep 13 16:33:11.169978 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 362/712] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:10 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:11.212044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:11.212683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:11.232392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.235643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.236376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.241090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.241861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.242452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.286204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:11.330577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.334646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.336269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.337914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.340566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.341861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.458083 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b8180dd-94b3-4600-93d5-bd88ef50dd6d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 1067 microversion: 2.1 time: 0.631255 Sep 13 16:33:11.477436 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 351/713] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:10 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 1067 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 13 16:33:11.487049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:11.489473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:11.512689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.514513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.516788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:11.518651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:11.522309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:11.523805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.119279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.136620 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad646f88-75cc-4c3d-ae4f-9769ed2d9073 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.942418 Sep 13 16:33:12.138617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 363/714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:11 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:12.168099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:12.168791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:12.182672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.183406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.184233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.185126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.187323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.187982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.279374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.290158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4fc59be-9e59-4b44-8790-16fc6acbe951 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1273 microversion: 2.1 time: 0.149791 Sep 13 16:33:12.291684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 364/715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:12 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:12.308959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:12.309941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:12.319254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.320275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.320975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.322098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.322785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.323437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.501751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.515455 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85477ecf-21e3-4161-b1df-c963a6584ce1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.221023 Sep 13 16:33:12.516215 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 365/716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:12 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:12.521884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:12.522860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:12.532566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.533405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.534169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.535767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.536345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.536887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.588486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.601976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95bafbdd-c573-42b6-8f6f-9bca15f8f6bc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1475 microversion: 2.1 time: 1.123108 Sep 13 16:33:12.602574 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 352/717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:11 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1475 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:12.613539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:12.614199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:12.633921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.634433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.634883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.638551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.639190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.639620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.707495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.717509 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55d62c55-79e1-4e6b-bba3-b545c51c7b44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.199590 Sep 13 16:33:12.721032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 366/718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:12 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:12.727538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:12.728160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:12.740962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.741469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.741921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.742562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:12.750583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:12.751054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:12.917054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.926498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.929126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:12.930320 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd3691da-970e-4945-9f93-c1486ca935ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.208253 Sep 13 16:33:12.930896 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 367/719] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:12 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:13.165379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:13.166659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:13.173816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.174568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.175016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.175916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.176383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.176822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.243006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:13.260108 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ad61611-c447-4ee7-8a38-669d0617a3d7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 0.656453 Sep 13 16:33:13.276691 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 353/720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:12 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:13.326009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:13.327184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:13.349628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.350599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.351283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.353576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.354344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.355063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.517839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:13.529680 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a019d0a2-ae28-4ce0-bada-920ea860a571 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1271 microversion: 2.1 time: 0.208828 Sep 13 16:33:13.531374 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 354/721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:13 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:13.554478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7c0dd726-ee09-4235-a964-a5d8d062cf73 req-1a13f65b-25e5-4d9b-9720-0e93e3570829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb790b17-b5c3-484b-81de-574c0f11fc05", "name": "network-vif-plugged", "status": "completed", "tag": "19c1bc2a-b0a8-4c1b-b2b3-b4aa6fc503be"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:13.576467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7c0dd726-ee09-4235-a964-a5d8d062cf73 req-1a13f65b-25e5-4d9b-9720-0e93e3570829 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.577945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7c0dd726-ee09-4235-a964-a5d8d062cf73 req-1a13f65b-25e5-4d9b-9720-0e93e3570829 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.578934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7c0dd726-ee09-4235-a964-a5d8d062cf73 req-1a13f65b-25e5-4d9b-9720-0e93e3570829 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.602739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7c0dd726-ee09-4235-a964-a5d8d062cf73 req-1a13f65b-25e5-4d9b-9720-0e93e3570829 service nova] Creating event network-vif-plugged:19c1bc2a-b0a8-4c1b-b2b3-b4aa6fc503be for instance fb790b17-b5c3-484b-81de-574c0f11fc05 on n-h2-857467-1 Sep 13 16:33:13.608781 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7c0dd726-ee09-4235-a964-a5d8d062cf73 req-1a13f65b-25e5-4d9b-9720-0e93e3570829 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074471 Sep 13 16:33:13.612786 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 355/722] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:13.629872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:13.640251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:13.663522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:13.673401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.675552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.677212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-906640da-91bb-48f6-b002-36a0536f2eca tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.519480 Sep 13 16:33:13.677930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.678862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.679534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.689289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.696127 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 368/723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:13 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:13.703391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:13.704279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:13.713335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.713863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.714313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.715034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.715547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.723838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.947119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:13.958439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de0a0d18-0b42-458e-89e2-24e7635240da tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1473 microversion: 2.1 time: 0.261112 Sep 13 16:33:13.959371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 369/724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:13 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:13.975339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:13.976905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:13.985390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.986039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.986714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:13.987615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:13.988271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:13.988713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.149649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.162688 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c46588ce-70a6-4d3d-b741-68bb3c3ce2bc tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.548411 Sep 13 16:33:14.163604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.167631 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 356/725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:13 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:14.177520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:14.179532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:14.182967 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96ae02cf-f278-49aa-971b-b2778f6828c1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.211696 Sep 13 16:33:14.183797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 370/726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:13 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:14.198370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.200045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.200564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.201427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.201937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.202586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.289401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:14.290661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:14.298125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.299749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.300412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.301249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.302038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.302692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.457952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.472421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf203c8c-2c62-451c-8ce8-0c6109001f1b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1319 microversion: 2.1 time: 0.188118 Sep 13 16:33:14.482925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 371/727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:14 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:14.556655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:14.557383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:14.565687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.567035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.567691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.568495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.569334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.569969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.643330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.653086 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79430469-55b3-4416-959e-6b5d155f6416 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1271 microversion: 2.1 time: 0.100790 Sep 13 16:33:14.658698 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 372/728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:14 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:14.707767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:14.708382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:14.714482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.715176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.715808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.716522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.717569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.718228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.737492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:14.743833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.753541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.755721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.757126 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6d0bfe9-0f78-4237-ada5-092d5c16e3c4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.588303 Sep 13 16:33:14.770396 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 357/729] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:14 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:14.861622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:14.871079 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd0f23c2-16b4-491a-9385-b55b5bdab458 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.167165 Sep 13 16:33:14.871677 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 373/730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:14 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:14.983467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:14.984543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:14.991415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.992125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.992723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:14.993449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:14.994396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:14.995196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.193234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:15.193872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:15.200138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.200817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.201279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.202154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.202597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.203021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.343663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:15.352475 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0496c0bd-568f-4e84-bdd0-21db3b88aa97 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.169333 Sep 13 16:33:15.353331 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 374/731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:15 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:15.358583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:15.359500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:15.380750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.393353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.399926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.401352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.406446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.406923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.665586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:15.679462 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0beaad19-4fcc-4a9b-879f-3058bd57d32a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1473 microversion: 2.1 time: 0.699749 Sep 13 16:33:15.680728 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 358/732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:14 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1473 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:15.690847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:15.691924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:15.703986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.704887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.705578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.706683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.707401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.709244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.737331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:15.751291 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e471eedc-9a1b-41f0-8840-c5e5f458a958 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.396629 Sep 13 16:33:15.752976 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 375/733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:15 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:15.775043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b7488cb0-b8b2-47c8-88ea-6f911d86b205 req-b8e97524-21cd-4bc4-9040-68c47babf340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f713f51-2900-40e9-982b-5a9b17a5729e", "name": "network-vif-plugged", "status": "completed", "tag": "239148a0-6245-4c20-8507-36285e1996c2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:15.786707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b7488cb0-b8b2-47c8-88ea-6f911d86b205 req-b8e97524-21cd-4bc4-9040-68c47babf340 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.787467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b7488cb0-b8b2-47c8-88ea-6f911d86b205 req-b8e97524-21cd-4bc4-9040-68c47babf340 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.787914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b7488cb0-b8b2-47c8-88ea-6f911d86b205 req-b8e97524-21cd-4bc4-9040-68c47babf340 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.799917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b7488cb0-b8b2-47c8-88ea-6f911d86b205 req-b8e97524-21cd-4bc4-9040-68c47babf340 service nova] Creating event network-vif-plugged:239148a0-6245-4c20-8507-36285e1996c2 for instance 3f713f51-2900-40e9-982b-5a9b17a5729e on n-h1-857467-1 Sep 13 16:33:15.805307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b7488cb0-b8b2-47c8-88ea-6f911d86b205 req-b8e97524-21cd-4bc4-9040-68c47babf340 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050730 Sep 13 16:33:15.805953 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 376/734] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:15.813470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:15.814249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:15.820933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.821482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.822019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.822976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.823620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.824061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.968882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:15.977093 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5d1175d1-ea18-417d-a25d-6e89fbb986cb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1313 microversion: 2.1 time: 0.169899 Sep 13 16:33:15.977805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 377/735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:15 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:15.982541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:15.983497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:15.991314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.992687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.994179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:15.995230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:15.995698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:15.996138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.144155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.157357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb1fd0b8-6f37-4143-b273-50277d11b749 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1469 microversion: 2.1 time: 0.475014 Sep 13 16:33:16.158247 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 359/736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:15 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1469 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:16.163205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:16.163827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:16.174108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.175524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.176726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.177677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.178466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.178794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.180022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.187670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.189130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.190374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-95279182-05f3-4416-bf50-74ee4b567172 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.211417 Sep 13 16:33:16.191280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 378/737] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:15 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:16.196017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:16.197250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:16.204412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.205091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.205689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.206593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.207213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.207831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.348945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.357243 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f2b12f0-00db-404b-ab0c-8863ca9cde08 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1319 microversion: 2.1 time: 0.164731 Sep 13 16:33:16.357960 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 379/738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:16.363328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-dfda050f-5248-4efb-9ef5-96fc1b08dd9c req-7f41b26a-f7ae-4cbf-adde-2d1fe7b80691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc75b21-5d7e-45f8-9e20-54284da59b4f", "tag": "8cecb1b1-676f-4d30-903a-addf6afd1de1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:16.374208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-dfda050f-5248-4efb-9ef5-96fc1b08dd9c req-7f41b26a-f7ae-4cbf-adde-2d1fe7b80691 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.374795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-dfda050f-5248-4efb-9ef5-96fc1b08dd9c req-7f41b26a-f7ae-4cbf-adde-2d1fe7b80691 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.375408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-dfda050f-5248-4efb-9ef5-96fc1b08dd9c req-7f41b26a-f7ae-4cbf-adde-2d1fe7b80691 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.387423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-dfda050f-5248-4efb-9ef5-96fc1b08dd9c req-7f41b26a-f7ae-4cbf-adde-2d1fe7b80691 service nova] Creating event network-changed:8cecb1b1-676f-4d30-903a-addf6afd1de1 for instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f on n-h2-857467-1 Sep 13 16:33:16.393150 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-dfda050f-5248-4efb-9ef5-96fc1b08dd9c req-7f41b26a-f7ae-4cbf-adde-2d1fe7b80691 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033273 Sep 13 16:33:16.393878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 380/739] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:16.398834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:16.399521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:16.405595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.406131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.406569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.407265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.407719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.408156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.549938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.558708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a657358-6372-4f8d-b5ca-1b9a68bdd5fe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.163665 Sep 13 16:33:16.559300 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 381/740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:16.636582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.645467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d49b10c-b66a-455f-96bd-7575b3931d77 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.485811 Sep 13 16:33:16.646080 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 360/741] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:16.702835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:16.703448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:16.710022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.710525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.710972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.711689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.712430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.712566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.780722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:16.781349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:16.787505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.788005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.788653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.789713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:16.790358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:16.790950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:16.809268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:16.868681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:16.877562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12357faa-ad09-4668-bd95-9238d80ee8c4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1473 microversion: 2.1 time: 0.178797 Sep 13 16:33:16.878553 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 382/742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:17.001860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.002490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.009025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.009528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.010045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.010779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.011244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.011919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.178379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.188102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b192f594-18ca-426b-b59d-7c91595d9d73 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1313 microversion: 2.1 time: 0.190030 Sep 13 16:33:17.189174 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 383/743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:17.215075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.215736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.223709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.224237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.224675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.225391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.225871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.226307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.372925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.385137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.388226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.389610 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-044b2e7f-a448-4034-9d69-3d372e2f99a0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.178412 Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 384/744] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:17 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.405985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.427714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.442707 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cef5d7a5-f94f-4a56-bbe2-e86b7319995e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.665419 Sep 13 16:33:17.457852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 361/745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:16 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:17.541764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.551058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4ecbb92-340b-43c3-b1dc-b87482b24918 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1319 microversion: 2.1 time: 0.159742 Sep 13 16:33:17.555059 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 385/746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:17 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:17.582043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.582591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.588663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.589158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.589772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.590505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.590977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.591410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.671924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.672852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.687170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.688435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.689103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.690348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.691048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.691681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.840389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:17.851869 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-450d2b1b-a49a-4c93-8ee7-36532a703461 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.273893 Sep 13 16:33:17.852465 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 362/747] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:17 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:17.901215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:17.901745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:17.909872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.910675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.911216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.912358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:17.912927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:17.913583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:17.995809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.010727 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-096bfc3c-02ce-43cb-befb-a5635fade54e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.343802 Sep 13 16:33:18.012307 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 386/748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:17 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:18.077671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.085919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-222badd0-5365-477b-af48-5a1fe0719537 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1473 microversion: 2.1 time: 0.188703 Sep 13 16:33:18.087064 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 363/749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:17 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:18.214718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:18.215251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:18.222388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.223390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.223842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.224554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.225021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.225457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.415993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:18.417110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:18.429064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.431612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.432067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.434264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.434919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.436177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.440781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.453077 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-910359bd-7080-48be-8845-70d8dae620a2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1334 microversion: 2.1 time: 0.242238 Sep 13 16:33:18.454221 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 387/750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:18 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1334 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:18.486998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:18.490092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:18.499314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.500065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.500502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.501221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.501767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.502631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.635735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.646057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.647543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.648815 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-18491bf6-b2d2-4c2d-b95a-82c9cd7c2277 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.237438 Sep 13 16:33:18.649744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 364/751] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:18 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:18.654860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:18.655484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:18.662459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.663510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.664247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.665846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.666501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.667196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.774178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.786776 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dac728ae-e835-4ea5-a660-194561e96028 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.319163 Sep 13 16:33:18.797697 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 388/752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:18 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:18.823189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:18.834439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f98ca5e9-ecf1-4939-ae9c-e93bce476471 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1319 microversion: 2.1 time: 0.183424 Sep 13 16:33:18.836517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 365/753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:18 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:18.877385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:18.878084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:18.887004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.887133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.887511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:18.888873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:18.890387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:18.890836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.042204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:19.044526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:19.075872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.076674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.077247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.078098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.078934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.079472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.140792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:19.148842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6127fb55-a48c-4480-9162-c6e2f033c40d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.276939 Sep 13 16:33:19.149862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 389/754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:18 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:19.165818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:19.166378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:19.179721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.180220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.180658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.181374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.181850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.182279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.261702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:19.271641 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3f20635-3e98-4dbb-a36c-7fdc4cb758c2 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.239383 Sep 13 16:33:19.272327 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 366/755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:19 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:19.435224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:19.445359 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3aa8b332-3a2c-44ca-9bf5-894898e6fcb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1473 microversion: 2.1 time: 0.294157 Sep 13 16:33:19.446376 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 390/756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:19 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:19.484766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:19.485393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:19.492255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.492750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.493664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.497593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.498568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.499130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.679851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:19.680672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:19.696316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.696886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.697341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.699409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.699902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.702074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.740756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:19.752429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:19.898356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:19.916724 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4eb7eff5-8ffe-4b66-9bf7-7ddc97ba284c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1334 microversion: 2.1 time: 0.436213 Sep 13 16:33:19.918370 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 367/757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:19 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1334 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:19.935349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:19.936429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:19.952530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.954417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.963348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.968499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:19.969293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:19.975066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:19.978820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:20.314463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:20.327673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:20.329133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:20.334739 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0572c307-a660-4d38-b42b-88d7c971e5f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.662619 Sep 13 16:33:20.335570 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 391/758] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:19 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:20.344963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:20.345603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:20.355757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.356248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.356680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.357445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.358132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.358419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.413897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=10 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:20.584967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:20.609162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:20.622775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf7cfe4d-8519-4348-b180-1701882960be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.700834 Sep 13 16:33:20.624236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 368/759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:19 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:20.633981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f4b6050c-464f-4947-afbf-0298abcfdf45 req-b48264e6-67fd-4d19-b50a-8cfd3c49f471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba427499-3971-463a-9fd1-065bbdee6476", "name": "network-vif-plugged", "status": "completed", "tag": "6f3c2223-a389-4adf-bbd7-8727cc9d53a9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:20.643175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:20.643864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f4b6050c-464f-4947-afbf-0298abcfdf45 req-b48264e6-67fd-4d19-b50a-8cfd3c49f471 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.644367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f4b6050c-464f-4947-afbf-0298abcfdf45 req-b48264e6-67fd-4d19-b50a-8cfd3c49f471 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.644821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f4b6050c-464f-4947-afbf-0298abcfdf45 req-b48264e6-67fd-4d19-b50a-8cfd3c49f471 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.653588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f82f46c-d9e5-47d8-aacc-bce8d150e2b9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1319 microversion: 2.1 time: 0.316944 Sep 13 16:33:20.659916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f4b6050c-464f-4947-afbf-0298abcfdf45 req-b48264e6-67fd-4d19-b50a-8cfd3c49f471 service nova] Creating event network-vif-plugged:6f3c2223-a389-4adf-bbd7-8727cc9d53a9 for instance ba427499-3971-463a-9fd1-065bbdee6476 on n-h1-857467-1 Sep 13 16:33:20.671398 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 392/760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:20 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:20.680851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:20.681151 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f4b6050c-464f-4947-afbf-0298abcfdf45 req-b48264e6-67fd-4d19-b50a-8cfd3c49f471 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054801 Sep 13 16:33:20.681615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:20.683226 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 369/761] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:20.690942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.692150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.692609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.693343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.693802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.694759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.715427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:20.718796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:20.729163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.729703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.730139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:20.734357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:20.734871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:20.735386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.019273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:21.029679 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e23c641-e578-46c9-b37c-7d43555fd492 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.356438 Sep 13 16:33:21.030232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 393/762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:20 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:21.051268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:21.052436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:21.062267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.063729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.066172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.066994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.067473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.067911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.169163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:21.190190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63b78711-37de-4636-b9e5-0d3cdb7e7dff tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.505633 Sep 13 16:33:21.194075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 370/763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:20 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:21.282894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:21.294621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-567b05ae-c49e-4944-afe5-d9708bd3134e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1470 microversion: 2.1 time: 0.251203 Sep 13 16:33:21.295536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 394/764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:21 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:21.305992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:21.305992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:21.323244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.323786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.329251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.330178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.330683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.331132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.517605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edd7f7bc-326e-4cc7-b445-5d44870025e2 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Action: 'create', calling method: .version_select at 0x7fbeb56253a0>, body: {"keypair": {"name": "tempest-keypair-1390776482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRy1R507vouTCWdu7DhWBd9xx8i0CS2VeC66hjLwgGDJ3kGJEDuRii+XVpXdQfUFRMpWKjxzuh+iRaomVp4tVAkGU0PLJgZV+D7x1MkypbvBbJfIqi7NGo8cqgKMZjhQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:21.598886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-edd7f7bc-326e-4cc7-b445-5d44870025e2 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Getting quotas for project cc8d9f6796994908b4601c27dbcf9a0a. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:21.601284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:21.614730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e5d74e5b-081f-4110-bf6d-90ab7ef724ab tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1334 microversion: 2.1 time: 0.318080 Sep 13 16:33:21.630633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-edd7f7bc-326e-4cc7-b445-5d44870025e2 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Getting quotas for user ddbb690a2e7245ceb2dd0a5ab52f0365 and project cc8d9f6796994908b4601c27dbcf9a0a. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:21.630734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 395/765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:21 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1334 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:21.640299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:21.641321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:21.657308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.659729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.660281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.662754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.664076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.665222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-edd7f7bc-326e-4cc7-b445-5d44870025e2 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.467371 Sep 13 16:33:21.665523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.665889 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 371/766] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:33:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:21.673557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:21.674915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:21.697296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.697970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.698426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.699148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.702394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.706433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.811280 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69ce0292-4c97-4e86-ae46-ea5a547f9d26 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6/action" status: 204 len: 0 microversion: 2.1 time: 0.181514 Sep 13 16:33:21.812220 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 396/767] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:21 2022] POST /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6/action => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:33:21.828513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:21.832505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:21.851418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.852275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.852936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:21.853872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:21.854541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:21.855204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.393874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:22.403822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:22.408664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:22.410199 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3122545c-be04-490f-8678-7fa61dab034a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.743026 Sep 13 16:33:22.425280 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 372/768] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:21 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:22.437204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:22.437893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:22.459799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:22.461519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.463857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.464754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.468292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.468868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.469334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.476146 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b220a144-0af9-4520-b247-270ffc3a4ddb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.656957 Sep 13 16:33:22.476994 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 397/769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:21 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:22.482316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:22.486113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:22.503359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.504115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.504739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.505976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.506626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.507235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.767904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:22.777268 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cefc81ab-cee0-4773-9ac9-546ade468ccf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1470 microversion: 2.1 time: 0.298474 Sep 13 16:33:22.790427 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 398/770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:22 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:22.799930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:22.801012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:22.807473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.808231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.808860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:22.809866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:22.810768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:22.811395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.264742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.279357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d45fe31-5373-4cf7-8a23-052f828a5ccb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1468 microversion: 2.1 time: 0.852131 Sep 13 16:33:23.280065 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 373/771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:22 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1468 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:23.299228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:23.300339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:23.309037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.309870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.318540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.319499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.319977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.320404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.336481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.346526 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be4cacbd-4e6a-432f-9cdf-9b9b611c9597 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1471 microversion: 2.1 time: 0.554702 Sep 13 16:33:23.358787 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 399/772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:22 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:23.370038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:23.370683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:23.378163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.378671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.379606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.380824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.381456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.382450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.570825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.580029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b1eed8f-7d5c-4136-812e-145e66caad8b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.219963 Sep 13 16:33:23.580625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 400/773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:23 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:23.585398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0272cbd-8228-4707-9a6b-8781acb6cde6", "name": "network-vif-plugged", "status": "completed", "tag": "3e05a151-0e1f-45e9-b3a0-919f9626ba5c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:23.596877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.597582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.598197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.617143 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] Creating event network-vif-plugged:3e05a151-0e1f-45e9-b3a0-919f9626ba5c for instance f0272cbd-8228-4707-9a6b-8781acb6cde6 on n-h1-857467-1 Sep 13 16:33:23.624412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:33:23.636973 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0b929f6e-ae2b-4408-b5ab-0780b62e4471 req-d890b7c2-c4e8-4f79-8035-83367a1e73a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054611 Sep 13 16:33:23.637670 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 401/774] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:23.644042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:23.649536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.650439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Searching by: {'reservation_id': 'r-wyung16u', 'deleted': False, 'project_id': 'ade763eb224a494f86d28a38ca26c17a'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:33:23.657132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.657637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.658153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.658865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.659326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.659756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.776056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:33:23.924182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.938392 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7add302d-689f-4719-acd4-e3dae4c944ba tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.653136 Sep 13 16:33:23.943682 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 374/775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:23 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:23.951837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:23.957155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:23.957818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:23.959866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.961018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.961470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.968037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.968786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.969335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:23.970339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:23.970913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:23.971540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.348734 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19aaa86a-2e6d-4fa3-b56c-ba92d4a92d8d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?reservation_id=r-wyung16u" status: 200 len: 2930 microversion: 2.1 time: 0.707855 Sep 13 16:33:24.350212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 402/776] 10.222.0.61 () {58 vars in 1197 bytes} [Tue Sep 13 16:33:23 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wyung16u => generated 2930 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:24.358867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:24.359625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:24.369264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.370040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.370488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.371240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.372216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.372216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.589083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:24.604673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00ec8366-d151-4c27-a4f6-0573b822cf5a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1310 microversion: 2.1 time: 0.253487 Sep 13 16:33:24.618309 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 403/777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:24 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1310 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:24.625724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:24.628255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:24.630787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:24.641241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.642104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.642607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.643528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.643990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.644594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.799179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:24.807964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:24.811911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:24.814373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:24.816044 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fba1c774-41fc-4929-a13c-dc3db1985fcf tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.871031 Sep 13 16:33:24.817182 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 375/778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:23 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:24.820187 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-efc0e5fe-22e2-4af4-9d94-ada77c31a5bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1470 microversion: 2.1 time: 0.200358 Sep 13 16:33:24.820762 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 404/779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:24 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:24.822773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:24.823616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:24.830989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec465d2e-429a-43b9-900b-b727696d73a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:24.834785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.835519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.836372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.837339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.838392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.841070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.846719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.server_groups [None req-ec465d2e-429a-43b9-900b-b727696d73a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Querying cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) for 2 instances {{(pid=122328) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 13 16:33:24.847656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec465d2e-429a-43b9-900b-b727696d73a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.848312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec465d2e-429a-43b9-900b-b727696d73a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.848745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec465d2e-429a-43b9-900b-b727696d73a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.892833 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec465d2e-429a-43b9-900b-b727696d73a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/cfb868d3-0846-4b93-bb1d-82fc0706cfd7" status: 200 len: 271 microversion: 2.1 time: 0.070507 Sep 13 16:33:24.893307 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 405/780] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:33:24 2022] GET /compute/v2.1/os-server-groups/cfb868d3-0846-4b93-bb1d-82fc0706cfd7 => generated 271 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:24.903970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:24.904640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:24.911142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.911632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.912070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:24.912766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:24.913391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:24.914016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.122311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:25.132920 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ccabc619-9af0-40a8-8035-cc9ef9b682ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.238280 Sep 13 16:33:25.134163 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 406/781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:24 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.139584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:25.140574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:25.147143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.148540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.149237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.150173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.150827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.151470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.160587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:25.291254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:25.317135 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-42938256-3b5e-46e6-ba64-0df049b216bd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1477 microversion: 2.1 time: 0.498438 Sep 13 16:33:25.318868 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 376/782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:24 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.334682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:25.336351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:25.346616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.347509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.349592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.350165 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e6b8261-51ab-463f-9965-965154c6362a tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1620 microversion: 2.1 time: 0.214690 Sep 13 16:33:25.350782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 407/783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:25 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1620 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.354689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.355410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.356173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.358776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cd576e92-1300-4d72-a27d-42ff9a883fad req-00810c60-e479-4bea-bba4-60cfccacb957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "tag": "28342331-1aa5-4c12-972c-8ea806b74294"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:25.368576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cd576e92-1300-4d72-a27d-42ff9a883fad req-00810c60-e479-4bea-bba4-60cfccacb957 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.369072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cd576e92-1300-4d72-a27d-42ff9a883fad req-00810c60-e479-4bea-bba4-60cfccacb957 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.370489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cd576e92-1300-4d72-a27d-42ff9a883fad req-00810c60-e479-4bea-bba4-60cfccacb957 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.384469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cd576e92-1300-4d72-a27d-42ff9a883fad req-00810c60-e479-4bea-bba4-60cfccacb957 service nova] Creating event network-changed:28342331-1aa5-4c12-972c-8ea806b74294 for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:33:25.391166 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cd576e92-1300-4d72-a27d-42ff9a883fad req-00810c60-e479-4bea-bba4-60cfccacb957 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038563 Sep 13 16:33:25.392103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 408/784] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:25.402799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:25.403516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:25.411723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.412308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.412823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.413676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.414227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.414727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.579947 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e79709b0-b9b6-4a14-959e-77611b3dafeb tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1619 microversion: 2.1 time: 0.186423 Sep 13 16:33:25.580544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 409/785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:25 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1619 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.591648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:25.607541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48790c91-c2d0-47eb-aa68-37300b8eaac0 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.286121 Sep 13 16:33:25.608209 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 377/786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:25 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.632791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:25.633622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:25.645404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.647308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.648850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.652535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.654642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.656640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.669390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11da3338-8829-45f4-83ef-80f4f8245aa0", "name": "network-vif-plugged", "status": "completed", "tag": "5dc80120-1f41-47b6-9362-e47f868e1fe8"}, {"server_uuid": "1bc75b21-5d7e-45f8-9e20-54284da59b4f", "name": "network-vif-plugged", "status": "completed", "tag": "8cecb1b1-676f-4d30-903a-addf6afd1de1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:25.684832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.686310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.686766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.702320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] Creating event network-vif-plugged:5dc80120-1f41-47b6-9362-e47f868e1fe8 for instance 11da3338-8829-45f4-83ef-80f4f8245aa0 on n-h1-857467-1 Sep 13 16:33:25.703083 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] Creating event network-vif-plugged:8cecb1b1-676f-4d30-903a-addf6afd1de1 for instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f on n-h2-857467-1 Sep 13 16:33:25.717167 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4a55a408-701e-4aaf-bc6e-708a45ccde9e req-30df9003-9f0a-4522-bec1-2127f1f42ca5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051776 Sep 13 16:33:25.718632 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 378/787] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:33:25.800653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1910269307", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "ea94c7be-d3dc-477b-8d97-6968a0f8e79b"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:25.832865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:25.841591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73c24464-ea11-4aaf-a02b-7edf289672b0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1493 microversion: 2.1 time: 0.213422 Sep 13 16:33:25.853849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 410/788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:25 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1493 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:25.853849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:25.853849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:25.867656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.872168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.872891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.874286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:25.875226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:25.876058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:25.883510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:26.048730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.063665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.065378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.066846 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47b4675b-c60e-48df-ba7f-c03021c6a8df tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.222515 Sep 13 16:33:26.067987 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 411/789] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:25 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:26.073328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.074162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.081454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.082340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.083068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.083980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.084614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.085251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.230972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.239401 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2835952c-7c26-46cf-9903-d62501fe0b95 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1470 microversion: 2.1 time: 0.170017 Sep 13 16:33:26.239974 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 412/790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:26.356757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:26.357276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:26.357752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:26.358191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:26.358763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:26.368850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.369346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.369868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.370817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.371941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.372384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.375258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.376465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.383804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.384296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.384734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.385912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.386731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.386973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.393195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:26.398739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:26.413317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:26.417280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:26.489816 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ad6fc4e-1b2d-4ec9-b4e3-e90bde7366bd tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699401 Sep 13 16:33:26.496623 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 379/791] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:33:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:33:26.496623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.496623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.504866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.505646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.506132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.506854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.507324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.507762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.590847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-869ca2fb-d195-44f9-969b-60829c2c88a9 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1644 microversion: 2.1 time: 0.349805 Sep 13 16:33:26.592976 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 413/792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1644 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:26.599415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.600035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.606233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.606784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.607288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.608073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.608543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.608979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.679529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.687907 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-630f7b0a-04f2-41d1-90d4-5f53291a443e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.196391 Sep 13 16:33:26.689055 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 380/793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:26.694808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f4841231-b682-4b56-88a4-5e013d65ef0e"}], "security_groups": [{"name": "tempest-securitygroup--980923805"}], "key_name": "tempest-keypair-1390776482", "user_data": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:26.787282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.797129 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b33aaf4-3766-4276-b83c-265d2321c503 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1477 microversion: 2.1 time: 0.202359 Sep 13 16:33:26.797719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 414/794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:26.802943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44163892-5921-4882-8291-c03b2788a1fb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.805326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44163892-5921-4882-8291-c03b2788a1fb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.816556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] validate_networks() for [('f4841231-b682-4b56-88a4-5e013d65ef0e', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:26.863540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44163892-5921-4882-8291-c03b2788a1fb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:26.870366 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44163892-5921-4882-8291-c03b2788a1fb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1217 microversion: 2.1 time: 0.071213 Sep 13 16:33:26.870950 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 415/795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:26.876062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:26.876754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:26.882793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.883547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.884218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:26.885150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:26.885874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:26.886517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.036923 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87fc878c-3cdd-4d26-8340-fc6db83889eb tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1644 microversion: 2.1 time: 0.164670 Sep 13 16:33:27.038066 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 416/796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:26 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1644 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:27.043301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:27.043993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:27.060810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.061271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.061881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.062733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.063200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.063684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.222921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:27.232791 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fbe32dac-79a4-479e-bb95-81fe3d5d7fdb tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1391 microversion: 2.1 time: 0.192561 Sep 13 16:33:27.233643 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 417/797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:27 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:27.240794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:27.246748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.247526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.250074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.250979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.252022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.252535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.287485 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6092681c-10a4-4474-a219-a96ff08b23f6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052175 Sep 13 16:33:27.288108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 418/798] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:33:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:27.288494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:27.289169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:27.289939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:27.290780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:27.291467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:27.293711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:27.295136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:27.302995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.303497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.304597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.305045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.305315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.305539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.305779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.306017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.306252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.307634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.308104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.308724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.318276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:27.331087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Getting quotas for project cc8d9f6796994908b4601c27dbcf9a0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:27.336507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Getting quotas for user ddbb690a2e7245ceb2dd0a5ab52f0365 and project cc8d9f6796994908b4601c27dbcf9a0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:27.350941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:27.353274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:27.368433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:27.422448 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bdd37e7f-b3f5-47d7-ae52-77722ece0e82 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.731724 Sep 13 16:33:27.441346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 381/799] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:33:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:33:27.445107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:27.445730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:27.460753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.461259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.461700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.462448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.462917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.463892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.741212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:27.750959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:27.755716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:27.758600 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11ace4d9-7dd9-4127-b2b9-e329b202f9c9 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1362 microversion: 2.25 time: 0.469297 Sep 13 16:33:27.774363 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 419/800] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:27 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:27.783080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-857467-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:27.786152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:27.797312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.798121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.798789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.800068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:27.800853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:27.801488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:27.827858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lazy-loading 'flavor' on Instance uuid ba427499-3971-463a-9fd1-065bbdee6476 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:27.842048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Going to try to live migrate instance to n-h2-857467-1 {{(pid=122328) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:33:28.159150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:28.174344 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-11a68010-8699-4862-ab77-55dad5911244 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1470 microversion: 2.1 time: 0.730859 Sep 13 16:33:28.177074 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 382/801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:27 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1470 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:28.183432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc11eaa6-76f0-4b4d-a6e5-c97efbae1895 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:28.184211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc11eaa6-76f0-4b4d-a6e5-c97efbae1895 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:28.366776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc11eaa6-76f0-4b4d-a6e5-c97efbae1895 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:28.376313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc11eaa6-76f0-4b4d-a6e5-c97efbae1895 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1226 microversion: 2.1 time: 0.197757 Sep 13 16:33:28.376979 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 383/802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:28 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:28.382582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:28.383181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:28.390132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:28.390681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:28.391122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:28.391834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:28.392435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:28.392778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:28.636386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:28.644582 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5a3f747-98d2-45f9-904a-a53583c71bce tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.266170 Sep 13 16:33:28.645515 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 384/803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:28 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:28.649794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:28.650429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:28.657048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:28.657544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:28.658029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:28.658714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:28.659174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:28.659601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.065461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.076730 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5deb3a32-f3fc-4fb6-a350-5e859d19fa2c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1477 microversion: 2.1 time: 0.429052 Sep 13 16:33:29.078266 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 385/804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:28 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1477 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:29.100835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:29.104855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:29.114011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.114516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.114961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.115676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.116131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.116570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.269943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.277625 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a366ac7-e0c3-4155-b745-e813786d3beb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1269 microversion: 2.1 time: 0.198136 Sep 13 16:33:29.278232 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 386/805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:29 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:29.283257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ce5a1687-11e7-4a7f-a491-3c85b8fa648b req-fe80a80e-150f-42f2-9146-eae3c36d1a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "name": "network-vif-unplugged", "status": "completed", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:29.294201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ce5a1687-11e7-4a7f-a491-3c85b8fa648b req-fe80a80e-150f-42f2-9146-eae3c36d1a2b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.295599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ce5a1687-11e7-4a7f-a491-3c85b8fa648b req-fe80a80e-150f-42f2-9146-eae3c36d1a2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.296060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ce5a1687-11e7-4a7f-a491-3c85b8fa648b req-fe80a80e-150f-42f2-9146-eae3c36d1a2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.311265 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ce5a1687-11e7-4a7f-a491-3c85b8fa648b req-fe80a80e-150f-42f2-9146-eae3c36d1a2b service nova] Creating event network-vif-unplugged:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:33:29.316954 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ce5a1687-11e7-4a7f-a491-3c85b8fa648b req-fe80a80e-150f-42f2-9146-eae3c36d1a2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037549 Sep 13 16:33:29.317576 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 387/806] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:29.323062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:29.323721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:29.330559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.331138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.331488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.332199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.333567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.334049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.552588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.562412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf95f08d-14e8-4a9f-b281-4b272d3e3d30 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1590 microversion: 2.1 time: 0.243531 Sep 13 16:33:29.563215 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 388/807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:29 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1590 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:29.579792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:29.580676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:29.597630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.598219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.600371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.601331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.602241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.602830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.901158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.913188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.915253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:29.917601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55a4fedc-ea0a-47ce-aab8-13132fc5e3d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1559 microversion: 2.25 time: 0.352481 Sep 13 16:33:29.935591 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 389/808] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:29 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1559 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:29.945365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:29.946345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:29.955177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.955969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.956772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:29.957971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:29.958659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:29.959273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.132488 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2349a33a-6137-41da-886e-3e29e0f8b3da tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476/action" status: 202 len: 0 microversion: 2.1 time: 2.356637 Sep 13 16:33:30.133770 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 420/809] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:27 2022] POST /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476/action => generated 0 bytes in 2359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:33:30.140196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:30.140849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:30.149626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.150190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.150829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.151542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.152184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.152797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.234423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:30.245449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f8e9c5d-cea6-471f-9432-647edc12c430 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1284 microversion: 2.1 time: 0.110207 Sep 13 16:33:30.246498 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 421/810] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:30 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:30.252931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-5102d00e-09bf-4229-a082-9968f44e8352 req-6ec75c98-c663-4369-9586-cbe6bdbfa083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "tag": "3d19d7c5-8520-4bfc-9102-67ff59c2ae8e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:30.264953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5102d00e-09bf-4229-a082-9968f44e8352 req-6ec75c98-c663-4369-9586-cbe6bdbfa083 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.265804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5102d00e-09bf-4229-a082-9968f44e8352 req-6ec75c98-c663-4369-9586-cbe6bdbfa083 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.266276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5102d00e-09bf-4229-a082-9968f44e8352 req-6ec75c98-c663-4369-9586-cbe6bdbfa083 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.278369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-5102d00e-09bf-4229-a082-9968f44e8352 req-6ec75c98-c663-4369-9586-cbe6bdbfa083 service nova] Creating event network-changed:3d19d7c5-8520-4bfc-9102-67ff59c2ae8e for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:33:30.283588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-5102d00e-09bf-4229-a082-9968f44e8352 req-6ec75c98-c663-4369-9586-cbe6bdbfa083 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035480 Sep 13 16:33:30.284425 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 422/811] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:30.290620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:30.291542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:30.299142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.299858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.300504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.301407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.302425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.303028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.394006 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7222a5da-b14d-4525-8a9f-5aa9419ffb6d tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108102 Sep 13 16:33:30.395731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 423/812] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:33:30 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:30.400725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:30.401392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:30.411419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.412198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.414533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.415776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.416500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.417407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.538219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:30.547683 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6dd9bc60-3066-414e-a12b-3f8e11a6a625 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1470 microversion: 2.1 time: 0.610649 Sep 13 16:33:30.562222 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 390/813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:29 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1470 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:30.568952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:30.569793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:30.576900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.577638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.578134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.578853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.579319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.579754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.877411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:30.886929 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68fc4c05-d69f-4e2c-915a-d81380f2d04e tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.489830 Sep 13 16:33:30.887786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 424/814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:30 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:30.893183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:30.894048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:30.900404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.900894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.901332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.902054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:30.902690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:30.903117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:30.906792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:31.219181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:31.228738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-51efba3f-cde6-4dd3-95f2-bc396fdde14e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1477 microversion: 2.1 time: 0.339348 Sep 13 16:33:31.230023 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 425/815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:30 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:31.236095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:31.237156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:31.244015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.244695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.245291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.246392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.247052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.248569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.508572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:31.522669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-829ce444-2086-4e86-897c-3da513ae75f7 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 2052 microversion: 2.25 time: 0.959279 Sep 13 16:33:31.523496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 391/816] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:30 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 2052 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:31.528153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:31.529635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:31.547851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.549151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.549853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.550776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.551475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.552088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.749583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:31.760548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b063bf7-9930-4edc-b6d4-811c637278a8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1275 microversion: 2.1 time: 0.235807 Sep 13 16:33:31.775620 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 392/817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:31 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:31.784810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:31.785737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:31.792467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.793351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.794164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.795345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.796235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.796885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.884062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:31.904852 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e143a7e-a5a5-4f80-9fb0-cf2a1a938aa7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.671868 Sep 13 16:33:31.918998 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 426/818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:31 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:31.930533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:31.931502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:31.942183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.944002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.945143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.955876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:31.962013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.966826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.967567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.972604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bbc6a181-701a-4a73-94ba-17b3ab18aad1 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1284 microversion: 2.1 time: 0.193120 Sep 13 16:33:31.974392 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 393/819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:31 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:31.988146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:31.988930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:31.995465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.996171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.996759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:31.998206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:31.998797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:31.999341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.333446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:32.350901 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e3b75a3-ad91-43b3-aab5-a678d2dfff8e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 2052 microversion: 2.25 time: 0.428680 Sep 13 16:33:32.351915 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 427/820] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:31 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 2052 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:32.358147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:32.358883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:32.365221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.365858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.366420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.367221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.367905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.368541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.444914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:32.462646 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c17dc41-01d1-4c69-832e-cae9e8bc3e8f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1462 microversion: 2.1 time: 0.486122 Sep 13 16:33:32.463807 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 394/821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:31 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1462 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:32.468548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a0b4729b-cf0b-4b68-94b9-aadc6e16813a req-234c913c-5698-4613-af6f-a31a21314db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "name": "network-vif-plugged", "status": "completed", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:32.478199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a0b4729b-cf0b-4b68-94b9-aadc6e16813a req-234c913c-5698-4613-af6f-a31a21314db6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.478887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a0b4729b-cf0b-4b68-94b9-aadc6e16813a req-234c913c-5698-4613-af6f-a31a21314db6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.479517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a0b4729b-cf0b-4b68-94b9-aadc6e16813a req-234c913c-5698-4613-af6f-a31a21314db6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.505008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a0b4729b-cf0b-4b68-94b9-aadc6e16813a req-234c913c-5698-4613-af6f-a31a21314db6 service nova] Creating event network-vif-plugged:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:33:32.519962 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a0b4729b-cf0b-4b68-94b9-aadc6e16813a req-234c913c-5698-4613-af6f-a31a21314db6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053108 Sep 13 16:33:32.522041 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 395/822] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:32.536668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:32.538303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:32.548833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.549471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.550019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.550854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.551446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.551992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.792738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:32.818162 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-775f19d0-ebd3-431e-9110-06882ef43d04 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.463806 Sep 13 16:33:32.821257 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 428/823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:32 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:32.831194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:32.845803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.847754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.848961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.850127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.850925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.851666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.901264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0a0f0cd-491d-4ab2-aeb6-f8998e52d0a2 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.078668 Sep 13 16:33:32.902694 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 429/824] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Sep 13 16:33:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:33:32.909044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-178a0ca4-8c1c-45fc-80a7-051217c99d55 req-17c002d1-7ed5-4aad-9dbd-910c1c067bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "tag": "b9a372e6-adb3-4274-a104-d9fad1b68fe7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:32.923072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-178a0ca4-8c1c-45fc-80a7-051217c99d55 req-17c002d1-7ed5-4aad-9dbd-910c1c067bd1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.924125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-178a0ca4-8c1c-45fc-80a7-051217c99d55 req-17c002d1-7ed5-4aad-9dbd-910c1c067bd1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.924812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-178a0ca4-8c1c-45fc-80a7-051217c99d55 req-17c002d1-7ed5-4aad-9dbd-910c1c067bd1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.945977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-178a0ca4-8c1c-45fc-80a7-051217c99d55 req-17c002d1-7ed5-4aad-9dbd-910c1c067bd1 service nova] Creating event network-changed:b9a372e6-adb3-4274-a104-d9fad1b68fe7 for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:33:32.953683 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-178a0ca4-8c1c-45fc-80a7-051217c99d55 req-17c002d1-7ed5-4aad-9dbd-910c1c067bd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048618 Sep 13 16:33:32.955081 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 430/825] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:32.962223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:32.963473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:32.992292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:32.995580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:32.996171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:32.997113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.000822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.001568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.297170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d5a2c5e-3b7c-4dbb-99d7-9485b41bf1ff tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1613 microversion: 2.1 time: 0.334203 Sep 13 16:33:33.300135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:33.300602 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 431/826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:32 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1613 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:33.307953 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a4efb794-4c78-4d1d-bf45-28f505058cd4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1477 microversion: 2.1 time: 0.782703 Sep 13 16:33:33.309648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.310704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:33.327227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.327380 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 396/827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:32 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1477 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:33.328353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.329619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.330641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.331456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.332223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.332850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:33.333294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.346156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.347047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.347675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.349412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.350087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.350778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.443354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:33.456776 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c61b474d-8ca9-4e8e-af22-c0e193f00c23 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1275 microversion: 2.1 time: 0.152990 Sep 13 16:33:33.458928 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 432/828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:33.463993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1a7ee251-ee37-4479-800b-df5b5bc2ed3a req-f6624ad4-afa8-4409-b7a7-caa87db4d240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11da3338-8829-45f4-83ef-80f4f8245aa0", "tag": "5dc80120-1f41-47b6-9362-e47f868e1fe8"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:33.477167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a7ee251-ee37-4479-800b-df5b5bc2ed3a req-f6624ad4-afa8-4409-b7a7-caa87db4d240 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.477702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a7ee251-ee37-4479-800b-df5b5bc2ed3a req-f6624ad4-afa8-4409-b7a7-caa87db4d240 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.478183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a7ee251-ee37-4479-800b-df5b5bc2ed3a req-f6624ad4-afa8-4409-b7a7-caa87db4d240 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.492913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1a7ee251-ee37-4479-800b-df5b5bc2ed3a req-f6624ad4-afa8-4409-b7a7-caa87db4d240 service nova] Creating event network-changed:5dc80120-1f41-47b6-9362-e47f868e1fe8 for instance 11da3338-8829-45f4-83ef-80f4f8245aa0 on n-h1-857467-1 Sep 13 16:33:33.499312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1a7ee251-ee37-4479-800b-df5b5bc2ed3a req-f6624ad4-afa8-4409-b7a7-caa87db4d240 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038697 Sep 13 16:33:33.499974 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 433/829] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:33.505606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:33.506429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:33.514738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.515568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.515841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.516633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.517173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.517675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.592005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-796df23e-b5d5-4966-968e-cfbeb189a71a tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f/action" status: 202 len: 0 microversion: 2.25 time: 0.089601 Sep 13 16:33:33.596197 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 434/830] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:33:33 2022] POST /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:33:33.599370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.600209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:33.610767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.611726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.612686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.613562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.614254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.614961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.852935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:33.895545 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c886c2ef-2f67-4ca4-914d-8d135cc81d95 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1590 microversion: 2.1 time: 0.566979 Sep 13 16:33:33.903132 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 397/831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1590 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:33.917580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.922387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:33.932848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.933580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.934067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.934795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.935981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.937702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.940351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:33.954979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73740198-3c51-4498-a2ab-533266e1b242 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.360216 Sep 13 16:33:33.956064 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 435/832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:33.963194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c8294bb2-8244-4b93-9494-d269bdaf37b2 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '.version_select at 0x7fbeb5a04160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.967805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8294bb2-8244-4b93-9494-d269bdaf37b2 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:33.968812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8294bb2-8244-4b93-9494-d269bdaf37b2 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:33.969318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8294bb2-8244-4b93-9494-d269bdaf37b2 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:33.984592 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c8294bb2-8244-4b93-9494-d269bdaf37b2 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.024184 Sep 13 16:33:33.998590 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 436/833] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:33.998590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:33.998590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:34.050353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.052095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.053655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.054719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.055677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.056012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.439355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:34.457635 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75821fdd-ddca-4353-93ab-a1f5d69e686d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 2057 microversion: 2.25 time: 0.470628 Sep 13 16:33:34.476456 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 437/834] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 2057 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:34.476456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:34.476456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:34.481074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.481683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.483344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.484760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.485329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.485986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.693423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:34.721569 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20754814-d400-4b3c-ac6d-00161ac68621 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.816921 Sep 13 16:33:34.738159 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 398/835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:33 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:34.745154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1665600791", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:34.795037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:34.806340 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73072204-9ba9-463e-8183-641cd1037484 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.341459 Sep 13 16:33:34.820558 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 438/836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:34 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:34.835279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:34.835947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:34.858640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.859166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.859611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.860340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:34.860811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:34.861244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:34.873564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:35.073740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:35.082360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c34be9a7-dc8a-4888-a093-fa24a8e914b3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1477 microversion: 2.1 time: 0.259697 Sep 13 16:33:35.083154 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 439/837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:34 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:35.087491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:35.088100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.094902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.095053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.096031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.102904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.103455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.103911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.244057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:35.254879 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e52211a-5716-4746-ad7a-fa79ff26b60c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.170557 Sep 13 16:33:35.266059 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 440/838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:35 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:35.266059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:35.266059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.272831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.272831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.272831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.272831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.273359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.274001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.440607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:35.448630 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45e79c34-87c1-4abf-ba25-6a365bab412b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.191791 Sep 13 16:33:35.458256 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 441/839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:35 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:35.491198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:35.491863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.497918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.498412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.498848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.499541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.500000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.500971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.588985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:35.589661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:35.590416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:35.590971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:35.592253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:35.602295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.602905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.603619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.605055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.605796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.606501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.624952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:35.631447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for user 80714f77e8904565bde7dc8e7dce1063 and project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:35.633619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:35.642115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:35.648654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:35.651367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:35.659732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64d1522b-2995-4752-a54c-7842535c1860 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 2037 microversion: 2.25 time: 0.172284 Sep 13 16:33:35.674092 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 442/840] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:35 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 2037 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:35.674092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba427499-3971-463a-9fd1-065bbdee6476", "name": "network-vif-unplugged", "status": "completed", "tag": "6f3c2223-a389-4adf-bbd7-8727cc9d53a9"}, {"name": "network-changed", "server_uuid": "ba427499-3971-463a-9fd1-065bbdee6476", "tag": "6f3c2223-a389-4adf-bbd7-8727cc9d53a9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:35.682880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.682880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.682880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.695067 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] Creating event network-vif-unplugged:6f3c2223-a389-4adf-bbd7-8727cc9d53a9 for instance ba427499-3971-463a-9fd1-065bbdee6476 on n-h1-857467-1 Sep 13 16:33:35.695584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] Creating event network-changed:6f3c2223-a389-4adf-bbd7-8727cc9d53a9 for instance ba427499-3971-463a-9fd1-065bbdee6476 on n-h1-857467-1 Sep 13 16:33:35.702463 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d2aba2a0-d4ec-4fd2-9575-1185f7e2ce55 req-aff32194-4e5f-4870-a560-940509fec8fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.040706 Sep 13 16:33:35.703793 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 443/841] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:35.707337 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1acfb1fc-7f36-40e0-8dc7-1f395d47994e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980385 Sep 13 16:33:35.719238 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 399/842] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:33:35.723254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": "auto"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:35.725253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7887ae29-93f6-437e-a4a5-508a96e08cfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:35.726183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7887ae29-93f6-437e-a4a5-508a96e08cfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.726906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.737181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.737797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.738771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.739990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.740754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.741816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.776472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'flavor' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:35.794529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Going to try to live migrate instance to n-h1-857467-1 {{(pid=122328) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:33:35.881226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7887ae29-93f6-437e-a4a5-508a96e08cfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:35.896732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7887ae29-93f6-437e-a4a5-508a96e08cfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1213 microversion: 2.1 time: 0.175959 Sep 13 16:33:35.904131 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 400/843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:35 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1213 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:35.918398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:35.919180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:35.930967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.931809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.932255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:35.932966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:35.933425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:35.934054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.415858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:36.428563 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc0f466c-1b9c-419f-a78c-ee9d263107e7 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.522287 Sep 13 16:33:36.442149 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 401/844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:35 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:36.442149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:36.442149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:36.443991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.444669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.445275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.446192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.446897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.447511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.454192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:36.859774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:36.868129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:36.873418 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9387653a-4413-4481-99e4-0d55ac4567eb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.441363 Sep 13 16:33:36.874136 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 402/845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:36 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:36.903791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4826cac4-ab8b-4f07-bc52-7ae68d20c5d0 req-de6f9b72-9f26-4645-8ed9-12693274e961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d2ba48-e0d8-4338-b6b7-020acfb148a4", "tag": "a7a87fa9-569d-47c3-b11b-0625377bbff1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:36.928726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4826cac4-ab8b-4f07-bc52-7ae68d20c5d0 req-de6f9b72-9f26-4645-8ed9-12693274e961 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.929379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4826cac4-ab8b-4f07-bc52-7ae68d20c5d0 req-de6f9b72-9f26-4645-8ed9-12693274e961 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.930136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4826cac4-ab8b-4f07-bc52-7ae68d20c5d0 req-de6f9b72-9f26-4645-8ed9-12693274e961 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.950631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4826cac4-ab8b-4f07-bc52-7ae68d20c5d0 req-de6f9b72-9f26-4645-8ed9-12693274e961 service nova] Creating event network-changed:a7a87fa9-569d-47c3-b11b-0625377bbff1 for instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 on n-h1-857467-1 Sep 13 16:33:36.964892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4826cac4-ab8b-4f07-bc52-7ae68d20c5d0 req-de6f9b72-9f26-4645-8ed9-12693274e961 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079459 Sep 13 16:33:36.966798 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 403/846] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:36.981359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:36.982706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:36.989590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.990540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.991421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:36.992578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:36.993257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:36.994256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.384946 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99fb1241-ce96-49ef-836e-c725f16ba4cf tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f/action" status: 202 len: 0 microversion: 2.25 time: 1.679250 Sep 13 16:33:37.386520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 444/847] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:33:35 2022] POST /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f/action => generated 0 bytes in 1682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:33:37.392104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.393003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.403393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.404866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.405509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.406578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.407282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.408001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.453983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.463627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34016383-5206-4707-b24f-7db6831cab8d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1463 microversion: 2.1 time: 0.495366 Sep 13 16:33:37.464436 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 404/848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:36 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1463 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:37.469913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.470535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.476886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.477545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.478818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.479701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.480326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.480924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.581933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.590170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e9abfab-3681-409e-b08a-5ab424188c43 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.202309 Sep 13 16:33:37.590756 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 445/849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:37.595637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.596246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.602500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.602997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.603432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.604143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.604596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.605021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.678781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.688571 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2cec5805-e3a6-40dc-a92d-3d73bfb162d5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1265 microversion: 2.1 time: 0.096734 Sep 13 16:33:37.689175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 446/850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:37.694221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.694965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.702363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.703541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.703983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.704715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.705182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.705613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.868860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.879036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.880766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.882017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4ceb9e7-0bc5-4b27-83c1-184f40b4de48 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.191790 Sep 13 16:33:37.882600 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 447/851] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:37.887410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.888680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.897293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.897814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.898297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.899019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.899485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.899918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.938818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:37.946704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae4509ef-8230-4764-ad97-118d2fd35e65 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.481300 Sep 13 16:33:37.947275 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 405/852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:37.952652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:37.953464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:37.959317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.959802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.960235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:37.961114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:37.961749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:37.962197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.037040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.044881 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1131c496-775c-40ce-b61f-21b133b3f4e9 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.161020 Sep 13 16:33:38.045466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 448/853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.050079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.050733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.052640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:38.057424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.057948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.058385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.059088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.059543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.060508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.099016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.107105 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c03bf23-6d11-467e-a39d-e91752201e5e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1463 microversion: 2.1 time: 0.158594 Sep 13 16:33:38.107721 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 406/854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:37 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.129446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:38.132563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.139398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.139886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.140321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.141017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.141476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.142034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.206568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.214609 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-51858dcc-0678-4be1-9c71-874f2e54fe25 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.168146 Sep 13 16:33:38.215178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 449/855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.221208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:38.221638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:38.222142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:38.222557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:38.222983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:38.284873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.290763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.291263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.291708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.292412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.292873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.293308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.321206 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0d17cd4-e9ae-419e-af32-5da8ffb0e714 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 1067 microversion: 2.1 time: 0.195584 Sep 13 16:33:38.321884 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 407/856] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:33:38 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 1067 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 13 16:33:38.340735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.341542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.347898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.348339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.348787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.349497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.350003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.350470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.487474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.495312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c20cdc99-5de1-4c11-bf9a-12cc0ce9f847 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.158381 Sep 13 16:33:38.495887 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 450/857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.614036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.614576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.620691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.621208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.621645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.623093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.623862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.624306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.712479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.713089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.719289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.719779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.720250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.721062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.721530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.721984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.760579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.769632 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be273854-a45b-413e-ac06-58788cd05daa tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.159530 Sep 13 16:33:38.770433 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 408/858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.785590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:38.793439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abd9e495-b1dc-4dbd-89be-f6f3bd2bd6ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1273 microversion: 2.1 time: 0.085041 Sep 13 16:33:38.794028 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 451/859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:38.909980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.910518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.916525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.917006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.917443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.918154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.918613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.919103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.970936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:38.971594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:38.979172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.979593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.980042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:38.980759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:38.981227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:38.981662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.062629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.072874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.074453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.076460 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-884b2330-50d3-45c2-866b-07184bc166d0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.170360 Sep 13 16:33:39.078457 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 409/860] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:39.085135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1946ca7b-4500-47ee-a875-2f829ce68627 req-e9ca73ef-e53e-41af-be86-d6c6a65c390f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4406cd-de58-4a5f-b59c-496bad570197", "tag": "acc2459c-3b15-4aa6-91fb-30309b1cd7ab"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:39.095545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1946ca7b-4500-47ee-a875-2f829ce68627 req-e9ca73ef-e53e-41af-be86-d6c6a65c390f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.096043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1946ca7b-4500-47ee-a875-2f829ce68627 req-e9ca73ef-e53e-41af-be86-d6c6a65c390f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.096486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1946ca7b-4500-47ee-a875-2f829ce68627 req-e9ca73ef-e53e-41af-be86-d6c6a65c390f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.108576 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1946ca7b-4500-47ee-a875-2f829ce68627 req-e9ca73ef-e53e-41af-be86-d6c6a65c390f service nova] Creating event network-changed:acc2459c-3b15-4aa6-91fb-30309b1cd7ab for instance 2b4406cd-de58-4a5f-b59c-496bad570197 on n-h2-857467-1 Sep 13 16:33:39.113366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1946ca7b-4500-47ee-a875-2f829ce68627 req-e9ca73ef-e53e-41af-be86-d6c6a65c390f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031742 Sep 13 16:33:39.113995 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 410/861] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:39.119902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:39.120613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:39.126751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.127243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.127689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.128397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.128863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.129328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.132792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.140652 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-241bd4cc-6ad6-40a7-bfe5-228d42ca496f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.174300 Sep 13 16:33:39.141248 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 452/862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:38 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:39.237604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:39.238403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:39.244377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.244867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.245301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.246111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.246874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.247343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.258030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.266351 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6657c01c-35ba-48c8-a071-c354e458df35 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.151094 Sep 13 16:33:39.266931 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 411/863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:39 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:39.393478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.401132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-244e7deb-371f-462f-8e2f-9b77b9244751 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.167428 Sep 13 16:33:39.401699 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 453/864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:39 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:39.519960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:39.520612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:39.526737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.527224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.527663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.528354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.529617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.530099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.658344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.666288 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1639638-0fbe-4032-b539-090afe420ae3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.150238 Sep 13 16:33:39.666859 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 412/865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:39 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:39.792492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:39.793026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:39.799639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.800121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.800559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.801244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.801701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.802150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.817037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:39.817756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:39.823732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.824285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.824788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.826457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:39.827085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:39.827584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:39.893551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.901539 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e47b56e-e201-43f4-b1d2-2fdfeea36e75 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1273 microversion: 2.1 time: 0.088433 Sep 13 16:33:39.902157 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 413/866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:39 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:39.938310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:39.945954 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2dbf53d8-1337-440e-8e45-790b03136d84 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.157435 Sep 13 16:33:39.946521 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 454/867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:39 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:40.103474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.104124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.110235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.110724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.111165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.111859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.112322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.112757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.163967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.164578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.170857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.171467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.171909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.172751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.173242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.173665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.243416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.251907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.253353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.254539 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-252634bc-c9e0-4961-8ab7-72365e360f7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.155082 Sep 13 16:33:40.255368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 414/868] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:40.289969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.290596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.296826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.297320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.297765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.298524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.298991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.299430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.306361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.314928 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7a698663-8b7b-4413-8146-a6fe93ef0a42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.154736 Sep 13 16:33:40.315447 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 455/869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:40.424752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.425362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.429621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.431333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.431816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.432285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.432978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.433433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.433869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.437987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c08e3fb-0e38-4f84-809b-0b280c183638 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.151998 Sep 13 16:33:40.438569 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 415/870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:40.575033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.583247 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3590fcb-0f1a-4431-8a9a-57347bdb690f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.162425 Sep 13 16:33:40.583799 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 456/871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:40.690542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.691164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.697276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.697770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.698249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.698948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.699693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.700218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.840942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:40.849429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a6932f79-b4c6-46aa-9798-1c5fbd0929a0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.162614 Sep 13 16:33:40.850471 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 416/872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:40.925029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.925646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.936990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.937504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.938111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.939174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.939647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.940115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.970285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:40.970917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:40.988789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.989467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.990122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:40.991092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:40.991791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:40.992336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.005575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.008705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:41.022832 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f91f0f17-ddd3-47fb-b70a-10abfa9a9f96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1273 microversion: 2.1 time: 0.101645 Sep 13 16:33:41.026280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 457/873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:41.269331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.277599 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-85387f11-7d12-4f10-89c5-9c39c5d41c55 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.311778 Sep 13 16:33:41.278890 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 417/874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:40 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:41.280857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:41.281469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:41.288865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.289436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.289897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.290593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.291049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.291471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.340110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:41.340735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:41.348208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.348632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.349080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.349978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.350289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.350732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.355908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:41.429352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.437732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.439308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.440474 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d00fa7d2-8f09-436e-ad69-5c97179181ad tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.164199 Sep 13 16:33:41.441032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 458/875] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:41 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:41.461675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:41.462325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:41.469138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.469637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.470109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.470819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.471288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.471723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.604853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.624892 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c470602-6f14-4111-abec-adac0ef158dc tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.166167 Sep 13 16:33:41.631749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 459/876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:41 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:41.632005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:41.632874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:41.641018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.641644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.642175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.643609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.643810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.644547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.714828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:41.725044 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0707ebd-74e9-4f27-90e2-35f07eb09286 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.388892 Sep 13 16:33:41.725865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 418/877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:41 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:41.874537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:41.874841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:41.878045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:41.882850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.883469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.884120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:41.884991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:41.885535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:41.886066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.167106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.180147 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae873a68-3f74-4d91-bb0e-62bed4a5c0d7 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.311261 Sep 13 16:33:42.195657 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 419/878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:41 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:42.202732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:42.203666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:42.212824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.213641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.214373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.217140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.217921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.218665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.279493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.287677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58e5e4f5-a6af-422f-957a-a28ec8bd6686 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.660450 Sep 13 16:33:42.307133 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 460/879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:41 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:42.315180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:42.316134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:42.323315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.324149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.324839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.326271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.327086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.327736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.343251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.353567 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0979d7a-b0f6-4903-a11e-f76c3e89967e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1271 microversion: 2.1 time: 0.156360 Sep 13 16:33:42.354193 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 420/880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:42 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:42.466590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:42.467683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:42.474533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.475028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.475694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.476410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.476875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.477335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.624499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.625693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.633245 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-724b7e6f-12ac-4ba8-945a-70dbf6d90bc0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.324529 Sep 13 16:33:42.634161 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 461/881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:42 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:42.637603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.639403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.640602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b414e44f-e169-448a-b835-58ef77ad1578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.178199 Sep 13 16:33:42.641551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 421/882] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:42 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:42.654185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:42.655026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:42.661074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.661565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.662030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.662717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.663170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.663597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.748097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:42.748713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:42.754684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.755532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.755976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.756674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:42.757203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:42.757632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:42.860611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:42.900826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.910098 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cabf4d74-ca45-42fb-ac83-15deb31401d9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.165926 Sep 13 16:33:42.910620 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 422/883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:42 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:42.952197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:42.960663 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9cad8666-4b25-4485-afe4-980a2efd590b tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.310796 Sep 13 16:33:42.973865 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 462/884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:42 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:43.205642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.206806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.213044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.213542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.214024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.214731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.215195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.215821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.314846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.315720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.323019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.323515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.323973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.324955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.325753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.326307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.373786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:43.384514 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9d00f00-34f4-4186-ab3a-aa53502821b4 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.183013 Sep 13 16:33:43.385126 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 423/885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:43.390103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.390735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.408381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.409212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.409351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.410347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.411002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.411744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.642150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:43.651086 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e9c4089-41a6-4916-8020-1ca109d04368 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.263799 Sep 13 16:33:43.653631 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 424/886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:43.662944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.664326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.672166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.672586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.673029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.674584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.674584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.675148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.775604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:43.789010 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d1ed1cb5-538a-4574-ad60-a5425c298829 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.479270 Sep 13 16:33:43.805411 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 463/887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:43.815979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.816637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.826931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.827437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.827994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.828845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.829314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.829743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.917476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:43.927506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a3c000bb-f213-42bf-868c-4109640b243a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.270919 Sep 13 16:33:43.942483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 425/888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:43.949892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:43.949892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:43.957360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.957992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.958514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:43.959811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:43.959811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:43.962124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.181976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.198106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.199642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.201246 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2a992c8-a0bb-4e1b-b364-a03dfd0a4497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.394362 Sep 13 16:33:44.206318 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 464/889] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:44.211051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.220725 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6714c0f7-1760-4908-b965-13ed58d5aca3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.277034 Sep 13 16:33:44.222488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:44.223374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:44.224676 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 426/890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:43 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:44.230158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.230677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.231120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.232555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.233201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.233634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.384716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9c985d76-7da7-46fa-9f27-f2896b7b5a8b req-0d4917e9-93f2-43af-a066-34017c8ca556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc75b21-5d7e-45f8-9e20-54284da59b4f", "name": "network-vif-unplugged", "status": "completed", "tag": "8cecb1b1-676f-4d30-903a-addf6afd1de1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:44.408554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c985d76-7da7-46fa-9f27-f2896b7b5a8b req-0d4917e9-93f2-43af-a066-34017c8ca556 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.409411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c985d76-7da7-46fa-9f27-f2896b7b5a8b req-0d4917e9-93f2-43af-a066-34017c8ca556 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.410082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c985d76-7da7-46fa-9f27-f2896b7b5a8b req-0d4917e9-93f2-43af-a066-34017c8ca556 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.428614 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9c985d76-7da7-46fa-9f27-f2896b7b5a8b req-0d4917e9-93f2-43af-a066-34017c8ca556 service nova] Creating event network-vif-unplugged:8cecb1b1-676f-4d30-903a-addf6afd1de1 for instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f on n-h2-857467-1 Sep 13 16:33:44.434443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9c985d76-7da7-46fa-9f27-f2896b7b5a8b req-0d4917e9-93f2-43af-a066-34017c8ca556 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054904 Sep 13 16:33:44.435866 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 427/891] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:44.441455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:44.442832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:44.449577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.451132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.451753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.453046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.453705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.454319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.597650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.605594 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f59b8be-f707-4356-94c9-7239d3929d02 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.168407 Sep 13 16:33:44.606337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 428/892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:44 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:44.643697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.663418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63fb31c6-8e3a-4018-8dc0-251820825c07 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.455522 Sep 13 16:33:44.678491 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 465/893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:44 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:44.680960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:44.681600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:44.690644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.691059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.691508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.692260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.692731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.693166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.817780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:44.818496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:44.827742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.830381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.830848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.832546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.833035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.833476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.867818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:44.880957 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea2f4f91-262f-4733-9d4b-47fd9a180382 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.204939 Sep 13 16:33:44.882234 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 429/894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:44 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:44.949288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:44.950048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:44.956577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.957071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.957770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:44.958292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:44.958810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:44.959211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.112683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.125518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2d5a3a02-07e7-4fe2-a6f8-b4b4d8c8e5cf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.180338 Sep 13 16:33:45.129871 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 430/895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:44 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:45.236131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:45.236757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:45.245271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.245566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.246223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.248600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.249778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.250668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.254319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.263400 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5dcd64d7-c7c3-491d-9176-d7088c2e9965 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.450099 Sep 13 16:33:45.269962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 466/896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:44 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:45.291866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:45.294428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:45.310624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.314926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.315744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.317492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.321436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.323165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.616015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:45.678851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.679861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.692357 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d648197-49e1-4858-947a-0b88b0da677f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.404327 Sep 13 16:33:45.693403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.695119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.696468 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83a59e8f-4a19-4d7d-a9b4-fa40e54660fa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.465431 Sep 13 16:33:45.710187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 467/897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:45 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:45.715371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 431/898] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:45 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:45.717212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:45.718966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:45.722977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:45.723576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:45.727850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.729570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.730158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.730593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.731409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.732419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.732667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.733251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.733677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.734244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.734492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.735085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.887585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=26 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:45.923013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:45.931063 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4cb84bf-7d9d-484a-929c-a28cb4b21c2d tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.214124 Sep 13 16:33:45.931651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 432/899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:45 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:45.936906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-22d02f45-bf40-441a-933e-d0fc2fecd4b0 req-e4b89f8b-e7c9-4272-9dcf-172499ec9238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d2ba48-e0d8-4338-b6b7-020acfb148a4", "name": "network-vif-plugged", "status": "completed", "tag": "a7a87fa9-569d-47c3-b11b-0625377bbff1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:45.946892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22d02f45-bf40-441a-933e-d0fc2fecd4b0 req-e4b89f8b-e7c9-4272-9dcf-172499ec9238 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.947382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22d02f45-bf40-441a-933e-d0fc2fecd4b0 req-e4b89f8b-e7c9-4272-9dcf-172499ec9238 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.947824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22d02f45-bf40-441a-933e-d0fc2fecd4b0 req-e4b89f8b-e7c9-4272-9dcf-172499ec9238 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.959411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-22d02f45-bf40-441a-933e-d0fc2fecd4b0 req-e4b89f8b-e7c9-4272-9dcf-172499ec9238 service nova] Creating event network-vif-plugged:a7a87fa9-569d-47c3-b11b-0625377bbff1 for instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 on n-h1-857467-1 Sep 13 16:33:45.964259 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-22d02f45-bf40-441a-933e-d0fc2fecd4b0 req-e4b89f8b-e7c9-4272-9dcf-172499ec9238 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031497 Sep 13 16:33:45.965041 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 433/900] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:45.971207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:45.971910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:45.978038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.978532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.979090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:45.979792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:45.980247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:45.980670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.035919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.048147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36be1ae7-c69d-4c9d-8a10-eab32d2906cb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.336492 Sep 13 16:33:46.048835 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 468/901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:45 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:46.151354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:46.152290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:46.158475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.158961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.159404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.160097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.160620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.161045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.226265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.235574 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-541e29bb-833f-44a7-a8ab-1fe3bb6dffd6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.268432 Sep 13 16:33:46.236174 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 434/902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:45 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:46.293026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:46.294666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:46.301153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.301656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.302124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.302836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.303301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.303896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.562952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.571021 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22ca5b8d-4429-4c8e-8101-095155424b77 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.423545 Sep 13 16:33:46.571964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 469/903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:46 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:46.577901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abc1103-ca94-4e9c-84e1-64c65215f6e7", "tag": "aa019033-acdd-499a-b7ba-87e4de3dc483"}, {"name": "network-changed", "server_uuid": "1bc75b21-5d7e-45f8-9e20-54284da59b4f", "tag": "8cecb1b1-676f-4d30-903a-addf6afd1de1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:46.589167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.590017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.590457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.604556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] Creating event network-changed:aa019033-acdd-499a-b7ba-87e4de3dc483 for instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 on n-h1-857467-1 Sep 13 16:33:46.605066 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] Creating event network-changed:8cecb1b1-676f-4d30-903a-addf6afd1de1 for instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f on n-h2-857467-1 Sep 13 16:33:46.615100 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-df70beea-37f3-473b-b026-e30d8015d769 req-6fe81a87-6ee2-44c7-8893-47ba05494a6f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041608 Sep 13 16:33:46.615906 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 470/904] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:46.624238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.632506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e034677e-1062-47c9-907f-7278c56b3b59 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.343746 Sep 13 16:33:46.633078 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 435/905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:46 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:46.718473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:46.719317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:46.726190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.726772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:46.727442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:46.727970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.728747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.730238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.731023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.731730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.734209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.734919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.735368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.736085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.738109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.738569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.741982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:46.964237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.972844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3689a0d3-20be-45ba-9219-211787cbc94f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1503 microversion: 2.1 time: 0.259719 Sep 13 16:33:46.973436 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 471/906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:46 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:46.974268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.978659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:46.979271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:46.984965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.985671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.986202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.986549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:46.986671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.987323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:46.987739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f44597ca-eb15-4743-9558-af5ab948fe04 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.265125 Sep 13 16:33:46.987850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:46.988206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:46.988835 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 436/907] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:46 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:47.074033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:47.074886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:47.082637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.083228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.083739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.084593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.085195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.085702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.215501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:47.227171 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bbb06b2c-7564-4af1-b720-a5a00905b91a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.252611 Sep 13 16:33:47.228808 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 472/908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:46 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:47.258787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:47.259403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:47.266196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.266697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.267214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.267940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.268400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.268829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.490863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:47.500521 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bfed01da-76e1-470a-a9ef-4d5fbaf9bc24 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.245911 Sep 13 16:33:47.501671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 473/909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:47 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:47.520237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:47.528055 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40d3e007-dcd7-4daf-98d1-073838d71805 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.458773 Sep 13 16:33:47.528658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 437/910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:47 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:47.594333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:47.594876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:47.600903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.601383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.601815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.602524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.602980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.603401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.657070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:47.657788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:47.665789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.666413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.666925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.667719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:47.668455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:47.668691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:47.749165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:47.758317 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aef80c92-394b-4260-8725-987fb14ea22e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.167159 Sep 13 16:33:47.758317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 474/911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:47 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:47.818034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:47.826527 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-659a3a46-d254-4c25-8483-f5e23430f562 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.175331 Sep 13 16:33:47.827095 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 438/912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:47 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:47.995364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:47.995974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.003061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.003554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.004027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.004729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.005449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.005907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.008558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:48.014199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.014934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.020885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.021368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.021804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.022521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.022978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.023408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.143452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.151360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35a82ddc-4920-443e-a25e-01f40180e008 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1493 microversion: 2.1 time: 0.159879 Sep 13 16:33:48.152536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 475/913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:47 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1493 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:48.155854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.163995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.165470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.166666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7173acfe-2e45-4ad6-b26b-d919e87aee15 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.157087 Sep 13 16:33:48.167225 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 439/914] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:48.173844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e0d7a78-9fbb-4682-8717-db0e5f01435c tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '.version_select at 0x7fbeb5244700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.177331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e0d7a78-9fbb-4682-8717-db0e5f01435c tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.177818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e0d7a78-9fbb-4682-8717-db0e5f01435c tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.178281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e0d7a78-9fbb-4682-8717-db0e5f01435c tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.187732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e0d7a78-9fbb-4682-8717-db0e5f01435c tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1557 microversion: 2.1 time: 0.017504 Sep 13 16:33:48.188302 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 476/915] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/os-migrations => generated 1557 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:48.202306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.202937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.209063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.209563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.210041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.210754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.211223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.211699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.253423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.254092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.260124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.260618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.261053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.261742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.262218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.262668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.338931 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa3c609f-99e9-4cff-a5cd-c8482dd017ce tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1644 microversion: 2.1 time: 0.140455 Sep 13 16:33:48.339705 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 440/916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1644 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:48.398253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.406111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8cdf701a-42ce-497c-80cd-6f67eeeb4a9c tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.156424 Sep 13 16:33:48.406625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 477/917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:48.455548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-813795486", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "8a9524ad-1d46-4f6a-be0d-1f61259b0753"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:48.509411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] validate_networks() for [('8a9524ad-1d46-4f6a-be0d-1f61259b0753', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:48.524266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.525097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.531381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.531879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.532326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.533032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.533499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.533961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.673893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.681885 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-352c0315-6b17-4c2b-9f6a-43741746d297 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.162014 Sep 13 16:33:48.682580 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 478/918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.697144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.839881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:48.850304 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6d081b5-2aa4-4c9f-945c-c3cbf1bd9154 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.166664 Sep 13 16:33:48.865775 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 479/919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:48.870609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:48.871225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:48.878124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.878616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.879055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.879760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.880482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.880905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.897411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:48.897985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:48.898326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:48.898774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:48.899188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:48.909288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.909778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.910320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.911060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:48.911530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:48.911945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:48.931582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:48.937091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for user 1fdc6602945c46fa98eebf50ea85a86e and project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:48.950647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:48.952984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:49.008501 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bbce6ac8-7003-484c-bac1-18e459372589 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555616 Sep 13 16:33:49.010830 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 441/920] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:33:49.017505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.018667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.027045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.027542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.027985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.029367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.029842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.030282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.041678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.051495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b163deb1-2357-4c2d-962c-ca43e4c0be06 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.183919 Sep 13 16:33:49.066332 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 480/921] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:48 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:49.071863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cbc792c2-6370-4987-90d5-f1c906271c08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.072476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cbc792c2-6370-4987-90d5-f1c906271c08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.136805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cbc792c2-6370-4987-90d5-f1c906271c08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.145767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cbc792c2-6370-4987-90d5-f1c906271c08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1210 microversion: 2.1 time: 0.078219 Sep 13 16:33:49.150674 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 481/922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:49.193973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.194597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.203241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.203743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.204216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.204938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.205402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.205849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.206424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.217190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-56639930-8be0-42cc-b73b-cfe2d72f88ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.205068 Sep 13 16:33:49.217781 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 442/923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:49.279437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bac8853d-9ac5-453d-be17-ad410769f3c9 req-e219ead0-d294-4fc5-9399-11ab977646de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "name": "network-vif-plugged", "status": "completed", "tag": "28342331-1aa5-4c12-972c-8ea806b74294"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:49.295777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bac8853d-9ac5-453d-be17-ad410769f3c9 req-e219ead0-d294-4fc5-9399-11ab977646de service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.295777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bac8853d-9ac5-453d-be17-ad410769f3c9 req-e219ead0-d294-4fc5-9399-11ab977646de service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.296585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bac8853d-9ac5-453d-be17-ad410769f3c9 req-e219ead0-d294-4fc5-9399-11ab977646de service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.322422 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bac8853d-9ac5-453d-be17-ad410769f3c9 req-e219ead0-d294-4fc5-9399-11ab977646de service nova] Creating event network-vif-plugged:28342331-1aa5-4c12-972c-8ea806b74294 for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:33:49.328776 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bac8853d-9ac5-453d-be17-ad410769f3c9 req-e219ead0-d294-4fc5-9399-11ab977646de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054578 Sep 13 16:33:49.329912 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 443/924] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:33:49.377429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.388333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.389939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.391343 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dac06830-7d60-4e70-b9a0-c17b33ecf522 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.201121 Sep 13 16:33:49.392116 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 482/925] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:49.429497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.430396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.437632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.438110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.438554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.439255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.439753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.440288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.590099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.599138 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-066d228d-d730-41e8-90fa-df94638580dd tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.174011 Sep 13 16:33:49.607056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 444/926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:49.705178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.705929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.712068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.712735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.713175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.713889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.714385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.714771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.864528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:49.872960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfee317d-822e-4fab-858f-a9295c0846cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.171691 Sep 13 16:33:49.873455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:49.874126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:49.874816 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 483/927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:49.883741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.884267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.884939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:49.885909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:49.886590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:49.887112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.038616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.047129 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce241ed5-9cc4-4279-b4bc-3ab1cfd1e443 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.178148 Sep 13 16:33:50.070042 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 445/928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:49 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:50.086447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.087285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.095471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.096266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.096714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.097429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.097926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.098360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.171239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.171987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.179064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.180439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.181098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.182083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.182917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.183647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.257514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.258660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.266124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06865be8-d5b1-45d8-a6ac-7c7f0a62942e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1262 microversion: 2.1 time: 0.100742 Sep 13 16:33:50.274697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 446/929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1262 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:50.280710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.281401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.284226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cca7f9fa-336f-4304-a94b-e8f77deb7801 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.210286 Sep 13 16:33:50.285281 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 484/930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:50.287926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.288419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.288862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.289566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.290065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.290497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.421659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.422592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.432792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.433296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.433734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.434531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.435026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.435544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.437044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.446277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe64e880-7f75-4527-b249-6500e6bb1c45 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.170311 Sep 13 16:33:50.462334 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 447/931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:50.625953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.626580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.633839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.634717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.635429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.635887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.636420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.636860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.671101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.680058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.681767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.683069 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce12dd59-168c-49d1-90e4-3b739cb79d8b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.266209 Sep 13 16:33:50.684070 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 485/932] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:50.783993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:50.792363 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-801b6486-fd31-43ea-b17a-442d06dd5e64 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.171609 Sep 13 16:33:50.793124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 448/933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:50.899125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:50.900355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:50.907234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.907812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.908603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:50.909371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:50.909936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:50.910431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.071434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.072101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.078524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.079210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.079660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.080365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.080838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.081276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.182950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.202429 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3e6954a-4bc5-465a-a2be-3786cae38641 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.308136 Sep 13 16:33:51.203023 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 486/934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:50 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:51.227731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.237139 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-608af54a-9af6-4058-bd32-f85e1d338e17 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.169580 Sep 13 16:33:51.237657 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 449/935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:51.289905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.290822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.297110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.297941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.298444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.299336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.299981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.300597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.307409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.308242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.315929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.317534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.318576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.320045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.321969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.323075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.396580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.414126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9923c026-9e1a-4707-a3c4-a1b3baa2145c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1268 microversion: 2.1 time: 0.127049 Sep 13 16:33:51.415534 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 487/936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:51.422987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "name": "network-vif-plugged", "status": "completed", "tag": "3d19d7c5-8520-4bfc-9102-67ff59c2ae8e"}, {"server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "name": "network-vif-plugged", "status": "completed", "tag": "b9a372e6-adb3-4274-a104-d9fad1b68fe7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:51.442625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.443145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.443573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.462844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] Creating event network-vif-plugged:3d19d7c5-8520-4bfc-9102-67ff59c2ae8e for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:33:51.463879 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] Creating event network-vif-plugged:b9a372e6-adb3-4274-a104-d9fad1b68fe7 for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:33:51.472842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f595bd71-deb6-4c60-90ca-095c1392f0db req-a5109446-580e-4b6a-be4c-a85c5505fce0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055786 Sep 13 16:33:51.475088 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 488/937] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:51.484721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.486681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.496223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.497557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.498255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.499207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.500375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.501028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.521270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.530841 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9d37e4a-72c0-40d7-88ee-0f61eb80fa42 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.227133 Sep 13 16:33:51.532102 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 450/938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:51.708629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.709243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.715422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.717119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.717640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.718484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.718953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.719381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.744086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.760249 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-467774e3-62df-40ef-af95-33a309b6785f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.283260 Sep 13 16:33:51.760864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 489/939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:51.818784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:51.819769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:51.828799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.829358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.829904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.830668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:51.831171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:51.831657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:51.973949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.983115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.984623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:51.985969 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c78735f9-175d-4602-8c99-6c2557586b3e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.281279 Sep 13 16:33:51.996882 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 451/940] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:52.142157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:52.151173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d21cb42-d5c6-495e-80e5-0c5597c4d150 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1351 microversion: 2.1 time: 0.337379 Sep 13 16:33:52.152768 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 490/941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:51 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1351 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:52.225651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:52.227133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:52.234699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.235712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.236332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.237043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.237595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.237966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.260840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:52.261369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:52.269682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.270433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.270876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.271590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.272251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.272684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.400250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:52.409097 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35214f41-a2ce-47f3-86a9-f7a9cb0e4aab tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.187094 Sep 13 16:33:52.410053 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 452/942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:52 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:52.445853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:52.446887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:52.456024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.457023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.457565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.458490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.459628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.460167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.611622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:52.620157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c90292bb-e448-49df-86bc-a11ac4d57b2d tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.363259 Sep 13 16:33:52.620846 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 491/943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:52 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:52.627353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:52.628233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:52.634771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.635357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.636245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.637151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.638301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.638944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.704855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:52.725566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a9f8315-50ec-47fb-99c6-71fed467ac8f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.288014 Sep 13 16:33:52.730052 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 453/944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:52 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:52.786789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:52.787637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:52.799492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.801443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.802053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.804270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.805049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.805570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.809028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:52.892776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:52.903986 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9861163-bb33-4917-ac81-25196557515f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.281670 Sep 13 16:33:52.905883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 492/945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:52 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:52.927806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c7b55f10-5a0e-4bfe-b36c-8388123455e2 req-352f74e4-7162-4b03-a4e5-f5c58d2d5c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6afe5ca-008b-43d4-93cb-7b1cc636ee58", "tag": "ab3df1fb-0ed3-41a4-9e86-3bef784c98f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:52.945510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c7b55f10-5a0e-4bfe-b36c-8388123455e2 req-352f74e4-7162-4b03-a4e5-f5c58d2d5c07 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:52.946297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c7b55f10-5a0e-4bfe-b36c-8388123455e2 req-352f74e4-7162-4b03-a4e5-f5c58d2d5c07 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:52.947483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c7b55f10-5a0e-4bfe-b36c-8388123455e2 req-352f74e4-7162-4b03-a4e5-f5c58d2d5c07 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:52.967225 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c7b55f10-5a0e-4bfe-b36c-8388123455e2 req-352f74e4-7162-4b03-a4e5-f5c58d2d5c07 service nova] Creating event network-changed:ab3df1fb-0ed3-41a4-9e86-3bef784c98f7 for instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 on n-h2-857467-1 Sep 13 16:33:52.972917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c7b55f10-5a0e-4bfe-b36c-8388123455e2 req-352f74e4-7162-4b03-a4e5-f5c58d2d5c07 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051601 Sep 13 16:33:52.973940 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 493/946] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:53.012108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:53.012840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:53.019010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.019499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.019936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.020632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.021097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.021530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.107599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.115679 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac9d5c45-6166-49da-920f-a1e50dcd4971 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.335479 Sep 13 16:33:53.116482 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 454/947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:52 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:53.162754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.165219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:53.174943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.176088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:53.176537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.177164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:53.178137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3ffc2e5-149a-455c-9184-714330761fd0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.170230 Sep 13 16:33:53.183837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.184466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.185013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.185808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.186393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.186947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.190416 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 494/948] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:53 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:53.335455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.346511 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60b047bf-8ab2-4364-8d0c-cac3eb0e424f tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1541 microversion: 2.1 time: 0.174185 Sep 13 16:33:53.347784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 455/949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:53 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1541 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:53.371420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:53.373090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:53.381959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.382570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.383093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.383857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.384392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.384920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.432532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:53.433456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:53.440121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.440627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.441075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.441785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.442837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.443278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.468443 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a878837-ac6b-4cf4-9090-599ec724b0fb tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101514 Sep 13 16:33:53.469178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 495/950] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:33:53 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:53.492413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-84d4e8a5-9e00-4ed0-9b10-4e9d99184cc1 req-6da883d4-b646-4844-88e2-40bf9420aa7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba427499-3971-463a-9fd1-065bbdee6476", "name": "network-vif-plugged", "status": "completed", "tag": "6f3c2223-a389-4adf-bbd7-8727cc9d53a9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:53.504391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-84d4e8a5-9e00-4ed0-9b10-4e9d99184cc1 req-6da883d4-b646-4844-88e2-40bf9420aa7c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.505670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-84d4e8a5-9e00-4ed0-9b10-4e9d99184cc1 req-6da883d4-b646-4844-88e2-40bf9420aa7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.506321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-84d4e8a5-9e00-4ed0-9b10-4e9d99184cc1 req-6da883d4-b646-4844-88e2-40bf9420aa7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.525711 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-84d4e8a5-9e00-4ed0-9b10-4e9d99184cc1 req-6da883d4-b646-4844-88e2-40bf9420aa7c service nova] Creating event network-vif-plugged:6f3c2223-a389-4adf-bbd7-8727cc9d53a9 for instance ba427499-3971-463a-9fd1-065bbdee6476 on n-h2-857467-1 Sep 13 16:33:53.531589 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-84d4e8a5-9e00-4ed0-9b10-4e9d99184cc1 req-6da883d4-b646-4844-88e2-40bf9420aa7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043518 Sep 13 16:33:53.532808 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 496/951] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:33:53.649931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:53.651476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:53.661951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.662543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.663291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.664165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.665057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.665648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.673105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:53.689922 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-576073f9-a55a-453d-8307-c54c778d2920 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.261119 Sep 13 16:33:53.690801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 456/952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:53 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:53.751921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:53.752667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:53.759557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.760393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.761217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:53.762189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:53.763815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:53.764461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.016146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.026727 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a942781-016f-4184-ad58-fca0ab3d3e00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.279738 Sep 13 16:33:54.027584 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 457/953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:53 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:54.047654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:54.048622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:54.072875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.073397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.073920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.074647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.075813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.076401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.253743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.263440 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aa95d22-e7a0-4b93-95c1-f1ccedd76660 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.219133 Sep 13 16:33:54.268142 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 458/954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:54 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:54.274651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:54.275668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:54.284671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.285174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.285621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.286368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.286833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.287267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.289015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.298477 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-02aad0a6-85b2-45f9-a451-5099fc93b746 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.657223 Sep 13 16:33:54.314341 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 497/955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:53 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:54.319389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:54.320005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:54.327935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.328657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.329103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.329813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.330306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.330734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.489596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.498966 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b111043a-3f09-4fff-85ed-cc73060cf88f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1355 microversion: 2.1 time: 0.229527 Sep 13 16:33:54.499714 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 459/956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:54 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1355 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:54.714727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:54.716140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:54.719941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.735511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.739055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.739699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.740255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.741955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:54.741955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:54.742385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:54.746067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.750170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad145ad3-44bb-4ac5-9085-83e9a777c357 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1569 microversion: 2.25 time: 0.432971 Sep 13 16:33:54.760321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 498/957] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:54 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1569 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:54.931556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:54.939753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4b09207-335d-4d60-a4f8-05051e0fc2ff tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.229077 Sep 13 16:33:54.940526 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 460/958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:54 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:55.052643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.053267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.058662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:55.064955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.064955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.064955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.064955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.064955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.064955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.286539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.291178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.291802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.295605 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef82f563-434e-4b21-83ef-b8a5c981096b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.246411 Sep 13 16:33:55.309892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 499/959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:55.318123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.319011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.319654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.320557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.321200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.321638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.339903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.341198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.368708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.369152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.370157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.371761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.372239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.373145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.514330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.523981 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-511fd434-08cc-4dd8-acee-5268ae1254f9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.236490 Sep 13 16:33:55.525131 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 461/960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:55.531499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.532891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.542066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:55.545101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.546406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.547095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.548241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.549713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.550989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.655411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.667560 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad1dbdc0-d6e2-4179-9f9c-7d07c38e59f1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.350285 Sep 13 16:33:55.681922 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 500/961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:55.690338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6faf7b48-0bff-4911-987e-28992bfd8f55 req-25e9a8e2-9eab-42ac-a3c3-6835b20ef5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d2ba48-e0d8-4338-b6b7-020acfb148a4", "tag": "a7a87fa9-569d-47c3-b11b-0625377bbff1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:55.709889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6faf7b48-0bff-4911-987e-28992bfd8f55 req-25e9a8e2-9eab-42ac-a3c3-6835b20ef5b7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.710942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6faf7b48-0bff-4911-987e-28992bfd8f55 req-25e9a8e2-9eab-42ac-a3c3-6835b20ef5b7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.711490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6faf7b48-0bff-4911-987e-28992bfd8f55 req-25e9a8e2-9eab-42ac-a3c3-6835b20ef5b7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.724930 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6faf7b48-0bff-4911-987e-28992bfd8f55 req-25e9a8e2-9eab-42ac-a3c3-6835b20ef5b7 service nova] Creating event network-changed:a7a87fa9-569d-47c3-b11b-0625377bbff1 for instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 on n-h1-857467-1 Sep 13 16:33:55.731781 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6faf7b48-0bff-4911-987e-28992bfd8f55 req-25e9a8e2-9eab-42ac-a3c3-6835b20ef5b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047370 Sep 13 16:33:55.736269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.740247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 501/962] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:55.748604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc3a17eb-f62e-484d-b2b5-3981831795ee tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1804 microversion: 2.1 time: 0.222228 Sep 13 16:33:55.749313 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 462/963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1804 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:55.753034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-170577d2-5d29-405c-a901-c2af566108dc req-84a88a02-5a95-4094-8a35-8b7245f66b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4406cd-de58-4a5f-b59c-496bad570197", "name": "network-vif-plugged", "status": "completed", "tag": "acc2459c-3b15-4aa6-91fb-30309b1cd7ab"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:55.764330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-170577d2-5d29-405c-a901-c2af566108dc req-84a88a02-5a95-4094-8a35-8b7245f66b22 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.764775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-170577d2-5d29-405c-a901-c2af566108dc req-84a88a02-5a95-4094-8a35-8b7245f66b22 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.765177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-170577d2-5d29-405c-a901-c2af566108dc req-84a88a02-5a95-4094-8a35-8b7245f66b22 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.776447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.777071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.787978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.788720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.789366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.789535 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-170577d2-5d29-405c-a901-c2af566108dc req-84a88a02-5a95-4094-8a35-8b7245f66b22 service nova] Creating event network-vif-plugged:acc2459c-3b15-4aa6-91fb-30309b1cd7ab for instance 2b4406cd-de58-4a5f-b59c-496bad570197 on n-h2-857467-1 Sep 13 16:33:55.790503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.791132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.791720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.797447 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-170577d2-5d29-405c-a901-c2af566108dc req-84a88a02-5a95-4094-8a35-8b7245f66b22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051454 Sep 13 16:33:55.798497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 502/964] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:55.804025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.804907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.814215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.815013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.815532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.816316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.816851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.817347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.850908 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2390802-5d64-4b22-bf8e-972858168722 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6/ips" status: 200 len: 217 microversion: 2.1 time: 0.051115 Sep 13 16:33:55.851754 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 503/965] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6/ips => generated 217 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:55.863916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.864501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.870812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.871461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.872701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.873490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.874055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.874556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.903880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:33:55.938943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.954651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.957281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:55.959137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1031db8-679b-42d1-90f7-3bbbea52620e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1544 microversion: 2.25 time: 0.186625 Sep 13 16:33:55.959952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 463/966] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1544 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:55.986129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:55.986847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:55.994086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.996339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.997019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:55.997991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:55.998643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:55.999263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.014521 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07b5baef-cd54-4369-b45a-303d6164e56a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 204 len: 0 microversion: 2.1 time: 0.153870 Sep 13 16:33:56.018188 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 504/967] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:33:55 2022] DELETE /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:33:56.021499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8cee8194-c268-4c68-9d5f-644cc344f0ab tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '.version_select at 0x7fbeb5231790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.026019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cee8194-c268-4c68-9d5f-644cc344f0ab tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.026650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cee8194-c268-4c68-9d5f-644cc344f0ab tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.027110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cee8194-c268-4c68-9d5f-644cc344f0ab tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.037318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8cee8194-c268-4c68-9d5f-644cc344f0ab tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.020353 Sep 13 16:33:56.037951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 505/968] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:56.048858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.048858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:56.074326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.075729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.076188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.076927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.077456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.078594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.166387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:56.176860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7ad33d6-46b9-41d3-9f05-6502fbb9f0a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.204329 Sep 13 16:33:56.190308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 464/969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:55 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:56.197453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.198160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:56.205799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.206425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.207026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.207743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.208208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.208639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.351358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:56.363023 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bb58e435-3156-4955-a571-73860d126fd8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1810 microversion: 2.1 time: 0.323573 Sep 13 16:33:56.363639 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 506/970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1810 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:56.369476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:33:56.374576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.374756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:56.390324 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76881730-b3de-4e87-b77e-1a753392ad13 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 2037 microversion: 2.25 time: 0.197726 Sep 13 16:33:56.391782 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 465/971] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 2037 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:33:56.392828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.393331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.393769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.394639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.394958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.395387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.423912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3100afe-1972-4eea-a2f3-4bc763cf9881 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Action: 'create', calling method: .version_select at 0x7fbeb5a9cdc0>, body: {"keypair": {"name": "tempest-keypair-1344773176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPONk5J5Nwp17g2r/ivNFMQUqxDC4ee0aRfbyQ1kcnL0SsgiHDPqUmJ/QACug42N5ajacOZGvUS6UL6QTXgkQpqGDcdcPcNBui+h4oBLvE/5hMUkqByXCSi3XQTs++Gsjg=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:56.440032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f3100afe-1972-4eea-a2f3-4bc763cf9881 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:56.445453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f3100afe-1972-4eea-a2f3-4bc763cf9881 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for user 792d76dbc4394c77bee09f600364cb74 and project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:56.474975 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3100afe-1972-4eea-a2f3-4bc763cf9881 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.056191 Sep 13 16:33:56.475771 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 466/972] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:33:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 13 16:33:56.550449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.551149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:56.557764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.558042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.558485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.559515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.560314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.560754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.619366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:56.632905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2676e8ae-655f-412b-ab5c-5414833ab98b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.268149 Sep 13 16:33:56.633500 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 507/973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:56.695408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:56.696209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:56.704562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.705358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.706229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.708330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:56.709849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:56.710578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:56.777182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:56.787465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63bcb7af-0526-4717-820e-6d0df67f9d6e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.241348 Sep 13 16:33:56.788374 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 467/974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:56.937191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:56.945948 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba6a5fb9-8e70-451b-9709-5d8c70f999e0 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.255284 Sep 13 16:33:56.956153 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 508/975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:56 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:57.201228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:57.201993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:57.208222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.208808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.209318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.210115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.210648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.211147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.387334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:57.388085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:57.394303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.394791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.395228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.395921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.396379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.396834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.432126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:57.441127 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-61237552-8713-4c02-9043-e1f4cac775a5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.244160 Sep 13 16:33:57.442023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 468/976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:57 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:57.573814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:57.584180 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-385951da-4a42-42f5-9a83-65d1b1dea2f3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1810 microversion: 2.1 time: 0.200710 Sep 13 16:33:57.584770 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 509/977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:57 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:57.657005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:57.657632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:57.663573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.664067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.664516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.665227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.665697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.666161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.812024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:57.812643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:57.819492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.820323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.827773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.828513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.828998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.830066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.906650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:57.919339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8cff2564-8996-4d2d-a3c1-448bf12d8606 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.265999 Sep 13 16:33:57.920282 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 469/978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:57 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:57.940037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-56ab455b-406a-4b50-be8b-981c779a3a49 req-bea9d53e-69f4-46cf-8e03-5b4aa402be57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abc1103-ca94-4e9c-84e1-64c65215f6e7", "name": "network-vif-plugged", "status": "completed", "tag": "aa019033-acdd-499a-b7ba-87e4de3dc483"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:57.950833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-56ab455b-406a-4b50-be8b-981c779a3a49 req-bea9d53e-69f4-46cf-8e03-5b4aa402be57 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.951609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-56ab455b-406a-4b50-be8b-981c779a3a49 req-bea9d53e-69f4-46cf-8e03-5b4aa402be57 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.952222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-56ab455b-406a-4b50-be8b-981c779a3a49 req-bea9d53e-69f4-46cf-8e03-5b4aa402be57 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.966012 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-56ab455b-406a-4b50-be8b-981c779a3a49 req-bea9d53e-69f4-46cf-8e03-5b4aa402be57 service nova] Creating event network-vif-plugged:aa019033-acdd-499a-b7ba-87e4de3dc483 for instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 on n-h1-857467-1 Sep 13 16:33:57.972158 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-56ab455b-406a-4b50-be8b-981c779a3a49 req-bea9d53e-69f4-46cf-8e03-5b4aa402be57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036615 Sep 13 16:33:57.972780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 470/979] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:33:57.979776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:57.980731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:57.989660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.990420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.991245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.991957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:57.992419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:57.992851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:57.993168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.002906 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c38a75ed-2004-4455-9e52-7162937ce96d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.195926 Sep 13 16:33:58.003831 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 510/980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:57 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:58.186525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.194374 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5f4f4e3-c179-41b0-8340-25e4e1053df9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.220312 Sep 13 16:33:58.194954 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 471/981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:57 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:58.254379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1785478237", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "e0e29954-773d-492f-aa39-e96119d607b1"}], "security_groups": [{"name": "tempest-securitygroup--1626717774"}], "key_name": "tempest-keypair-1344773176", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:33:58.357010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] validate_networks() for [('e0e29954-773d-492f-aa39-e96119d607b1', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:33:58.469317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:58.470049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:58.476172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.476745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.477258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.478069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.478607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.479130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.484108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:58.616581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.624921 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e645d62-0842-4fc7-abf2-6d21bc3c65b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.160403 Sep 13 16:33:58.625503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 472/982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:58 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:58.630321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:58.630924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:58.637437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.638352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.638813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.639881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.640500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.640940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.737111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:33:58.737591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:33:58.738100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:33:58.738551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:33:58.738969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:33:58.749619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.750150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.750599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.751409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.751875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.752310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.769397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:33:58.774667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for user 792d76dbc4394c77bee09f600364cb74 and project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:33:58.787116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.787613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:33:58.789746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:33:58.795724 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f954fc8e-dfff-469b-9f36-3840f59ffdd2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1810 microversion: 2.1 time: 0.169101 Sep 13 16:33:58.796306 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 473/983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:58 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:58.838997 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e4fc07d-d777-49f6-9c3a-a778e35566cb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.588469 Sep 13 16:33:58.839648 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 511/984] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:33:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 16:33:58.851267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-589a6262-7568-4bc5-8fd8-9d7f321b7d41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:58.851874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-589a6262-7568-4bc5-8fd8-9d7f321b7d41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:58.917658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-589a6262-7568-4bc5-8fd8-9d7f321b7d41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.920587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:58.927512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-589a6262-7568-4bc5-8fd8-9d7f321b7d41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.929192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-589a6262-7568-4bc5-8fd8-9d7f321b7d41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:58.930571 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-589a6262-7568-4bc5-8fd8-9d7f321b7d41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1286 microversion: 2.25 time: 0.083056 Sep 13 16:33:58.931439 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 474/985] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:58 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:33:58.947111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:58.948199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:58.955312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.955895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.956421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:58.957678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:58.957892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:58.958305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.026775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:59.027635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:59.034980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.035521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.035898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.036920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.037334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.037751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.202321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:59.210776 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-853f9984-2682-41ce-917b-1057a790a06d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.188439 Sep 13 16:33:59.211633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 475/986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:59 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:59.221590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:59.222429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:59.231318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.232300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.232859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.233787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.234509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.235254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.392654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:59.401649 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48b410e5-f404-47a1-93fe-d26b2a80399a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.184592 Sep 13 16:33:59.402271 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 476/987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:59 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:59.433366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:59.441846 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2caac28-d40c-4c2b-a347-c3f6eb3e001d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.498945 Sep 13 16:33:59.442445 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 512/988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:58 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:59.649336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:59.650286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:59.657207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.657792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.658344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.659133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.659872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.660510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.820661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:59.821897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:59.823189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:59.830923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.831732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.832154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abbee252-35b3-4364-999b-d148fdda4f6c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1313 microversion: 2.1 time: 0.186843 Sep 13 16:33:59.832897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.833850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.835101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.835762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.843286 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 477/989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:59 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:33:59.962508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:33:59.963126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:33:59.969921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.970416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.970860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.971566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:33:59.972031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:33:59.972467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:33:59.981618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:33:59.985538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:33:59.992251 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0854a758-41cd-4927-a69c-9b5ef17ce5c8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1810 microversion: 2.1 time: 0.176234 Sep 13 16:33:59.992838 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 513/990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:33:59 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:33:59.997289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0ad53352-a0a9-4793-b777-5c4babfd6ef9 req-d2bd1442-0613-41b2-b6de-ea2e03b4d428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc75b21-5d7e-45f8-9e20-54284da59b4f", "name": "network-vif-plugged", "status": "completed", "tag": "8cecb1b1-676f-4d30-903a-addf6afd1de1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:00.007657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0ad53352-a0a9-4793-b777-5c4babfd6ef9 req-d2bd1442-0613-41b2-b6de-ea2e03b4d428 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.008143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0ad53352-a0a9-4793-b777-5c4babfd6ef9 req-d2bd1442-0613-41b2-b6de-ea2e03b4d428 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.008581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0ad53352-a0a9-4793-b777-5c4babfd6ef9 req-d2bd1442-0613-41b2-b6de-ea2e03b4d428 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.033054 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0ad53352-a0a9-4793-b777-5c4babfd6ef9 req-d2bd1442-0613-41b2-b6de-ea2e03b4d428 service nova] Creating event network-vif-plugged:8cecb1b1-676f-4d30-903a-addf6afd1de1 for instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f on n-h1-857467-1 Sep 13 16:34:00.038891 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0ad53352-a0a9-4793-b777-5c4babfd6ef9 req-d2bd1442-0613-41b2-b6de-ea2e03b4d428 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044883 Sep 13 16:34:00.040547 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 514/991] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:00.058377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.067419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.068869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.070004 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c5e3e61-a020-4861-9178-4c8055aae8be tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1338 microversion: 2.25 time: 0.111394 Sep 13 16:34:00.070565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 478/992] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:33:59 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:34:00.235156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:00.235874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:00.242480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.242980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.243427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.244131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.244591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.245020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.429278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:00.431525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:00.441107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.441893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.442565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.443291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.443764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.444208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.448865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.457569 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9dc6a4a-09c5-45cf-91d3-6dc1bd4dc2f7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.227100 Sep 13 16:34:00.458194 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 515/993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:00 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:00.463323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:00.464146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:00.471196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.471916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.472531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.473430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.474096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.474545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.597399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.605172 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-042a06e3-48ff-4205-a890-ab840dfa2e42 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.180365 Sep 13 16:34:00.605921 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 479/994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:00 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:00.613621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:00.622011 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ba89b09-627d-487f-8c52-75262f5e2572 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.161995 Sep 13 16:34:00.622974 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 516/995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:00 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:00.855586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:00.856498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:00.862347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.862840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.863308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:00.864071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:00.864458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:00.864888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.008244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.016188 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a736a389-32c6-4a29-8d94-09575e96cfc1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1463 microversion: 2.1 time: 0.164520 Sep 13 16:34:01.016763 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 480/996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:00 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:01.018047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.018737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.024773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.025265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.025742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.026553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.027018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.027471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.040255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:01.042824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.049587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.050245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.050940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.056856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.057581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.058240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.151657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.158298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 16:34:01.165169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:01.165588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:01.166375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:01.166797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:01.167198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:01.259867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.268896 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33b3c68e-55af-470f-a883-10bd16fe5954 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1810 microversion: 2.1 time: 0.256190 Sep 13 16:34:01.269807 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 517/997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1810 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:01.274764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.275801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.282435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.283165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.283608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.284319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.284898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.285354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.300911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-653ef879-d025-44b4-89f0-49808a7e2c36 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7/action" status: 202 len: 0 microversion: 2.1 time: 0.264788 Sep 13 16:34:01.302324 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 481/998] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:34:01 2022] POST /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:34:01.312402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.313210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.320890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.321899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.322052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.322920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.323604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.324148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.373497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.382920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.384303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.385762 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2381d007-0ddd-4329-9a16-9c054dc5b757 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1344 microversion: 2.25 time: 0.114662 Sep 13 16:34:01.386369 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 518/999] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:01.481497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.482418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.489551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.490091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.490529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.491547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.492015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.492510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.493712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.504592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a6dc47e4-6c3e-4917-af2c-23c2229a0734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.197609 Sep 13 16:34:01.506081 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 482/1000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:01.629418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.630534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.637939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.638663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.639266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.640288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.641024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.641672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.816679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.826157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc45f9dc-9e6c-4c0b-af26-2a8978a09059 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1317 microversion: 2.1 time: 0.348852 Sep 13 16:34:01.835736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:01.847263 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 519/1001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:01.849992 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76f7fd81-bd89-4cab-abd8-4eac5aa1e588 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.225378 Sep 13 16:34:01.850791 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 483/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:01.852114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:01.852733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:01.862386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.863146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.863803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:01.864730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:01.865639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:01.866301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.206005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:02.219149 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5f319fd-eeca-4736-9765-a9de81cbde7b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.370695 Sep 13 16:34:02.219757 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 520/1003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:01 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:02.228674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7ad04e25-15ac-4d1a-a34a-02f25c2f9eef req-93b81d82-959f-4462-9266-9d201e44dae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6afe5ca-008b-43d4-93cb-7b1cc636ee58", "name": "network-vif-plugged", "status": "completed", "tag": "ab3df1fb-0ed3-41a4-9e86-3bef784c98f7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:02.245669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7ad04e25-15ac-4d1a-a34a-02f25c2f9eef req-93b81d82-959f-4462-9266-9d201e44dae7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.246194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7ad04e25-15ac-4d1a-a34a-02f25c2f9eef req-93b81d82-959f-4462-9266-9d201e44dae7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.248225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7ad04e25-15ac-4d1a-a34a-02f25c2f9eef req-93b81d82-959f-4462-9266-9d201e44dae7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.263351 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7ad04e25-15ac-4d1a-a34a-02f25c2f9eef req-93b81d82-959f-4462-9266-9d201e44dae7 service nova] Creating event network-vif-plugged:ab3df1fb-0ed3-41a4-9e86-3bef784c98f7 for instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 on n-h2-857467-1 Sep 13 16:34:02.269078 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7ad04e25-15ac-4d1a-a34a-02f25c2f9eef req-93b81d82-959f-4462-9266-9d201e44dae7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045172 Sep 13 16:34:02.270175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 484/1004] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:02.293151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:02.294322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:02.301696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.302457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.303164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.304144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.304661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.305295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.412291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:02.413298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:02.424230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.425476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.426577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.428067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.428553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.429168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.692132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:02.707590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:02.709636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:02.711164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-772e0dab-e4f8-4c10-8ed4-349d43a36f9b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.303328 Sep 13 16:34:02.712877 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 485/1005] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:02 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:02.718696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:02.719508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:02.725992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.727019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.727711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.728670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.730042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.859298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:02.876189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13c063a5-7fba-4f93-82c3-af27303d299d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1810 microversion: 2.1 time: 0.587287 Sep 13 16:34:02.878716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 521/1006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:02 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1810 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:02.905615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ad6f60a6-78a5-46fc-8d62-564aa0ae5cde req-c9629907-42a0-4689-a744-a94b781706dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "name": "network-vif-deleted", "tag": "28342331-1aa5-4c12-972c-8ea806b74294"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:02.915774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ad6f60a6-78a5-46fc-8d62-564aa0ae5cde req-c9629907-42a0-4689-a744-a94b781706dd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.916294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ad6f60a6-78a5-46fc-8d62-564aa0ae5cde req-c9629907-42a0-4689-a744-a94b781706dd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.916736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ad6f60a6-78a5-46fc-8d62-564aa0ae5cde req-c9629907-42a0-4689-a744-a94b781706dd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.931073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ad6f60a6-78a5-46fc-8d62-564aa0ae5cde req-c9629907-42a0-4689-a744-a94b781706dd service nova] Creating event network-vif-deleted:28342331-1aa5-4c12-972c-8ea806b74294 for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:34:02.934549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:02.937814 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ad6f60a6-78a5-46fc-8d62-564aa0ae5cde req-c9629907-42a0-4689-a744-a94b781706dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040897 Sep 13 16:34:02.939785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 522/1007] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:02.946424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:02.946424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:02.947146 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e38b505-cc72-4cbc-82f7-8674f27c8534 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.232665 Sep 13 16:34:02.948418 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 486/1008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:02 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:02.959102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:02.959492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:02.970381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.970886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.971516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.972346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.972782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.973082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.973538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.974275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:02.975328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.975553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:02.975826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:02.976468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.176895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:03.189957 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb3ce637-0e6f-4103-a1e1-f9d843d4bb36 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.239382 Sep 13 16:34:03.194622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 487/1009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:02 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:03.243859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:03.244492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:03.252593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:03.253086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:03.253527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.254253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:03.254727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:03.255407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.338016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:03.347843 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8bf2ad43-356d-4636-8930-a339e66823c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1467 microversion: 2.1 time: 0.406864 Sep 13 16:34:03.349410 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 523/1010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:02 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1467 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:03.371040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:03.372149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:03.379294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:03.380340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:03.380782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.381660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:03.382306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:03.382741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.401862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:03.410704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fef0d0f4-efad-42fe-8398-4ce11bc30d12 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.171172 Sep 13 16:34:03.411285 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 488/1011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:03 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:03.667672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-86e1fde8-a792-4760-9520-bd2fb4f7b679 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1618 microversion: 2.1 time: 0.300516 Sep 13 16:34:03.681854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 524/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:03 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1618 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:03.737086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1830682248", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["ea94c7be-d3dc-477b-8d97-6968a0f8e79b"]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:03.740591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:03.741206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:03.748998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:03.749526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:03.750001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.750756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:03.751213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:03.751856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:03.801916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:04.016111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.024580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.026390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.027673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-89b38d25-704e-4466-94d4-81a05777a3d6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.291000 Sep 13 16:34:04.028750 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 525/1013] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:03 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:04.051628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:04.052266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:04.060441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.060997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.061454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.062222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.062874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.063318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.069706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:04.070233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:04.070787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:04.071270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:04.071828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:04.081485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.082139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.082654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.083469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.084104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.084636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.092005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:04.105322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:04.112194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:04.125809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:04.128246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:04.173594 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b20a5e96-220b-4ae0-993e-d57751883871 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.440522 Sep 13 16:34:04.180137 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 489/1014] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:34:04.180137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:04.180137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:04.186791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.187292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.187738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.188450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.189866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.190454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.385502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.395854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4626cc89-5b03-40a6-9dfe-51bb5a26f0e3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.220470 Sep 13 16:34:04.397099 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 490/1015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:04 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:04.399842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.413713 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f426ca24-7113-4f8d-b1a2-cf5fa75015b7 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1653 microversion: 2.1 time: 0.366184 Sep 13 16:34:04.414957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd2e7d0c-0e1b-4b71-a585-9b37bb20ee50 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:04.416270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cd2e7d0c-0e1b-4b71-a585-9b37bb20ee50 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:04.419280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 526/1016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:04 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1653 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:04.430210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:04.431090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:04.440051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.440759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.441362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.442284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.442900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.443569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.517949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd2e7d0c-0e1b-4b71-a585-9b37bb20ee50 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.535153 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd2e7d0c-0e1b-4b71-a585-9b37bb20ee50 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1217 microversion: 2.1 time: 0.133643 Sep 13 16:34:04.545905 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 491/1017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:04 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:04.545905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:04.545905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:04.553356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.553356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.553356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.553356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:04.553356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:04.553925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:04.719009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:04.730011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a6d5da1-20b3-44dc-9f43-7381886d4c00 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1310 microversion: 2.1 time: 0.191202 Sep 13 16:34:04.732144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 492/1018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:04 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:04.986447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "name": "network-vif-deleted", "tag": "3d19d7c5-8520-4bfc-9102-67ff59c2ae8e"}, {"name": "network-changed", "server_uuid": "f7305af6-eeb4-43bc-ac65-52988a63a1de", "tag": "623fd98d-6910-4803-8c51-595d0e97b6c3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:05.001873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.002369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.002817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.027590 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] Creating event network-vif-deleted:3d19d7c5-8520-4bfc-9102-67ff59c2ae8e for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:34:05.028588 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] Creating event network-changed:623fd98d-6910-4803-8c51-595d0e97b6c3 for instance f7305af6-eeb4-43bc-ac65-52988a63a1de on n-h1-857467-1 Sep 13 16:34:05.037361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.040762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-382668c8-328b-4980-8bab-5d61e9c06509 req-668432d2-90a1-4121-a2d1-6844801f79bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058553 Sep 13 16:34:05.041564 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 493/1019] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:05.048170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0fe1b41a-7783-4eb1-8eff-a9ad2b144414 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.625917 Sep 13 16:34:05.048928 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 527/1020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:04 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:05.062040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.064362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.074260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.074853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.075252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.075970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.076433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.076858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.220160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.229456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.231748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.233423 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-246ff46d-72bb-4bd4-895b-1e7c2edc5a65 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.181731 Sep 13 16:34:05.234696 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 494/1021] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:05.423216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.423865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.429865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.430378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.430799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.431501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.431964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.432392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.455300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.455933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.462527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.463248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.464312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.466166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.467037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.467851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.548399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.556904 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4cef7be8-4bb9-48f0-a491-a417990d9ec5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1298 microversion: 2.1 time: 0.117574 Sep 13 16:34:05.557795 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 495/1022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:05.562926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.563571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.567175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:05.570682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.571365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.572139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.573003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.573622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.574083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.599965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.609346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42486784-4526-42ad-8ef1-f72d83e2b343 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.190776 Sep 13 16:34:05.610262 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 528/1023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:05.650401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.658559 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27ed1466-c570-4bef-8db6-0e6c539de1d9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1269 microversion: 2.1 time: 0.099568 Sep 13 16:34:05.659139 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 496/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:05.755617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.756230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.762244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.762793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.763227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.763917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.764448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.764776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.892775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:05.900397 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0cda1b60-9c2c-40b5-8fcc-592757f2d39d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1492 microversion: 2.1 time: 0.148885 Sep 13 16:34:05.900966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 529/1025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1492 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:05.923560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:05.924189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:05.930263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.930756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.931203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:05.931905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:05.932374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:05.932813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.073816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.074670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.081605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.082163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.082621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.083350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.083827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.084266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.249611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.265547 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ee2387c-5d51-4d8d-b77e-478add1759ea tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.195599 Sep 13 16:34:06.266796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 530/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:06.278784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.279881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.287103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.287842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.288444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.289626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.289715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.290146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.357377 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-934d79f9-038e-4bb8-bc6b-37d342e23769 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1643 microversion: 2.1 time: 0.437383 Sep 13 16:34:06.362072 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 497/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:05 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1643 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:06.389565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.390212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.405372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.406030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.406640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.407624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.408173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.409160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.487249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.489554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:06.497443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.498997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.500055 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-510f3b81-035c-435b-9e54-70510d3460d1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.231125 Sep 13 16:34:06.500644 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 531/1028] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:06.543631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b9f005d-c101-47d7-aa8e-fce5e4b171f5 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1643 microversion: 2.1 time: 0.157872 Sep 13 16:34:06.544666 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 498/1029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1643 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:06.569917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.573554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.574136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.580324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.580948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.584040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.584903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.585455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.585864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.597243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.597750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.598270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.599001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.599470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.599906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.622102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d1ce323-7d1a-4fc2-996c-e1bd8d9f34fd tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055208 Sep 13 16:34:06.629817 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 532/1030] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:06.635085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.636109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.643600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.644101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.644562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.645464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.646126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.646852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.649331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.649945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.650474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.651193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lazy-loading 'fault' on Instance uuid 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:06.710771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.720164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a19c255e-a74c-41f8-b723-39ea6ee7c1e4 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 200 len: 1303 microversion: 2.1 time: 0.143452 Sep 13 16:34:06.725878 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 499/1031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:06.726523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:06.727242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.733122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.733615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.734094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.734965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.735436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.735863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.805269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-daa0aab5-d364-4907-8bd2-74366eba6fd8 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58/action" status: 202 len: 0 microversion: 2.1 time: 0.082618 Sep 13 16:34:06.806332 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 500/1032] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:34:06 2022] POST /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:34:06.811972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.812681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.818895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.819384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.819885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.820592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.821072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.821486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.879763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.890356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:06.891360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07bbe7c0-07eb-4fb9-bc18-02d290fb9de3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.259917 Sep 13 16:34:06.892033 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 533/1033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:06.898225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:06.898942 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c73d1f3-e03c-4d6c-95d5-007de58c0aa1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1275 microversion: 2.1 time: 0.091415 Sep 13 16:34:06.899808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:06.899985 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 501/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:06.907450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.908156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.908619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:06.909320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:06.909777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:06.910330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.086128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e220aa89-bdcc-4046-af0e-64e9a7570f5d req-25dd9fa6-707f-4c64-9055-b2efe6747bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6", "name": "network-vif-deleted", "tag": "b9a372e6-adb3-4274-a104-d9fad1b68fe7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:07.104288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e220aa89-bdcc-4046-af0e-64e9a7570f5d req-25dd9fa6-707f-4c64-9055-b2efe6747bf8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.106872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e220aa89-bdcc-4046-af0e-64e9a7570f5d req-25dd9fa6-707f-4c64-9055-b2efe6747bf8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.107339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e220aa89-bdcc-4046-af0e-64e9a7570f5d req-25dd9fa6-707f-4c64-9055-b2efe6747bf8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.138194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd56a3f3-9a0e-4fb4-a4e4-3dd01c3390a3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1648 microversion: 2.1 time: 0.244203 Sep 13 16:34:07.138794 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 534/1035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:06 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1648 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:07.141611 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e220aa89-bdcc-4046-af0e-64e9a7570f5d req-25dd9fa6-707f-4c64-9055-b2efe6747bf8 service nova] Creating event network-vif-deleted:b9a372e6-adb3-4274-a104-d9fad1b68fe7 for instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 on n-h2-857467-1 Sep 13 16:34:07.146610 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e220aa89-bdcc-4046-af0e-64e9a7570f5d req-25dd9fa6-707f-4c64-9055-b2efe6747bf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064426 Sep 13 16:34:07.147497 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 502/1036] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:07.294463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:07.295295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:07.302079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.302701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.303209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.304004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.304536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.305035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.458636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:07.473970 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0cb100d-ed83-41b0-a4ec-b8268e8b7773 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.184976 Sep 13 16:34:07.474873 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 535/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:07 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:07.525289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:07.526334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:07.533530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.534183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.534735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.535551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.536238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.536779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.691998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:07.702432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:07.704643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:07.706132 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69fe701d-1b08-44b9-b31e-a4b555d9c523 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.185182 Sep 13 16:34:07.714217 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 503/1038] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:07 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:07.743939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:07.745692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:07.753301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.753798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.754268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.755237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.756016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.756600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.774401 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] HTTP exception thrown: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Request method failure captured: Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 HTTP/1.1 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILC8mApAnqIbLHSZyUwr5lllNf--_UG1OI0_gBEAXHABuj3CWB7tOL6QbZnwyP8m_YU0JFSUA9vU1m2HrUXkkzQfMVr4sSGOWNDnIewv_Br3BJwVw4CyNAIuNXjPNKPHiEDY0c5giY-LWSh37BsATVMYMsjw70-PZ80Rjt6HQouQcLw Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a87575b0c830464695e168873145ba5b Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6'} Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:07.776503 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:07.781775 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:07.783697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Returning 404 to user: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:07.784580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dff396eb-dc3f-43a7-b47a-93c21418989f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 404 len: 111 microversion: 2.1 time: 0.044618 Sep 13 16:34:07.785375 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 536/1039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:07 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:07.919826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:07.920963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:07.923711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:07.924330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:07.929100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.930329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.930966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.931855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.932699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.933792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.934247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.936781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.937254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:07.938141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:07.938615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:07.939054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.176066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:08.185396 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7ff1a2d4-50f2-4dac-8d87-c5d70333fddd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.273541 Sep 13 16:34:08.186027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 504/1040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:07 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:08.198437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:08.207144 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db3ae169-451f-4ce1-bb48-3c8c5b2a105d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.287705 Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.221342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.226038 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 537/1041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:07 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:08.502941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:08.503575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:08.506778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:08.508267 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-836a1aaf-a70f-4bcf-90df-5f3b67645c25 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1628 microversion: 2.1 time: 0.307643 Sep 13 16:34:08.509630 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 505/1042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:08 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1628 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:08.532882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.533398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.534118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.535150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.535859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.536514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.539435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:08.542312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:08.554262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.557139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.557608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.563015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.563584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.564045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.650321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lazy-loading 'flavor' on Instance uuid d6afe5ca-008b-43d4-93cb-7b1cc636ee58 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:08.720154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Going to try to live migrate instance to n-h1-857467-1 {{(pid=122327) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:34:08.745955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:08.782243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:08.884945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:08.897984 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aba24b76-9381-4d9d-89c7-cd0840051af9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.401204 Sep 13 16:34:08.899352 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 538/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:08 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:08.906679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:08.907885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:08.916505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.917248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.918047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:08.919268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:08.920301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:08.921806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:09.407334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:09.420734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:09.422850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:09.424723 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e98fd3ff-06c6-4656-a11c-723b912d147a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.523812 Sep 13 16:34:09.425462 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 539/1044] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:08 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:09.430777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9cbcd5de-1bb3-42ce-97ae-0aff3bec0367 req-729263fc-03b0-49d5-ae5e-0105c356d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f185f77c-94f1-429e-9782-ce89ae81a742", "tag": "12c3a7a0-d1b0-4535-884d-bb214b9e8898"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:09.443257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9cbcd5de-1bb3-42ce-97ae-0aff3bec0367 req-729263fc-03b0-49d5-ae5e-0105c356d0c5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:09.444062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9cbcd5de-1bb3-42ce-97ae-0aff3bec0367 req-729263fc-03b0-49d5-ae5e-0105c356d0c5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:09.445232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9cbcd5de-1bb3-42ce-97ae-0aff3bec0367 req-729263fc-03b0-49d5-ae5e-0105c356d0c5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:09.460852 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9cbcd5de-1bb3-42ce-97ae-0aff3bec0367 req-729263fc-03b0-49d5-ae5e-0105c356d0c5 service nova] Creating event network-changed:12c3a7a0-d1b0-4535-884d-bb214b9e8898 for instance f185f77c-94f1-429e-9782-ce89ae81a742 on n-h2-857467-1 Sep 13 16:34:09.469276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9cbcd5de-1bb3-42ce-97ae-0aff3bec0367 req-729263fc-03b0-49d5-ae5e-0105c356d0c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042353 Sep 13 16:34:09.470067 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 540/1045] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:09.475570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:09.476606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:09.486410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:09.487078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:09.487678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:09.488704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:09.489449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:09.490596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.333475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:10.342974 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2fed8a13-aa5b-4e7f-9f6b-0b80e52c3a7e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1472 microversion: 2.1 time: 0.871476 Sep 13 16:34:10.343568 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 541/1046] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:09 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1472 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:10.348053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:10.348656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:10.354381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:10.354901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:10.355336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.357329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:10.357800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:10.358364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.620693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:10.629442 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3e83099-bcea-44d5-af7c-676428111a49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.284888 Sep 13 16:34:10.630535 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 542/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:10 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:10.634737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:10.635377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:10.642420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:10.642917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:10.643357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.644244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:10.644716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:10.645147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:10.982149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.024746 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-499664df-c4b6-4436-8b43-7e218f13b250 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.393274 Sep 13 16:34:11.025486 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 543/1048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:10 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:11.036138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:11.038191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:11.052476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.052982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.053429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.058294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.059375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.060777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.103311 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cfd4e4ae-defc-4128-85e4-6804634385e3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58/action" status: 202 len: 0 microversion: 2.1 time: 2.567733 Sep 13 16:34:11.108516 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 506/1049] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:34:08 2022] POST /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58/action => generated 0 bytes in 2574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:34:11.113744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:11.114663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:11.123474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.124434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.125265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.126241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.131676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.132387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.244929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.256627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.258662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.259840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f7b8812-32c0-45cf-be7b-8f594ffe0c21 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.233133 Sep 13 16:34:11.260627 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 544/1050] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:11 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:11.366966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:11.368307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:11.375531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.376029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.376467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.377182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.377642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.378100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.393660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.401531 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-994a9bfc-fd29-4ddc-826b-141702155526 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.291567 Sep 13 16:34:11.403022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 507/1051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:11 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:11.536621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.549580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ea7c177-768a-4ad9-a157-b01ab0ef8b48 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.182324 Sep 13 16:34:11.550249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 545/1052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:11 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:11.654704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:11.655322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:11.664460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.665355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.666173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.667429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:11.668368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:11.669375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:11.824043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:11.833030 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-17db32cf-e763-4d89-b330-75f358492a39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.183750 Sep 13 16:34:11.833979 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 508/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:11 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:12.050014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:12.057075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:12.071078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.071804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.072465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.073726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.074964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.075569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.257033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:12.266988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1321e886-50d6-4b30-805e-9b2c20f16d65 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.221258 Sep 13 16:34:12.281541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 546/1054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:12 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:12.293940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1539053872", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "047472c2-542f-441f-bbca-316689165f96"}, {"uuid": "ce60aa0c-a497-4a27-a845-67fb26ca41a1"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:12.302132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:12.308003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:12.315005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.315796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.315924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.323623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.325536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.326382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.372931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] validate_networks() for [('047472c2-542f-441f-bbca-316689165f96', None, None, None, None, None), ('ce60aa0c-a497-4a27-a845-67fb26ca41a1', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:12.490218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:12.500608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:12.502255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:12.503695 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c4badf3-5e8b-4850-9073-62cda828f6dc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.217296 Sep 13 16:34:12.504506 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 509/1055] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:12 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:12.524511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:12.529762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:12.536431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.537036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.537558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.538385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.539036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.539707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.765051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:12.784261 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d07e9ad2-d70b-4a61-b681-7b1f4421822e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.263546 Sep 13 16:34:12.784854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 510/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:12 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:12.791082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:12.791924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:12.798742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.799431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.800286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.801169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:12.801845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:12.802623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:12.988596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:13.020478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4dcff223-b843-48f7-9761-8b9ba38993c9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.234119 Sep 13 16:34:13.035420 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 511/1057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:12 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:13.063140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:13.065591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:13.085338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.085338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.085684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.089576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.091000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.091473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.271843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:13.272705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:13.273702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:13.274103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:13.274531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:13.288057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.288932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.289556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.290510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.291251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.292472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.331264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Getting quotas for project a0136fccf2da48be91b87cc0e501a571. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:13.348663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Getting quotas for user a87575b0c830464695e168873145ba5b and project a0136fccf2da48be91b87cc0e501a571. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:13.365851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:13.378286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:13.380738 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb264553-1766-4213-bec7-8199e69bfcd2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.344075 Sep 13 16:34:13.381756 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 512/1058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:13 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:13.383227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:13.387945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-86b2b70a-9f20-48b3-b770-4a52b5592ce8 req-b0292a8e-4abd-42fd-8444-bc5fb12c4658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7305af6-eeb4-43bc-ac65-52988a63a1de", "name": "network-vif-plugged", "status": "completed", "tag": "623fd98d-6910-4803-8c51-595d0e97b6c3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:13.405506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-86b2b70a-9f20-48b3-b770-4a52b5592ce8 req-b0292a8e-4abd-42fd-8444-bc5fb12c4658 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.406867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-86b2b70a-9f20-48b3-b770-4a52b5592ce8 req-b0292a8e-4abd-42fd-8444-bc5fb12c4658 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.407514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-86b2b70a-9f20-48b3-b770-4a52b5592ce8 req-b0292a8e-4abd-42fd-8444-bc5fb12c4658 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.422402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-86b2b70a-9f20-48b3-b770-4a52b5592ce8 req-b0292a8e-4abd-42fd-8444-bc5fb12c4658 service nova] Creating event network-vif-plugged:623fd98d-6910-4803-8c51-595d0e97b6c3 for instance f7305af6-eeb4-43bc-ac65-52988a63a1de on n-h1-857467-1 Sep 13 16:34:13.428884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-86b2b70a-9f20-48b3-b770-4a52b5592ce8 req-b0292a8e-4abd-42fd-8444-bc5fb12c4658 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045292 Sep 13 16:34:13.430396 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 513/1059] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:13.439612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:13.440409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:13.447843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.448161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.448610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.449935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.450619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.451164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.467794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a117277-9ed4-48cf-8c78-f15e99275809 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178087 Sep 13 16:34:13.469214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 547/1060] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:34:13.483539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c613f6e3-1b06-4c78-b091-cca87baa4a3a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:13.486819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c613f6e3-1b06-4c78-b091-cca87baa4a3a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:13.663167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c613f6e3-1b06-4c78-b091-cca87baa4a3a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:13.692985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:13.708859 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e23a84f6-7f52-4458-a0ad-0c47ef206a29 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1472 microversion: 2.1 time: 0.276270 Sep 13 16:34:13.711670 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 514/1061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:13 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:13.717525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:13.718429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:13.723702 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c613f6e3-1b06-4c78-b091-cca87baa4a3a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1213 microversion: 2.1 time: 0.246219 Sep 13 16:34:13.732928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.734759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.735225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.736260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.737293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.737932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.741239 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 548/1062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:13 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:13.821048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:13.825760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:13.847804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.854744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.856022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:13.862319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:13.863284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:13.864500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.026116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.037034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.039272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.040860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-240c8218-e221-460e-bdf2-968031cd821b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.328213 Sep 13 16:34:14.041623 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 515/1063] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:13 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:14.055722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:14.060328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:14.070852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.071361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.071807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.072577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.073157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.073599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.100030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:14.114821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.123777 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2683e538-d230-49e5-8f0e-f188b668caa3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.314565 Sep 13 16:34:14.125680 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 549/1064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:13 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:14.251062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.259392 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3db3feb6-2ca4-4b16-98c9-550d676b6ba7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.212226 Sep 13 16:34:14.259976 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 516/1065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:14 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:14.410357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:14.411179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:14.420745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.421606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.423966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.427262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.428554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.429347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.733333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:14.734116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:14.745095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=20 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:14.753008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.753664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.759385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.760840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.765009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.766122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.766984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.776907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6481eed3-088b-4775-8b22-b6fcd28f1372 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.371468 Sep 13 16:34:14.796758 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 550/1066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:14 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:14.804750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:14.809946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:14.826770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.828446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.831756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.833128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:14.833856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:14.834786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:14.946162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:14.958014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a7e880c-7bb6-4ba4-98fe-6917b8d7f470 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1265 microversion: 2.1 time: 0.159911 Sep 13 16:34:14.971700 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 551/1067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:14 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:15.024081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.037965 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d935214f-a513-4f05-b465-683f6c0c581a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1490 microversion: 2.1 time: 0.308857 Sep 13 16:34:15.038663 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 517/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:14 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1490 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:15.072513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:15.073060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:15.082651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.083159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.083607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.084334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.084806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.085244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.138221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:15.153665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:15.154695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:15.166556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.167134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.168676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.173024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.173739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.174459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.403874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.414323 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f9f0664-c7b3-47a6-8ad2-09eab22a6318 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.266680 Sep 13 16:34:15.415800 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 518/1069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:15 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:15.421891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:15.422836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:15.435232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.435646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.436112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.436814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.437555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.438060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.607357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.624562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.626992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.628479 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb5d58f5-e336-4646-a9c9-ef0e609f1e80 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1412 microversion: 2.25 time: 0.559853 Sep 13 16:34:15.629609 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 552/1070] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:15 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1412 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:15.634134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.643498 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5b47a3d-505f-42a9-8022-5e614d6d0a88 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.226223 Sep 13 16:34:15.644452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 519/1071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:15 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:15.808750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:15.809507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:15.816161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.816663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.817114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.817868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.818498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.819126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.966183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:15.973903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-654a5e45-2b5f-4791-8926-a853165ee44c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.169352 Sep 13 16:34:15.974497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 553/1072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:15 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:15.983642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:15.984258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:15.990692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.991473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.991914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:15.992605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:15.993061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:15.993489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.056738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:16.067198 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c0f4664-a90a-4484-b0d8-0a8b0c2d34ac tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1283 microversion: 2.1 time: 0.087499 Sep 13 16:34:16.067699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:16.067816 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 520/1073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:15 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:16.068320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:16.075439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.075941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.076392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.077105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.077572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.078036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.282865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:16.290878 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-74fafc4c-78f4-4f6e-aced-158934321789 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1478 microversion: 2.1 time: 0.226949 Sep 13 16:34:16.291544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 554/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:16 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1478 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:16.439645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:16.440255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:16.446220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.446702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.447139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.447828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.448287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.448714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.577191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:16.585493 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a2bb474-2a0e-41b4-9030-04101eb4fc27 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.149638 Sep 13 16:34:16.586408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 521/1075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:16 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:16.654098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:16.654718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:16.660688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.661204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.661644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.662374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.663089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.663345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.669557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:16.670417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:16.676444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.677099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.677602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.678961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:16.679423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:16.679853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:16.813931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:16.816249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:16.823087 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dd1d160e-33eb-44c6-9221-168c1ecfbcc7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.158716 Sep 13 16:34:16.823689 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 522/1076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:16 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:16.997426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:16.998312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.006386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.006847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.007269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.007973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.008427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.008856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.158441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.166583 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7ade4bd8-79ba-49ec-a4a6-4af3803bc5b7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.173715 Sep 13 16:34:17.178845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 523/1077] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:16 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:17.178845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:17.178845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.180207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.180705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.181145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.182501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.183135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.184791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.209977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.224722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.226881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.228263 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f899fe3c-b2d8-45fa-bf64-7de9639b5ecc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1608 microversion: 2.25 time: 0.578234 Sep 13 16:34:17.229348 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 555/1078] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:34:16 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1608 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:34:17.258939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:17.259454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.263449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.270326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.271067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.271297 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9168f1e0-a1d8-4ca4-8b73-9a5a8a2faaf0 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1283 microversion: 2.1 time: 0.102745 Sep 13 16:34:17.271875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.277901 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 524/1079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:17 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:17.279062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.279674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.280509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.314891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:17.315460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.321609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.322150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.322820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.323703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.324895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.325279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.409960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b0999d3-f184-4726-b98c-2230580045f8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.157251 Sep 13 16:34:17.411119 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 556/1080] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 16:34:17 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:34:17.415920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6823646b-0a29-4797-8ecf-7410aa2d435f req-59a42789-bac8-4062-89fa-dc1204636ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6afe5ca-008b-43d4-93cb-7b1cc636ee58", "name": "network-vif-unplugged", "status": "completed", "tag": "ab3df1fb-0ed3-41a4-9e86-3bef784c98f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:17.430636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6823646b-0a29-4797-8ecf-7410aa2d435f req-59a42789-bac8-4062-89fa-dc1204636ded service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.432819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6823646b-0a29-4797-8ecf-7410aa2d435f req-59a42789-bac8-4062-89fa-dc1204636ded service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.433776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6823646b-0a29-4797-8ecf-7410aa2d435f req-59a42789-bac8-4062-89fa-dc1204636ded service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.450190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6823646b-0a29-4797-8ecf-7410aa2d435f req-59a42789-bac8-4062-89fa-dc1204636ded service nova] Creating event network-vif-unplugged:ab3df1fb-0ed3-41a4-9e86-3bef784c98f7 for instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 on n-h2-857467-1 Sep 13 16:34:17.456960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6823646b-0a29-4797-8ecf-7410aa2d435f req-59a42789-bac8-4062-89fa-dc1204636ded service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044561 Sep 13 16:34:17.458360 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 557/1081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:17.477213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d0f9f18a-121c-4276-8f98-8d814fdaf819 req-f075d6a9-7c9b-4eab-9566-fc9fb9a629b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f185f77c-94f1-429e-9782-ce89ae81a742", "name": "network-vif-plugged", "status": "completed", "tag": "12c3a7a0-d1b0-4535-884d-bb214b9e8898"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:17.499344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0f9f18a-121c-4276-8f98-8d814fdaf819 req-f075d6a9-7c9b-4eab-9566-fc9fb9a629b8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.499851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0f9f18a-121c-4276-8f98-8d814fdaf819 req-f075d6a9-7c9b-4eab-9566-fc9fb9a629b8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.500334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0f9f18a-121c-4276-8f98-8d814fdaf819 req-f075d6a9-7c9b-4eab-9566-fc9fb9a629b8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.515334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d0f9f18a-121c-4276-8f98-8d814fdaf819 req-f075d6a9-7c9b-4eab-9566-fc9fb9a629b8 service nova] Creating event network-vif-plugged:12c3a7a0-d1b0-4535-884d-bb214b9e8898 for instance f185f77c-94f1-429e-9782-ce89ae81a742 on n-h2-857467-1 Sep 13 16:34:17.522011 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d0f9f18a-121c-4276-8f98-8d814fdaf819 req-f075d6a9-7c9b-4eab-9566-fc9fb9a629b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050414 Sep 13 16:34:17.523287 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 558/1082] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:17.563004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.571675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1bed894e-32fe-419b-aca5-fd83c0b26abd tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1478 microversion: 2.1 time: 0.261074 Sep 13 16:34:17.572255 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 525/1083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:17 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1478 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:17.609577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:17.610360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.616644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.617138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.617674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.618445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.618966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.619443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.814529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:17.822796 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-535742df-db75-4395-8c7d-9744056d8c39 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.217670 Sep 13 16:34:17.823415 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 559/1084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:17 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:17.846115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:17.846737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:17.852766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.853254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.853749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:17.854476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:17.854936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:17.855369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.189027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:18.189846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:18.196161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.196646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.197076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.197765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.198246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.198666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.212633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:18.222177 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aaebfbf8-e8b4-4058-b115-6e92224cfabd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.379884 Sep 13 16:34:18.222780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 526/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:17 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:18.296576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:18.297360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:18.303676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.304177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.304619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.305335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.305799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.306252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.340775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:18.349188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d5872af3-4ccc-4675-a448-0e9e2930fe96 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.163892 Sep 13 16:34:18.357629 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 560/1086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:18 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:18.597245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:18.597997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:18.606659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.607259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.607789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.608598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.609866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.609866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.616372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:18.630206 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8779adc0-0314-4cc5-8eb8-be2098ffd7e5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1283 microversion: 2.1 time: 0.337848 Sep 13 16:34:18.631369 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 527/1087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:18 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1283 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:18.847257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:18.847917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:18.856376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.857133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.857775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.858583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:18.859216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:18.860030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:18.867690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:18.881044 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45113914-b5fd-4662-869f-4e561d40d87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1478 microversion: 2.1 time: 0.287939 Sep 13 16:34:18.882472 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 561/1088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:18 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1478 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:19.115101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:19.153540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e16bc329-2a9c-439f-b546-dc57cb73c2cf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.308218 Sep 13 16:34:19.156350 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 528/1089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:18 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:19.233243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-89491561-8e84-41e0-b571-caf55112d22f req-3c1ddb54-4f6d-49ef-9634-ceb46acf65f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7305af6-eeb4-43bc-ac65-52988a63a1de", "tag": "623fd98d-6910-4803-8c51-595d0e97b6c3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:19.249368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:19.250357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:19.251680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89491561-8e84-41e0-b571-caf55112d22f req-3c1ddb54-4f6d-49ef-9634-ceb46acf65f1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.252178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89491561-8e84-41e0-b571-caf55112d22f req-3c1ddb54-4f6d-49ef-9634-ceb46acf65f1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.252613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89491561-8e84-41e0-b571-caf55112d22f req-3c1ddb54-4f6d-49ef-9634-ceb46acf65f1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.259105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.260180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.260832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.263008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.263735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.265573 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-89491561-8e84-41e0-b571-caf55112d22f req-3c1ddb54-4f6d-49ef-9634-ceb46acf65f1 service nova] Creating event network-changed:623fd98d-6910-4803-8c51-595d0e97b6c3 for instance f7305af6-eeb4-43bc-ac65-52988a63a1de on n-h1-857467-1 Sep 13 16:34:19.266622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.270847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-89491561-8e84-41e0-b571-caf55112d22f req-3c1ddb54-4f6d-49ef-9634-ceb46acf65f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042431 Sep 13 16:34:19.276124 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 562/1090] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:19.373598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:19.374625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:19.384153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.390599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.397573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.398963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.399608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.400394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.469435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:19.480143 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99b36cc7-b63b-4fa1-bfad-eccdd15e1a65 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.237725 Sep 13 16:34:19.482144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 529/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:19 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:19.520204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b9dd4157-faeb-4dfe-82ea-e81304d6f870 req-eb3856e4-bc41-44bb-b1eb-9512a5cc61f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6afe5ca-008b-43d4-93cb-7b1cc636ee58", "tag": "ab3df1fb-0ed3-41a4-9e86-3bef784c98f7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:19.530442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b9dd4157-faeb-4dfe-82ea-e81304d6f870 req-eb3856e4-bc41-44bb-b1eb-9512a5cc61f5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.530841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b9dd4157-faeb-4dfe-82ea-e81304d6f870 req-eb3856e4-bc41-44bb-b1eb-9512a5cc61f5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.531289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b9dd4157-faeb-4dfe-82ea-e81304d6f870 req-eb3856e4-bc41-44bb-b1eb-9512a5cc61f5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.543622 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b9dd4157-faeb-4dfe-82ea-e81304d6f870 req-eb3856e4-bc41-44bb-b1eb-9512a5cc61f5 service nova] Creating event network-changed:ab3df1fb-0ed3-41a4-9e86-3bef784c98f7 for instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 on n-h2-857467-1 Sep 13 16:34:19.549048 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b9dd4157-faeb-4dfe-82ea-e81304d6f870 req-eb3856e4-bc41-44bb-b1eb-9512a5cc61f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032425 Sep 13 16:34:19.549815 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 530/1092] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:19.657778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:19.658665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:19.665639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.666283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.666795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.669138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.670034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.670630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.786465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:19.797446 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f1b64d4-b496-460a-be76-163610a26c3d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.428496 Sep 13 16:34:19.798667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 563/1093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:19 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:19.804483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-49d2ecdd-a004-4866-b543-dcb41435499c req-a86f86f9-b095-4d0e-ba7f-e7de61592e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "name": "network-vif-unplugged", "status": "completed", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:19.816218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49d2ecdd-a004-4866-b543-dcb41435499c req-a86f86f9-b095-4d0e-ba7f-e7de61592e3f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.817123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49d2ecdd-a004-4866-b543-dcb41435499c req-a86f86f9-b095-4d0e-ba7f-e7de61592e3f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.817552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49d2ecdd-a004-4866-b543-dcb41435499c req-a86f86f9-b095-4d0e-ba7f-e7de61592e3f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.829432 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-49d2ecdd-a004-4866-b543-dcb41435499c req-a86f86f9-b095-4d0e-ba7f-e7de61592e3f service nova] Creating event network-vif-unplugged:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:34:19.834752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-49d2ecdd-a004-4866-b543-dcb41435499c req-a86f86f9-b095-4d0e-ba7f-e7de61592e3f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034729 Sep 13 16:34:19.836546 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 564/1094] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:19.880336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:19.889303 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3af221af-bf18-4dfb-9260-3c38bab5cd1a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1313 microversion: 2.1 time: 0.238015 Sep 13 16:34:19.890317 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 531/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:19 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:19.910197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:19.910903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:19.917306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.917528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.918108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:19.918913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:19.919559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:19.919989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.180110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:20.180630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:20.188463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.189191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.189846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.191056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.191679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.192105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.280602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:20.290882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5d1458e-aa48-4298-bc3a-15cb5f38ec7a tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1478 microversion: 2.1 time: 0.388773 Sep 13 16:34:20.292101 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 565/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:19 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1478 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:20.348706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:20.358822 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6a834f0-18f7-4760-867d-7150b04a5565 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.182501 Sep 13 16:34:20.359412 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 532/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:20 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:20.504005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:20.504622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:20.514442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.517553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.518036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.518769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.519229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.519655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.665429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:20.677041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-236657e1-78aa-40c0-8dae-6441340eca5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.177576 Sep 13 16:34:20.677618 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 566/1098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:20 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:20.822736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:20.823356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:20.829800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.830312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.830748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.831441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.831895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.832321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.914166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:20.914963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:20.921748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.922345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.922875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.923643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:20.924170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:20.924661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:20.963897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:20.972255 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-453825fa-3690-4ff6-a8ef-273a33a43e38 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1317 microversion: 2.1 time: 0.153309 Sep 13 16:34:20.972926 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 533/1099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:20 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:21.075857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:21.083780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a475282c-b26a-4e16-91ff-e2ff7aa12004 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.173896 Sep 13 16:34:21.084359 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 567/1100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:20 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:21.315525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:21.316139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:21.322681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.323167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.323601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.324805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.325258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.325686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.383549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:21.384171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:21.391338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.391832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.392349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.393063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.393528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.394012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.471534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:21.479823 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60606ee2-6cb4-41c4-b808-1ecd017d7202 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1478 microversion: 2.1 time: 0.168023 Sep 13 16:34:21.481267 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 534/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:21 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1478 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:21.536720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:21.544419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de9dff31-70fc-4b38-8905-93bfa17dfdee tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.165134 Sep 13 16:34:21.544996 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 568/1102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:21 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:21.700094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:21.700702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:21.706644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.707126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.707560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.708246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:21.708701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:21.709127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:21.838259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:21.846887 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea6d7955-f3a2-4e19-8db9-56eff7bf7326 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.151216 Sep 13 16:34:21.847473 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 535/1103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:21 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:21.996065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:21.996877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.002948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.003655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.004086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.005418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.005895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.006327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.108093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:22.108716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.114801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.115276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.115718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.116426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.117285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.117285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.220349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:22.228556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f37f90f-66ce-451a-95f3-282aaf9c93cc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1467 microversion: 2.1 time: 0.236670 Sep 13 16:34:22.229321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 569/1104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:21 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1467 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:22.251427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:22.252035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.258185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:22.259200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.259694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.260128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.260840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.261865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.262441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.267659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1bbf9e29-38c4-4d63-9ef5-f3e7d7b28ed5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.163617 Sep 13 16:34:22.268763 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 536/1105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:22 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:22.497659 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcc1d828-5d6a-4109-9f19-18561948c118 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1618 microversion: 2.1 time: 0.248470 Sep 13 16:34:22.503665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:22.504513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.510120 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 570/1106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:22 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1618 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:22.511723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.512450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.512956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.514109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.514836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.515336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.567998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:22.568620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.575535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.576040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.576483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.577197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.577660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.578176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.704278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:22.712515 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78626380-c03d-4749-aec3-39b2bf6468e8 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1478 microversion: 2.1 time: 0.212781 Sep 13 16:34:22.713456 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 537/1107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:22 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1478 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:22.718897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1795569468", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ea94c7be-d3dc-477b-8d97-6968a0f8e79b"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:22.774734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:22.814622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:22.816911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:22.824770 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa0e3f6e-3a90-4625-b648-3276e3ecd6f9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.259742 Sep 13 16:34:22.825678 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 571/1108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:22 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:22.830552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-79e1d737-c1a2-4e1b-8ebd-5b179293658d req-b2e9db46-9f8e-450b-9a55-e5069adae5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c87a1a3-b6f0-4156-9094-15e0d132f9fc", "tag": "7e8fc2f7-9130-471c-b592-000b7483b65e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:22.840981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79e1d737-c1a2-4e1b-8ebd-5b179293658d req-b2e9db46-9f8e-450b-9a55-e5069adae5e3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.841471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79e1d737-c1a2-4e1b-8ebd-5b179293658d req-b2e9db46-9f8e-450b-9a55-e5069adae5e3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.841934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79e1d737-c1a2-4e1b-8ebd-5b179293658d req-b2e9db46-9f8e-450b-9a55-e5069adae5e3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.852694 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-79e1d737-c1a2-4e1b-8ebd-5b179293658d req-b2e9db46-9f8e-450b-9a55-e5069adae5e3 service nova] Creating event network-changed:7e8fc2f7-9130-471c-b592-000b7483b65e for instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc on n-h2-857467-1 Sep 13 16:34:22.858169 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-79e1d737-c1a2-4e1b-8ebd-5b179293658d req-b2e9db46-9f8e-450b-9a55-e5069adae5e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031172 Sep 13 16:34:22.858920 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 572/1109] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:22.870261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:22.871204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:22.879088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.879579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.880638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.881444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:22.882009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:22.882482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:22.999983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:23.000402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:23.000874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:23.001277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:23.001686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:23.011031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.012057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.012584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.013417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.014207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.014776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.023269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:23.031813 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d5a87e6b-8fd2-4cc3-8b30-ebf1cf684dcb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.165593 Sep 13 16:34:23.032409 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 573/1110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:22 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:23.033843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:23.039456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Getting quotas for user 63e5f78d68c64970ab2a816eda0f95fa and project ade763eb224a494f86d28a38ca26c17a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:23.052166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:23.054683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:23.066970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:23.102096 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bde4912-8380-474d-81d4-03214a7a97a7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.387511 Sep 13 16:34:23.109441 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 538/1111] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:34:23.114755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db64d8ae-0f52-4b1e-abd0-5425018a85f0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:23.115854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db64d8ae-0f52-4b1e-abd0-5425018a85f0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:23.226509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db64d8ae-0f52-4b1e-abd0-5425018a85f0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:23.233726 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db64d8ae-0f52-4b1e-abd0-5425018a85f0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1217 microversion: 2.1 time: 0.122937 Sep 13 16:34:23.234353 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 574/1112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:23 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:23.294158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:23.295451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:23.304203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.304921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.305609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.306873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.307540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.309998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.704994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:23.716896 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a9152a2-5535-4ca8-9ef3-d9dbedfae993 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.425941 Sep 13 16:34:23.717521 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 539/1113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:23 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:23.742979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:23.743940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:23.747507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:23.768046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.768827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.769505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.770480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.771159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.771786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.849376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:23.850409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:23.857607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.858492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.859223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:23.860196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:23.861008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:23.861691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.042279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:24.044927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:24.045938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:24.061253 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-430c5ee4-4ac5-4205-ab13-f85ad457f7a6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.215076 Sep 13 16:34:24.061253 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 540/1114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:23 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:24.062034 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-420a9a85-d169-4b95-9d88-8b80b1a50ebe tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1463 microversion: 2.1 time: 0.323814 Sep 13 16:34:24.062892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 575/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:23 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1463 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:24.090892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:24.092204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:24.096003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:24.098349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.098993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:24.099133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.099550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.100509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.100987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.101398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.107924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.108828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.109693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.110781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.111455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.112093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.217517 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cda44ef6-001a-4946-bed0-7e85c68cfbf9 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 0 microversion: 2.1 time: 0.127402 Sep 13 16:34:24.222271 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 576/1116] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:34:24 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:34:24.239673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:24.240823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:24.248125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.248689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.249173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.251271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.251271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.251271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.299923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:24.313296 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a11b580-d23b-4054-ac20-2fe6bb2c7691 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.251343 Sep 13 16:34:24.314563 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 541/1117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:24 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:24.319425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.319852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:24.319991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.320342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.320793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lazy-loading 'fault' on Instance uuid 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:24.321332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:24.329861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.331301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.331816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.332659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.333322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.333757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.405676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:24.416210 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a4d92844-571a-40ae-b40a-021c688b7eae tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1269 microversion: 2.1 time: 0.100100 Sep 13 16:34:24.421948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 542/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:24 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:24.740077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:24.740786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:24.747873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.748332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.748771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.749482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.749970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.750398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.867939 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7076c38a-9d30-44e8-9619-b608ad336997 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1597 microversion: 2.1 time: 0.633569 Sep 13 16:34:24.868779 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 577/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:24 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1597 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:24.893057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:24.895780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:24.898459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:24.906050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.906998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.907592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.908474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.909266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.909902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:24.943232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:24.953596 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bcf37cfc-fcc2-4ffa-8a7d-29194c36f42f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.217279 Sep 13 16:34:24.954613 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 543/1120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:24 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:24.977619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-45eafbb9-cc51-49a9-afe9-e900fd8515f4 req-e9d4cfaa-a7ec-4ad8-a2ea-3a6cabba8dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c87a1a3-b6f0-4156-9094-15e0d132f9fc", "tag": "1aca45e0-ff26-4c64-a5af-e7d049b8acc9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:24.991225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-45eafbb9-cc51-49a9-afe9-e900fd8515f4 req-e9d4cfaa-a7ec-4ad8-a2ea-3a6cabba8dbf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:24.991731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-45eafbb9-cc51-49a9-afe9-e900fd8515f4 req-e9d4cfaa-a7ec-4ad8-a2ea-3a6cabba8dbf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:24.992242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-45eafbb9-cc51-49a9-afe9-e900fd8515f4 req-e9d4cfaa-a7ec-4ad8-a2ea-3a6cabba8dbf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.009868 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6bc976a0-90dc-4c27-8b28-b72182c54dcb tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action" status: 202 len: 0 microversion: 2.1 time: 0.121313 Sep 13 16:34:25.010712 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 578/1121] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:34:24 2022] POST /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:34:25.015702 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-45eafbb9-cc51-49a9-afe9-e900fd8515f4 req-e9d4cfaa-a7ec-4ad8-a2ea-3a6cabba8dbf service nova] Creating event network-changed:1aca45e0-ff26-4c64-a5af-e7d049b8acc9 for instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc on n-h2-857467-1 Sep 13 16:34:25.021554 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-45eafbb9-cc51-49a9-afe9-e900fd8515f4 req-e9d4cfaa-a7ec-4ad8-a2ea-3a6cabba8dbf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051559 Sep 13 16:34:25.022559 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 544/1122] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:25.027440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.028267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.035261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.036001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.036481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.037254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.037721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.038189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.097181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.097947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.112136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.112633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.113071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.114140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.114604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.115219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.397287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4f159ba-453b-412f-97b2-803913e946f8 tempest-ServersAdminTestJSON-1887008041 tempest-ServersAdminTestJSON-1887008041-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1614 microversion: 2.1 time: 0.381121 Sep 13 16:34:25.398935 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 579/1123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1614 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:25.416252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.420958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.424884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:25.439720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.440706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-819ab651-91e8-4f9e-a571-5329bc060e9c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.346703 Sep 13 16:34:25.453912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.454142 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 545/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:25.454231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.454231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.454231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.454231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.456303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.457572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.473800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.474332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.478103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.481757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.482320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.484005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.526352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:25.670102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc008459-d839-4d86-aa6e-0e7250c6474f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 204 len: 0 microversion: 2.1 time: 0.226374 Sep 13 16:34:25.672525 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 546/1125] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:25 2022] DELETE /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:34:25.678176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.678893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.685992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.686482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.687012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.687783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.688104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.689520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.728536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:25.737454 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8abf05f6-68da-4206-9661-64e936ab5d1e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.337166 Sep 13 16:34:25.738306 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 580/1126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:25.743259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d149c3cd-4b31-4e37-aa48-39d76d35b9ef req-30170c01-1aaf-4da0-a173-cb1e8e8fb9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "name": "network-vif-plugged", "status": "completed", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:25.758732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d149c3cd-4b31-4e37-aa48-39d76d35b9ef req-30170c01-1aaf-4da0-a173-cb1e8e8fb9f0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.759290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d149c3cd-4b31-4e37-aa48-39d76d35b9ef req-30170c01-1aaf-4da0-a173-cb1e8e8fb9f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.759844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d149c3cd-4b31-4e37-aa48-39d76d35b9ef req-30170c01-1aaf-4da0-a173-cb1e8e8fb9f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.771780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d149c3cd-4b31-4e37-aa48-39d76d35b9ef req-30170c01-1aaf-4da0-a173-cb1e8e8fb9f0 service nova] Creating event network-vif-plugged:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:34:25.777158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d149c3cd-4b31-4e37-aa48-39d76d35b9ef req-30170c01-1aaf-4da0-a173-cb1e8e8fb9f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037530 Sep 13 16:34:25.777786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 581/1127] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:25.783015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.783986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.790081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:25.790600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.790942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.791381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.792071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.793343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.794128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.805437 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f04b6c15-d96f-4cda-8807-e0a100a01aaf tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1275 microversion: 2.1 time: 0.131070 Sep 13 16:34:25.806626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 547/1128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:25.984855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:25.985646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:25.992858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.993437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.994346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:25.995370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:25.996306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:25.996976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.039924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:26.047741 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4ce6962-1a28-4cad-9678-e848a5cd7e28 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1469 microversion: 2.1 time: 0.268646 Sep 13 16:34:26.048413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 582/1129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:26.225818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:26.236710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe58e73c-6b36-49d9-aa44-8256937bd626 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.257782 Sep 13 16:34:26.237865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 548/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:25 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:26.475307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:26.476566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:26.483579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.484433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.485086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.486040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.486812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.487621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.632393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:26.642091 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7f95fb79-9638-457b-836f-86461e72a315 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.175446 Sep 13 16:34:26.643179 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 583/1131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:26 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:26.762379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:26.762998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:26.769457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.769990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.770442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.771150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.771615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.772045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.832933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:26.833699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:26.841118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.841369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.841808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.842557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:26.843022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:26.843455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:26.929237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:26.939390 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb4bcd68-1f81-44d2-b2a3-fd5074455dd9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.181354 Sep 13 16:34:26.940540 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 549/1132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:26 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:27.022990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:27.034381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96ae3155-f6f4-4fb3-9aa6-dd5c6e3396ee tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.205248 Sep 13 16:34:27.035602 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 584/1133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:26 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:27.072925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:27.075502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:27.081718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.082490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.083158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.084174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.084783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.085368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.265596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:27.269075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:27.270074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:27.273578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fab52d30-02e9-4128-8917-35d699e983b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1469 microversion: 2.1 time: 0.204872 Sep 13 16:34:27.274195 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 550/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:27 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:27.276382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.277545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.278054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.278757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.279216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.279644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.424315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:27.432363 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4ebadad-3359-4bfb-9423-3f5922d3a76c tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.174157 Sep 13 16:34:27.432992 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 585/1135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:27 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:27.671779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:27.673049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:27.682368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.684801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.685361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.686243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.686826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.687368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.967393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:27.968773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:27.977655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.978523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.979186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:27.980178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:27.982125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:27.982675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.131224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:28.140766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50156fa5-3411-4021-bdf6-c150839a3727 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.478181 Sep 13 16:34:28.148144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 551/1136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:27 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:28.157496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:28.158148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:28.164756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.165436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.166068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.166936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.168239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.168951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.323059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:28.334452 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c108233-3d18-434d-ab29-89f9db30aeac tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.184501 Sep 13 16:34:28.335555 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 552/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:28 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:28.341032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:28.341631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:28.358244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.358767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.360350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.361101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.362218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.363010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.440164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:28.449649 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-062fdcf2-2153-49a2-bcd3-6be175002662 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1477 microversion: 2.1 time: 0.488810 Sep 13 16:34:28.458265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 586/1138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:27 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1477 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:28.463303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:28.466362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:28.473040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.473547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.474075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.474733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:28.475196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:28.475627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:28.491302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:28.516838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:28.525868 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90d24adb-d635-41c1-9561-0be91971ac87 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1469 microversion: 2.1 time: 0.188887 Sep 13 16:34:28.526417 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 553/1139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:28 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:28.876203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:28.884539 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d72ff7ed-c196-43eb-a53f-8cd7ba6920ec tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.425116 Sep 13 16:34:28.901533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 587/1140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:28 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:29.163991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:29.164614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:29.174389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b640583d-a128-44b9-bd3e-afeb3f5dc426 req-bfef1163-3f2b-4e34-a5fc-cfd31e146205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd125db0-334a-4f83-a30f-878f41c4e688", "name": "network-vif-deleted", "tag": "5ee2ceed-907c-4d70-993e-f0ac285a032f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:29.182355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.183219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.183925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.184944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.185593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.186226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.195234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b640583d-a128-44b9-bd3e-afeb3f5dc426 req-bfef1163-3f2b-4e34-a5fc-cfd31e146205 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.195726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b640583d-a128-44b9-bd3e-afeb3f5dc426 req-bfef1163-3f2b-4e34-a5fc-cfd31e146205 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.196166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b640583d-a128-44b9-bd3e-afeb3f5dc426 req-bfef1163-3f2b-4e34-a5fc-cfd31e146205 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.221217 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b640583d-a128-44b9-bd3e-afeb3f5dc426 req-bfef1163-3f2b-4e34-a5fc-cfd31e146205 service nova] Creating event network-vif-deleted:5ee2ceed-907c-4d70-993e-f0ac285a032f for instance fd125db0-334a-4f83-a30f-878f41c4e688 on n-h2-857467-1 Sep 13 16:34:29.226637 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b640583d-a128-44b9-bd3e-afeb3f5dc426 req-bfef1163-3f2b-4e34-a5fc-cfd31e146205 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055779 Sep 13 16:34:29.227758 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 588/1141] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:29.359571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:29.360071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:29.361097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:29.368791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.369297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.369737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.371621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.372320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.373083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.375911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e3af38f-2ba7-43c9-822c-e1c44a5b6f87 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1502 microversion: 2.1 time: 0.215382 Sep 13 16:34:29.376758 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 554/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:29 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:29.473457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:29.474047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:29.481387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.482212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.482840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.483557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.484169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.484861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.670217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:29.685454 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4fa38415-fcd8-4e24-85eb-c68c5ca1b732 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1476 microversion: 2.1 time: 0.215229 Sep 13 16:34:29.687538 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 555/1143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:29 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:29.694225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:29.697663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:29.708405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.709162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.709864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.711230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.711914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.712354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.731937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:29.795177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:29.803222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e4dd278a-bf3b-45ed-82ee-d180c336f0a1 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1427 microversion: 2.1 time: 0.114130 Sep 13 16:34:29.803817 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 556/1144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:29 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:29.909301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:29.910066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:29.916328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.916711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.917164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.918475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:29.918938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:29.919372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:29.946491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:29.954467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6327c530-6b22-4ffd-a879-1dc96f0abb91 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.599846 Sep 13 16:34:29.969851 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 589/1145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:29 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:30.057065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:30.065603 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e74c47e-5d1e-4c08-9754-273d2da4ebea tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.160149 Sep 13 16:34:30.066655 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 557/1146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:29 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:30.400730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.401348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:30.408862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.409357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.409804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.410530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.410996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.411428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.538745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:30.546515 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc60247b-8e80-4816-8e3a-81cb913ab639 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1477 microversion: 2.1 time: 0.149727 Sep 13 16:34:30.547088 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 590/1147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:30.568439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a733bd0f-d5e9-4ac7-bc2b-675ea35e3f74 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '.version_select at 0x7fbeb56fb160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.571931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a733bd0f-d5e9-4ac7-bc2b-675ea35e3f74 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.572426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a733bd0f-d5e9-4ac7-bc2b-675ea35e3f74 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.572903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a733bd0f-d5e9-4ac7-bc2b-675ea35e3f74 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.584097 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a733bd0f-d5e9-4ac7-bc2b-675ea35e3f74 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2341 microversion: 2.1 time: 0.019255 Sep 13 16:34:30.584676 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 558/1148] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/os-migrations => generated 2341 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:30.599526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.600179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:30.608099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.608594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.609032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.609732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.610242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.610672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.709983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.710611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:30.716927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.717418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.717895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.718601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.719065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.719534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.736140 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76c730bf-4b5f-40d0-823c-8c9d90a51ae1 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1628 microversion: 2.1 time: 0.140222 Sep 13 16:34:30.737013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 591/1149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1628 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:30.767633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b528bda-1549-4e3d-aebc-54a6a27328f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Action: 'create', calling method: .version_select at 0x7fbeb5231430>, body: {"keypair": {"name": "tempest-keypair-1145535241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZdjupz9iHEiMADffXH1muoKyevV7MkMPx19r4/y7uWycllYbezKGkCSlVokGqFF4u2/0orvjm7gtEhBnPxaJ/yeztPab1l643k+NbjFjzwrVEH/laJNqaFXJgnmvBeTg=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:30.783472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5b528bda-1549-4e3d-aebc-54a6a27328f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for project aadc29bce0b24edc80de72d3e6337c10. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:30.788619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5b528bda-1549-4e3d-aebc-54a6a27328f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for user 1fdc6602945c46fa98eebf50ea85a86e and project aadc29bce0b24edc80de72d3e6337c10. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:30.813333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b528bda-1549-4e3d-aebc-54a6a27328f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049586 Sep 13 16:34:30.813966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 592/1150] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:34:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:30.827867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.828480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:30.834767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.835241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.835868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.836572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.837032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.837749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.865987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:30.875350 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37f7bce7-4c66-4306-b8f5-29d2fbdc6485 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1476 microversion: 2.1 time: 0.169213 Sep 13 16:34:30.875937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 559/1151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:30.925271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:30.933574 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00b4f052-3ecc-44fc-bacf-0f51036b5e6e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1427 microversion: 2.1 time: 0.110586 Sep 13 16:34:30.934892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 593/1152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:30.978682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:30.980356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:30.986502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.987087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.987700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:30.988474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:30.988902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:30.989359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.089225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:31.090133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:31.097250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.098008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.098627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.099518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.100071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.100570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.130244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:31.144087 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79fc2d67-3402-45fd-8e9b-02d7bde1993d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.169490 Sep 13 16:34:31.144673 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 560/1153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:30 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:31.269242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f69ce542-7245-4fad-8fc4-42568ae8fb98 req-1f93e057-6bbd-4cf8-813c-20eb037c67bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20af6189-c7b9-4c72-9d88-77e615de61fb", "tag": "c67c3918-3bd7-459d-823f-d131a1082f50"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:31.277508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:31.293000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f69ce542-7245-4fad-8fc4-42568ae8fb98 req-1f93e057-6bbd-4cf8-813c-20eb037c67bd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.293602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f69ce542-7245-4fad-8fc4-42568ae8fb98 req-1f93e057-6bbd-4cf8-813c-20eb037c67bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.294142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f69ce542-7245-4fad-8fc4-42568ae8fb98 req-1f93e057-6bbd-4cf8-813c-20eb037c67bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.294330 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3e5df54-e85e-463f-8bdd-cea444345179 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.205188 Sep 13 16:34:31.295076 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 594/1154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:31 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:31.308712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f69ce542-7245-4fad-8fc4-42568ae8fb98 req-1f93e057-6bbd-4cf8-813c-20eb037c67bd service nova] Creating event network-changed:c67c3918-3bd7-459d-823f-d131a1082f50 for instance 20af6189-c7b9-4c72-9d88-77e615de61fb on n-h1-857467-1 Sep 13 16:34:31.314806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f69ce542-7245-4fad-8fc4-42568ae8fb98 req-1f93e057-6bbd-4cf8-813c-20eb037c67bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050971 Sep 13 16:34:31.315946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 561/1155] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:31.905449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:31.906270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:31.918077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.922181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.924239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.925215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.929341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.930047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.960344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:31.961312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:31.969446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.970072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.970801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:31.971815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:31.972481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:31.973111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.009336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.010076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.010740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.011939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lazy-loading 'fault' on Instance uuid fd125db0-334a-4f83-a30f-878f41c4e688 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:32.112790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:32.123434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43b1bf9e-e754-429f-83b2-a50db9b9ca06 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1476 microversion: 2.1 time: 0.224255 Sep 13 16:34:32.124062 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 595/1156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:31 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:32.132727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:32.167801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:32.168713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:32.175026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.175769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.176387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.177278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.177857 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ebb09887-4f29-485a-bdd2-254002d8eb93 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1303 microversion: 2.1 time: 0.221084 Sep 13 16:34:32.178112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.178700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.180647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 562/1157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:31 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:32.318974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:32.319889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:32.326365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.327102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.327709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.328579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.329188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.329776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.408236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:32.418147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9484606d-25aa-40dd-9dcc-7158d5c5e596 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.254127 Sep 13 16:34:32.433988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 596/1158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:32 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:32.673396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abc1103-ca94-4e9c-84e1-64c65215f6e7", "name": "network-vif-unplugged", "status": "completed", "tag": "aa019033-acdd-499a-b7ba-87e4de3dc483"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:32.690090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:32.691532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:32.692523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:32.710384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:32.720484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-247526df-ac6d-475b-94e0-6bbed0d5a36d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.405245 Sep 13 16:34:32.734133 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 563/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:32 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:32.758738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] Creating event network-vif-unplugged:aa019033-acdd-499a-b7ba-87e4de3dc483 for instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 on n-h2-857467-1 Sep 13 16:34:32.776254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:34:32.798441 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-5b45f4bc-e9cb-4adb-809a-07e29d0ec345 req-7ae639a1-d476-4e97-956c-5aa750f7e5e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133608 Sep 13 16:34:32.799253 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 597/1160] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:32.835761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2100883407", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "8a9524ad-1d46-4f6a-be0d-1f61259b0753"}], "security_groups": [{"name": "tempest-securitygroup--86134598"}], "key_name": "tempest-keypair-1145535241", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:33.008410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] validate_networks() for [('8a9524ad-1d46-4f6a-be0d-1f61259b0753', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:33.024290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:33.046545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:33.149467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:33.150210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:33.156651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.157241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.157965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.158739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.159269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.159767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.350034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:33.358768 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0073904-44bb-4514-aded-3c71ad56acb2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1476 microversion: 2.1 time: 0.214538 Sep 13 16:34:33.359393 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 598/1161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:33 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:33.363983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:33.364792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:33.376458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.376995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.377434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.378191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.378653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.379086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.410939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.411335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.411774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.412213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lazy-loading 'fault' on Instance uuid fd125db0-334a-4f83-a30f-878f41c4e688 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:33.456612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:33.465028 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85435a22-2b9b-4f71-9113-410526546e0f tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 200 len: 1303 microversion: 2.1 time: 0.104542 Sep 13 16:34:33.465629 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 599/1162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:33 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:33.473440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:33.474105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:33.481311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.481854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.482414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.483215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.483686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.484119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.600611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:33.601098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:33.601628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:33.603095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:33.603517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:33.613810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.614530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.614970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.615799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.616267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.616696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.630643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:33.636840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:33.642593 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5aacb156-77af-482b-9037-bbc590d0c53b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.175776 Sep 13 16:34:33.642746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for user 1fdc6602945c46fa98eebf50ea85a86e and project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:33.644216 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 600/1163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:33 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:33.656587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:33.659110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:33.708710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad062074-3936-46d7-94b6-a194f2898d44 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.876589 Sep 13 16:34:33.710115 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 564/1164] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:34:33.723193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-245778e6-491c-4cde-afcc-dc5b76f737d8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:33.724256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-245778e6-491c-4cde-afcc-dc5b76f737d8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:33.747103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:33.758349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:33.770429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.771905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.772582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.774493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:33.775915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:33.778583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:33.810745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-245778e6-491c-4cde-afcc-dc5b76f737d8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:33.831481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-245778e6-491c-4cde-afcc-dc5b76f737d8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1235 microversion: 2.1 time: 0.113267 Sep 13 16:34:33.835246 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 601/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:33 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1235 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:34.060922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:34.072610 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6f833fa-a5fd-4211-8f73-db60d5c8eef5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.329692 Sep 13 16:34:34.075093 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 565/1166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:33 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:34.383324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.384697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.392122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.392601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.393186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.393838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.394301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.394744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.488485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.489103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: fd125db0-334a-4f83-a30f-878f41c4e688] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.496224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.496900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.497473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.498220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.499720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.500164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.517316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] HTTP exception thrown: Instance fd125db0-334a-4f83-a30f-878f41c4e688 could not be found. Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Request method failure captured: Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 HTTP/1.1 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8l0gcnKyaW8c54l8wnBQDlhovAJTTQjLCzcC5hBAsHRGOXrEm4tFmSOkEOs2f3Wjzy8UbN26WNWWdhUSVmqNNX-tQNtF2rgKhnWOcR2Bh5cElLOPbswwiqMZY4U_EdWCyqJStJ26jbzVnuBERd3O6AWYPzYLGCO6Cnd2XyahI6D8 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: fd7b2634429c46c1ac366579351c3389 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd7b2634429c46c1ac366579351c3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: fd7b2634429c46c1ac366579351c3389 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminTestJSON-1866691583-project Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 76067e188d0047d8939862b78f0abea9 Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminTestJSON-1866691583-project Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance fd125db0-334a-4f83-a30f-878f41c4e688 could not be found. Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'fd125db0-334a-4f83-a30f-878f41c4e688'} Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd125db0-334a-4f83-a30f-878f41c4e688 could not be found. Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd125db0-334a-4f83-a30f-878f41c4e688 could not be found. Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:34.519016 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd125db0-334a-4f83-a30f-878f41c4e688 could not be found. Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Returning 404 to user: Instance fd125db0-334a-4f83-a30f-878f41c4e688 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c647dac-690f-486d-9010-08611a56794c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688" status: 404 len: 111 microversion: 2.1 time: 0.036267 Sep 13 16:34:34.524564 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 566/1167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:34 2022] GET /compute/v2.1/servers/fd125db0-334a-4f83-a30f-878f41c4e688 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:34:34.529016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.529515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.535332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.535823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.536265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.536970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.537432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.537890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.540583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:34.548562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14e4c471-6243-47d1-ab50-05cd5a6a2a2d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1476 microversion: 2.1 time: 0.169840 Sep 13 16:34:34.549150 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 602/1168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:34 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:34.569290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:34.649366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2fff726-1069-4ba9-a0a2-5ed9955fee20 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 204 len: 0 microversion: 2.1 time: 0.124117 Sep 13 16:34:34.649972 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 567/1169] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:34 2022] DELETE /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:34:34.658647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.659273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.665214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.665710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.666201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.666902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.668007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.668126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.668527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.668735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.674623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.675108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.675538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.676347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.676810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.677236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.801800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:34.810029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d45289e-02f3-4f6b-8fbb-43fcbd639a7e tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1469 microversion: 2.1 time: 0.155029 Sep 13 16:34:34.810628 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 603/1170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:34 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:34.812472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:34.820565 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-170fddc0-45d0-4d35-9b0a-12ae2f9718d2 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.157388 Sep 13 16:34:34.826845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abc1103-ca94-4e9c-84e1-64c65215f6e7", "tag": "aa019033-acdd-499a-b7ba-87e4de3dc483"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:34.830092 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 568/1171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:34 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:34.836323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.836812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.837252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.849478 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] Creating event network-changed:aa019033-acdd-499a-b7ba-87e4de3dc483 for instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 on n-h2-857467-1 Sep 13 16:34:34.854870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:34:34.855405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:34.856029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:34.862017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.862505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.862944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.863649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:34.864130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:34.864561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:34.865629 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f0f04f70-4e02-446e-b724-1e467ada6fe9 req-3d2eda40-2bd0-48d1-9fbc-e45e551ee371 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043342 Sep 13 16:34:34.866272 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 604/1172] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:34.927388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:34.935380 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01a3fb69-1b91-440f-a636-e29b0df20524 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.084245 Sep 13 16:34:34.935966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 569/1173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:34 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:35.099730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:35.100432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:35.106677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.107161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.107595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.108288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.108741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.109164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.337321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:35.345765 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dae157b9-a0b9-4181-8e8f-7323717b0c62 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.250259 Sep 13 16:34:35.346722 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 605/1174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:35 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:35.571752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:35.572371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:35.579606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.580090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.580529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.581225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.581688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.582150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.710484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:35.718688 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6154f5c4-ca15-4688-81d4-c9099b6be1e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1474 microversion: 2.1 time: 0.150759 Sep 13 16:34:35.719442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 570/1175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:35 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1474 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:35.833198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:35.833808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:35.840890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.841629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.842425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.843449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.843588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:35.844130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:35.844255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.844994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.850212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.850698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.851144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.851829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:35.852287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:35.852715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:35.979644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:35.986839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:35.987777 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e7c6cd5-0bdd-4520-946b-5d0ccb5078fb tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1469 microversion: 2.1 time: 0.158399 Sep 13 16:34:35.988369 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 606/1176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:35 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:35.993327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:35.993963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:35.996270 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90a4cf11-aa5d-4b71-8e28-034bf0d37b85 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.155668 Sep 13 16:34:36.005991 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 571/1177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:35 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:36.014142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.014747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.015277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.016150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.016682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.017190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.021762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:36.082276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:36.090512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-364d3e5c-0428-42e6-bae1-6a4884431387 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.100654 Sep 13 16:34:36.091095 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 607/1178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:35 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:36.368508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:36.369126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:36.375514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.376009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.376453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.377152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.377617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.378082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.515108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:36.522767 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc0bf21e-85d8-44d3-98d9-a1241a48b4dc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.158080 Sep 13 16:34:36.523348 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 572/1179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:36 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:36.742409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:36.743031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:36.751025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.751694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.752229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.752928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:36.753385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:36.753814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:36.887870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:36.896085 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52dc1430-43fc-4c4b-9c6f-2b3e115c21b8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1474 microversion: 2.1 time: 0.157525 Sep 13 16:34:36.896662 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 608/1180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:36 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:37.011568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:37.012500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:37.016232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:37.020396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.020896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.021338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.022079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.022547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.022977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.032975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:37.033582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:37.040381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.042191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.042764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.043790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.044414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.044948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.178459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:37.183846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:37.191002 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ab56d18-cd7f-4083-8018-b128f90241b2 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1469 microversion: 2.1 time: 0.183956 Sep 13 16:34:37.191925 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 573/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:37 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:37.196719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:37.197399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:37.205478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.206103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.206593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.207383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.207933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.208347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.214453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:37.224160 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-633461a9-caee-4f18-8c15-a8b7d8d51c39 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.195343 Sep 13 16:34:37.234487 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 609/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:37 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:37.242288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-93487719-447c-46db-9534-efaa28f060a7 req-1c85ad11-4544-4efb-84e5-2148c6351555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c87a1a3-b6f0-4156-9094-15e0d132f9fc", "name": "network-vif-plugged", "status": "completed", "tag": "1aca45e0-ff26-4c64-a5af-e7d049b8acc9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:37.253047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-93487719-447c-46db-9534-efaa28f060a7 req-1c85ad11-4544-4efb-84e5-2148c6351555 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.253459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-93487719-447c-46db-9534-efaa28f060a7 req-1c85ad11-4544-4efb-84e5-2148c6351555 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.253962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-93487719-447c-46db-9534-efaa28f060a7 req-1c85ad11-4544-4efb-84e5-2148c6351555 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.268765 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-93487719-447c-46db-9534-efaa28f060a7 req-1c85ad11-4544-4efb-84e5-2148c6351555 service nova] Creating event network-vif-plugged:1aca45e0-ff26-4c64-a5af-e7d049b8acc9 for instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc on n-h2-857467-1 Sep 13 16:34:37.273972 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-93487719-447c-46db-9534-efaa28f060a7 req-1c85ad11-4544-4efb-84e5-2148c6351555 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037512 Sep 13 16:34:37.274590 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 610/1183] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:37.283866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:37.292465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b40fa0b2-7edd-482e-9faa-940b095d5f19 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.099170 Sep 13 16:34:37.293227 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 574/1184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:37 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:37.547452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:37.548184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:37.554372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.554853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.555285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.555970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.556424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.556846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.697934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:37.707597 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ee56760-16b0-44ad-bd59-14a80f81cc6a tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.164225 Sep 13 16:34:37.709074 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 611/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:37 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:37.920063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:37.920677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:37.926614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.927111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.927541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:37.928233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:37.928695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:37.929125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.064547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:38.072542 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1a5dad52-4239-44f4-9ae7-81ac4f676c7f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1474 microversion: 2.1 time: 0.156522 Sep 13 16:34:38.073153 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 575/1186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:37 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:38.215418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:38.216030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:38.222606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.223092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.223527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.224216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.224670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.225092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.248220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:38.248966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:38.255531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.256025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.256702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.257633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.258127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.258566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.369543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:38.378416 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-428cbcfc-2f14-473c-a47e-b6fa9e968eae tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1469 microversion: 2.1 time: 0.166932 Sep 13 16:34:38.379225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 612/1187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:38 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:38.384161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:38.384767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:38.392631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.393125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.393568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.394373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.394838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.395266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.418058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:38.426123 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d227cac3-21e5-4545-a8be-2eceee6dabc7 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.182567 Sep 13 16:34:38.426787 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 576/1188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:38 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:38.458697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:38.466959 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46b7159d-f059-45ca-9eca-bb463aa105bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.086331 Sep 13 16:34:38.467533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 613/1189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:38 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:38.732167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:38.732791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:38.738920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.739408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.739850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.740546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:38.741011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:38.741446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:38.879220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:38.887321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c80dd44b-5f71-4338-9c92-04ae06d84ed8 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.159712 Sep 13 16:34:38.887897 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 577/1190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:38 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:39.095892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:39.096513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:39.102600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.103095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.103534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.104263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.105381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.105815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.235575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:39.243251 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e5d8f223-1728-4655-be60-881c00f6cb9b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1474 microversion: 2.1 time: 0.151254 Sep 13 16:34:39.243831 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 614/1191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:39 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1474 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:39.289065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c87a1a3-b6f0-4156-9094-15e0d132f9fc", "name": "network-vif-plugged", "status": "completed", "tag": "7e8fc2f7-9130-471c-b592-000b7483b65e"}, {"server_uuid": "20af6189-c7b9-4c72-9d88-77e615de61fb", "name": "network-vif-plugged", "status": "completed", "tag": "c67c3918-3bd7-459d-823f-d131a1082f50"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:39.299564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.300051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.300489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.313246 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] Creating event network-vif-plugged:7e8fc2f7-9130-471c-b592-000b7483b65e for instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc on n-h2-857467-1 Sep 13 16:34:39.313765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] Creating event network-vif-plugged:c67c3918-3bd7-459d-823f-d131a1082f50 for instance 20af6189-c7b9-4c72-9d88-77e615de61fb on n-h1-857467-1 Sep 13 16:34:39.321899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1e44651c-bad5-41d8-88ad-b79e304cd6a9 req-9f8e8abc-6058-489a-9efc-bcb75b3d0bac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036501 Sep 13 16:34:39.322496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 578/1192] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:39.405574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:39.406415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:39.412349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.412846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.413294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.414024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.414499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.414933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.449996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:39.450708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:39.457361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.457921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.458369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.459110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.459660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.460093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.596547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:39.604202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:39.607172 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f5d1c9d-68ec-495c-a93b-4f6a54d62c56 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1469 microversion: 2.1 time: 0.206144 Sep 13 16:34:39.607717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 615/1193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:39 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:39.612860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:39.613467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:39.619543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.620666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.621456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.622202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.622824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.623409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.628138 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5b5da27-f178-4ada-9aaf-f35be24ba6ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.183293 Sep 13 16:34:39.628743 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 579/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:39 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:39.705326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:39.716016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a783d78-d740-462f-a92a-f8124303b332 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.106440 Sep 13 16:34:39.717003 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 616/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:39 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:39.909984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:39.910607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:39.917600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.918120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.918565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:39.919264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:39.919731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:39.920166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.110800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:40.118371 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-201735f4-776a-4fc9-ac4b-f6a6e35ec5c3 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.212269 Sep 13 16:34:40.118944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 580/1196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:39 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:40.266039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:40.266656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.273219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.273707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.274177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.274933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.275439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.275886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.408912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:40.416910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5537c165-5fce-44af-8de3-45ba4e24a2b2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1471 microversion: 2.1 time: 0.154723 Sep 13 16:34:40.418206 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 617/1197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:40 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:40.440122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:40.441270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.448097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.448986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.449437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.450270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.450737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.451168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.526916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4efa4212-11c9-4b68-b875-56951d775568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7/action" status: 204 len: 0 microversion: 2.1 time: 0.090657 Sep 13 16:34:40.527774 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 581/1198] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:34:40 2022] POST /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:34:40.538049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:40.539195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.546790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.547866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.548912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.549692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.550300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.550734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.636564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:40.637554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.644206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.645028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.645743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.647074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.647714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.648491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.686742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:40.694866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf61296c-86b7-4043-8307-67671ac844d4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1471 microversion: 2.1 time: 0.162157 Sep 13 16:34:40.695444 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 618/1199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:40 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:40.700585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:40.701201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.706995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.707495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.707940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.708811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.709424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.710049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.873451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:40.882431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9fdf20c1-3890-4fd0-899a-5e84accf7964 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1469 microversion: 2.1 time: 0.250407 Sep 13 16:34:40.886690 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 582/1200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:40 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1469 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:40.893155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:40.894996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:40.903546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.905074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.905625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.906464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:40.907107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:40.908196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:40.944615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:40.954477 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00ff1d46-1c23-41e1-a124-6195e42b6696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1317 microversion: 2.1 time: 0.257819 Sep 13 16:34:40.955249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 619/1201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:40 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:41.010003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:41.018990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a5e9c5a-eb14-4405-a396-d7d99fde9245 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.130767 Sep 13 16:34:41.021864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 583/1202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:40 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:41.200870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2264bb88-5fc8-4d9a-931b-d5ad05db86a9 req-ea330e9c-6e99-4046-8705-9c0b383b4a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0df885-185c-4351-bd0e-c3c13774f815", "name": "network-vif-deleted", "tag": "0cf241fd-8101-4e4e-9dbe-3fd46afa5365"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:41.201751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:41.202425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:41.208660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.209152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.209597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.210215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2264bb88-5fc8-4d9a-931b-d5ad05db86a9 req-ea330e9c-6e99-4046-8705-9c0b383b4a6e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.210349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.210688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2264bb88-5fc8-4d9a-931b-d5ad05db86a9 req-ea330e9c-6e99-4046-8705-9c0b383b4a6e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.210789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.211117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2264bb88-5fc8-4d9a-931b-d5ad05db86a9 req-ea330e9c-6e99-4046-8705-9c0b383b4a6e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.211230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.223905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2264bb88-5fc8-4d9a-931b-d5ad05db86a9 req-ea330e9c-6e99-4046-8705-9c0b383b4a6e service nova] Creating event network-vif-deleted:0cf241fd-8101-4e4e-9dbe-3fd46afa5365 for instance 5b0df885-185c-4351-bd0e-c3c13774f815 on n-h2-857467-1 Sep 13 16:34:41.228728 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2264bb88-5fc8-4d9a-931b-d5ad05db86a9 req-ea330e9c-6e99-4046-8705-9c0b383b4a6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033676 Sep 13 16:34:41.229547 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 620/1203] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:41.365398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:41.374704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65dc9427-99aa-4064-9a14-76902a3c0244 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.178072 Sep 13 16:34:41.389771 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 584/1204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:41 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:41.719116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:41.719819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:41.721731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:41.728003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.728656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.729152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.730505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.730985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.731409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.876895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:41.885218 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6aa2060-d74b-4f9f-9018-935e533101d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1471 microversion: 2.1 time: 0.170824 Sep 13 16:34:41.885956 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 621/1205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:41 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:41.905989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:41.906820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:41.913103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.913597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.914068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.914771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.915237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.915670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.981151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:41.981921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:41.984324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:41.988675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.989275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.989980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.990793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:41.991409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:41.992184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:41.992637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e6bf332-da47-4b36-9b48-3d5db8627ae9 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1427 microversion: 2.1 time: 0.091547 Sep 13 16:34:41.993394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 585/1206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:41 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:42.043575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.044328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.050620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.051213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.051735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.053119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.053899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.054716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.141725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:42.144489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:42.155064 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a32792d6-3fd7-45da-b216-1a50fe781c48 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1467 microversion: 2.1 time: 0.180473 Sep 13 16:34:42.169971 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 622/1207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:41 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1467 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:42.170322 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0b52bda-5f70-45f6-9a33-791356518055 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1287 microversion: 2.1 time: 0.121868 Sep 13 16:34:42.173017 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 586/1208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:42 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:42.200119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.200875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.205702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abc1103-ca94-4e9c-84e1-64c65215f6e7", "name": "network-vif-plugged", "status": "completed", "tag": "aa019033-acdd-499a-b7ba-87e4de3dc483"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:42.212969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.214704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.215662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.216972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.218328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.218963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.223916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.224413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.224859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.242159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] Creating event network-vif-plugged:aa019033-acdd-499a-b7ba-87e4de3dc483 for instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 on n-h2-857467-1 Sep 13 16:34:42.249230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:34:42.265969 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0035f9d7-2e18-4c2a-9326-093ef37286af req-2a87896f-d279-4e23-9d88-a002b3cca919 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071330 Sep 13 16:34:42.267018 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 623/1209] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:42.403093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.403918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.407996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc7ecea5-57ce-452c-ac3e-90a4a72a9378 tempest-ServersOnMultiNodesTest-741325660 tempest-ServersOnMultiNodesTest-741325660-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1618 microversion: 2.1 time: 0.214682 Sep 13 16:34:42.408910 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 587/1210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:42 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1618 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:42.411110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.411647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.412193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.412957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.414510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.415315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.433779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.434619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.440847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.441343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.442058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.442781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.443250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.443684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.481644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:42.526691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:42.587437 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb5be20a-af36-448f-b18d-154d71b3b64e tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 204 len: 0 microversion: 2.1 time: 0.157644 Sep 13 16:34:42.588242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:42.588541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 588/1211] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:42 2022] DELETE /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:34:42.598123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.598885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.602294 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e391e1f-2eed-48e0-91c7-57653f90438d tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1334 microversion: 2.1 time: 0.205482 Sep 13 16:34:42.606797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 624/1212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:42 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1334 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:42.608299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.608794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.609228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.610025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.610468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.611302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.768900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:42.778611 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62a3a889-156b-4f2f-a9cf-4d60ba7d0de1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1473 microversion: 2.1 time: 0.185191 Sep 13 16:34:42.779302 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 589/1213] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:42 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:42.908605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:42.909223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:42.916398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.917537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.918084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.918835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:42.919250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:42.919675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:42.935373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:43.018336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:43.018886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:43.026682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.027775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.027775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.028303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.028764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.029906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.061746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.062279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.062721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.063179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lazy-loading 'fault' on Instance uuid 5b0df885-185c-4351-bd0e-c3c13774f815 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:43.066578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:43.074467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-211915c2-dc19-442b-b1c3-2f8d50987cd1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1471 microversion: 2.1 time: 0.169826 Sep 13 16:34:43.075049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 625/1214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:42 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:43.105182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:43.114537 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f96f398-632d-446e-8097-a77e813b93e3 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 200 len: 1303 microversion: 2.1 time: 0.100023 Sep 13 16:34:43.115598 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 590/1215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:43 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:43.184889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:43.185505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:43.191405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.191889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.192522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.193330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.194072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.194651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.267354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:43.275894 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8d43255-44a8-4461-90f7-079503dae7bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1293 microversion: 2.1 time: 0.095575 Sep 13 16:34:43.277342 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 626/1216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:43 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:43.626705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:43.627280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:43.629306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:43.635223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.636412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.636856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.637573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.638102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.638531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.654737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:43.802331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:43.803090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:43.816902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.817875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.818919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.820289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.821108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.821821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.839070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=16 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:43.907976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:43.916790 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-17e562d5-6cdd-46d8-8a75-69ecf8329ac2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1669 microversion: 2.1 time: 0.293971 Sep 13 16:34:43.917729 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 591/1217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:43 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1669 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:43.943838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:43.944404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:43.952589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.953351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.954264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.955118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:43.956040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:43.956504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:43.987712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0b3d16e-896d-4ada-a0ac-0c602bb8fb7b tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc/ips" status: 200 len: 179 microversion: 2.1 time: 0.050986 Sep 13 16:34:43.988678 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 592/1218] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:34:43 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc/ips => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:44.007099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.007653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.016457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:44.029523 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2efdbf93-19f0-4b2d-b747-51315ff29fd1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1473 microversion: 2.1 time: 0.230960 Sep 13 16:34:44.029754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.030905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.031345 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 627/1219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:43 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:44.031460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.032114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.032597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.033025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.101022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.102085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.110430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.111142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.111762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.113145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.113968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.114557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.142558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:44.286945 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2809235-10ed-4067-a0f0-b53422a761b9 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 204 len: 0 microversion: 2.1 time: 0.290116 Sep 13 16:34:44.292189 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 593/1220] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:43 2022] DELETE /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:34:44.303893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.304753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 5b0df885-185c-4351-bd0e-c3c13774f815] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.311862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.312500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.313130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.313904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.314710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.315306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.341049 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] HTTP exception thrown: Instance 5b0df885-185c-4351-bd0e-c3c13774f815 could not be found. Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Request method failure captured: Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 HTTP/1.1 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB8l0gcnKyaW8c54l8wnBQDlhovAJTTQjLCzcC5hBAsHRGOXrEm4tFmSOkEOs2f3Wjzy8UbN26WNWWdhUSVmqNNX-tQNtF2rgKhnWOcR2Bh5cElLOPbswwiqMZY4U_EdWCyqJStJ26jbzVnuBERd3O6AWYPzYLGCO6Cnd2XyahI6D8 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: fd7b2634429c46c1ac366579351c3389 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd7b2634429c46c1ac366579351c3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: fd7b2634429c46c1ac366579351c3389 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminTestJSON-1866691583-project Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 76067e188d0047d8939862b78f0abea9 Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminTestJSON-1866691583-project Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 5b0df885-185c-4351-bd0e-c3c13774f815 could not be found. Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '5b0df885-185c-4351-bd0e-c3c13774f815'} Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0df885-185c-4351-bd0e-c3c13774f815 could not be found. Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0df885-185c-4351-bd0e-c3c13774f815 could not be found. Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:44.346824 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0df885-185c-4351-bd0e-c3c13774f815 could not be found. Sep 13 16:34:44.351239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:44.355314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Returning 404 to user: Instance 5b0df885-185c-4351-bd0e-c3c13774f815 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:44.356404 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d16836b-b43d-45f6-8b62-a236bd6dad61 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815" status: 404 len: 111 microversion: 2.1 time: 0.056919 Sep 13 16:34:44.359894 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 594/1221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/5b0df885-185c-4351-bd0e-c3c13774f815 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:44.367496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.368764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.388995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.389522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.390025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.390747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.391376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.392005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.404191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:44.415768 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5d689762-6627-4ac4-b28c-6dab638aca7d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1463 microversion: 2.1 time: 0.319342 Sep 13 16:34:44.421569 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 628/1222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1463 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:44.435796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.437547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.450955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.453450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.456444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.457754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.458193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.458635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.629431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:44.639323 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22448509-7f06-4a1b-bb19-935215b36e98 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.216368 Sep 13 16:34:44.640402 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 629/1223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:44.646242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.646967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.654880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.655556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.656232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.656842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.657298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.657727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.684025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:44.756561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:44.773883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d7c3924-3af6-4fc0-9c1e-16dbfa1c70f5 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1675 microversion: 2.1 time: 0.412348 Sep 13 16:34:44.790959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 595/1224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1675 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:44.790959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.790959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.790959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.790959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.790959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.791920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.792540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.793235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.811977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2ce870fa-139d-4cae-b4a4-ab050879fca5 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 204 len: 0 microversion: 2.1 time: 0.170114 Sep 13 16:34:44.812964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 630/1225] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:44 2022] DELETE /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:34:44.822442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:44.824700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:44.830944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.831437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.831878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:44.832587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:44.833049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:44.833483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.060343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:45.075389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-38eae8d4-3d13-402c-ba5e-cdbab7d518e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1463 microversion: 2.1 time: 0.299426 Sep 13 16:34:45.076600 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 596/1226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:45.081511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:45.082390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:45.089641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.090398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.091037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.091952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.092589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.093200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.321682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:45.337412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-158919d6-bec8-4443-a0bb-3e2284fb51e1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1473 microversion: 2.1 time: 0.255901 Sep 13 16:34:45.338488 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 597/1227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:45 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:45.353525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3ea2a0e-5154-4c85-b293-34d5e42ee656 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'create', calling method: .version_select at 0x7fbeb5436a60>, body: {"keypair": {"name": "tempest-keypair-1226846906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBO8DuVadqS1bUjJ6OfaeULnRV8Qm8opd72Gsi50ozpJiH3hXzTbeB5+blrJnjy461rf8tZWFTGqzO+Jt5QZ0iTcZYxExUkDK/+x1NSUWlOwEpZBL2gD3K+JZgQHngw0EQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:45.374799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:45.386389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f3ea2a0e-5154-4c85-b293-34d5e42ee656 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for project fbdc043f15794fe6af24d0816bc6a344. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:45.389425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2bc720f9-9baf-44e1-a1f7-f64c0fd59377 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1469 microversion: 2.1 time: 0.572053 Sep 13 16:34:45.392128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f3ea2a0e-5154-4c85-b293-34d5e42ee656 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for user 80714f77e8904565bde7dc8e7dce1063 and project fbdc043f15794fe6af24d0816bc6a344. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:45.395970 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 631/1228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:44 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1469 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:45.420618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3ea2a0e-5154-4c85-b293-34d5e42ee656 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077890 Sep 13 16:34:45.422250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d0484c40-a7f9-4bd0-a306-31e50abbd456 req-00bb5193-80ae-4f33-984f-36e062eb6f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af1ff17-c9a7-4884-a14f-cf19ab92e5e9", "tag": "b85d6229-5594-4441-8f64-63c4a4b3c750"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:45.426047 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 598/1229] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:34:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:45.439842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0484c40-a7f9-4bd0-a306-31e50abbd456 req-00bb5193-80ae-4f33-984f-36e062eb6f98 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.440590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0484c40-a7f9-4bd0-a306-31e50abbd456 req-00bb5193-80ae-4f33-984f-36e062eb6f98 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.441246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0484c40-a7f9-4bd0-a306-31e50abbd456 req-00bb5193-80ae-4f33-984f-36e062eb6f98 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.456870 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d0484c40-a7f9-4bd0-a306-31e50abbd456 req-00bb5193-80ae-4f33-984f-36e062eb6f98 service nova] Creating event network-changed:b85d6229-5594-4441-8f64-63c4a4b3c750 for instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 on n-h2-857467-1 Sep 13 16:34:45.480550 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d0484c40-a7f9-4bd0-a306-31e50abbd456 req-00bb5193-80ae-4f33-984f-36e062eb6f98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048966 Sep 13 16:34:45.481919 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 632/1230] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:45.664258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:45.664889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:45.676984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.677505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.681937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.684197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.684771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.685224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.703259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-092de9ca-ec9e-4cd0-bcef-95c476dfd827 req-036570df-7993-41cd-b3a8-27aeb14265b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af6189-c7b9-4c72-9d88-77e615de61fb", "name": "network-vif-deleted", "tag": "c67c3918-3bd7-459d-823f-d131a1082f50"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:45.722768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-092de9ca-ec9e-4cd0-bcef-95c476dfd827 req-036570df-7993-41cd-b3a8-27aeb14265b1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.724358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-092de9ca-ec9e-4cd0-bcef-95c476dfd827 req-036570df-7993-41cd-b3a8-27aeb14265b1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.725098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-092de9ca-ec9e-4cd0-bcef-95c476dfd827 req-036570df-7993-41cd-b3a8-27aeb14265b1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.757223 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-092de9ca-ec9e-4cd0-bcef-95c476dfd827 req-036570df-7993-41cd-b3a8-27aeb14265b1 service nova] Creating event network-vif-deleted:c67c3918-3bd7-459d-823f-d131a1082f50 for instance 20af6189-c7b9-4c72-9d88-77e615de61fb on n-h1-857467-1 Sep 13 16:34:45.767721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-092de9ca-ec9e-4cd0-bcef-95c476dfd827 req-036570df-7993-41cd-b3a8-27aeb14265b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069947 Sep 13 16:34:45.775683 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 633/1231] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:45.804295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:45.806500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:45.820408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.821286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.821930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.822967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:45.824310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:45.825051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:45.969073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:45.981102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee5f2f30-2e09-43b8-851e-fe619cc8efec tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.321441 Sep 13 16:34:45.982031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 599/1232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:45 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:46.107343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:46.119188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5eedc6fa-dcfe-4cd7-b782-99e1714091d2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1675 microversion: 2.1 time: 0.324534 Sep 13 16:34:46.120801 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 634/1233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:45 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1675 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:46.364187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:46.364810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:46.373733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.374083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.374763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.375456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.375894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.376640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.414543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:46.415830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:46.424198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.425027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.425563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.426675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.427631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.428273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.438270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:46.438966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:46.439564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:46.440218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid 20af6189-c7b9-4c72-9d88-77e615de61fb {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:46.510092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:46.524017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ee6d4ed-a4fd-44d5-b013-6d4e3a436b18 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 200 len: 1307 microversion: 2.1 time: 0.165090 Sep 13 16:34:46.524616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 600/1234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:46 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:46.646261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:46.655491 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b0ad409-e109-41f5-9984-d53b36f64898 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1469 microversion: 2.1 time: 0.246109 Sep 13 16:34:46.656356 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 635/1235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:46 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:47.005138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.005763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.013170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.013664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.014144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.014848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.015312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.015739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.029536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8e58afb-0445-4a40-af9f-f55d3cd04e13 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '.version_select at 0x7fbeb51001f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.033045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e58afb-0445-4a40-af9f-f55d3cd04e13 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.033717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e58afb-0445-4a40-af9f-f55d3cd04e13 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.034247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e58afb-0445-4a40-af9f-f55d3cd04e13 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.045865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8e58afb-0445-4a40-af9f-f55d3cd04e13 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.021220 Sep 13 16:34:47.046800 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 636/1236] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:47.077332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c48f06a-5afd-480e-ac3d-61c742c2cb95 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.083908 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c48f06a-5afd-480e-ac3d-61c742c2cb95 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011008 Sep 13 16:34:47.085163 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 637/1237] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:47.096946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd3eb48b-353a-4473-bdd3-3d7df0ec36f5 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-864882148", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:47.119008 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd3eb48b-353a-4473-bdd3-3d7df0ec36f5 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.025782 Sep 13 16:34:47.119657 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 638/1238] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Sep 13 16:34:47 2022] POST /compute/v2.1/flavors => generated 498 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:47.131633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d69b83a7-90b9-46a5-9803-f3fd830b7fdd tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.139401 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d69b83a7-90b9-46a5-9803-f3fd830b7fdd tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011514 Sep 13 16:34:47.139971 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 639/1239] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:34:47.144375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.144978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.152008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.152501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.152935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.154309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.154484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.154932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.175198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:47.185148 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13aaef39-fa27-42c7-9735-8ae53de2b176 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.184096 Sep 13 16:34:47.186052 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 601/1240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:46 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:47.197503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1678555941", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "fb9c7619-f0ea-4112-b8b9-d35db649113e"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:47.251248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:47.311435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:47.319313 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32fc9c37-7154-4fd1-8793-f750ea1608e2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1675 microversion: 2.1 time: 0.178415 Sep 13 16:34:47.319883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 640/1241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:47.459712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:47.460179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:47.460627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:47.461035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:47.461444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:47.470975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.471457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.471892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.472617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.473071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.473495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.489781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:47.495162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for user 80714f77e8904565bde7dc8e7dce1063 and project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:47.507444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:47.509700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:47.546417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.547029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 20af6189-c7b9-4c72-9d88-77e615de61fb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.552908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.553390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.553844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.554528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.555154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.555581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.556208 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ddb64f43-ee7c-47fa-979e-ad85eea4bff8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.364946 Sep 13 16:34:47.557171 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 602/1242] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:34:47.567616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-012dc82e-fd85-42b8-b4f8-233ec4ba3078 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.568240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-012dc82e-fd85-42b8-b4f8-233ec4ba3078 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.569537 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance 20af6189-c7b9-4c72-9d88-77e615de61fb could not be found. Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb HTTP/1.1 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 20af6189-c7b9-4c72-9d88-77e615de61fb could not be found. Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '20af6189-c7b9-4c72-9d88-77e615de61fb'} Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20af6189-c7b9-4c72-9d88-77e615de61fb could not be found. Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20af6189-c7b9-4c72-9d88-77e615de61fb could not be found. Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:47.571926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20af6189-c7b9-4c72-9d88-77e615de61fb could not be found. Sep 13 16:34:47.580193 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:47.581634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:47.581733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance 20af6189-c7b9-4c72-9d88-77e615de61fb could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:47.585021 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76961e30-e615-422f-b3d7-364adb14a507 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb" status: 404 len: 111 microversion: 2.1 time: 0.042474 Sep 13 16:34:47.589277 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 641/1243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/servers/20af6189-c7b9-4c72-9d88-77e615de61fb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:47.593966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.594465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.601574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.602296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.602923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.604920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.605327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.606305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.627537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-012dc82e-fd85-42b8-b4f8-233ec4ba3078 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:47.633031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:47.638079 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-012dc82e-fd85-42b8-b4f8-233ec4ba3078 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1279 microversion: 2.1 time: 0.073463 Sep 13 16:34:47.638678 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 603/1244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1279 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:47.688061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.688771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.698489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.699404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.700165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.702979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.703898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.704744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.723091 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14639d31-d81b-4b42-892d-b9dcd00e50ba tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 204 len: 0 microversion: 2.1 time: 0.132019 Sep 13 16:34:47.724771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 642/1245] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:47 2022] DELETE /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:34:47.734617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:47.735726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:47.743792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.744453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.745060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.745954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:47.746623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:47.747093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:47.899761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:47.909212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ed8eec4-cf8f-45a9-9915-4de399aa6560 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1473 microversion: 2.1 time: 0.180228 Sep 13 16:34:47.909999 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 643/1246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:47.924396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:47.933229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77ab7488-0676-454c-81aa-be1c9e21c87b tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1469 microversion: 2.1 time: 0.256523 Sep 13 16:34:47.934126 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 604/1247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:47 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:48.208726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.209289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.216267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.216762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.217204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.218077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.218547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.218985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.234678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:48.342877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.343627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.349757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.350289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.350929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.351137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:48.351642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.352110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.352570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.361227 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e4e4223-e811-4eec-b079-2b6e92b6ebaf tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.156476 Sep 13 16:34:48.361925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 644/1248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:48.496837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:48.504876 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-61c242d7-6328-4739-8f0e-54c0e9dc513f tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1675 microversion: 2.1 time: 0.165694 Sep 13 16:34:48.505453 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 605/1249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:48.660481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.661087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.667958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.668451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.668886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.669586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.670069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.670496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.731188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:48.738961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63063b7b-ed04-415b-823e-0f7c51c69129 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1283 microversion: 2.1 time: 0.082363 Sep 13 16:34:48.739529 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 645/1250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1283 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:48.932787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.933406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.939496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.939987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.940431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.941131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.941595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.942066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.946050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:48.956503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:48.957232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:48.963263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.964484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.964931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:48.965739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:48.966135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:48.966569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.079741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:49.087631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35de7eea-9a53-4775-ab52-5e43e4dd1848 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1473 microversion: 2.1 time: 0.159070 Sep 13 16:34:49.088208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 606/1251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1473 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:49.103630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:49.111485 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ddf437ad-c014-4a80-bf2b-894072df1925 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1469 microversion: 2.1 time: 0.158869 Sep 13 16:34:49.112065 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 646/1252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:48 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:49.387686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:49.388666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:49.395942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.396434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.396874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.397577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.398070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.398497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.530050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:49.531341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:49.540820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.542174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.543005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.543947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.544410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.545029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.730496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:49.742581 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bf76f08-1a55-494c-8d25-bb88c9b3db05 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.359765 Sep 13 16:34:49.745963 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 607/1253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:49 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:49.764367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:49.765291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:49.766009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:49.775265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.776787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.778091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.779935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:49.780357 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-773ea35f-68df-42dc-89ea-85bad64526ba tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1675 microversion: 2.1 time: 0.254111 Sep 13 16:34:49.782516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:49.784682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:49.792548 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 647/1254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:49 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:49.884340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:49.893528 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b44423c5-1fda-4a0b-a6be-84a39e4d7918 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1331 microversion: 2.1 time: 0.135310 Sep 13 16:34:49.894148 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 608/1255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:49 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:50.039067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-85ce62b1-da7c-43d5-830b-07d40af0be96 req-0411ed7a-08c8-4510-890e-f9eefe035592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf023ce-75bf-46cd-87e1-a5913fc20ab0", "name": "network-vif-deleted", "tag": "e8193859-9664-4b83-bb63-cdb60326345f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:50.049993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85ce62b1-da7c-43d5-830b-07d40af0be96 req-0411ed7a-08c8-4510-890e-f9eefe035592 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.050495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85ce62b1-da7c-43d5-830b-07d40af0be96 req-0411ed7a-08c8-4510-890e-f9eefe035592 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.050928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85ce62b1-da7c-43d5-830b-07d40af0be96 req-0411ed7a-08c8-4510-890e-f9eefe035592 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.092166 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-85ce62b1-da7c-43d5-830b-07d40af0be96 req-0411ed7a-08c8-4510-890e-f9eefe035592 service nova] Creating event network-vif-deleted:e8193859-9664-4b83-bb63-cdb60326345f for instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 on n-h2-857467-1 Sep 13 16:34:50.096327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a060a61b-918d-4112-82af-9d54f46cc8cf req-ace178ff-2adf-48e1-96f7-8210d26f9756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c87a1a3-b6f0-4156-9094-15e0d132f9fc", "name": "network-vif-deleted", "tag": "7e8fc2f7-9130-471c-b592-000b7483b65e"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:50.097677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-85ce62b1-da7c-43d5-830b-07d40af0be96 req-0411ed7a-08c8-4510-890e-f9eefe035592 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062097 Sep 13 16:34:50.098676 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 648/1256] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:50.114294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:50.115235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:50.123510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.124043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.124881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.125721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.126222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.130415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.136283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a060a61b-918d-4112-82af-9d54f46cc8cf req-ace178ff-2adf-48e1-96f7-8210d26f9756 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.137802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a060a61b-918d-4112-82af-9d54f46cc8cf req-ace178ff-2adf-48e1-96f7-8210d26f9756 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.138839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a060a61b-918d-4112-82af-9d54f46cc8cf req-ace178ff-2adf-48e1-96f7-8210d26f9756 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.156545 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a060a61b-918d-4112-82af-9d54f46cc8cf req-ace178ff-2adf-48e1-96f7-8210d26f9756 service nova] Creating event network-vif-deleted:7e8fc2f7-9130-471c-b592-000b7483b65e for instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc on n-h2-857467-1 Sep 13 16:34:50.165965 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a060a61b-918d-4112-82af-9d54f46cc8cf req-ace178ff-2adf-48e1-96f7-8210d26f9756 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072184 Sep 13 16:34:50.167803 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 609/1257] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:50.179745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:50.181361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:50.206562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.207344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.208041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.211120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.211832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.212468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.347708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:50.359616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab954231-cd69-4e28-84ec-2e28c5fc8727 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1473 microversion: 2.1 time: 0.250684 Sep 13 16:34:50.360645 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 649/1258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:50 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:50.403524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:50.418241 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d96555da-8d5d-4050-b44a-1569ec6aea48 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1299 microversion: 2.1 time: 0.248512 Sep 13 16:34:50.419329 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 610/1259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:50 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1299 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:50.768532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:50.770098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:50.777539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.778073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.778519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.779238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.779710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.780172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.806824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:50.809155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:50.822577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.823833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.824380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.825207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:50.827665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:50.828213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:50.978227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:51.005391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-506b5448-cb51-491f-8ef1-ae25bdbe8a11 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.241621 Sep 13 16:34:51.009614 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 650/1260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:50 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:51.016154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:51.016954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:51.031757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.032255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.032702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.033525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.034024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.034450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.144110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:51.152822 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1e057a1-9390-455a-adae-7434bdc2b7c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1349 microversion: 2.1 time: 0.141847 Sep 13 16:34:51.158547 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 651/1261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:51 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1349 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:51.389004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:51.389629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:51.402535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.403029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.403652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.407803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.408449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.409045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.430599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:51.445068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90ff49f6-4307-464b-a1ba-eca7b7febeeb tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1496 microversion: 2.1 time: 0.643876 Sep 13 16:34:51.462229 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 611/1262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:50 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1496 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:51.462229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:51.462229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:51.480812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.481516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.482186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.483125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.484791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.485590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.534650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:51.535487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:51.536153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:51.536959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lazy-loading 'fault' on Instance uuid 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:51.622724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76067e188d0047d8939862b78f0abea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7b2634429c46c1ac366579351c3389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:51.639060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65156041-f6f7-4f78-9ba5-65abfabafd9c tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 200 len: 1304 microversion: 2.1 time: 0.188032 Sep 13 16:34:51.639956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 612/1263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:51 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:51.641970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:51.659961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d47fff2b-6b63-4a93-bcfb-0abbd0f0e255 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1431 microversion: 2.1 time: 0.278971 Sep 13 16:34:51.662378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 652/1264] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:51 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1431 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:52.031873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:52.033089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:52.039951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.040468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.040898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.042194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.042657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.043095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.176777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:52.183597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:52.190200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.190693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.191129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.191836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.192296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.192726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.202899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:52.210898 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-321bc8e8-8c61-453f-9ff1-f011d6b9ace5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.183656 Sep 13 16:34:52.211401 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 613/1265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:52 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:52.216473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c87a1a3-b6f0-4156-9094-15e0d132f9fc", "name": "network-vif-deleted", "tag": "1aca45e0-ff26-4c64-a5af-e7d049b8acc9"}, {"server_uuid": "f185f77c-94f1-429e-9782-ce89ae81a742", "name": "network-vif-deleted", "tag": "12c3a7a0-d1b0-4535-884d-bb214b9e8898"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:52.227869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.228355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.229354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.243027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] Creating event network-vif-deleted:1aca45e0-ff26-4c64-a5af-e7d049b8acc9 for instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc on n-h2-857467-1 Sep 13 16:34:52.243830 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] Creating event network-vif-deleted:12c3a7a0-d1b0-4535-884d-bb214b9e8898 for instance f185f77c-94f1-429e-9782-ce89ae81a742 on n-h2-857467-1 Sep 13 16:34:52.251639 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-def597d4-8540-4929-aa91-4c8ef4c01ddf req-baeb1f5e-5ab6-4a6f-b943-fdd87e2f0d99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038815 Sep 13 16:34:52.252279 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 614/1266] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:52.337712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:52.346226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-56862429-a41f-4754-9df2-dc5c4a7b0800 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.173400 Sep 13 16:34:52.346813 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 653/1267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:52 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:52.476924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:52.477637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:52.484442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.484934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.485380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.486118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.486583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.487018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.520762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.521254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.521700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.522184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lazy-loading 'fault' on Instance uuid 5c87a1a3-b6f0-4156-9094-15e0d132f9fc {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:52.566359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:52.574592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad42efb2-297e-4b63-9d01-ecadd0a14af2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1303 microversion: 2.1 time: 0.102428 Sep 13 16:34:52.575166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 615/1268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:52 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:52.663675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:52.664326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] [instance: 4cf023ce-75bf-46cd-87e1-a5913fc20ab0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:52.671055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.671548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.671997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.672838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.673156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.673589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.684366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:52.684995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:52.687176 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] HTTP exception thrown: Instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 could not be found. Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Request method failure captured: Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 HTTP/1.1 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB8l0gcnKyaW8c54l8wnBQDlhovAJTTQjLCzcC5hBAsHRGOXrEm4tFmSOkEOs2f3Wjzy8UbN26WNWWdhUSVmqNNX-tQNtF2rgKhnWOcR2Bh5cElLOPbswwiqMZY4U_EdWCyqJStJ26jbzVnuBERd3O6AWYPzYLGCO6Cnd2XyahI6D8 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: fd7b2634429c46c1ac366579351c3389 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd7b2634429c46c1ac366579351c3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd7b2634429c46c1ac366579351c3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: fd7b2634429c46c1ac366579351c3389 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdminTestJSON-1866691583 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdminTestJSON-1866691583-project Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 76067e188d0047d8939862b78f0abea9 Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdminTestJSON-1866691583-project Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 could not be found. Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4cf023ce-75bf-46cd-87e1-a5913fc20ab0'} Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 could not be found. Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 could not be found. Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:52.688860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 could not be found. Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] Returning 404 to user: Instance 4cf023ce-75bf-46cd-87e1-a5913fc20ab0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63b6318b-9f18-42f3-be72-9d0d91b77379 tempest-ServersAdminTestJSON-1866691583 tempest-ServersAdminTestJSON-1866691583-project] 10.222.0.61 "GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0" status: 404 len: 111 microversion: 2.1 time: 0.030539 Sep 13 16:34:52.693601 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 654/1269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:52 2022] GET /compute/v2.1/servers/4cf023ce-75bf-46cd-87e1-a5913fc20ab0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:52.694648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.694648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.694648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.694648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.694648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.695617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.727383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:52.727898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:52.728345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:52.728799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid f185f77c-94f1-429e-9782-ce89ae81a742 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:52.774581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:52.783465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a7af1aa-fe10-40c0-9f39-82e87140a8ed tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1307 microversion: 2.1 time: 0.103023 Sep 13 16:34:52.784411 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 616/1270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:52 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:53.234063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:53.234819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:53.241377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.241896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.242340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.243029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.243484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.243913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.369890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:53.370790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:53.377033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.377625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.378134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.378899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.379864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.380355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.383909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:53.392253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-297decbe-61b5-44d2-90ff-e8fc93636163 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.162322 Sep 13 16:34:53.392842 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 655/1271] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:53 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:53.515540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:53.523593 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-042a8df0-7ed1-49b3-9664-513e19cffc70 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.157602 Sep 13 16:34:53.524172 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 617/1272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:53 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:53.598451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:53.599062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:53.605587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.606114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.606553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.607256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.607710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.608147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.642309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.642803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.643244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.643766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lazy-loading 'fault' on Instance uuid 5c87a1a3-b6f0-4156-9094-15e0d132f9fc {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:53.691432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:53.699768 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-edc3fede-8970-49fa-9ac5-306fff659edc tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1303 microversion: 2.1 time: 0.105139 Sep 13 16:34:53.700348 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 656/1273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:53 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:53.806370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:53.807798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:53.813698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.814221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.814658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.815352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.815811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.816241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.849122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:53.849650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:53.850137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:53.850616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid f185f77c-94f1-429e-9782-ce89ae81a742 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:53.892472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:53.901335 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78541efe-9cba-4f9f-a876-5bfe82880da1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1307 microversion: 2.1 time: 0.098259 Sep 13 16:34:53.901959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 618/1274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:53 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:54.416002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:54.416979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:54.424285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.424855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.425359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.426163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.426622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.427046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.555960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:54.558717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:54.575445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:54.581016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.581514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.581989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.587622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.589537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.590182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.592287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f1e5aa4-95b6-4d89-8e79-3dbacc606fdc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.180664 Sep 13 16:34:54.598414 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 657/1275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:54 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:54.725019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:54.726116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:54.736149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.740191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.740814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.742355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.746039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.747758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.755008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:54.765312 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35d9e001-ccfb-4270-b6be-c81dac3470e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.221580 Sep 13 16:34:54.766359 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 619/1276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:54 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:54.785621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.787143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.787837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.788441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lazy-loading 'fault' on Instance uuid 5c87a1a3-b6f0-4156-9094-15e0d132f9fc {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:54.857278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87575b0c830464695e168873145ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0136fccf2da48be91b87cc0e501a571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:54.874517 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca7c04df-89e1-4624-970f-68632bf56c56 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 200 len: 1303 microversion: 2.1 time: 0.155211 Sep 13 16:34:54.889872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 658/1277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:54 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:54.924739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:54.925368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:54.931549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.933108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.933839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.934743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.935366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.935954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.972180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:54.972968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:54.974120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:54.974856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid f185f77c-94f1-429e-9782-ce89ae81a742 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:34:55.024633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:55.033016 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88d74841-0bf8-47a9-9968-bee8fe6aea49 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 200 len: 1307 microversion: 2.1 time: 0.112624 Sep 13 16:34:55.034100 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 620/1278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:54 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:55.243441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-998134043", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:55.315708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:34:55.455857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4e141d63-443f-44ce-996f-120b3f220354 req-4e8c7228-d9d3-4e83-b6d0-b6083055e621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:55.469596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4e141d63-443f-44ce-996f-120b3f220354 req-4e8c7228-d9d3-4e83-b6d0-b6083055e621 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.472021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4e141d63-443f-44ce-996f-120b3f220354 req-4e8c7228-d9d3-4e83-b6d0-b6083055e621 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.473415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4e141d63-443f-44ce-996f-120b3f220354 req-4e8c7228-d9d3-4e83-b6d0-b6083055e621 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.486735 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4e141d63-443f-44ce-996f-120b3f220354 req-4e8c7228-d9d3-4e83-b6d0-b6083055e621 service nova] Creating event network-changed:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h2-857467-1 Sep 13 16:34:55.491838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4e141d63-443f-44ce-996f-120b3f220354 req-4e8c7228-d9d3-4e83-b6d0-b6083055e621 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040065 Sep 13 16:34:55.492541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 621/1279] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:34:55.622258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:55.622967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:55.626571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:34:55.627010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:34:55.627466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:34:55.627885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:34:55.628303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:34:55.629738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.630268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.630707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.631410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.631875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.632308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.638665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.639191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.639637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.640420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.640919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.641603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.659092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Getting quotas for project 409ba2c2d1584f149ae92325c5261aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:34:55.664447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Getting quotas for user 2304cb72a88f454a9b4a0ce7f8e37174 and project 409ba2c2d1584f149ae92325c5261aa1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:34:55.667482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:55.680832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:34:55.684056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:34:55.732952 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25a6b01b-9ff9-4d24-b186-23366b68f182 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619293 Sep 13 16:34:55.740039 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 659/1280] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:34:55.745723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6dc66a2-5d23-439d-b8ab-5f61c7e39296 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:55.746368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a6dc66a2-5d23-439d-b8ab-5f61c7e39296 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:55.774822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:55.783825 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c27f6700-8ae7-4e7b-a03b-5267b492b47a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.166820 Sep 13 16:34:55.784447 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 622/1281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:55 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:55.789554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:55.790474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:55.797437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.798222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.798907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.799826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.800504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.801219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.816175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6dc66a2-5d23-439d-b8ab-5f61c7e39296 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:55.825417 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6dc66a2-5d23-439d-b8ab-5f61c7e39296 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1213 microversion: 2.1 time: 0.084064 Sep 13 16:34:55.825609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:55.826041 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 660/1282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:55 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:55.899661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:55.900292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:55.912353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.912866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.913479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.917063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:55.917690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:55.919309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:55.954274 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] HTTP exception thrown: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Request method failure captured: Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc HTTP/1.1 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILC8mApAnqIbLHSZyUwr5lllNf--_UG1OI0_gBEAXHABuj3CWB7tOL6QbZnwyP8m_YU0JFSUA9vU1m2HrUXkkzQfMVr4sSGOWNDnIewv_Br3BJwVw4CyNAIuNXjPNKPHiEDY0c5giY-LWSh37BsATVMYMsjw70-PZ80Rjt6HQouQcLw Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a87575b0c830464695e168873145ba5b Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5c87a1a3-b6f0-4156-9094-15e0d132f9fc'} Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:55.956361 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:55.960517 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:55.962796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Returning 404 to user: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:55.964351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17cc24dc-df84-47a5-924c-fa793c919ec2 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 404 len: 111 microversion: 2.1 time: 0.068595 Sep 13 16:34:55.968185 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 661/1283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:55 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:55.975475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:55.988301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3cc14d74-e622-4353-b7ba-7661e542b5c2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.202713 Sep 13 16:34:56.001500 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 623/1284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:55 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:56.059715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:56.059949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: f185f77c-94f1-429e-9782-ce89ae81a742] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:56.066255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.066757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.067201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.067930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.068380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.068815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.084342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance f185f77c-94f1-429e-9782-ce89ae81a742 could not be found. Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 HTTP/1.1 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance f185f77c-94f1-429e-9782-ce89ae81a742 could not be found. Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'f185f77c-94f1-429e-9782-ce89ae81a742'} Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f185f77c-94f1-429e-9782-ce89ae81a742 could not be found. Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f185f77c-94f1-429e-9782-ce89ae81a742 could not be found. Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:56.085917 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f185f77c-94f1-429e-9782-ce89ae81a742 could not be found. Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance f185f77c-94f1-429e-9782-ce89ae81a742 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:56.090530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-161af992-de22-4583-9793-c22d17095696 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742" status: 404 len: 111 microversion: 2.1 time: 0.033315 Sep 13 16:34:56.096784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:56.097288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:56.102370 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 662/1285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:56 2022] GET /compute/v2.1/servers/f185f77c-94f1-429e-9782-ce89ae81a742 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:56.104922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.105700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.106177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.106932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.107416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.108076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.136449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:34:56.241637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98fa05e7-9276-4f25-8de1-bc4dd46c6bb1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 204 len: 0 microversion: 2.1 time: 0.148294 Sep 13 16:34:56.242513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 624/1286] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:56 2022] DELETE /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:34:56.251664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:56.252287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:56.261105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.261906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.262414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.263145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.263608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.264042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.414412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:56.424356 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4c0e5518-8eb6-49e7-aab3-627a89302442 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1473 microversion: 2.1 time: 0.176581 Sep 13 16:34:56.425593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 663/1287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:56 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:56.814061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:56.814799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:56.821361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.821883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.822341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.823811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.824298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.824734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.848440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:56.849053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:56.855970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.856700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.857136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.857857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:56.858307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:56.858937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:56.921108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:56.923708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:56.930573 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6edac5e-9452-496a-b988-c58861443708 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1217 microversion: 2.1 time: 0.085918 Sep 13 16:34:56.931190 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 664/1288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:56 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:57.017746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:57.018558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:57.028736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:57.030237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:57.030861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:57.031756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:57.032426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:57.034223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:57.080999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:57.118386 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4230961f-0ca5-4eb5-ab6b-afee17c9c075 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.308516 Sep 13 16:34:57.122141 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 625/1289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:56 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:57.297633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:57.307132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62d02529-16d7-4a5d-8cfc-b90ea4d44c5d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.298036 Sep 13 16:34:57.307729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 665/1290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:57 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:57.448108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:57.449186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:57.455610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:57.456110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:57.456548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:57.457260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:57.457729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:57.458192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:57.480734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:57.632865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:57.636358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:34:57.645810 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a035d762-5b5d-4052-b0d1-1bcfd4901ee1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1473 microversion: 2.1 time: 0.201836 Sep 13 16:34:57.647788 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 626/1291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:57 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1473 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:57.957083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:57.958718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:57.965888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:57.966731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:57.967393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:57.968355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:57.969053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:57.969974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.080381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:58.089507 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be94d171-8834-4f02-989a-20f8e6553f9b tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1209 microversion: 2.1 time: 0.137306 Sep 13 16:34:58.094736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 666/1292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:57 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1209 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:58.146445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.147344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.156307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.157079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.157535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.159404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.159883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.160323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.206851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.207655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.217415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.217947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.218387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.222760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.223430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.223881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.238899 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] HTTP exception thrown: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Request method failure captured: Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc HTTP/1.1 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILC8mApAnqIbLHSZyUwr5lllNf--_UG1OI0_gBEAXHABuj3CWB7tOL6QbZnwyP8m_YU0JFSUA9vU1m2HrUXkkzQfMVr4sSGOWNDnIewv_Br3BJwVw4CyNAIuNXjPNKPHiEDY0c5giY-LWSh37BsATVMYMsjw70-PZ80Rjt6HQouQcLw Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a87575b0c830464695e168873145ba5b Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5c87a1a3-b6f0-4156-9094-15e0d132f9fc'} Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:58.240860 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.246229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.250169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Returning 404 to user: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:58.251286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2fe96e76-ee1f-4fa5-91d6-3c3c44a8d533 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 404 len: 111 microversion: 2.1 time: 0.048099 Sep 13 16:34:58.251608 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 667/1293] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:58 2022] DELETE /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:58.260266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.261624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 5c87a1a3-b6f0-4156-9094-15e0d132f9fc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.269138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.269631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.270117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.270943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.271557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.271991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.287418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] HTTP exception thrown: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Request method failure captured: Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc HTTP/1.1 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILC8mApAnqIbLHSZyUwr5lllNf--_UG1OI0_gBEAXHABuj3CWB7tOL6QbZnwyP8m_YU0JFSUA9vU1m2HrUXkkzQfMVr4sSGOWNDnIewv_Br3BJwVw4CyNAIuNXjPNKPHiEDY0c5giY-LWSh37BsATVMYMsjw70-PZ80Rjt6HQouQcLw Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a87575b0c830464695e168873145ba5b Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5c87a1a3-b6f0-4156-9094-15e0d132f9fc'} Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.289042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Returning 404 to user: Instance 5c87a1a3-b6f0-4156-9094-15e0d132f9fc could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-937a4c60-6c37-4a88-a9f0-3a079b9f8d01 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc" status: 404 len: 111 microversion: 2.1 time: 0.034758 Sep 13 16:34:58.293701 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 668/1294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:58 2022] GET /compute/v2.1/servers/5c87a1a3-b6f0-4156-9094-15e0d132f9fc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:34:58.299525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.299982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.305897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.306387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.307478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.308347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.308811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.309236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.322970 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] HTTP exception thrown: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Request method failure captured: Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 HTTP/1.1 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILC8mApAnqIbLHSZyUwr5lllNf--_UG1OI0_gBEAXHABuj3CWB7tOL6QbZnwyP8m_YU0JFSUA9vU1m2HrUXkkzQfMVr4sSGOWNDnIewv_Br3BJwVw4CyNAIuNXjPNKPHiEDY0c5giY-LWSh37BsATVMYMsjw70-PZ80Rjt6HQouQcLw Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a87575b0c830464695e168873145ba5b Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6'} Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:58.324535 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Returning 404 to user: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:58.329872 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ea4dcaa-fa33-4d3b-9d94-a3a4b35a4614 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 404 len: 111 microversion: 2.1 time: 0.030428 Sep 13 16:34:58.330749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:58.330951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 669/1295] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:34:58 2022] DELETE /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:34:58.334339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.334949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.335997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6c42105-7faa-4d01-a288-c39c7e7384c2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.193779 Sep 13 16:34:58.336578 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 627/1296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:58 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:58.341763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.342298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.342735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.343461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.343889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.344312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.345582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.346227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] [instance: 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.355305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.355826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.356267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.357309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.358615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.358615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.380408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] HTTP exception thrown: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Request method failure captured: Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 HTTP/1.1 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILC8mApAnqIbLHSZyUwr5lllNf--_UG1OI0_gBEAXHABuj3CWB7tOL6QbZnwyP8m_YU0JFSUA9vU1m2HrUXkkzQfMVr4sSGOWNDnIewv_Br3BJwVw4CyNAIuNXjPNKPHiEDY0c5giY-LWSh37BsATVMYMsjw70-PZ80Rjt6HQouQcLw Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a0136fccf2da48be91b87cc0e501a571"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a0136fccf2da48be91b87cc0e501a571 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestMultiNic-744521204 Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a87575b0c830464695e168873145ba5b Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestMultiNic-744521204-project Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6'} Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:34:58.382255 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] Returning 404 to user: Instance 1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-735ef80a-d83a-4c9b-b843-e20b248ae081 tempest-ServersTestMultiNic-744521204 tempest-ServersTestMultiNic-744521204-project] 10.222.0.61 "GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6" status: 404 len: 111 microversion: 2.1 time: 0.042312 Sep 13 16:34:58.386976 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 628/1297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:58 2022] GET /compute/v2.1/servers/1fb6aaf9-b6ee-40f9-a78e-30efd61c8bb6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:34:58.489435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:58.497974 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a82a6da0-e924-43c2-bf12-3536f277851d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.167161 Sep 13 16:34:58.498560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 670/1298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:58 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:58.671773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:58.672414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:58.679314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.679804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.680241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.680934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:58.681390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:58.682436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:58.930700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:58.939260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf3bd713-c396-4796-bdb0-5c4620f448b4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1473 microversion: 2.1 time: 0.272591 Sep 13 16:34:58.940009 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 629/1299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:58 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:59.115668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:59.116288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:59.133441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.133973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.134417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.135728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.136186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.136619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.198325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:59.206025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e37fa932-e887-44e7-808f-b5514120f833 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1209 microversion: 2.1 time: 0.094208 Sep 13 16:34:59.206599 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 671/1300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:59 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:59.361388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:59.362036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:59.369569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.370252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.370767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.371545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.372242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.372741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.446428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1f54ad53-fb1f-4c8f-a1c2-33cc93f77f61 req-4792adce-ccb2-4c50-a48a-ae15d286d360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af1ff17-c9a7-4884-a14f-cf19ab92e5e9", "name": "network-vif-plugged", "status": "completed", "tag": "b85d6229-5594-4441-8f64-63c4a4b3c750"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:34:59.466792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1f54ad53-fb1f-4c8f-a1c2-33cc93f77f61 req-4792adce-ccb2-4c50-a48a-ae15d286d360 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.467291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1f54ad53-fb1f-4c8f-a1c2-33cc93f77f61 req-4792adce-ccb2-4c50-a48a-ae15d286d360 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.467876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1f54ad53-fb1f-4c8f-a1c2-33cc93f77f61 req-4792adce-ccb2-4c50-a48a-ae15d286d360 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.482106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1f54ad53-fb1f-4c8f-a1c2-33cc93f77f61 req-4792adce-ccb2-4c50-a48a-ae15d286d360 service nova] Creating event network-vif-plugged:b85d6229-5594-4441-8f64-63c4a4b3c750 for instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 on n-h2-857467-1 Sep 13 16:34:59.488764 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1f54ad53-fb1f-4c8f-a1c2-33cc93f77f61 req-4792adce-ccb2-4c50-a48a-ae15d286d360 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047050 Sep 13 16:34:59.489369 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 672/1301] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:34:59.523805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:59.524773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:59.532391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.533040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.533510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.534250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.534703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.535129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.600654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:59.610506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff1e79a3-2583-4127-82e9-989d0ee4fa02 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.253996 Sep 13 16:34:59.619707 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 630/1302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:59 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:34:59.684786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:34:59.692700 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-254e2498-d922-421f-a5ae-87a507ebe72e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.174052 Sep 13 16:34:59.693272 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 673/1303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:59 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:34:59.963899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:34:59.964414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:34:59.970800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.971288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.971730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:34:59.972683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:34:59.973226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:34:59.973663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.193502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:00.202856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00281535-df62-49cc-99f2-68e9428a4ab1 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1473 microversion: 2.1 time: 0.243591 Sep 13 16:35:00.203442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 631/1304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:34:59 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1473 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:00.229216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:00.230533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:00.237293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:00.238581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:00.239339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.240614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:00.241728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:00.242380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.313446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:00.321667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f8d4133-9ce6-43fa-8d76-853caf9fff51 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1209 microversion: 2.1 time: 0.096848 Sep 13 16:35:00.323448 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 674/1305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:00 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:00.633530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:00.634365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:00.640770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:00.641253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:00.641694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.642414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:00.642869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:00.643285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.717006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:00.717861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:00.734334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:00.738318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:00.739391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.740230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:00.740797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:00.741334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:00.972675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:00.992391 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03de274c-a837-4771-9af9-4c4b78ee4ed2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.362938 Sep 13 16:35:00.993958 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 632/1306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:00 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:01.226978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:01.228032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:01.235067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:01.236332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:01.236850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:01.237810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:01.238513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:01.239030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:01.402371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:01.428369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66aa816d-d0c4-4fea-894c-a9988faad17d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.713823 Sep 13 16:35:01.430284 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 675/1307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:00 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:01.446443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:01.447432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:01.465645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:01.466594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:01.467235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:01.468072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:01.468968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:01.471003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:01.479445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:01.489276 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f1339d8b-83f1-42e9-b607-aef3d593e527 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1473 microversion: 2.1 time: 0.266325 Sep 13 16:35:01.491611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 633/1308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:01 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1473 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:01.599011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-28809be0-a080-4ef5-8477-cd2be1ca28d5 req-c86f7c8f-7a3c-4d10-86b0-cfa4f657785a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4406cd-de58-4a5f-b59c-496bad570197", "name": "network-vif-deleted", "tag": "acc2459c-3b15-4aa6-91fb-30309b1cd7ab"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:01.609355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28809be0-a080-4ef5-8477-cd2be1ca28d5 req-c86f7c8f-7a3c-4d10-86b0-cfa4f657785a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:01.610057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28809be0-a080-4ef5-8477-cd2be1ca28d5 req-c86f7c8f-7a3c-4d10-86b0-cfa4f657785a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:01.610477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28809be0-a080-4ef5-8477-cd2be1ca28d5 req-c86f7c8f-7a3c-4d10-86b0-cfa4f657785a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:01.624261 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-28809be0-a080-4ef5-8477-cd2be1ca28d5 req-c86f7c8f-7a3c-4d10-86b0-cfa4f657785a service nova] Creating event network-vif-deleted:acc2459c-3b15-4aa6-91fb-30309b1cd7ab for instance 2b4406cd-de58-4a5f-b59c-496bad570197 on n-h2-857467-1 Sep 13 16:35:01.630439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-28809be0-a080-4ef5-8477-cd2be1ca28d5 req-c86f7c8f-7a3c-4d10-86b0-cfa4f657785a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035349 Sep 13 16:35:01.631362 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 634/1309] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:01.655577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:01.666746 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2491e5ba-ca10-495a-af30-3f59ceab8dab tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1265 microversion: 2.1 time: 0.233008 Sep 13 16:35:01.667997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 676/1310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:01 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:02.020248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:02.021087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:02.041866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.042380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.042826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.043793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.049239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.049930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.302349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:02.315400 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32615933-ceb0-4990-8278-a4160d0a4d16 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1359 microversion: 2.1 time: 0.301254 Sep 13 16:35:02.316926 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 635/1311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:02 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:02.457819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:02.458562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:02.469083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.469848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.470644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.471586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.473230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.474974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.522737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:02.530052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:02.558920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.559753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.560263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.561145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.570492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.570986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.641814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.642339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.642784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.643241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid 2b4406cd-de58-4a5f-b59c-496bad570197 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:02.755538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:02.774221 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b801834-34e0-4ae3-b244-4eb4ecd62dc6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 200 len: 1307 microversion: 2.1 time: 0.261931 Sep 13 16:35:02.789854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:02.789854 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c67cd62c-6dea-45e2-8f69-18cbbb7eaf00 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.337027 Sep 13 16:35:02.789854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 677/1312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:02 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:02.792639 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 636/1313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:02 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:02.800259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:02.800922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:02.818449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.819134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.819576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.820630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:02.820771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:02.821177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:02.918212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:02.926364 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-54acac24-dad8-4b01-a9a2-3a90d976b8d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1283 microversion: 2.1 time: 0.137854 Sep 13 16:35:02.926968 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 678/1314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:02 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:03.340854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:03.342212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:03.349116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.349883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.350511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.351579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.353218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.354644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.570258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:03.578886 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-024b1215-0892-4438-bdbc-1bdb296b22fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1541 microversion: 2.1 time: 0.242828 Sep 13 16:35:03.580291 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 637/1315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:03 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1541 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:03.604390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:03.605454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:03.613097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.613936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.614571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.615709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.616335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.617031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.738591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7f088c4d-30a3-4e53-806a-6d41296cdbfb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139200 Sep 13 16:35:03.739447 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 679/1316] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:35:03 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:03.803999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:03.804588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 2b4406cd-de58-4a5f-b59c-496bad570197] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:03.815114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:03.815750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:03.815991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.816653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.817384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.818444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.819554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.820000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.826789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.827298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.827734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.831686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.833685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.834279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.839253 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance 2b4406cd-de58-4a5f-b59c-496bad570197 could not be found. Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 HTTP/1.1 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 2b4406cd-de58-4a5f-b59c-496bad570197 could not be found. Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '2b4406cd-de58-4a5f-b59c-496bad570197'} Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b4406cd-de58-4a5f-b59c-496bad570197 could not be found. Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b4406cd-de58-4a5f-b59c-496bad570197 could not be found. Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:03.842749 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b4406cd-de58-4a5f-b59c-496bad570197 could not be found. Sep 13 16:35:03.848281 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:03.850529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance 2b4406cd-de58-4a5f-b59c-496bad570197 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:03.851769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2e0eb20-f003-4ebb-8031-f23e8533ac78 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197" status: 404 len: 111 microversion: 2.1 time: 0.053706 Sep 13 16:35:03.853018 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 638/1317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:03 2022] GET /compute/v2.1/servers/2b4406cd-de58-4a5f-b59c-496bad570197 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:03.872887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:03.873917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:03.882057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.882846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.883570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.884577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:03.886362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:03.887141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:03.924436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:03.927842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:04.094752 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df4997d6-eedd-418a-b63c-f2b012c91694 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 204 len: 0 microversion: 2.1 time: 0.234163 Sep 13 16:35:04.096034 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 639/1318] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:03 2022] DELETE /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:04.107989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:04.108768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:04.115501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:04.117192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:04.117690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:04.118160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:04.118887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:04.120857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:04.121304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:04.131370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:04.141535 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b3970c9-7a3f-48ea-adc1-662cf6b959a7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.332766 Sep 13 16:35:04.142162 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 680/1319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:03 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:04.161331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:04.162140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:04.177294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:04.178165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:04.178652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:04.179328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:04.179793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:04.180255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:04.261605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:04.392029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-48276c3d-5ead-412d-9288-8d8180cfb697 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 204 len: 0 microversion: 2.1 time: 0.236734 Sep 13 16:35:04.392924 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 681/1320] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:04 2022] DELETE /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:04.404696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:04.405413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:04.412349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:04.420860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:04.421808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:04.422339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:04.423095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:04.423681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:04.423811 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d890b2c-9d4d-4a72-add3-ddd140521e7d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.326490 Sep 13 16:35:04.424024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:04.424331 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 640/1321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:04 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:04.757302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:04.759720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:04.768284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-043f2520-c4f5-4c15-a6cf-311ad2331f1a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1474 microversion: 2.1 time: 0.370480 Sep 13 16:35:04.769024 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 682/1322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:04 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:05.165456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:05.166761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:05.183883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.184731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.185613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.186585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.187220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.187992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.361925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e1bebb89-a6de-4c63-a436-efe3da61301b req-c853890d-946f-4906-94b1-04a39999663d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af1ff17-c9a7-4884-a14f-cf19ab92e5e9", "tag": "b85d6229-5594-4441-8f64-63c4a4b3c750"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:05.373944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e1bebb89-a6de-4c63-a436-efe3da61301b req-c853890d-946f-4906-94b1-04a39999663d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.374710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e1bebb89-a6de-4c63-a436-efe3da61301b req-c853890d-946f-4906-94b1-04a39999663d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.375297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e1bebb89-a6de-4c63-a436-efe3da61301b req-c853890d-946f-4906-94b1-04a39999663d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.392734 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e1bebb89-a6de-4c63-a436-efe3da61301b req-c853890d-946f-4906-94b1-04a39999663d service nova] Creating event network-changed:b85d6229-5594-4441-8f64-63c4a4b3c750 for instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 on n-h2-857467-1 Sep 13 16:35:05.400582 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e1bebb89-a6de-4c63-a436-efe3da61301b req-c853890d-946f-4906-94b1-04a39999663d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042125 Sep 13 16:35:05.401631 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 683/1323] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:05.449421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:05.468802 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-57ddd75c-4b74-46c0-9517-de41fa624c2a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.307687 Sep 13 16:35:05.485855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 641/1324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:05 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:05.486229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:05.486229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:05.486229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.486229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.488294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.489583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.490146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.490964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.519484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f131465c-4b14-42e2-bb0f-99ef76fe9981 req-a0a1557c-323b-402c-a7ae-168502daf162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "name": "network-vif-plugged", "status": "completed", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:05.532795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f131465c-4b14-42e2-bb0f-99ef76fe9981 req-a0a1557c-323b-402c-a7ae-168502daf162 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.533478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f131465c-4b14-42e2-bb0f-99ef76fe9981 req-a0a1557c-323b-402c-a7ae-168502daf162 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.534146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f131465c-4b14-42e2-bb0f-99ef76fe9981 req-a0a1557c-323b-402c-a7ae-168502daf162 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.550926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f131465c-4b14-42e2-bb0f-99ef76fe9981 req-a0a1557c-323b-402c-a7ae-168502daf162 service nova] Creating event network-vif-plugged:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h2-857467-1 Sep 13 16:35:05.557960 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f131465c-4b14-42e2-bb0f-99ef76fe9981 req-a0a1557c-323b-402c-a7ae-168502daf162 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044808 Sep 13 16:35:05.559977 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 642/1325] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:05.650032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:05.797658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:05.798535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:05.798922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:05.809037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3f388e4-80b3-4f9c-b8c6-8cd30696306d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.344745 Sep 13 16:35:05.811270 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 684/1326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:05 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:05.817321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.817854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.818307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:05.819068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:05.819533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:05.819969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:06.498415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:06.499323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:06.501523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:06.513359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:06.513880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:06.514500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:06.515460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:06.516073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:06.516656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:06.622116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:06.634113 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa6d6fde-339e-466d-9621-2e33f7ed750b tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1474 microversion: 2.1 time: 0.845079 Sep 13 16:35:06.636195 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 643/1327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:05 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1474 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:06.802315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:06.817290 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1efa6b82-e6d2-4b36-bd07-1dd08bc5b27e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.323342 Sep 13 16:35:06.832054 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 685/1328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:06 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:06.842293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:06.842915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:06.854324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:06.855255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:06.856801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:06.857869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:06.860246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:06.861613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:07.423060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-691016c4-c025-4dad-935d-ca37087eb1f0 req-39371717-dbdd-4ac1-a160-18654aede6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f713f51-2900-40e9-982b-5a9b17a5729e", "name": "network-vif-deleted", "tag": "239148a0-6245-4c20-8507-36285e1996c2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:07.444275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-691016c4-c025-4dad-935d-ca37087eb1f0 req-39371717-dbdd-4ac1-a160-18654aede6fe service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:07.445142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-691016c4-c025-4dad-935d-ca37087eb1f0 req-39371717-dbdd-4ac1-a160-18654aede6fe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:07.445880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-691016c4-c025-4dad-935d-ca37087eb1f0 req-39371717-dbdd-4ac1-a160-18654aede6fe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:07.456936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:07.468712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b99ff44a-44b5-48c1-912e-07e370b5c529 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.638121 Sep 13 16:35:07.469132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-691016c4-c025-4dad-935d-ca37087eb1f0 req-39371717-dbdd-4ac1-a160-18654aede6fe service nova] Creating event network-vif-deleted:239148a0-6245-4c20-8507-36285e1996c2 for instance 3f713f51-2900-40e9-982b-5a9b17a5729e on n-h1-857467-1 Sep 13 16:35:07.469379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 644/1329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:06 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:07.488984 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-691016c4-c025-4dad-935d-ca37087eb1f0 req-39371717-dbdd-4ac1-a160-18654aede6fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069397 Sep 13 16:35:07.489682 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 686/1330] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:07.662479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:07.663861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:07.693622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:07.696534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:07.697397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:07.700008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:07.702559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:07.703418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:07.747151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:07.747882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:07.748556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:07.749228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid 3f713f51-2900-40e9-982b-5a9b17a5729e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:07.824448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:07.832402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d020d30e-e0f6-44a3-b5fd-a74be5ab8fe8 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 200 len: 1309 microversion: 2.1 time: 0.177438 Sep 13 16:35:07.833658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 645/1331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:07 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:07.850574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:07.851284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:07.859792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:07.860295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:07.860929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:07.861648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:07.862144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:07.862575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.003140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:08.012088 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-068be096-2722-4b0b-91be-7afe65510bd8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1379 microversion: 2.1 time: 0.171155 Sep 13 16:35:08.012677 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 687/1332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:07 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1379 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:08.106648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4f99b3cf-f328-4370-a1ca-e9a23ec1ab1a req-a7b422f1-fc95-4d6b-91af-640088f7dba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb790b17-b5c3-484b-81de-574c0f11fc05", "name": "network-vif-deleted", "tag": "19c1bc2a-b0a8-4c1b-b2b3-b4aa6fc503be"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:08.118566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4f99b3cf-f328-4370-a1ca-e9a23ec1ab1a req-a7b422f1-fc95-4d6b-91af-640088f7dba7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.120099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4f99b3cf-f328-4370-a1ca-e9a23ec1ab1a req-a7b422f1-fc95-4d6b-91af-640088f7dba7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.120836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4f99b3cf-f328-4370-a1ca-e9a23ec1ab1a req-a7b422f1-fc95-4d6b-91af-640088f7dba7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.135865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4f99b3cf-f328-4370-a1ca-e9a23ec1ab1a req-a7b422f1-fc95-4d6b-91af-640088f7dba7 service nova] Creating event network-vif-deleted:19c1bc2a-b0a8-4c1b-b2b3-b4aa6fc503be for instance fb790b17-b5c3-484b-81de-574c0f11fc05 on n-h2-857467-1 Sep 13 16:35:08.141437 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4f99b3cf-f328-4370-a1ca-e9a23ec1ab1a req-a7b422f1-fc95-4d6b-91af-640088f7dba7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039544 Sep 13 16:35:08.143510 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 646/1333] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:08.494065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:08.495384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:08.506424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.506985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.507611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.519685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.521315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.521791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.736694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:08.749291 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0d00a38-519e-46b5-a70c-8030f01f8095 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.260068 Sep 13 16:35:08.750365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 688/1334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:08 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:08.859550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:08.860337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 3f713f51-2900-40e9-982b-5a9b17a5729e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:08.872682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.873865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.874542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.875451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.876165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.876605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.896580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance 3f713f51-2900-40e9-982b-5a9b17a5729e could not be found. Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e HTTP/1.1 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3f713f51-2900-40e9-982b-5a9b17a5729e could not be found. Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3f713f51-2900-40e9-982b-5a9b17a5729e'} Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f713f51-2900-40e9-982b-5a9b17a5729e could not be found. Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f713f51-2900-40e9-982b-5a9b17a5729e could not be found. Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:08.900017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f713f51-2900-40e9-982b-5a9b17a5729e could not be found. Sep 13 16:35:08.906225 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:08.917427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance 3f713f51-2900-40e9-982b-5a9b17a5729e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:08.918466 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62a35426-e906-4941-a68f-96d071b4d9bc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e" status: 404 len: 111 microversion: 2.1 time: 0.065173 Sep 13 16:35:08.919061 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 647/1335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:08 2022] GET /compute/v2.1/servers/3f713f51-2900-40e9-982b-5a9b17a5729e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:08.928352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:08.929410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:08.936564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.937161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.937666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.938663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.939226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.939899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.977423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:08.977963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:08.978649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:08.979119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid fb790b17-b5c3-484b-81de-574c0f11fc05 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:09.024653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:09.035406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:09.036022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:09.036767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8eddbf38-1bf6-41f6-beaa-f6a687e842c3 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 200 len: 1309 microversion: 2.1 time: 0.113126 Sep 13 16:35:09.037592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 689/1336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:08 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:09.042033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.042517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.043265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.043627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.044086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.044522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.387718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:09.397661 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c075663-d5e2-4a68-9438-f404e3972e59 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1528 microversion: 2.1 time: 0.366010 Sep 13 16:35:09.398638 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 648/1337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:09 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1528 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:09.423997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:09.425037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:09.431338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.432546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.433234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.434059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.434589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.435290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.581634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:09.591817 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5dc96c2f-6b33-4dec-a91f-9c74a2f2297d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1528 microversion: 2.1 time: 0.175659 Sep 13 16:35:09.593102 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 690/1338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:09 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1528 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:09.617650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-970b5c1c-2d01-4c79-81af-94ab53d29335 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:09.643721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-970b5c1c-2d01-4c79-81af-94ab53d29335 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/fb9c7619-f0ea-4112-b8b9-d35db649113e" status: 202 len: 0 microversion: 2.1 time: 0.029585 Sep 13 16:35:09.655259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cf0fff5-a4d9-470d-9cc6-bbe02f44ac77 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:09.664665 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 649/1339] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:09 2022] DELETE /compute/v2.1/flavors/fb9c7619-f0ea-4112-b8b9-d35db649113e => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:35:09.680634 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cf0fff5-a4d9-470d-9cc6-bbe02f44ac77 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028525 Sep 13 16:35:09.690786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 691/1340] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:35:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:09.705458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:09.708153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:09.721303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.722165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.723413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.724459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.725987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.726688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.765754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:09.776100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:09.777541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:09.784725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Old instance type tempest-test_resize_flavor_-864882148, new instance type m1.heat {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 16:35:09.787839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.789856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.790550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.793135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.795579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.796312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.805779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:35:09.811689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:35:09.812943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:35:09.816496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:35:09.817208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:35:09.939293 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ca7e51d-66ee-429a-a51f-fd7749c4860c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88/action" status: 202 len: 0 microversion: 2.1 time: 0.239401 Sep 13 16:35:09.939926 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 650/1341] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:35:09 2022] POST /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:35:09.948768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:09.949403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:09.955714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.956441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.957051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.957991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:09.959790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:09.960390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:09.988557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:09.998075 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ec7690e-ba27-4fb0-897a-571e5a5af7d3 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.225926 Sep 13 16:35:10.021344 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 692/1342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:09 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:10.065727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:10.066620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: fb790b17-b5c3-484b-81de-574c0f11fc05] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:10.079469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.081234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.086146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.087100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.088287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.088962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.105710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance fb790b17-b5c3-484b-81de-574c0f11fc05 could not be found. Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 HTTP/1.1 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance fb790b17-b5c3-484b-81de-574c0f11fc05 could not be found. Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'fb790b17-b5c3-484b-81de-574c0f11fc05'} Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb790b17-b5c3-484b-81de-574c0f11fc05 could not be found. Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb790b17-b5c3-484b-81de-574c0f11fc05 could not be found. Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:10.107708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb790b17-b5c3-484b-81de-574c0f11fc05 could not be found. Sep 13 16:35:10.112133 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:10.113975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance fb790b17-b5c3-484b-81de-574c0f11fc05 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:10.115045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c48426c9-7ed5-4850-b1d0-23d45961e6ce tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05" status: 404 len: 111 microversion: 2.1 time: 0.056817 Sep 13 16:35:10.115955 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 693/1343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:10 2022] GET /compute/v2.1/servers/fb790b17-b5c3-484b-81de-574c0f11fc05 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:10.131014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e27ea5e4-b19f-4343-a6bf-4cb194e38130 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:10.173681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e27ea5e4-b19f-4343-a6bf-4cb194e38130 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/cfb868d3-0846-4b93-bb1d-82fc0706cfd7" status: 204 len: 0 microversion: 2.1 time: 0.052273 Sep 13 16:35:10.175065 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 694/1344] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:35:10 2022] DELETE /compute/v2.1/os-server-groups/cfb868d3-0846-4b93-bb1d-82fc0706cfd7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:10.187303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:10.188299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:10.194951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.195633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.196158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.197039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.197890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.198882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.240458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:10.279478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:10.290455 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66c264a0-a53a-4822-8c71-293efaef08e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1537 microversion: 2.1 time: 0.344091 Sep 13 16:35:10.295654 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 651/1345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:09 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1537 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:10.354613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:10.370182 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0da62923-97b4-475c-807a-ff82f2a9ff86 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 204 len: 0 microversion: 2.1 time: 0.189702 Sep 13 16:35:10.371404 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 695/1346] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:10 2022] DELETE /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:10.381865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:10.381865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:10.389775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.399253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.399862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.401632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.402621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.403736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.438934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:10.534969 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-612a9e4c-9c2d-4e9b-ad88-87802e7d33e6 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 204 len: 0 microversion: 2.1 time: 0.158504 Sep 13 16:35:10.536027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 652/1347] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:10 2022] DELETE /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:10.547238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:10.548236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:10.555487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.556827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.557893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.558902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.559562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.560205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.574420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-071229ec-efe6-4e40-8606-8adfa2a35e11 req-7215ca05-a083-4297-96a5-97ee0312ccb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b0ff4f-90c8-49c1-bfa1-80c91e45f473", "tag": "0c1fdeab-9962-4fac-bd62-633887708fc9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:10.591774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-071229ec-efe6-4e40-8606-8adfa2a35e11 req-7215ca05-a083-4297-96a5-97ee0312ccb5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:10.596304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-071229ec-efe6-4e40-8606-8adfa2a35e11 req-7215ca05-a083-4297-96a5-97ee0312ccb5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:10.596945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-071229ec-efe6-4e40-8606-8adfa2a35e11 req-7215ca05-a083-4297-96a5-97ee0312ccb5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:10.630095 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-071229ec-efe6-4e40-8606-8adfa2a35e11 req-7215ca05-a083-4297-96a5-97ee0312ccb5 service nova] Creating event network-changed:0c1fdeab-9962-4fac-bd62-633887708fc9 for instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 on n-h2-857467-1 Sep 13 16:35:10.638824 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-071229ec-efe6-4e40-8606-8adfa2a35e11 req-7215ca05-a083-4297-96a5-97ee0312ccb5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069410 Sep 13 16:35:10.640167 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 653/1348] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:10.780439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:10.792175 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-acce21b4-14d3-4db8-b078-f7349811e51f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1473 microversion: 2.1 time: 0.250066 Sep 13 16:35:10.803172 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 696/1349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:10 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:11.031166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:11.031995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:11.038788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:11.039384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:11.040236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:11.041234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:11.041967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:11.042653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:11.302621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:11.311044 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c7e6c0f-40ad-4d96-a2ed-d96b15d7166d tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.285890 Sep 13 16:35:11.311822 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 654/1350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:11 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:11.316719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:11.317329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:11.324502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:11.325151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:11.325746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:11.326647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:11.327103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:11.327527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:11.493587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:11.512774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5ac9aa1-032b-44c7-ba03-524a7234e0b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1537 microversion: 2.1 time: 0.199749 Sep 13 16:35:11.513395 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 697/1351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:11 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:11.818352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:11.819084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:11.827774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:11.828375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:11.828893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:11.829686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:11.830253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:11.830760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:11.837202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:12.205759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:12.214117 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ebd858da-f156-4681-8e3b-5429feea9d0d tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1473 microversion: 2.1 time: 0.399946 Sep 13 16:35:12.214801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 655/1352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:11 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:12.334473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:12.335259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:12.341328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:12.341903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:12.342438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:12.343058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:12.343514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:12.343940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:12.501987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:12.510865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f9e484b-eb22-44fa-8da7-a77010a8c2ec tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.180825 Sep 13 16:35:12.511452 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 698/1353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:12 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:12.536535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:12.536934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1323535997", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "a16cf007-124f-41ad-8590-f3708a57547d"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:12.537470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:12.544294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:12.544797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:12.545230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:12.546178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:12.546834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:12.547481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:12.601661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] validate_networks() for [('a16cf007-124f-41ad-8590-f3708a57547d', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:35:12.686010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:12.693577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c05f9163-2e3f-4350-aaa1-a244ebe6488f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1537 microversion: 2.1 time: 0.161056 Sep 13 16:35:12.694185 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 699/1354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:12 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:13.110770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:35:13.113420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:35:13.113962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:35:13.115771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:35:13.116202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:35:13.127283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.127774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.128245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.128987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.129705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.130160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.153875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Getting quotas for project 79168c543bf8428e9e76ebc13bdb7a15. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:35:13.160370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Getting quotas for user e3da4809a3864022b00c71c8f8f55f43 and project 79168c543bf8428e9e76ebc13bdb7a15. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:35:13.177207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:35:13.179701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:35:13.238340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:13.239050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:13.248222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.249092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.249914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.250934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.251532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.252267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.266474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b31d6a8-6be6-4ecd-ab22-65b4874e6614 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804057 Sep 13 16:35:13.268802 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 656/1355] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:35:13.281222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4741119a-7814-4fd1-b7c8-0f0d1b300d01 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:13.282649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4741119a-7814-4fd1-b7c8-0f0d1b300d01 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:13.357026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4741119a-7814-4fd1-b7c8-0f0d1b300d01 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:13.372145 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4741119a-7814-4fd1-b7c8-0f0d1b300d01 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1217 microversion: 2.1 time: 0.094565 Sep 13 16:35:13.374334 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 657/1356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:13 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:13.538917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:13.539646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:13.560781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.561974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.562736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.563964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.564787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.565874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.841948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:13.854176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ad202f3-758f-426e-8bdb-d21dd078d9c6 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.322438 Sep 13 16:35:13.877991 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 658/1357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:13 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:13.902853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:13.904126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:13.935539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.936057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.936502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:13.941755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:13.942385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:13.943684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.023652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:14.042997 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e8a85b7-7789-4e62-8b57-ff61c62a6fa4 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1473 microversion: 2.1 time: 0.808359 Sep 13 16:35:14.043591 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 700/1358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:13 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1473 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:14.048836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:14.049558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:14.076972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.081126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.095934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.119113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.120571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.122796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.147963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:14.172751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:14.239062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:14.250629 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-11ec3b28-c3ef-45dd-83d9-0cc8be0599be tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1537 microversion: 2.1 time: 0.370739 Sep 13 16:35:14.251350 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 659/1359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:13 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1537 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:14.286342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66341d77-02cd-472b-a510-37bdcf9d9e11 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 204 len: 0 microversion: 2.1 time: 0.240743 Sep 13 16:35:14.287396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 701/1360] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:14 2022] DELETE /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:14.295881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:14.296507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:14.303242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.303664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.304184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.304994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.305532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.305988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.400926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:14.402729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:14.434956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.445605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.448327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.450910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.452147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.452802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.468191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:14.484229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a6aafa3-0ee5-40a4-a58e-515d3d6c4567 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1715 microversion: 2.1 time: 0.192328 Sep 13 16:35:14.485185 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 660/1361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:14 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:14.606574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:14.621708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03b79766-e3c9-475b-82f3-205b6b8f2b6e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1221 microversion: 2.1 time: 0.228490 Sep 13 16:35:14.622366 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 702/1362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:14 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:14.842705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-542bd9af-f4d0-40d0-aa49-6696f32b13be req-0e10c6f9-8ac2-4160-a153-7d52f202c673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b984a09d-0655-47e7-9ede-734c8f6c11d2", "name": "network-vif-deleted", "tag": "3ac3e3aa-04f0-4793-a8b6-006ae37a4a69"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:14.856587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-542bd9af-f4d0-40d0-aa49-6696f32b13be req-0e10c6f9-8ac2-4160-a153-7d52f202c673 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.857519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-542bd9af-f4d0-40d0-aa49-6696f32b13be req-0e10c6f9-8ac2-4160-a153-7d52f202c673 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.858862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-542bd9af-f4d0-40d0-aa49-6696f32b13be req-0e10c6f9-8ac2-4160-a153-7d52f202c673 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.887932 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-542bd9af-f4d0-40d0-aa49-6696f32b13be req-0e10c6f9-8ac2-4160-a153-7d52f202c673 service nova] Creating event network-vif-deleted:3ac3e3aa-04f0-4793-a8b6-006ae37a4a69 for instance b984a09d-0655-47e7-9ede-734c8f6c11d2 on n-h1-857467-1 Sep 13 16:35:14.888505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:14.889622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:14.896313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-542bd9af-f4d0-40d0-aa49-6696f32b13be req-0e10c6f9-8ac2-4160-a153-7d52f202c673 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060187 Sep 13 16:35:14.898015 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 661/1363] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:14.898396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.898911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.899362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:14.900287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:14.900802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:14.901292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.078923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:15.079784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:15.082190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:15.086885 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6862ff3-b73f-4bc9-8a04-3c09e989bd5c tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.204969 Sep 13 16:35:15.088486 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 703/1364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:14 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:15.097236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.097954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.098911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.099783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.100536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.103893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.217925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:15.231425 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fba490c6-84e4-4dca-9b6f-aa9caae5f175 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1431 microversion: 2.1 time: 0.160325 Sep 13 16:35:15.233440 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 662/1365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:15 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1431 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:15.275636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:15.276358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:15.283518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.284336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.284997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.285982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.286519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.287026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.463887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:15.473026 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68b9999a-ebc8-4fd7-b4d5-b7cb026d1e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1537 microversion: 2.1 time: 0.201868 Sep 13 16:35:15.473707 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 704/1366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:15 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:15.508426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:15.509665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:15.515677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.516168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.516832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.517536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.518028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.518461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.652319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:15.653111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:15.661794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:15.662890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.663562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.664921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.666957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:15.667650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:15.668256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:15.671890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4461d4f6-1a85-4072-89bd-fe93ff6b2011 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1715 microversion: 2.1 time: 0.167623 Sep 13 16:35:15.672490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 663/1367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:15 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:15.823372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:15.831513 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6114e8ff-0f88-4625-b79e-5fe7a62d683e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1213 microversion: 2.1 time: 0.188990 Sep 13 16:35:15.832393 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 705/1368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:15 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:16.116377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:16.116651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:16.124140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.124631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.125070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.125770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.126255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.126676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.257303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:16.257951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:16.265805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.266335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.266770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.267488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.267946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.268377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.306944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:16.310399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.310893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.311330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.311782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid b984a09d-0655-47e7-9ede-734c8f6c11d2 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:16.315686 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b838ba8a-1896-4358-b085-85b2cc724a57 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.205185 Sep 13 16:35:16.316451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 664/1369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:16 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:16.359210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:16.367552 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33fd5192-11b7-41c9-85a8-3ba1806d1f15 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1308 microversion: 2.1 time: 0.115989 Sep 13 16:35:16.368365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 706/1370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:16 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:16.505162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:16.505986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:16.513760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.514532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.514886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.515843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.516412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.516921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.672097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:16.680095 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ab593cd-1f8e-419a-8f9c-541448e81e10 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.187336 Sep 13 16:35:16.680679 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 665/1371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:16 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:16.701260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:16.702150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:16.709313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.709816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.711098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.711250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.711637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.712069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.857458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:16.861308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:16.870491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.871516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.872143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.874562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:16.876485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:16.877364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:16.970084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:16.978480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c87afb6a-cce2-4c9b-a5dc-f8cf9198a946 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1715 microversion: 2.1 time: 0.280937 Sep 13 16:35:16.982557 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 707/1372] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:16 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1715 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:16.989050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0e129de8-8fa4-48d8-8797-0d7ba5044683 req-d8c36a54-b26b-4a10-b808-0d562fa9f0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8955426a-c06a-42e1-9082-fabd1426e8ed", "name": "network-vif-deleted", "tag": "2774dfb9-4912-4236-a39f-05bd4425a594"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:16.996762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:17.010484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8278cda-5dbb-4216-bed3-f53c680d8a75 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1269 microversion: 2.1 time: 0.158157 Sep 13 16:35:17.014508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0e129de8-8fa4-48d8-8797-0d7ba5044683 req-d8c36a54-b26b-4a10-b808-0d562fa9f0f0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.016598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0e129de8-8fa4-48d8-8797-0d7ba5044683 req-d8c36a54-b26b-4a10-b808-0d562fa9f0f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.016748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0e129de8-8fa4-48d8-8797-0d7ba5044683 req-d8c36a54-b26b-4a10-b808-0d562fa9f0f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.016870 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 666/1373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:16 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:17.037189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0e129de8-8fa4-48d8-8797-0d7ba5044683 req-d8c36a54-b26b-4a10-b808-0d562fa9f0f0 service nova] Creating event network-vif-deleted:2774dfb9-4912-4236-a39f-05bd4425a594 for instance 8955426a-c06a-42e1-9082-fabd1426e8ed on n-h1-857467-1 Sep 13 16:35:17.042599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0e129de8-8fa4-48d8-8797-0d7ba5044683 req-d8c36a54-b26b-4a10-b808-0d562fa9f0f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058545 Sep 13 16:35:17.043467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 708/1374] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:17.342494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:17.343964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:17.351692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.352385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.352879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.354593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.355486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.356175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.394374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:17.395489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:17.410837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.413564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.414187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.416314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.429384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.432539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.500463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.501595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.502282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.503108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid b984a09d-0655-47e7-9ede-734c8f6c11d2 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:17.563259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:17.572672 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7fb27371-ff89-4da5-8c27-b200b877e3a1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.236105 Sep 13 16:35:17.574983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 667/1375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:17 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:17.579781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:17.588954 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-02d4cfab-a5b7-405d-b810-56397eae774f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1308 microversion: 2.1 time: 0.200210 Sep 13 16:35:17.589767 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 709/1376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:17 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:17.644478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6ad7886c-81e5-4407-b5fa-677801008026 req-853875f7-eee1-4afd-afc7-fc343def2ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b0ff4f-90c8-49c1-bfa1-80c91e45f473", "name": "network-vif-plugged", "status": "completed", "tag": "0c1fdeab-9962-4fac-bd62-633887708fc9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:17.658232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6ad7886c-81e5-4407-b5fa-677801008026 req-853875f7-eee1-4afd-afc7-fc343def2ac5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.659046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6ad7886c-81e5-4407-b5fa-677801008026 req-853875f7-eee1-4afd-afc7-fc343def2ac5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.659826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6ad7886c-81e5-4407-b5fa-677801008026 req-853875f7-eee1-4afd-afc7-fc343def2ac5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.671588 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6ad7886c-81e5-4407-b5fa-677801008026 req-853875f7-eee1-4afd-afc7-fc343def2ac5 service nova] Creating event network-vif-plugged:0c1fdeab-9962-4fac-bd62-633887708fc9 for instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 on n-h2-857467-1 Sep 13 16:35:17.677125 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6ad7886c-81e5-4407-b5fa-677801008026 req-853875f7-eee1-4afd-afc7-fc343def2ac5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Sep 13 16:35:17.678118 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 668/1377] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:17.703799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:17.704819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:17.712047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.713442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.714522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:17.715495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:17.716208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:17.716913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.015569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:18.016529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:18.027576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.028428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.029671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.030876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.031549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.032248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.053426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:18.066174 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e34ad99-b810-4555-ac95-aef374cf63b7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.366109 Sep 13 16:35:18.067006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 710/1378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:17 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:18.075810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:18.076726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:18.090872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.093396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.094103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.095067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.096749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.102459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.138313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:18.152672 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fb3a76c-c8de-4df7-b6ea-c8da74b3e846 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1647 microversion: 2.1 time: 0.146092 Sep 13 16:35:18.171489 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 669/1379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:18 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1647 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:18.220625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:18.236346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9466379a-a0de-41f4-981e-870c8998cd5e tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1275 microversion: 2.1 time: 0.165253 Sep 13 16:35:18.236988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 711/1380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:18 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:18.597451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:18.598815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:18.606370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.606873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.607315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.608215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.608952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.609551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.612347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:18.612969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:18.621313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.621819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.622347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.623064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.623528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.624103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.661109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:18.661624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:18.662202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:18.662732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid b984a09d-0655-47e7-9ede-734c8f6c11d2 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:18.790210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:18.816256 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c52a0ea4-74f3-4132-96f2-b534494a7897 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 200 len: 1308 microversion: 2.1 time: 0.197841 Sep 13 16:35:18.818104 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 712/1381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:18 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:18.881086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:18.895172 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c03854d-3459-4c41-9e87-248e2df7517a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1313 microversion: 2.1 time: 0.301660 Sep 13 16:35:18.896047 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 670/1382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:18 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:19.077447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-54c0fba1-c6ef-45f3-91e3-a8d1f6446c8b req-59506651-09ba-4344-9ec4-5d08a4b80b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11da3338-8829-45f4-83ef-80f4f8245aa0", "name": "network-vif-deleted", "tag": "5dc80120-1f41-47b6-9362-e47f868e1fe8"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:19.092426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-54c0fba1-c6ef-45f3-91e3-a8d1f6446c8b req-59506651-09ba-4344-9ec4-5d08a4b80b74 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.092986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.093704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.094452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-54c0fba1-c6ef-45f3-91e3-a8d1f6446c8b req-59506651-09ba-4344-9ec4-5d08a4b80b74 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.095243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-54c0fba1-c6ef-45f3-91e3-a8d1f6446c8b req-59506651-09ba-4344-9ec4-5d08a4b80b74 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.101415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.106460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.107810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.109386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.110266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.111212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.115588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-54c0fba1-c6ef-45f3-91e3-a8d1f6446c8b req-59506651-09ba-4344-9ec4-5d08a4b80b74 service nova] Creating event network-vif-deleted:5dc80120-1f41-47b6-9362-e47f868e1fe8 for instance 11da3338-8829-45f4-83ef-80f4f8245aa0 on n-h1-857467-1 Sep 13 16:35:19.122081 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-54c0fba1-c6ef-45f3-91e3-a8d1f6446c8b req-59506651-09ba-4344-9ec4-5d08a4b80b74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048106 Sep 13 16:35:19.123217 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 713/1383] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:19.184998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.185911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.192790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.193293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.193774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.198887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.199632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.200791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.252323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.254861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.255567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.256297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lazy-loading 'fault' on Instance uuid 11da3338-8829-45f4-83ef-80f4f8245aa0 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:19.305614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:19.323198 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed356a0f-76cd-490d-a481-763513f67fb5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.236561 Sep 13 16:35:19.328363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 671/1384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:19 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:19.333619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.334459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.334835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfa5c9e4b2b47dfb53c471554382f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a858bc8ce4e413daa756d969d53a093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:19.342493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.343209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.343855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.345617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.346498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.347099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.348746 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2cd0c107-4896-4daa-981b-4cccad3a9f0e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 200 len: 1355 microversion: 2.1 time: 0.175770 Sep 13 16:35:19.359546 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 714/1385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:19 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 1355 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:19.562503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:19.570394 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32f52599-bcba-4464-963f-eea34a79331c tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.241000 Sep 13 16:35:19.571054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 672/1386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:19 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:19.845630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.846381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: b984a09d-0655-47e7-9ede-734c8f6c11d2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.853262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.854107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.854709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.855419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.855883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.856314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.870779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance b984a09d-0655-47e7-9ede-734c8f6c11d2 could not be found. Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 HTTP/1.1 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b984a09d-0655-47e7-9ede-734c8f6c11d2 could not be found. Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b984a09d-0655-47e7-9ede-734c8f6c11d2'} Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b984a09d-0655-47e7-9ede-734c8f6c11d2 could not be found. Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b984a09d-0655-47e7-9ede-734c8f6c11d2 could not be found. Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:19.872474 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b984a09d-0655-47e7-9ede-734c8f6c11d2 could not be found. Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance b984a09d-0655-47e7-9ede-734c8f6c11d2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6331b547-d777-4f1b-9751-607dfc3f42cb tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2" status: 404 len: 111 microversion: 2.1 time: 0.032205 Sep 13 16:35:19.876900 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 715/1387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:19 2022] GET /compute/v2.1/servers/b984a09d-0655-47e7-9ede-734c8f6c11d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:19.883062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.883675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: 8955426a-c06a-42e1-9082-fabd1426e8ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.890378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.890866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.891308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.892002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.892455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.892883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.906874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance 8955426a-c06a-42e1-9082-fabd1426e8ed could not be found. Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed HTTP/1.1 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8955426a-c06a-42e1-9082-fabd1426e8ed could not be found. Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8955426a-c06a-42e1-9082-fabd1426e8ed'} Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8955426a-c06a-42e1-9082-fabd1426e8ed could not be found. Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8955426a-c06a-42e1-9082-fabd1426e8ed could not be found. Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:19.908561 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8955426a-c06a-42e1-9082-fabd1426e8ed could not be found. Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance 8955426a-c06a-42e1-9082-fabd1426e8ed could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51f38525-848a-4106-9567-33d5e186cb3f tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed" status: 404 len: 111 microversion: 2.1 time: 0.031902 Sep 13 16:35:19.912965 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 673/1388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:19 2022] GET /compute/v2.1/servers/8955426a-c06a-42e1-9082-fabd1426e8ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:19.919076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.919641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e43142e-b6e9-458e-ae3c-478c77c279c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.919778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.925780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.926040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:19.926307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.926944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.927954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.928582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.929016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.955229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e43142e-b6e9-458e-ae3c-478c77c279c9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/673962af-7385-446a-8995-effa05af0d17" status: 204 len: 0 microversion: 2.1 time: 0.039810 Sep 13 16:35:19.956119 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 674/1389] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:35:19 2022] DELETE /compute/v2.1/os-server-groups/673962af-7385-446a-8995-effa05af0d17 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:19.964241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:19.964797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:19.970899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.971386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.971820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:19.972515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:19.972969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:19.973392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.000034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:20.027599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:20.083368 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-583c996c-1340-414f-8c5b-63b5aaeb864c tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 204 len: 0 microversion: 2.1 time: 0.122844 Sep 13 16:35:20.084324 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 675/1390] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:19 2022] DELETE /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:20.093845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.094558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.100505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.101153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.101670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.102420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.103636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.104214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.156366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:20.164267 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e74df406-bfda-421b-93d2-e471ea6c69d5 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1463 microversion: 2.1 time: 0.249569 Sep 13 16:35:20.164839 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 716/1391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:19 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1463 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:20.244410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:20.252847 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f70d881-0129-42aa-9f21-87184a93add9 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1473 microversion: 2.1 time: 0.163107 Sep 13 16:35:20.253429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 676/1392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1473 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:20.302238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Calling method '.version_select at 0x7fbeb51aeca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.314101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.314583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.315029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.331264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.331749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.332189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.341314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:20.349419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c4e605ca-b41e-416a-928a-5ef0322078a3 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/409ba2c2d1584f149ae92325c5261aa1?start=2022-09-12T16%3A35%3A20.180484&end=2022-09-14T16%3A35%3A20.180484" status: 200 len: 698 microversion: 2.1 time: 0.164940 Sep 13 16:35:20.350027 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 717/1393] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/os-simple-tenant-usage/409ba2c2d1584f149ae92325c5261aa1?start=2022-09-12T16%3A35%3A20.180484&end=2022-09-14T16%3A35%3A20.180484 => generated 698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:20.352580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.353324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.359384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.359855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.360366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.361077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.361537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.362324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.366123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '.version_select at 0x7fbeb50ce700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.377770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.378298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.378738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.388453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.388936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.389516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.400616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-535a592e-8e60-4248-ad92-e8e6a11eb145 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/409ba2c2d1584f149ae92325c5261aa1?start=2022-09-12T16%3A35%3A20.180484&end=2022-09-14T16%3A35%3A20.180484" status: 200 len: 698 microversion: 2.1 time: 0.038740 Sep 13 16:35:20.401207 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 718/1394] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/os-simple-tenant-usage/409ba2c2d1584f149ae92325c5261aa1?start=2022-09-12T16%3A35%3A20.180484&end=2022-09-14T16%3A35%3A20.180484 => generated 698 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:20.405916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.406537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.412508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.413010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.413455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.414193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.414656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.415096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.429230 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 HTTP/1.1 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '11da3338-8829-45f4-83ef-80f4f8245aa0'} Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:20.430801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59916f82-f105-4b27-b9d2-e416df3829f5 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 404 len: 111 microversion: 2.1 time: 0.030413 Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 719/1395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:20.439333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Calling method '.version_select at 0x7fbeb513cb80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.446361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.446977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.447313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.462368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.462904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.463308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.499627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:20.507649 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c35cf3a7-c888-4dab-aa39-cae64485a0a4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.159033 Sep 13 16:35:20.508220 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 677/1396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:20.512571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.513065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.518621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.519104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.519539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.520225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.520680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.521103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.526121 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cad3a80-179c-4795-b43a-7534a8a63322 tempest-TenantUsagesTestJSON-1234485714 tempest-TenantUsagesTestJSON-1234485714-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-12T16%3A35%3A20.180484&end=2022-09-14T16%3A35%3A20.180484&detailed=1" status: 200 len: 14292 microversion: 2.1 time: 0.091513 Sep 13 16:35:20.526760 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 720/1397] 10.222.0.61 () {58 vars in 1335 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-12T16%3A35%3A20.180484&end=2022-09-14T16%3A35%3A20.180484&detailed=1 => generated 14292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:35:20.534487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 HTTP/1.1 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '58a647c7-7b9d-4873-bfb2-006e147ec404'} Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:20.536129 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9f469e00-975e-4445-bc4a-b253942b7b5e tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 404 len: 111 microversion: 2.1 time: 0.028375 Sep 13 16:35:20.541627 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 678/1398] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:20 2022] DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:20.546601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.547213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.553353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.553811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.553956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.554290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.554416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.554981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.555433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.555856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.560737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.561218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.561653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.562371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.562828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.563252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.569926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 HTTP/1.1 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '58a647c7-7b9d-4873-bfb2-006e147ec404'} Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.571448 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aac9c962-9c64-4c1c-baf1-043ae01b8411 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 404 len: 111 microversion: 2.1 time: 0.029982 Sep 13 16:35:20.577139 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 721/1399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:20.581121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6bb3712e-7cfc-4614-b5a1-6929c504ece9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '.version_select at 0x7fbeb50e4ca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.591770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:20.601166 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6bb3712e-7cfc-4614-b5a1-6929c504ece9 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864724555" status: 202 len: 0 microversion: 2.1 time: 0.023432 Sep 13 16:35:20.601745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 722/1400] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:35:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864724555 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:35:20.610149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.610766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.617495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.618035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.619166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.619916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.620377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.622065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.682313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4166994b-f0e0-4d86-b76f-6952c10971b1 tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "DELETE /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 204 len: 0 microversion: 2.1 time: 0.130908 Sep 13 16:35:20.686957 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 679/1401] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:20 2022] DELETE /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:35:20.692635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:20.693333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:20.699791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.700308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.700834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.701806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:20.702348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:20.702891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:20.818884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:20.827693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6ca64f2-fe4e-4614-984c-91288aa012ee tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.221133 Sep 13 16:35:20.831175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 723/1402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:20.847956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:20.857136 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b644ad55-d1c4-4cc5-b805-d32bf7b6694e tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1469 microversion: 2.1 time: 0.168510 Sep 13 16:35:20.857726 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 680/1403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:20 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:21.276374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:21.276979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:21.283963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.284459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.284898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.285614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.286100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.286534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.403083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-41ac8e3b-1cba-4718-922a-04f0392b5fe9 req-29bf9425-dae1-4a61-90b0-f3f6968857aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327cf176-8920-4464-86a0-863d9a996419", "tag": "a7fee257-9881-48a0-af4f-cee00b28e128"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:21.412880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-41ac8e3b-1cba-4718-922a-04f0392b5fe9 req-29bf9425-dae1-4a61-90b0-f3f6968857aa service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.413463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-41ac8e3b-1cba-4718-922a-04f0392b5fe9 req-29bf9425-dae1-4a61-90b0-f3f6968857aa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.413994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-41ac8e3b-1cba-4718-922a-04f0392b5fe9 req-29bf9425-dae1-4a61-90b0-f3f6968857aa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.425820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-41ac8e3b-1cba-4718-922a-04f0392b5fe9 req-29bf9425-dae1-4a61-90b0-f3f6968857aa service nova] Creating event network-changed:a7fee257-9881-48a0-af4f-cee00b28e128 for instance 327cf176-8920-4464-86a0-863d9a996419 on n-h1-857467-1 Sep 13 16:35:21.432002 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-41ac8e3b-1cba-4718-922a-04f0392b5fe9 req-29bf9425-dae1-4a61-90b0-f3f6968857aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032234 Sep 13 16:35:21.432752 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 681/1404] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:21.532092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:21.532916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:21.539087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.539568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.540001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.541270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.541728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.542175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.552830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:21.561611 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ace2658-0f52-47a4-b26d-72b79cb9cb9a tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1473 microversion: 2.1 time: 0.289730 Sep 13 16:35:21.562221 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 724/1405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:21 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1473 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:21.678278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5bd6e9ee-46ad-403e-bde7-d311f08f7c24 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:21.695660 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5bd6e9ee-46ad-403e-bde7-d311f08f7c24 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/320586413" status: 202 len: 0 microversion: 2.1 time: 0.020919 Sep 13 16:35:21.695883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:21.696223 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 725/1406] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:35:21 2022] DELETE /compute/v2.1/flavors/320586413 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:35:21.704657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-def75cfc-bc6c-49a4-b310-83fab384e539 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:21.705429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f56cbebe-8686-42c5-b294-5ea5b2263f85 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.177573 Sep 13 16:35:21.706351 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 682/1407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:21 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:21.855043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:21.855595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:21.862251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.862762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.863207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.863943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.864409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.864850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.920145 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-def75cfc-bc6c-49a4-b310-83fab384e539 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.219230 Sep 13 16:35:21.920748 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 726/1408] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:35:21 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:21.925341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:21.925998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:21.932303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.932803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.933242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:21.933974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:21.934436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:21.934869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.001795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:22.009959 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bac1637e-b398-416c-a866-2bb7950533d4 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.159795 Sep 13 16:35:22.010536 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 683/1409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:21 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:22.015069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52ebe51a-642d-49f8-8c25-893ba97d1765 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.032417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52ebe51a-642d-49f8-8c25-893ba97d1765 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1694019408" status: 202 len: 0 microversion: 2.1 time: 0.020750 Sep 13 16:35:22.033004 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 684/1410] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:35:22 2022] DELETE /compute/v2.1/flavors/1694019408 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:35:22.041532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-577fec2d-6a07-47a1-88bf-fc2425d61f22 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.064627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-577fec2d-6a07-47a1-88bf-fc2425d61f22 tempest-ServersWithSpecificFlavorTestJSON-1243304277 tempest-ServersWithSpecificFlavorTestJSON-1243304277-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025298 Sep 13 16:35:22.064627 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 685/1411] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:35:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:22.077512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:22.085378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b351e2d2-f264-4acb-9937-ce3a6e78309f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1469 microversion: 2.1 time: 0.163674 Sep 13 16:35:22.097523 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 727/1412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:21 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:22.101108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.101662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:22.108939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.109365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.109808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.110534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.110995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.111427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.125970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 HTTP/1.1 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '11da3338-8829-45f4-83ef-80f4f8245aa0'} Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:22.127641 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ceefd04b-8574-442c-b64f-5779c9fe6b2a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 404 len: 111 microversion: 2.1 time: 0.039428 Sep 13 16:35:22.132977 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 686/1413] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:22 2022] DELETE /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:22.138198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.138853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 11da3338-8829-45f4-83ef-80f4f8245aa0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:22.144899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.145410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.145851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.146563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.147030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.147462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.161058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 HTTP/1.1 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '11da3338-8829-45f4-83ef-80f4f8245aa0'} Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.162669 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 11da3338-8829-45f4-83ef-80f4f8245aa0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7a870296-b7db-4e46-baca-0935cb2e964a tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0" status: 404 len: 111 microversion: 2.1 time: 0.030017 Sep 13 16:35:22.167883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 728/1414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:22 2022] GET /compute/v2.1/servers/11da3338-8829-45f4-83ef-80f4f8245aa0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:22.173677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.174212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:22.180150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.180637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.181979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.182779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.183242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.183674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 HTTP/1.1 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '58a647c7-7b9d-4873-bfb2-006e147ec404'} Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:35:22.201675 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3c98317d-f078-4ea2-9012-48cfa5619ce7 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 404 len: 111 microversion: 2.1 time: 0.031196 Sep 13 16:35:22.206699 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 687/1415] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:22 2022] DELETE /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:22.209329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.209975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] [instance: 58a647c7-7b9d-4873-bfb2-006e147ec404] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:22.216103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.216597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.217036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.217735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.218232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.218667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.232631 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] HTTP exception thrown: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Request method failure captured: Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 HTTP/1.1 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILA1Bx0ICsx6zE5yR8fT7dnnOEfUyeVCgLd5mD2Khs3A4uSZphI83EUVrql7lfZeGyYWYgzdzfxOmFrsVRJMesIrgUbFzkAWgC_1r3U0WoA4UF1kjNDqOwoEtkLl1G92vqR-8V2LBpqpM2OGmmOTaKyOG_7Sx6e_3qpQ5WXV0VUzXmA Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2a858bc8ce4e413daa756d969d53a093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2a858bc8ce4e413daa756d969d53a093 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407 Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5bfa5c9e4b2b47dfb53c471554382f2d Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1057585407-project Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '58a647c7-7b9d-4873-bfb2-006e147ec404'} Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.234248 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] Returning 404 to user: Instance 58a647c7-7b9d-4873-bfb2-006e147ec404 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c3cf1fa-b4b2-4706-abc8-862ff48251f3 tempest-ServersWithSpecificFlavorTestJSON-1057585407 tempest-ServersWithSpecificFlavorTestJSON-1057585407-project] 10.222.0.61 "GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404" status: 404 len: 111 microversion: 2.1 time: 0.030075 Sep 13 16:35:22.238739 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 729/1416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:22 2022] GET /compute/v2.1/servers/58a647c7-7b9d-4873-bfb2-006e147ec404 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:22.584486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.585108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:22.592160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.592655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.593103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.593808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.594301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.594735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.728599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:22.729334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:22.735911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.736487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.737006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.737790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:22.738391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:22.738905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:22.861084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:22.871041 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a744b6c7-7230-4ce7-80c8-29aa4336ea79 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1473 microversion: 2.1 time: 0.290301 Sep 13 16:35:22.871805 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 688/1417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:22 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:22.957285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:22.966930 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c02878f8-79da-4b39-983e-882ef1448da3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.242119 Sep 13 16:35:22.967444 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 730/1418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:22 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:23.032453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:23.033076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:23.039355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.039849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.040330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.041044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.041509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.041974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.108891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:23.109656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:23.115936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.116551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.117236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.118162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.119241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.119761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.138974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:23.254125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:23.262842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3159be79-c051-4500-b0d6-d3e8b178831a tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1469 microversion: 2.1 time: 0.158133 Sep 13 16:35:23.263433 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 731/1419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:23 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:23.320697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:23.328665 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6754c359-2415-4059-9c1c-dc60fee4c650 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.300065 Sep 13 16:35:23.329249 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 689/1420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:23 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:23.605021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9ab3c6fc-c785-47dd-b5b5-430dfa149198 req-6356a484-9b04-4e15-91c8-4b1579618662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b0ff4f-90c8-49c1-bfa1-80c91e45f473", "name": "network-vif-deleted", "tag": "0c1fdeab-9962-4fac-bd62-633887708fc9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:23.622434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9ab3c6fc-c785-47dd-b5b5-430dfa149198 req-6356a484-9b04-4e15-91c8-4b1579618662 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.622832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9ab3c6fc-c785-47dd-b5b5-430dfa149198 req-6356a484-9b04-4e15-91c8-4b1579618662 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.623400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9ab3c6fc-c785-47dd-b5b5-430dfa149198 req-6356a484-9b04-4e15-91c8-4b1579618662 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.647060 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9ab3c6fc-c785-47dd-b5b5-430dfa149198 req-6356a484-9b04-4e15-91c8-4b1579618662 service nova] Creating event network-vif-deleted:0c1fdeab-9962-4fac-bd62-633887708fc9 for instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 on n-h2-857467-1 Sep 13 16:35:23.654308 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9ab3c6fc-c785-47dd-b5b5-430dfa149198 req-6356a484-9b04-4e15-91c8-4b1579618662 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052083 Sep 13 16:35:23.655499 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 732/1421] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:23.895307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:23.895954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:23.897862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:23.904868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.905380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.905820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.906689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:23.907156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:23.907828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:23.992161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:23.994930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:24.002296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.002916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.003427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.004221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.005245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.005735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.343601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:24.360013 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b012f5e-5a44-4767-b227-029e1020c9b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.373195 Sep 13 16:35:24.364036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 733/1422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:23 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:24.373388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:24.374733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:24.381242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:24.386836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.387613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.388283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.389231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.390302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.391062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.450480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:24.461182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c20d63e8-19e8-4835-90ef-5dde3cd2b8c0 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1473 microversion: 2.1 time: 0.569645 Sep 13 16:35:24.475594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.476327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.478251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.478950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lazy-loading 'fault' on Instance uuid 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:24.480490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 690/1423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:23 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1473 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:24.487785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:24.488716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:24.497475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.498248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.498742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.499903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:24.500545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:24.501163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:24.582278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2304cb72a88f454a9b4a0ce7f8e37174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409ba2c2d1584f149ae92325c5261aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:24.590150 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3bb258b-5dbe-46a3-b5d8-0c0f360b529f tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 200 len: 1303 microversion: 2.1 time: 0.224796 Sep 13 16:35:24.590950 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 734/1424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:24 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:24.809115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:24.817086 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-565a96fd-3d6c-49fe-bc22-89be2805b386 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.335207 Sep 13 16:35:24.817675 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 691/1425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:24 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:25.392602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:25.393233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:25.400728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.401436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.402072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.402975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.403602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.404204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.492021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:25.493958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:25.506308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.507021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.507677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.508609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.509303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.509999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.559530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.560265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.560909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.561523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lazy-loading 'fault' on Instance uuid ea94c7be-d3dc-477b-8d97-6968a0f8e79b {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:25.620494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e5f78d68c64970ab2a816eda0f95fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade763eb224a494f86d28a38ca26c17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:25.640917 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a1bec3a-7835-4e85-96df-f5bac61ce3fc tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 200 len: 1307 microversion: 2.1 time: 0.153533 Sep 13 16:35:25.657155 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 692/1426] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:25 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:25.657155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:25.657155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] [instance: 94b0ff4f-90c8-49c1-bfa1-80c91e45f473] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:25.663584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.664086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.664522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.665777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.666298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.666759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.683891 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] HTTP exception thrown: Instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 could not be found. Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Request method failure captured: Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 HTTP/1.1 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILEuFuBTH7Jj-5qVj2it8ybqk5eWzNIdQ9dJkz64jAZzTx24bYnV3FThzA7djwYH_6QHD4z-tbOeoVm3VrkhMvwDet-0r7-XOtL1-zBcROIVXeDWTU3jd7vJzbhPRwcY9cEoZh4pVFKUASW-TzOLHOuFPlFNYb1qfgCWIfm6Y6fy_t8 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 409ba2c2d1584f149ae92325c5261aa1 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TenantUsagesTestJSON-914557827 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/409ba2c2d1584f149ae92325c5261aa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_409ba2c2d1584f149ae92325c5261aa1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/409ba2c2d1584f149ae92325c5261aa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/409ba2c2d1584f149ae92325c5261aa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TenantUsagesTestJSON-914557827 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 409ba2c2d1584f149ae92325c5261aa1 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TenantUsagesTestJSON-914557827 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TenantUsagesTestJSON-914557827-project Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2304cb72a88f454a9b4a0ce7f8e37174 Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TenantUsagesTestJSON-914557827-project Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 could not be found. Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '94b0ff4f-90c8-49c1-bfa1-80c91e45f473'} Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 could not be found. Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 could not be found. Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:25.685842 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 could not be found. Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] Returning 404 to user: Instance 94b0ff4f-90c8-49c1-bfa1-80c91e45f473 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5b73ad0-e26f-4ea9-b201-8ca33dfc25ba tempest-TenantUsagesTestJSON-914557827 tempest-TenantUsagesTestJSON-914557827-project] 10.222.0.61 "GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473" status: 404 len: 111 microversion: 2.1 time: 0.042277 Sep 13 16:35:25.689858 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 693/1427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:25 2022] GET /compute/v2.1/servers/94b0ff4f-90c8-49c1-bfa1-80c91e45f473 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:25.693858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f75ba3d7-25e4-4b8a-a91a-34367424f4ea req-0c00b389-32d9-4554-b4e7-b882e1fe0804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea94c7be-d3dc-477b-8d97-6968a0f8e79b", "name": "network-vif-deleted", "tag": "197dd283-c3f7-48a0-a880-f8d4ee9b6982"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:25.705165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f75ba3d7-25e4-4b8a-a91a-34367424f4ea req-0c00b389-32d9-4554-b4e7-b882e1fe0804 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.705661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f75ba3d7-25e4-4b8a-a91a-34367424f4ea req-0c00b389-32d9-4554-b4e7-b882e1fe0804 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.706117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f75ba3d7-25e4-4b8a-a91a-34367424f4ea req-0c00b389-32d9-4554-b4e7-b882e1fe0804 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.732448 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f75ba3d7-25e4-4b8a-a91a-34367424f4ea req-0c00b389-32d9-4554-b4e7-b882e1fe0804 service nova] Creating event network-vif-deleted:197dd283-c3f7-48a0-a880-f8d4ee9b6982 for instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b on n-h1-857467-1 Sep 13 16:35:25.739527 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f75ba3d7-25e4-4b8a-a91a-34367424f4ea req-0c00b389-32d9-4554-b4e7-b882e1fe0804 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049072 Sep 13 16:35:25.740708 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 694/1428] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:25.850938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:25.852070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:25.862966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.863605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.864346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.865564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:25.866615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:25.867300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:25.890493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:25.909858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:25.922251 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8198e85d-1780-4509-ad60-956600a486eb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.532407 Sep 13 16:35:25.941122 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 735/1429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:25 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:26.085176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:26.094741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2d745fb-08c0-48aa-b24a-c0bf8ba166ec tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.251392 Sep 13 16:35:26.095956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 695/1430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:25 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:26.666120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:26.667271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] [instance: ea94c7be-d3dc-477b-8d97-6968a0f8e79b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:26.686613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:26.687373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:26.687991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:26.688722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:26.689178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:26.689597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:26.716204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] HTTP exception thrown: Instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b could not be found. Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Request method failure captured: Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b HTTP/1.1 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB2YdLTqlBcqZ59zpUmwHN2NpIh1xb5ICy47fn32WCU0Przq15UD6HXRA7a9JiPwsTONKSvBntLQRADoMuHeIzEd_FEeztntI5xeF7yWUMQpUwJu_AWoMm6K_tHiKqhCiAZA2ZWXAnTLuxE5dv0XmUfdKY-PLxDwvKRtWCpcnPUwdI Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ade763eb224a494f86d28a38ca26c17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ade763eb224a494f86d28a38ca26c17a Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-706089824 Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 63e5f78d68c64970ab2a816eda0f95fa Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersOnMultiNodesTest-706089824-project Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b could not be found. Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ea94c7be-d3dc-477b-8d97-6968a0f8e79b'} Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b could not be found. Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b could not be found. Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:26.724261 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b could not be found. Sep 13 16:35:26.730247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:26.731879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] Returning 404 to user: Instance ea94c7be-d3dc-477b-8d97-6968a0f8e79b could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:26.732995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad53c104-0693-4c58-8601-79710efb5e11 tempest-ServersOnMultiNodesTest-706089824 tempest-ServersOnMultiNodesTest-706089824-project] 10.222.0.61 "GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b" status: 404 len: 111 microversion: 2.1 time: 0.072250 Sep 13 16:35:26.734098 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 736/1431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:26 2022] GET /compute/v2.1/servers/ea94c7be-d3dc-477b-8d97-6968a0f8e79b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:26.949808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:26.950467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:26.966447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:26.967308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:26.967936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:26.968943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:26.969610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:26.971443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:27.122563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:27.124107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:27.134681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:27.135397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:27.136108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:27.137019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:27.137707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:27.138392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:27.301456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:27.312164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-290908f6-e292-4fa6-8bef-afba6b98ebed tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.367825 Sep 13 16:35:27.315750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 696/1432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:26 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:27.493018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:27.509389 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7876ad3-98cb-4845-89e0-6dd73eff21b5 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.391279 Sep 13 16:35:27.510679 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 737/1433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:27 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:27.655240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6c71662a-2e9a-4d15-b271-a6e099264782 req-4b900b59-46fa-4856-a773-8cf362c3e8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327cf176-8920-4464-86a0-863d9a996419", "name": "network-vif-plugged", "status": "completed", "tag": "a7fee257-9881-48a0-af4f-cee00b28e128"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:27.702304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c71662a-2e9a-4d15-b271-a6e099264782 req-4b900b59-46fa-4856-a773-8cf362c3e8e0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:27.704998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c71662a-2e9a-4d15-b271-a6e099264782 req-4b900b59-46fa-4856-a773-8cf362c3e8e0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:27.707234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c71662a-2e9a-4d15-b271-a6e099264782 req-4b900b59-46fa-4856-a773-8cf362c3e8e0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:27.727506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6c71662a-2e9a-4d15-b271-a6e099264782 req-4b900b59-46fa-4856-a773-8cf362c3e8e0 service nova] Creating event network-vif-plugged:a7fee257-9881-48a0-af4f-cee00b28e128 for instance 327cf176-8920-4464-86a0-863d9a996419 on n-h1-857467-1 Sep 13 16:35:27.734986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6c71662a-2e9a-4d15-b271-a6e099264782 req-4b900b59-46fa-4856-a773-8cf362c3e8e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084776 Sep 13 16:35:27.735946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 697/1434] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:28.163982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:28.166315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:28.190990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.192269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.193432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.194831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.196423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.197001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.234977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:28.340340 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38c0a370-6984-4ae1-89ce-7eb156bf63fa tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "DELETE /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 204 len: 0 microversion: 2.1 time: 0.182496 Sep 13 16:35:28.341353 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 738/1435] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:28 2022] DELETE /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:28.342639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:28.343354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:28.351264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.351781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.352219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.360722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:28.362129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.362772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.363230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.363831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:28.382958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.383470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.383996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.385147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.388156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.388618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.625607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:28.637615 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-632f91c7-a61f-41ed-8ce8-5bb6ca516357 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1666 microversion: 2.1 time: 0.290298 Sep 13 16:35:28.641397 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 739/1436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:28 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1666 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:28.654237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:28.655080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:28.671393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.674649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.675112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.675864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:28.676473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:28.676805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:28.847462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:28.860523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c02e5f79-ba9b-4f01-9af6-b8ccde5ec118 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.524341 Sep 13 16:35:28.861648 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 698/1437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:28 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:29.225173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:29.228814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:29.245932 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc8108e5-8ac9-46bf-a730-1f3f648085d2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.602351 Sep 13 16:35:29.247648 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 740/1438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:28 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:29.665150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:29.666041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:29.686820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:29.688478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:29.688478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:29.690887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:29.691406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:29.692544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:29.886063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:29.887518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:29.905790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:29.907203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:29.910780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:29.911733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:29.912295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:29.913999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:29.949132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:29.959343 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf9b90dc-9ec4-4d9a-92ed-6dd45e4c224e tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1666 microversion: 2.1 time: 0.298637 Sep 13 16:35:29.964056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 699/1439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:29 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1666 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:30.176947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-adb5aa1d-b3a9-4201-b36a-4aa2821434ae tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:30.186674 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-adb5aa1d-b3a9-4201-b36a-4aa2821434ae tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.166112 Sep 13 16:35:30.188372 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 700/1440] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:35:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:30.214730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:30.228507 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f148161-ddf4-4fb0-ac46-97c0592ac223 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.348069 Sep 13 16:35:30.230327 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 741/1441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:29 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:30.270953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:30.271812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:30.283546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:30.284518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:30.285153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:30.286056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:30.287829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:30.288436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:30.732031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:30.748068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-80a1b70f-442c-46b3-a49c-cb7e6a8f5aa1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1317 microversion: 2.1 time: 0.480706 Sep 13 16:35:30.751391 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 701/1442] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:30 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:30.987464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90f6a36f-0d1c-4f81-87c7-de2cbb9e5751 tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-539960678", "imageRef": "fc50aace-7504-40f8-b624-90309271473e", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:30.988480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:30.989619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:30.998003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:30.998787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:30.999600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:31.000680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:31.001373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:31.002207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:31.021002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:31.059399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-90f6a36f-0d1c-4f81-87c7-de2cbb9e5751 tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:35:31.372511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:31.381519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-052b6a80-53f7-4c7e-8c5a-5add1897cba3 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1666 microversion: 2.1 time: 0.397264 Sep 13 16:35:31.388834 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 702/1443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:30 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1666 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:31.409056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:31.409790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:31.419352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:31.423271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:31.424352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:31.426376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:31.427654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:31.428190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:31.509782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-90f6a36f-0d1c-4f81-87c7-de2cbb9e5751 tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90f6a36f-0d1c-4f81-87c7-de2cbb9e5751 tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] Request method failure captured: Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 142 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFRF6rzLGg-T1r1VurndHWK_-ja1Yfig5YGJLdtXzpm-QPrQ82_lZOWBSQdZUBr3R4ZuACXcAliO3-nSBZKxgohhuj4Hev_KMi9zBr30HrqXAVUOw-CHCculJ1qsQ9xTQewWWzBTlQS-bPCbCq1g3-mFSjd3kHjtjD6R-eCN6pXDT4 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 299b215c3510495fb10ee1611cff3e3f Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FlavorsV2NegativeTest-105650991 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/299b215c3510495fb10ee1611cff3e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_299b215c3510495fb10ee1611cff3e3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/299b215c3510495fb10ee1611cff3e3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/299b215c3510495fb10ee1611cff3e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FlavorsV2NegativeTest-105650991 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 299b215c3510495fb10ee1611cff3e3f Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-105650991 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FlavorsV2NegativeTest-105650991-project Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 56aa1f6c64e7484d958c4ef43db3f373 Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FlavorsV2NegativeTest-105650991-project Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-539960678", "imageRef": "fc50aace-7504-40f8-b624-90309271473e", "flavorRef": "452"}} Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: exception: Flavor's memory is too small for requested image. Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-539960678', 'imageRef': 'fc50aace-7504-40f8-b624-90309271473e', 'flavorRef': '452'}}} Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:35:31.512246 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90f6a36f-0d1c-4f81-87c7-de2cbb9e5751 tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90f6a36f-0d1c-4f81-87c7-de2cbb9e5751 tempest-FlavorsV2NegativeTest-105650991 tempest-FlavorsV2NegativeTest-105650991-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.532285 Sep 13 16:35:31.517314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 742/1444] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:35:30 2022] POST /compute/v2.1/servers => generated 93 bytes in 534 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:35:31.774649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:31.775432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:31.796086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:31.796599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:31.797341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:31.797776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:31.798272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:31.798712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:31.964647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:31.976233 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61910823-3b6e-4405-af1e-d2b39f8e01d0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1506 microversion: 2.1 time: 0.205954 Sep 13 16:35:31.987162 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 743/1445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:31 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:32.002208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:32.002812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:32.011398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.012406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.013085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.014124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.014648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.016140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.047285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59f9acb5-69db-4518-b0c9-ef2a08b0c388 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419/ips" status: 200 len: 109 microversion: 2.1 time: 0.049514 Sep 13 16:35:32.058246 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 744/1446] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:35:31 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419/ips => generated 109 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:32.064132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:32.064634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:32.071993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.072497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.075139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.076287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.076774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.077282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.120017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a552355-51e3-4953-b5d5-cbd11c9c44eb tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419/ips" status: 200 len: 109 microversion: 2.1 time: 0.059471 Sep 13 16:35:32.121587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 745/1447] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:35:32 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419/ips => generated 109 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:32.133699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:32.145812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:32.146662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:32.154916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f403fad4-c651-4506-95b6-1295a6a55a76 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.751697 Sep 13 16:35:32.155712 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 703/1448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:31 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:32.164527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.167548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.168180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.169341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.177280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.182141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.242109 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a19a22c0-fbbe-411c-b3d1-68875f6366b2 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419/ips/tempest-ServerAddressesTestJSON-719915244-network" status: 200 len: 94 microversion: 2.1 time: 0.113212 Sep 13 16:35:32.243606 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 746/1449] 10.222.0.61 () {58 vars in 1398 bytes} [Tue Sep 13 16:35:32 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419/ips/tempest-ServerAddressesTestJSON-719915244-network => generated 94 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:35:32.256772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:32.257730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:32.268126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.268893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.269805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.270886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.271544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.272177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.338618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:35:32.417490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:32.418841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:32.432357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.433925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.434630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.437619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.438304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.439915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.513732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-46075871-2365-4a4d-a9eb-f2eb65a955b6 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "DELETE /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 204 len: 0 microversion: 2.1 time: 0.260657 Sep 13 16:35:32.514966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 704/1450] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:35:32 2022] DELETE /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:35:32.528538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:32.529590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:32.539498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.540446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.541192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.542234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:32.543659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:32.544512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:32.783935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:32.794208 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0bc4fec-3bda-4906-b8d4-84bbb4210192 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1666 microversion: 2.1 time: 0.383314 Sep 13 16:35:32.795836 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 747/1451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:32 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1666 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:33.090747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:33.118429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03b8d084-8a8f-4836-91c0-ee098e817816 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1512 microversion: 2.1 time: 0.596879 Sep 13 16:35:33.137388 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 705/1452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:32 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:33.178964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:33.179812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:33.191916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:33.206603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:33.207308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:33.213542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:33.214327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:33.214971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:33.559602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:33.572723 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6b6bc68-4215-4279-a0ea-0765b11104cf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.397369 Sep 13 16:35:33.573784 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 748/1453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:33 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:33.818683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:33.819560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:33.827707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:33.828464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:33.829060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:33.829978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:33.830590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:33.831174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:33.968646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddbb690a2e7245ceb2dd0a5ab52f0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8d9f6796994908b4601c27dbcf9a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:33.978793 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2f441e2-abc6-403f-b0a6-4ac61d4ebb5a tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 200 len: 1599 microversion: 2.1 time: 0.163894 Sep 13 16:35:33.979394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 706/1454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:33 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:34.086690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d0daa608-dd89-4fc9-ac21-6bc01f0fdb0d req-8643ec7a-3be6-4412-a35f-dc3c38d9daf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d2ba48-e0d8-4338-b6b7-020acfb148a4", "name": "network-vif-deleted", "tag": "a7a87fa9-569d-47c3-b11b-0625377bbff1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:34.115633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0daa608-dd89-4fc9-ac21-6bc01f0fdb0d req-8643ec7a-3be6-4412-a35f-dc3c38d9daf4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:34.116410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0daa608-dd89-4fc9-ac21-6bc01f0fdb0d req-8643ec7a-3be6-4412-a35f-dc3c38d9daf4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:34.117142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d0daa608-dd89-4fc9-ac21-6bc01f0fdb0d req-8643ec7a-3be6-4412-a35f-dc3c38d9daf4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:34.135332 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d0daa608-dd89-4fc9-ac21-6bc01f0fdb0d req-8643ec7a-3be6-4412-a35f-dc3c38d9daf4 service nova] Creating event network-vif-deleted:a7a87fa9-569d-47c3-b11b-0625377bbff1 for instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 on n-h1-857467-1 Sep 13 16:35:34.144772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:34.146149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:34.156167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:34.157022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d0daa608-dd89-4fc9-ac21-6bc01f0fdb0d req-8643ec7a-3be6-4412-a35f-dc3c38d9daf4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073866 Sep 13 16:35:34.159091 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 749/1455] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:34.159891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:34.161108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:34.162523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:34.163221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:34.163905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:34.598155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:34.599156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:34.606581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:34.607352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:34.607953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:34.608843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:34.609476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:34.610094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:34.732780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:34.744402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32b46f7a-2a8b-44cc-9246-1a6e783a2a4f tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1512 microversion: 2.1 time: 0.603399 Sep 13 16:35:34.746195 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 707/1456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:34 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:34.859326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:34.890541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3606b3f-fe02-46fc-846f-27acd217f18a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.297269 Sep 13 16:35:34.903139 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 750/1457] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:34 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:35.007608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:35.008276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] [instance: 41d2ba48-e0d8-4338-b6b7-020acfb148a4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:35.012515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:UPDATE=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:35.026566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:35.027393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:35.027848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:35.028598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:35.029068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:35.029510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:35.062294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] HTTP exception thrown: Instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 could not be found. Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Request method failure captured: Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 HTTP/1.1 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILDQeJx-I3FXu149IfS-KXupb_TjqV0jRlu-r8FAjpY3soGSQUYq0-qvY4sBrQOG1lOJsQ_RwffCfhR1ZVvuDsPH8s7JfOfNt5P9J_fC99UuqicWRYsot7_mAN8tvhccDBtvkAFuAWTEf7UK0aoq1hlH1FFLQIRUXTJ6iXtU9p01NMc Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: cc8d9f6796994908b4601c27dbcf9a0a Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestFqdnHostnames-1374189819 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cc8d9f6796994908b4601c27dbcf9a0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cc8d9f6796994908b4601c27dbcf9a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cc8d9f6796994908b4601c27dbcf9a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cc8d9f6796994908b4601c27dbcf9a0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestFqdnHostnames-1374189819 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: cc8d9f6796994908b4601c27dbcf9a0a Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1374189819 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestFqdnHostnames-1374189819-project Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ddbb690a2e7245ceb2dd0a5ab52f0365 Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestFqdnHostnames-1374189819-project Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 could not be found. Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '41d2ba48-e0d8-4338-b6b7-020acfb148a4'} Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 could not be found. Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 could not be found. Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:35.064592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 could not be found. Sep 13 16:35:35.068758 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:35.085250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Returning 404 to user: Instance 41d2ba48-e0d8-4338-b6b7-020acfb148a4 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:35.088613 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24d3a3b8-25e7-447b-9e6f-9f42f071c9a0 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4" status: 404 len: 111 microversion: 2.1 time: 0.085313 Sep 13 16:35:35.094931 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 708/1458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:35 2022] GET /compute/v2.1/servers/41d2ba48-e0d8-4338-b6b7-020acfb148a4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:35.100714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39b8dd25-b193-410b-96c0-16c73088e403 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] Calling method '.version_select at 0x7fbeb50ce040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:35.139122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39b8dd25-b193-410b-96c0-16c73088e403 tempest-ServersTestFqdnHostnames-1374189819 tempest-ServersTestFqdnHostnames-1374189819-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390776482" status: 202 len: 0 microversion: 2.1 time: 0.043658 Sep 13 16:35:35.141108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 751/1459] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:35:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390776482 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:35:35.772962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:35.773699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:35.785725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:35.788536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:35.791141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:35.792336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:35.794898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:35.795342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:35.928441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:35.929190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:35.948957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:35.949645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:35.951644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:35.954904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:35.955741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:35.957051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:36.199950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:36.215503 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f76f35dd-df09-41be-94ce-7b9758f537aa tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1470 microversion: 2.1 time: 0.446363 Sep 13 16:35:36.215960 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 709/1460] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:35 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1470 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:36.430097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d79f8993-1007-4c0c-b6f8-27b0409e0d13 req-92c14570-4abe-4a4b-831f-c155736cfc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327cf176-8920-4464-86a0-863d9a996419", "name": "network-vif-deleted", "tag": "a7fee257-9881-48a0-af4f-cee00b28e128"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:36.460956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d79f8993-1007-4c0c-b6f8-27b0409e0d13 req-92c14570-4abe-4a4b-831f-c155736cfc5a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:36.461898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d79f8993-1007-4c0c-b6f8-27b0409e0d13 req-92c14570-4abe-4a4b-831f-c155736cfc5a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:36.462587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d79f8993-1007-4c0c-b6f8-27b0409e0d13 req-92c14570-4abe-4a4b-831f-c155736cfc5a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:36.499602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d79f8993-1007-4c0c-b6f8-27b0409e0d13 req-92c14570-4abe-4a4b-831f-c155736cfc5a service nova] Creating event network-vif-deleted:a7fee257-9881-48a0-af4f-cee00b28e128 for instance 327cf176-8920-4464-86a0-863d9a996419 on n-h1-857467-1 Sep 13 16:35:36.506121 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d79f8993-1007-4c0c-b6f8-27b0409e0d13 req-92c14570-4abe-4a4b-831f-c155736cfc5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085458 Sep 13 16:35:36.510517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 710/1461] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:36.599441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:36.622594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52d55f08-7159-4044-aca7-58bd88ab6a74 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.700965 Sep 13 16:35:36.623204 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 752/1462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:35 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:37.249131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:37.250662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:37.304598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:37.308361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:37.311261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:37.315078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:37.317366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:37.318297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:37.447481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:37.448782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:37.449460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:37.451665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lazy-loading 'fault' on Instance uuid 327cf176-8920-4464-86a0-863d9a996419 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:37.593175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3da4809a3864022b00c71c8f8f55f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79168c543bf8428e9e76ebc13bdb7a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:37.612733 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5804a201-7f83-4ad6-a41e-af1ad03066f1 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 200 len: 1307 microversion: 2.1 time: 0.372643 Sep 13 16:35:37.621892 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 711/1463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:37 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:37.654154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:37.656967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:37.681818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:37.682275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:37.684885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:37.685711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:37.686228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:37.686782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:38.165146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:38.178299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46d73033-774d-4a34-a480-1ea03ba410ba tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.530504 Sep 13 16:35:38.184916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 753/1464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:37 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:38.645552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:38.646387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] [instance: 327cf176-8920-4464-86a0-863d9a996419] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:38.661430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:38.662358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:38.678762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:38.682615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:38.686150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:38.686965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:38.728349 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] HTTP exception thrown: Instance 327cf176-8920-4464-86a0-863d9a996419 could not be found. Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Request method failure captured: Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 HTTP/1.1 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFArNey4cTKpnS8l-tbC_skX0ii0USid-Z6a5Y6_VvT0x3GqMCerb046ZSvwoaWufEVvz9h2s2BPPbtPIoqaow5S2qDzoD9EhzQYwfu5xC3UQWKRJJmv3iF9SjTyw2i8sAMfnvGc55RaccBPHXzbhOtHAuquhN-jPPvRSJUUj_GMJY Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 79168c543bf8428e9e76ebc13bdb7a15 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerAddressesTestJSON-804273176 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79168c543bf8428e9e76ebc13bdb7a15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79168c543bf8428e9e76ebc13bdb7a15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79168c543bf8428e9e76ebc13bdb7a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79168c543bf8428e9e76ebc13bdb7a15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerAddressesTestJSON-804273176 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 79168c543bf8428e9e76ebc13bdb7a15 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerAddressesTestJSON-804273176 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerAddressesTestJSON-804273176-project Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: e3da4809a3864022b00c71c8f8f55f43 Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerAddressesTestJSON-804273176-project Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 327cf176-8920-4464-86a0-863d9a996419 could not be found. Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '327cf176-8920-4464-86a0-863d9a996419'} Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327cf176-8920-4464-86a0-863d9a996419 could not be found. Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327cf176-8920-4464-86a0-863d9a996419 could not be found. Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:38.735705 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327cf176-8920-4464-86a0-863d9a996419 could not be found. Sep 13 16:35:38.741164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:38.743388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] Returning 404 to user: Instance 327cf176-8920-4464-86a0-863d9a996419 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:38.744890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f99358f3-ed4f-4aab-bb76-317e902fa3f0 tempest-ServerAddressesTestJSON-804273176 tempest-ServerAddressesTestJSON-804273176-project] 10.222.0.61 "GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419" status: 404 len: 111 microversion: 2.1 time: 0.106237 Sep 13 16:35:38.749292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 712/1465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:38 2022] GET /compute/v2.1/servers/327cf176-8920-4464-86a0-863d9a996419 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:39.203285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:39.203905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:39.213556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:39.213991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:39.214706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:39.215659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:39.216331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:39.217131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:39.756835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:39.770168 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45d4d7cd-0f16-47ad-bd53-5aa4bb5dca98 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.570254 Sep 13 16:35:39.780430 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 754/1466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:39 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:39.926411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-957036490", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "d6d4f0b9-e6f0-4179-8206-f838ec11e666"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:39.998589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] validate_networks() for [('d6d4f0b9-e6f0-4179-8206-f838ec11e666', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:35:40.549625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:35:40.550088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:35:40.550565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:35:40.550974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:35:40.551554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:35:40.564357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:40.565411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:40.566923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:40.568939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:40.569579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:40.570223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:40.595320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for project c8d1b8d477d0424b924671970921a5e5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:35:40.601587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for user fd124267837344e580ca605c2a646736 and project c8d1b8d477d0424b924671970921a5e5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:35:40.620032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:35:40.622880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:35:40.684545 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2056b1f-986c-4f61-9963-6a47c2ad7303 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151241 Sep 13 16:35:40.686128 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 713/1467] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:35:40.697628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4c7d783-e7c3-4e23-8ec2-71879f39d065 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:40.698519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4c7d783-e7c3-4e23-8ec2-71879f39d065 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:40.776227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4c7d783-e7c3-4e23-8ec2-71879f39d065 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:40.784862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4c7d783-e7c3-4e23-8ec2-71879f39d065 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1224 microversion: 2.1 time: 0.092100 Sep 13 16:35:40.785810 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 714/1468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:40 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:40.802248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Calling method '.version_select at 0x7fbeb51584c0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:40.806592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:40.807323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:40.807858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:40.808681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:40.809209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:40.809348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:40.809744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:40.809895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:40.835218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:40.835640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:40.836087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:40.837497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:40.838082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:40.838524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:40.841876 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0306b70a-4c0d-4752-b2b7-46e7902545b9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.255590 Sep 13 16:35:40.843384 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 755/1469] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Sep 13 16:35:40 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:40.867353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:41.027551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.038361 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea5b3b31-fa7e-407e-af29-fdbdf12df752 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.238817 Sep 13 16:35:41.057241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6995cdb-a7b6-4ec8-aa9d-2d948e7adb29 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Calling method '.version_select at 0x7fbeb50ee4c0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.077864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f6995cdb-a7b6-4ec8-aa9d-2d948e7adb29 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '8fc957fac94941ed82bb063243e980f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324602d8561f4edea0e50ddbf9a58107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.082410 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 715/1470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:40 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6995cdb-a7b6-4ec8-aa9d-2d948e7adb29 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Request method failure captured: Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbZZY4alEvCMw9nK6gSiRAo2KoiNGHY8VumAvY9VROMcowec1qkNHdYQ02813CsDx44yr4zE-L6sxnqr1KcnLktCWyxzclbJ95Xz72y5K96eIPymYIdj0znDiMa6ZHID6gHfczi4FYH5IYwBhPVS-wmngJ0I5jKs_ReRDEjSGHBuA Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 8fc957fac94941ed82bb063243e980f3 Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.087583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6995cdb-a7b6-4ec8-aa9d-2d948e7adb29 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.091886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6995cdb-a7b6-4ec8-aa9d-2d948e7adb29 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.237475 Sep 13 16:35:41.094250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 756/1471] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Sep 13 16:35:40 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:41.099553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59af7454-1009-4715-90b6-9f4aff4354d0 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Calling method '.version_select at 0x7fbeb53c7f70>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.101303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-59af7454-1009-4715-90b6-9f4aff4354d0 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '8fc957fac94941ed82bb063243e980f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324602d8561f4edea0e50ddbf9a58107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59af7454-1009-4715-90b6-9f4aff4354d0 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Request method failure captured: Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hosts/n-d-857467-1/reboot HTTP/1.1 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbZZY4alEvCMw9nK6gSiRAo2KoiNGHY8VumAvY9VROMcowec1qkNHdYQ02813CsDx44yr4zE-L6sxnqr1KcnLktCWyxzclbJ95Xz72y5K96eIPymYIdj0znDiMa6ZHID6gHfczi4FYH5IYwBhPVS-wmngJ0I5jKs_ReRDEjSGHBuA Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8fc957fac94941ed82bb063243e980f3 Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-d-857467-1'} Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.111757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.115839 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.115839 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.115839 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:35:41.115839 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:35:41.115839 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 13 16:35:41.115839 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.116741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59af7454-1009-4715-90b6-9f4aff4354d0 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.121950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-59af7454-1009-4715-90b6-9f4aff4354d0 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-857467-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.021941 Sep 13 16:35:41.124443 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 716/1472] 10.222.0.61 () {58 vars in 1188 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/n-d-857467-1/reboot => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:41.136004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37148fb3-eab5-4edc-b721-61f6c6e8be8d tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Calling method '.version_select at 0x7fbeb5118c10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.158159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-37148fb3-eab5-4edc-b721-61f6c6e8be8d tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37148fb3-eab5-4edc-b721-61f6c6e8be8d tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'nonexistent_hostname'} Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.162219 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.166355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37148fb3-eab5-4edc-b721-61f6c6e8be8d tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.168833 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-37148fb3-eab5-4edc-b721-61f6c6e8be8d tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.036316 Sep 13 16:35:41.168833 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 757/1473] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:35:41.178275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18d10891-822b-4093-9647-3727f3fe3c92 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Calling method '.version_select at 0x7fbeb9760670>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.180927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18d10891-822b-4093-9647-3727f3fe3c92 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '8fc957fac94941ed82bb063243e980f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324602d8561f4edea0e50ddbf9a58107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18d10891-822b-4093-9647-3727f3fe3c92 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Request method failure captured: Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hosts/n-d-857467-1 HTTP/1.1 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbZZY4alEvCMw9nK6gSiRAo2KoiNGHY8VumAvY9VROMcowec1qkNHdYQ02813CsDx44yr4zE-L6sxnqr1KcnLktCWyxzclbJ95Xz72y5K96eIPymYIdj0znDiMa6ZHID6gHfczi4FYH5IYwBhPVS-wmngJ0I5jKs_ReRDEjSGHBuA Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8fc957fac94941ed82bb063243e980f3 Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-d-857467-1'} Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.183571 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18d10891-822b-4093-9647-3727f3fe3c92 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-18d10891-822b-4093-9647-3727f3fe3c92 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-857467-1" status: 403 len: 109 microversion: 2.1 time: 0.011346 Sep 13 16:35:41.187629 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 717/1474] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/n-d-857467-1 => generated 109 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:41.202737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bb49903-1b98-4446-aed8-31f569fd0130 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Calling method '.version_select at 0x7fbeb5158430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.209059 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-1bb49903-1b98-4446-aed8-31f569fd0130 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bb49903-1b98-4446-aed8-31f569fd0130 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'nonexistent_hostname'} Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.210956 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.215610 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.216061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bb49903-1b98-4446-aed8-31f569fd0130 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.216603 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bb49903-1b98-4446-aed8-31f569fd0130 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025651 Sep 13 16:35:41.218089 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 758/1475] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:35:41.234259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec302dc4-7f9a-446e-93ba-d7fdcdaad67d tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Calling method '.version_select at 0x7fbeb97239d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.236080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec302dc4-7f9a-446e-93ba-d7fdcdaad67d tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '8fc957fac94941ed82bb063243e980f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324602d8561f4edea0e50ddbf9a58107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec302dc4-7f9a-446e-93ba-d7fdcdaad67d tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Request method failure captured: Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hosts/n-d-857467-1/shutdown HTTP/1.1 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbZZY4alEvCMw9nK6gSiRAo2KoiNGHY8VumAvY9VROMcowec1qkNHdYQ02813CsDx44yr4zE-L6sxnqr1KcnLktCWyxzclbJ95Xz72y5K96eIPymYIdj0znDiMa6ZHID6gHfczi4FYH5IYwBhPVS-wmngJ0I5jKs_ReRDEjSGHBuA Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8fc957fac94941ed82bb063243e980f3 Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-d-857467-1'} Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.237723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.243576 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.243576 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.243576 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:35:41.243576 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:35:41.243576 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 13 16:35:41.243576 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.246042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec302dc4-7f9a-446e-93ba-d7fdcdaad67d tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.247190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec302dc4-7f9a-446e-93ba-d7fdcdaad67d tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-857467-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.022036 Sep 13 16:35:41.248256 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 718/1476] 10.222.0.61 () {58 vars in 1194 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/n-d-857467-1/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:41.262385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adf8f93f-0f33-4edf-9984-2e59ed430b27 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Calling method '.version_select at 0x7fbeb50ee700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.275030 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-adf8f93f-0f33-4edf-9984-2e59ed430b27 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adf8f93f-0f33-4edf-9984-2e59ed430b27 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'nonexistent_hostname'} Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.284075 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adf8f93f-0f33-4edf-9984-2e59ed430b27 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-adf8f93f-0f33-4edf-9984-2e59ed430b27 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.030797 Sep 13 16:35:41.288217 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 759/1477] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:35:41.295891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-636848c2-c711-4c59-ac6e-dd9aad6151c1 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Calling method '.version_select at 0x7fbeb53c7f70>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.297558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-636848c2-c711-4c59-ac6e-dd9aad6151c1 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '8fc957fac94941ed82bb063243e980f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324602d8561f4edea0e50ddbf9a58107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-636848c2-c711-4c59-ac6e-dd9aad6151c1 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Request method failure captured: Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-hosts/n-d-857467-1/startup HTTP/1.1 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbZZY4alEvCMw9nK6gSiRAo2KoiNGHY8VumAvY9VROMcowec1qkNHdYQ02813CsDx44yr4zE-L6sxnqr1KcnLktCWyxzclbJ95Xz72y5K96eIPymYIdj0znDiMa6ZHID6gHfczi4FYH5IYwBhPVS-wmngJ0I5jKs_ReRDEjSGHBuA Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8fc957fac94941ed82bb063243e980f3 Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-d-857467-1'} Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.299149 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-636848c2-c711-4c59-ac6e-dd9aad6151c1 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-636848c2-c711-4c59-ac6e-dd9aad6151c1 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-857467-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008572 Sep 13 16:35:41.307532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 719/1478] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/n-d-857467-1/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:41.312011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e748e6d-c7bd-4b1a-b57f-13db25f9a321 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Calling method '.version_select at 0x7fbeb5158d30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.322807 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9e748e6d-c7bd-4b1a-b57f-13db25f9a321 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e748e6d-c7bd-4b1a-b57f-13db25f9a321 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'nonexistent_hostname'} Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.324833 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e748e6d-c7bd-4b1a-b57f-13db25f9a321 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e748e6d-c7bd-4b1a-b57f-13db25f9a321 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019088 Sep 13 16:35:41.330545 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 760/1479] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:35:41.338199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e0a7c9c-c532-433b-9b4b-72676da53ab9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb9760550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e0a7c9c-c532-433b-9b4b-72676da53ab9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/os-hosts/n-d-857467-1 HTTP/1.1 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 51 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: {"status": "enable", "maintenance_mode": "invalid"} Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-d-857467-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'disable', Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'Enable', Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'Disable', Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance: Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'invalid' Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:35:41.342164 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e0a7c9c-c532-433b-9b4b-72676da53ab9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.347531 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e0a7c9c-c532-433b-9b4b-72676da53ab9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-857467-1" status: 400 len: 199 microversion: 2.1 time: 0.009696 Sep 13 16:35:41.349315 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 720/1480] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:35:41 2022] PUT /compute/v2.1/os-hosts/n-d-857467-1 => generated 199 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:35:41.354717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f9427f9-a079-4c2d-9d0e-7e4190ec34c9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb50ce310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f9427f9-a079-4c2d-9d0e-7e4190ec34c9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/os-hosts/n-d-857467-1 HTTP/1.1 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 51 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: {"status": "invalid", "maintenance_mode": "enable"} Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'n-d-857467-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'disable', Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'Enable', Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'Disable', Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance: Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'invalid' Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:35:41.361689 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f9427f9-a079-4c2d-9d0e-7e4190ec34c9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f9427f9-a079-4c2d-9d0e-7e4190ec34c9 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-857467-1" status: 400 len: 189 microversion: 2.1 time: 0.014400 Sep 13 16:35:41.367252 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 761/1481] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:35:41 2022] PUT /compute/v2.1/os-hosts/n-d-857467-1 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:35:41.377405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6fd0256b-dcb9-49e8-a136-f825f6d2b484 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Action: 'update', calling method: .version_select at 0x7fbeb9760700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:41.381479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6fd0256b-dcb9-49e8-a136-f825f6d2b484 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '8fc957fac94941ed82bb063243e980f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324602d8561f4edea0e50ddbf9a58107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6fd0256b-dcb9-49e8-a136-f825f6d2b484 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Request method failure captured: Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/os-hosts/n-d-857467-1 HTTP/1.1 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 50 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbZZY4alEvCMw9nK6gSiRAo2KoiNGHY8VumAvY9VROMcowec1qkNHdYQ02813CsDx44yr4zE-L6sxnqr1KcnLktCWyxzclbJ95Xz72y5K96eIPymYIdj0znDiMa6ZHID6gHfczi4FYH5IYwBhPVS-wmngJ0I5jKs_ReRDEjSGHBuA Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/324602d8561f4edea0e50ddbf9a58107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 324602d8561f4edea0e50ddbf9a58107 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2099196684 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8fc957fac94941ed82bb063243e980f3 Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2099196684-project Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: {"status": "enable", "maintenance_mode": "enable"} Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'n-d-857467-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 13 16:35:41.384425 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6fd0256b-dcb9-49e8-a136-f825f6d2b484 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6fd0256b-dcb9-49e8-a136-f825f6d2b484 tempest-HostsAdminNegativeTestJSON-2099196684 tempest-HostsAdminNegativeTestJSON-2099196684-project] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-857467-1" status: 403 len: 111 microversion: 2.1 time: 0.013476 Sep 13 16:35:41.389609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 721/1482] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:35:41 2022] PUT /compute/v2.1/os-hosts/n-d-857467-1 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:35:41.395910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca125f68-71ab-452a-9cb3-88373e39d770 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb6338a60>, body: {"status": null, "maintenance_mode": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca125f68-71ab-452a-9cb3-88373e39d770 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/os-hosts/n-d-857467-1 HTTP/1.1 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 42 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: {"status": null, "maintenance_mode": null} Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'n-d-857467-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'disable', Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'Enable', Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'Disable', Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance: Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi None Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:35:41.400668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca125f68-71ab-452a-9cb3-88373e39d770 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca125f68-71ab-452a-9cb3-88373e39d770 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-857467-1" status: 400 len: 127 microversion: 2.1 time: 0.010593 Sep 13 16:35:41.405794 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 762/1483] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:35:41 2022] PUT /compute/v2.1/os-hosts/n-d-857467-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:35:41.412421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-44ca0495-9a73-47a8-aeef-ebb4c5a24720 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb97bde50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:41.417867 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.hosts [None req-44ca0495-9a73-47a8-aeef-ebb4c5a24720 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Enabling host nonexistent_hostname. Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-44ca0495-9a73-47a8-aeef-ebb4c5a24720 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-44ca0495-9a73-47a8-aeef-ebb4c5a24720 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Request method failure captured: Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 50 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFcy8YAaXoPvsGaoBV3qv2Ty7Le6gCWtsSdJvcxOVg-FPAYG1Vz_lh56qaieNfiduXIAc5ipxSne0uDFaXWpwT2jo-NXKiioBbeWSNv91KYZdZiOzdxIdiHClZISmKzHImAIuJgRLVsQu3E3MFBVTX3l4V62LFK3BockGS6FbsPV4g Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2cbe84229f24c6282cfa0bf855d4c28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a2cbe84229f24c6282cfa0bf855d4c28 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1427843193 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 04bcc24033a2419d8ae2bb406b232f89 Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1427843193-project-admin Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: {"status": "enable", "maintenance_mode": "enable"} Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.431599 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-44ca0495-9a73-47a8-aeef-ebb4c5a24720 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-44ca0495-9a73-47a8-aeef-ebb4c5a24720 tempest-HostsAdminNegativeTestJSON-1427843193 tempest-HostsAdminNegativeTestJSON-1427843193-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023340 Sep 13 16:35:41.438906 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 722/1484] 10.222.0.61 () {60 vars in 1211 bytes} [Tue Sep 13 16:35:41 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:35:41.809709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:41.810392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:41.823724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:41.824490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:41.825135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:41.826368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:41.827006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:41.827603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:42.075003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:42.090914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:42.091537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:42.100052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d59961e-cce8-4b2f-a189-030943120f30 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1220 microversion: 2.1 time: 0.296856 Sep 13 16:35:42.103079 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 763/1485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:41 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1220 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:42.105307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:42.106425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:42.108161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:42.110731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:42.111273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:42.111881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:42.989943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:43.007185 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c04b06a8-0031-4e83-8b8a-2001267ea9f3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1542 microversion: 2.1 time: 0.920789 Sep 13 16:35:43.008646 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 723/1486] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:42 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1542 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:43.135158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:43.137750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:43.148111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:43.149084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:43.150331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:43.152575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:43.153458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:43.154231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:43.351385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:43.371944 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b8f89ca3-1e87-4fed-8ee6-f839fa66b230 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1282 microversion: 2.1 time: 0.246361 Sep 13 16:35:43.388770 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 764/1487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:43 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:44.038377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:44.043255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:44.058251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:44.059084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:44.065322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:44.066497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:44.067143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:44.067747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:44.395950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:44.396561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:44.412342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:44.412866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:44.413222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:44.413941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:44.415294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:44.420480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:44.568905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:44.577504 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7c497e4-d679-4077-98f7-1b391163b8a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1282 microversion: 2.1 time: 0.185318 Sep 13 16:35:44.597183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 765/1488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:44 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:44.688698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:44.701366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ccc2f37-36ea-4d33-89b5-a0d80e4b88a6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1541 microversion: 2.1 time: 0.671888 Sep 13 16:35:44.702337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 724/1489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:44 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1541 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:45.606307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:45.607692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:45.621860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:45.629005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:45.629720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:45.631120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:45.631587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:45.632021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:45.733266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:45.736303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:45.759735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:45.763288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:45.764462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:45.765425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:45.772010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:45.774465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:46.149574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:46.172032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ecf479cc-ddf0-48f7-a2b3-e55d1e0a7605 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1282 microversion: 2.1 time: 0.570602 Sep 13 16:35:46.187534 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 766/1490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:45 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1282 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:46.538351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:46.568407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:46.569250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:46.570099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:46.589134 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] Creating event network-vif-unplugged:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h1-857467-1 Sep 13 16:35:46.598907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:35:46.620184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9675e196-d74a-44dc-9cf4-900c6efb3a5a req-ec2a5886-5e90-4274-bc88-22442857568c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.430986 Sep 13 16:35:46.621813 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 767/1491] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:46.670167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:46.680439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-897b25fd-4843-4604-bf77-e2eadbea86d6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1541 microversion: 2.1 time: 0.953290 Sep 13 16:35:46.681224 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 725/1492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:45 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1541 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:47.201949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:47.202922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:47.212896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:47.213708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:47.214419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:47.215291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:47.216085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:47.216741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:47.721031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:47.724052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:47.745294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:47.755535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:47.756159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:47.761553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:47.767474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:47.769596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:48.156509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:48.165731 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef9af7c9-5848-42b4-b64f-504d1dcc96c1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.970823 Sep 13 16:35:48.178087 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 768/1493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:47 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:48.305960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:48.324029 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-422d2175-1556-4723-bab6-4a1459e36b7c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1541 microversion: 2.1 time: 0.622415 Sep 13 16:35:48.325130 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 726/1494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:47 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1541 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:48.676137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:48.692227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:48.697901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:48.698789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:48.714929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:48.746407 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] Creating event network-changed:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h1-857467-1 Sep 13 16:35:48.771560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:35:48.788490 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e34c72fd-b15f-4503-8b53-f2adb2abb61f req-c0bbc2d2-366e-4688-a135-3ec0e432dac7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116029 Sep 13 16:35:48.790412 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 769/1495] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:49.194278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:49.194978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:49.200230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:49.200903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:49.209471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.210280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.211108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.213482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.214835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.215285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.217966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.218608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.219401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.231689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.233005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.240244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.493132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:49.501942 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e89ef763-2d2b-46f7-9a1d-55f87dd34cae tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.311656 Sep 13 16:35:49.502525 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 770/1496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:49 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:49.661541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb51d9310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:49.663532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.664022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.665028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.681116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.682089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.682689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.695123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.696469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.697139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.703701 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcac8911-caa4-4d61-a559-ec840ea85287 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.199508 Sep 13 16:35:49.704578 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 771/1497] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:35:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:49.717348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:49.718344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:49.725698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.726546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.727260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.728213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:49.728885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:49.730416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:49.828437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid f7305af6-eeb4-43bc-ac65-52988a63a1de {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:35:49.866040 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bde55467-bc72-48d0-9e64-dd1b2b8bec08 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 2345 microversion: 2.25 time: 0.679509 Sep 13 16:35:49.881067 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 727/1498] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:35:49 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 2345 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:35:50.011286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1132580068", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "179fb6ca-f6bf-4d09-a618-632e7e778e62"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:50.068624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:50.078683 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-132822d6-f1cc-4c57-b48d-f97d068ff355 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1473 microversion: 2.1 time: 0.372679 Sep 13 16:35:50.079582 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 772/1499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:49 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:50.097645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb5100670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.099856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.100767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.101475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.134227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] validate_networks() for [('179fb6ca-f6bf-4d09-a618-632e7e778e62', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:35:50.151594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.152803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.153448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.171229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.171946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.172553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.181307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-37da3ea4-72bf-4293-8fb0-239d44bea7bc tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.099082 Sep 13 16:35:50.194910 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 773/1500] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:50.202918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.209704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.211732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.212397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.213334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.214066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.214706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.247133 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebc71883-ddc5-4ce9-99ea-e9a2a445b3e3 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055175 Sep 13 16:35:50.248472 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 774/1501] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:35:50.253578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cdf3e72d-645a-4112-b37a-2a79c067bf70 req-19169430-fc8e-4b43-8bd9-3fcd0492f6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3077469c-eab1-4d60-bc5b-5dd44d7de667", "tag": "444fb5da-76b5-4504-b8cb-6ad808423cdf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:50.266635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cdf3e72d-645a-4112-b37a-2a79c067bf70 req-19169430-fc8e-4b43-8bd9-3fcd0492f6d8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.267437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cdf3e72d-645a-4112-b37a-2a79c067bf70 req-19169430-fc8e-4b43-8bd9-3fcd0492f6d8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.268171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cdf3e72d-645a-4112-b37a-2a79c067bf70 req-19169430-fc8e-4b43-8bd9-3fcd0492f6d8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.291223 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cdf3e72d-645a-4112-b37a-2a79c067bf70 req-19169430-fc8e-4b43-8bd9-3fcd0492f6d8 service nova] Creating event network-changed:444fb5da-76b5-4504-b8cb-6ad808423cdf for instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 on n-h1-857467-1 Sep 13 16:35:50.298281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cdf3e72d-645a-4112-b37a-2a79c067bf70 req-19169430-fc8e-4b43-8bd9-3fcd0492f6d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048299 Sep 13 16:35:50.302147 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 775/1502] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:50.308316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb5100160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.319914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.320501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.321667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.353428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.356046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.356524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.380138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.380643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.381098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.409275 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-24dd484e-a3df-4f4e-9596-f12f808bf24b tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.105831 Sep 13 16:35:50.409942 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 776/1503] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:50.422778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb5100430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.425680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.426584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.427287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.448182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:50.457521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.458066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.458523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.472129 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2624ccc-fc21-4868-9aee-ce2f16efd8ac tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.053688 Sep 13 16:35:50.480019 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 777/1504] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:50.497566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cac9436-f199-43e1-add7-f9c4e7a09a7c tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb516cd30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.499644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cac9436-f199-43e1-add7-f9c4e7a09a7c tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.500147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cac9436-f199-43e1-add7-f9c4e7a09a7c tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.500595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cac9436-f199-43e1-add7-f9c4e7a09a7c tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.537037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cac9436-f199-43e1-add7-f9c4e7a09a7c tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.043433 Sep 13 16:35:50.537622 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 778/1505] 10.222.0.61 () {58 vars in 1179 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:50.551666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.552452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:50.567568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.568211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.568671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.569427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.569924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.574028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.582703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:50.781131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:50.869468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:50.881735 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62761910-3aa7-43d2-8b50-fad3a4966175 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.340148 Sep 13 16:35:50.882671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 779/1506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:50.891388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb5ac9a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.894587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.895528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.897796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.924996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.925600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.926095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.942293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.943052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.943701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.953108 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5474312a-19cc-4256-b8ee-d42bf5e0cde3 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067371 Sep 13 16:35:50.953730 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 780/1507] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:50.965360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb516ce50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:50.967519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.968197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.969073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.986803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:50.987558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:50.988229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:50.997965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cb145e9-6e95-4f23-adb8-4b0c43a7001e tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.037508 Sep 13 16:35:51.010057 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 781/1508] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:35:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:51.019627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb51000d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:51.023282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.024710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.026484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.042918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.044810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.045541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.065587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-997c9462-58be-499e-adbe-0b63487b9704 tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.042878 Sep 13 16:35:51.066636 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 782/1509] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:35:51 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:51.088325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Calling method '.version_select at 0x7fbeb5d19700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:51.093426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.095711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.096982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.132088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.132889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.134220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.176967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.178855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.180196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.735806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:35:51.736321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:35:51.736822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:35:51.737296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:35:51.737991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:35:51.755275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.756264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.756861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.758184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.759034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.759682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.784511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:35:51.792373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for user 67dc5c1abf0649888b406f5911e5e5dd and project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:35:51.809985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:35:51.819116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:35:51.967402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0cdc2b1d-fbce-4251-b9b9-edb7edf1283c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.071618 Sep 13 16:35:51.968658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 728/1510] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:35:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:35:51.974741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:51.975801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:51.985554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.986295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.986884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:51.987856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:51.988470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:51.989183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:52.183354 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1cece127-1933-4643-8c3e-b05b5850e51d tempest-HypervisorAdminTestJSON-155298345 tempest-HypervisorAdminTestJSON-155298345-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 1.103014 Sep 13 16:35:52.183983 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 783/1511] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Sep 13 16:35:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:35:52.199185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:52.203647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:52.227771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:52.228264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:52.228785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:52.229506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:52.241341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:52.242366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:52.277870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:52.285913 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ba562152-22fe-458e-a7af-c31555f6d8b5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1473 microversion: 2.1 time: 0.315918 Sep 13 16:35:52.286500 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 729/1512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:51 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1473 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:52.324051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ec0b11f-49b1-423f-8e53-0ce6dd03945a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:52.327018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ec0b11f-49b1-423f-8e53-0ce6dd03945a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:52.514496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ec0b11f-49b1-423f-8e53-0ce6dd03945a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:52.526549 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ec0b11f-49b1-423f-8e53-0ce6dd03945a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1208 microversion: 2.1 time: 0.217429 Sep 13 16:35:52.529284 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 730/1513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:52 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1208 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:52.760582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:52.779458 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d8ad6aaf-71da-4747-8333-febd6bce5e9a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.584676 Sep 13 16:35:52.783465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 784/1514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:52 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:53.313758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:53.314427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:53.347915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:53.353037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:53.354964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:53.358509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:53.359251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:53.360597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:53.553268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:53.554058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:53.597358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:53.602775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:53.606342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:53.609277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:53.609768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:53.612826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:53.854104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:53.890675 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a312d36-de06-4e1d-be95-d506801cdf1f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1260 microversion: 2.1 time: 0.329749 Sep 13 16:35:53.896624 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 785/1515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:53 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1260 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:53.902175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:53.905282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:53.949373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:53.949952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:53.955773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:53.956607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:53.962281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:53.964248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.132779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:54.143051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6bb4ee0-ac5c-4cc8-8eb6-41d70c6d8a93 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1470 microversion: 2.1 time: 0.834836 Sep 13 16:35:54.151441 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 731/1516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:53 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1470 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:54.174519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:54.175377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:54.186135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.187280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.188102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.189497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.192175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.192865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.251344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.252094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.252724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.254490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.255161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.256474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.287480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:35:54.301307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:54.302538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for user 80714f77e8904565bde7dc8e7dce1063 and project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:35:54.320097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7efa0856-1884-4afd-8064-7385b5a2c33b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.424395 Sep 13 16:35:54.321872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 786/1517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:53 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:54.641968 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d3eef9c4-9cb5-428f-a2b5-25aacd68b2e6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88/action" status: 202 len: 0 microversion: 2.1 time: 0.471735 Sep 13 16:35:54.645852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 732/1518] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:35:54 2022] POST /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:35:54.659829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:54.661385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:54.675354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.677653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.678445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.679463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.680449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.681281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.906376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82caedb5-ed7e-4ce6-9089-824822b66e96", "device": "/dev/xvdb"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:54.909933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:54.919687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.920428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.921229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:54.922202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:54.922929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:54.923607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:55.110399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:55.135147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc3e054c-82d7-43d7-a765-0302377c8daa tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1469 microversion: 2.1 time: 0.487888 Sep 13 16:35:55.150605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 787/1519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:54 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1469 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:55.176949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:55.177639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:55.185625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:55.186413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:55.187439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:55.188592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:55.189546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:55.190280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:55.309167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:55.322706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b15b6ba-5afe-4d43-a5b3-ef8e4fb6ea8b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1266 microversion: 2.1 time: 0.168773 Sep 13 16:35:55.340144 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 788/1520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:55 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:55.356125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:55.356671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:55.364238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:55.364741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:55.365277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:55.366034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:55.366551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:55.367015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:55.395819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:55.744041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:55.768480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a748e32d-0a4e-41ed-a092-33a58bbcb0b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.425143 Sep 13 16:35:55.770616 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 789/1521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:55 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:56.167212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:56.167836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:56.174504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:56.175216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:56.175808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:56.176668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:56.177285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:56.177894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:56.449616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:56.459963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f6f2db9-5c39-4b02-95df-ba67a6a4af80 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1469 microversion: 2.1 time: 0.297197 Sep 13 16:35:56.473849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 790/1522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:56 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:56.473849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:56.473849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:56.488679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:56.489688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:56.492988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:56.494473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:56.495214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:56.495879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:56.742769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:56.755088 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7a86cd90-426f-4a69-82be-07454c24be8d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.289838 Sep 13 16:35:56.756799 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 791/1523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:56 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:57.021589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "name": "network-vif-plugged", "status": "completed", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:57.034810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.035310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.035757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.054392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] Creating event network-vif-plugged:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h1-857467-1 Sep 13 16:35:57.066618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:35:57.102740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3a92c2e6-985a-4d76-a26b-d53d6ffe013b req-eb3ba501-fd9b-4278-8485-f8a6e4ffc780 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342070 Sep 13 16:35:57.107171 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 792/1524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:57.127337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:57.128058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:57.154102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.156528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.157787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.159095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.162416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.164794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.505085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:57.510901 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-117ade9b-82da-4ebf-83ae-6643a7193497 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "POST /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.609265 Sep 13 16:35:57.511519 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 733/1525] 10.222.0.61 () {62 vars in 1364 bytes} [Tue Sep 13 16:35:54 2022] POST /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 194 bytes in 2612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:35:57.519939 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b10ab709-70c8-4f9c-a3da-dcb82028d473 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.411614 Sep 13 16:35:57.525491 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 793/1526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:57 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:57.539600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:57.541367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:57.551001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-98d355ed-3187-442b-a407-54e8bd8ff0ca req-44714558-3d27-4711-bf45-4a17f3809d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5793c3-b5e5-4b6c-91cd-62af303c98de", "tag": "0ba191e1-13c0-4460-ab74-b400fb91de9d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:35:57.557325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.558140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.560052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.562024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.564112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.564790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.567992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-98d355ed-3187-442b-a407-54e8bd8ff0ca req-44714558-3d27-4711-bf45-4a17f3809d56 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.568715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-98d355ed-3187-442b-a407-54e8bd8ff0ca req-44714558-3d27-4711-bf45-4a17f3809d56 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.569330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-98d355ed-3187-442b-a407-54e8bd8ff0ca req-44714558-3d27-4711-bf45-4a17f3809d56 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.582845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-98d355ed-3187-442b-a407-54e8bd8ff0ca req-44714558-3d27-4711-bf45-4a17f3809d56 service nova] Creating event network-changed:0ba191e1-13c0-4460-ab74-b400fb91de9d for instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de on n-h2-857467-1 Sep 13 16:35:57.590534 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-98d355ed-3187-442b-a407-54e8bd8ff0ca req-44714558-3d27-4711-bf45-4a17f3809d56 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044722 Sep 13 16:35:57.591406 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 734/1527] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:35:57.784467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:57.785699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:57.802151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.802875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.805115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.806094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:57.808520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:57.809146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:57.869783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:57.879669 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-72b22435-7d5b-4ed1-be25-3d06b5a1705f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1469 microversion: 2.1 time: 0.352333 Sep 13 16:35:57.880645 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 794/1528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:57 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:58.288307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:58.298130 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4228532f-0c0d-4a9f-a6d1-529b00abb0f6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.517970 Sep 13 16:35:58.299373 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 735/1529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:57 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:35:58.549027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:58.550176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:58.561868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:58.563215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:58.564256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:58.566168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:58.567365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:58.568501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:58.912060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:58.925284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:58.938527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:58.939633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:58.940808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:58.941786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:58.942544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:58.943200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.337308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:59.350126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70d6ab27-1e8d-4fa1-9c49-d8027fa6ee6a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.805965 Sep 13 16:35:59.364244 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 795/1530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:58 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:59.539827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:35:59.543403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:35:59.551108 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aad0910-270b-4fce-8d2b-d8ff5eb424ca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1469 microversion: 2.1 time: 0.649863 Sep 13 16:35:59.555806 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 736/1531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:58 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1469 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:35:59.563918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:59.566531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:35:59.586385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.587124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.587741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.588624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.589262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.589886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.600188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Calling method '.version_select at 0x7fbeb51eaaf0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:59.611794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.619675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.622667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.680847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.681453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.682798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.763136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.763639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.764074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.802068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.808867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.809475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.877429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.879638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.880256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.897216 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d723a34e-e04a-4882-b15d-acda794764d5 tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2467 microversion: 2.53 time: 0.526257 Sep 13 16:35:59.901178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 796/1532] 10.222.0.61 () {60 vars in 1243 bytes} [Tue Sep 13 16:35:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2467 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:35:59.921393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Calling method '.version_select at 0x7fbeb50ce3a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:35:59.925389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.928302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.928978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:35:59.951744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:35:59.952542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:35:59.953173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.013042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.013753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.014429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.018856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:00.028900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-082a7fee-f52a-4d46-a5ab-a40e30591091 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.471847 Sep 13 16:36:00.031181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.031327 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 737/1533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:35:59 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:00.032547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.033286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.082196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.083031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.084455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.094160 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-828800ce-b5b3-4f4d-9a1d-4feb6d55e87a tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1160 microversion: 2.53 time: 0.176223 Sep 13 16:36:00.103238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 797/1534] 10.222.0.61 () {60 vars in 1222 bytes} [Tue Sep 13 16:35:59 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1160 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:36:00.108961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Calling method '.version_select at 0x7fbeb970ff70>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:00.112714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.113210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.113651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.136395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.136910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.137338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.146838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5fb83f67-d561-45d0-b01d-be04ebfc294d tempest-HypervisorAdminV253TestBase-197910865 tempest-HypervisorAdminV253TestBase-197910865-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/0b414386-b5d2-4013-8332-c9f732b51926" status: 200 len: 791 microversion: 2.53 time: 0.041496 Sep 13 16:36:00.150907 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 738/1535] 10.222.0.61 () {60 vars in 1298 bytes} [Tue Sep 13 16:36:00 2022] GET /compute/v2.1/os-hypervisors/0b414386-b5d2-4013-8332-c9f732b51926 => generated 791 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:36:00.379634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:00.381151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:00.389703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:00.391861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.392600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.393271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.394306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.394963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.395586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.575477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:00.576096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:00.586657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.588538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.592718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.593716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.594387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.597156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.749253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:00.760376 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a7da5738-3ed2-43ed-936e-e27b1f60b68c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.387488 Sep 13 16:36:00.765342 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 798/1536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:00 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:00.782186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6c2b1830-bcb6-4351-bfa1-9f904f3c3143 req-a14bafbf-7075-4f42-aa3c-d81bac5f3bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3077469c-eab1-4d60-bc5b-5dd44d7de667", "name": "network-vif-plugged", "status": "completed", "tag": "444fb5da-76b5-4504-b8cb-6ad808423cdf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:00.797958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6c2b1830-bcb6-4351-bfa1-9f904f3c3143 req-a14bafbf-7075-4f42-aa3c-d81bac5f3bb2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:00.798687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6c2b1830-bcb6-4351-bfa1-9f904f3c3143 req-a14bafbf-7075-4f42-aa3c-d81bac5f3bb2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:00.800230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6c2b1830-bcb6-4351-bfa1-9f904f3c3143 req-a14bafbf-7075-4f42-aa3c-d81bac5f3bb2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:00.819779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6c2b1830-bcb6-4351-bfa1-9f904f3c3143 req-a14bafbf-7075-4f42-aa3c-d81bac5f3bb2 service nova] Creating event network-vif-plugged:444fb5da-76b5-4504-b8cb-6ad808423cdf for instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 on n-h1-857467-1 Sep 13 16:36:00.828569 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6c2b1830-bcb6-4351-bfa1-9f904f3c3143 req-a14bafbf-7075-4f42-aa3c-d81bac5f3bb2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060801 Sep 13 16:36:00.829951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 799/1537] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:01.052944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:01.054015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:01.072560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:01.073365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:01.074021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:01.075047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:01.075685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:01.076291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:01.126509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:01.142446 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-976d18d8-e440-4bab-8220-bd445373a602 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1469 microversion: 2.1 time: 0.571148 Sep 13 16:36:01.157865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 739/1538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:00 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1469 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:01.718118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:01.732410 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba3e8d3e-744d-40c1-b16a-7d8dd587abb1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.682718 Sep 13 16:36:01.751121 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 800/1539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:01 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:01.792403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:01.793248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:01.803379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:01.807146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:01.811047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:01.812010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:01.815618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:01.816322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:01.817855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:02.170512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:02.172045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:02.194688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:02.198095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:02.203010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:02.204049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:02.207598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:02.209390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:02.427869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:02.443841 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-423c1796-6a2e-4bfb-bc8c-cdc765b6832b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1324 microversion: 2.1 time: 0.655892 Sep 13 16:36:02.445108 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 740/1540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:01 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1324 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:02.740280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:02.753506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4582dbc8-24ae-4554-8c03-4d94925530db tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1469 microversion: 2.1 time: 0.587026 Sep 13 16:36:02.754953 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 801/1541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:02 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:02.760427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:02.761140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:02.764097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:02.772399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:02.778459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:02.779222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:02.780198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:02.780878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:02.781542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:03.473341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:03.474829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:03.498353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:03.500132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:03.501118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:03.502907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:03.504718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:03.506286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:03.921534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:03.938963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1535c279-2453-4810-9fe9-af31607740b3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.471824 Sep 13 16:36:03.941947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 802/1542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:03 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:03.943884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:03.958268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:03.961130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:03.986132 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-05c503ab-3ab4-4f42-b43d-b9c2ac26d941 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 1.217913 Sep 13 16:36:03.988490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 741/1543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:02 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:03.990666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:03.991456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:03.994561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:03.997514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:03.998578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:03.999704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:04.002055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:04.005928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:04.018812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:04.019529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:04.021613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:04.022534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:04.029582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:04.030206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:04.397622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=5 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:04.743226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:04.761437 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14fa6923-2dd4-4694-a479-749f1b3a3880 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.818178 Sep 13 16:36:04.767042 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 803/1544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:03 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:04.785757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:04.810701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:04.811465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:04.812324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:04.832977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:04.838239 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] Creating event network-vif-unplugged:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h2-857467-1 Sep 13 16:36:04.849192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:36:04.872369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6cf0fbb6-436a-4bf3-9617-9bf62545364c req-15a67ef0-a401-4b01-b32e-ee0d88590603 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102235 Sep 13 16:36:04.873912 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 804/1545] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:05.015634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:05.016407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:05.029857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:05.034076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:05.034959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:05.035724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:05.036195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:05.036623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:05.639525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:05.661724 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f148acc0-f577-4da9-97ce-01fc435abbcc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.640826 Sep 13 16:36:05.681483 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 805/1546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:05 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:05.791968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:05.792906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:05.806607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:05.809931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:05.810660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:05.812441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:05.813174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:05.814061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:06.043487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:06.067428 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92cd1e7c-9411-4ee6-8868-f720addd19f6 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.279909 Sep 13 16:36:06.082331 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 806/1547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:05 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:06.110881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:06.120520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-150f3932-b732-4288-8f25-ceedbf3cbe6e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 2.130747 Sep 13 16:36:06.131845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 742/1548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:03 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:06.147328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98255f78-9c8a-48d9-bf4b-2caab85ab9ee tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-269260562", "metadata": {"": ""}}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98255f78-9c8a-48d9-bf4b-2caab85ab9ee tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action HTTP/1.1 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 106 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-269260562", "metadata": {"": ""}}} Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-269260562', 'metadata': {'': ''}}}} Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'': ''} Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:36:06.160938 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:06.167402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98255f78-9c8a-48d9-bf4b-2caab85ab9ee tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:06.169761 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98255f78-9c8a-48d9-bf4b-2caab85ab9ee tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action" status: 400 len: 170 microversion: 2.1 time: 0.027154 Sep 13 16:36:06.177140 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 743/1549] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Sep 13 16:36:06 2022] POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:36:06.197649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:06.198948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:06.208908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:06.211631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:06.212434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:06.214516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:06.215015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:06.218621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:06.339161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-faebb289-c241-4c04-8488-54e6ca2876f3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Action: 'create', calling method: .version_select at 0x7fbeb52440d0>, body: {"keypair": {"name": "tempest-keypair-1135819688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6hcLU4o03qpmQJQAcFvbCB5NYKY6Te00k3oUovXtmvbzor/OKMNeaOjVHuqH3XgBsWXzzQYLmPeQdgNnbdQUmXmelHJspBnZoeYD2AofViJ3vv8pyXrTdaoBDHAoxV5Q=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:06.363844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-faebb289-c241-4c04-8488-54e6ca2876f3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Getting quotas for project 1ef9a16f03094174989a3789f779e920. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:06.383109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-faebb289-c241-4c04-8488-54e6ca2876f3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Getting quotas for user c5a13c6d9196461eab07a95626c2858b and project 1ef9a16f03094174989a3789f779e920. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:06.428127 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-faebb289-c241-4c04-8488-54e6ca2876f3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.356464 Sep 13 16:36:06.436923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 807/1550] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:36:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:06.659466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:06.681945 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df1a7a59-b3d9-4c15-8b5a-551508c5bfca tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.503155 Sep 13 16:36:06.682976 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 744/1551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:06 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:06.686369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:06.687360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:06.700214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:06.700895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:06.702443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:06.703326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:06.708906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:06.710926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:06.714175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:06.714796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:06.743638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:06.744140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:06.744580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:06.745304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:06.745765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:06.746224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:07.028429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:07.039737 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a57ca656-456e-4b93-aa82-d9390bd15527 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.357662 Sep 13 16:36:07.045589 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 808/1552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:06 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:07.092030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:07.092986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:07.101816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:07.102615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:07.103014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:07.103860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:07.104317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:07.111018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:07.116838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:07.130082 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c71ea4e-587c-485b-b500-bf2072ea484d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.416702 Sep 13 16:36:07.130708 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 745/1553] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:06 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:07.170770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc882053-b1fc-4c3d-9f11-b2433385273e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1348926332", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc882053-b1fc-4c3d-9f11-b2433385273e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action HTTP/1.1 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 619 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1348926332", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1348926332', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:36:07.180608 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:36:07.183912 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:07.187530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc882053-b1fc-4c3d-9f11-b2433385273e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:07.187530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc882053-b1fc-4c3d-9f11-b2433385273e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action" status: 400 len: 938 microversion: 2.1 time: 0.030053 Sep 13 16:36:07.189838 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 746/1554] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Sep 13 16:36:07 2022] POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action => generated 938 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:36:07.197814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:07.205475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:07.265702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:07.271476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:07.271956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:07.280125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:07.286309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:07.287229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:07.355131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:07.384053 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f125767e-d66c-434e-acfd-b8783718d5d9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.296094 Sep 13 16:36:07.386040 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 809/1555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:07 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:07.797728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:07.811423 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0845eeb-9101-470e-8f99-20b6539a595c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.618157 Sep 13 16:36:07.813101 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 747/1556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:07 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:07.860034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:07.861737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:07.886957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:07.888808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:07.890001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:07.891028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:07.895400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:07.898062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:08.317982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2091161925", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:08.346960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:08.358762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-186c6e18-04a5-4116-b31a-f96c2e0a247d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.518301 Sep 13 16:36:08.364009 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 748/1557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:07 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:08.379590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:08.380480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:08.387161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:08.390486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:08.391177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:08.392109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:08.394108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:08.395633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:08.442751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] validate_networks() for [('6421ed40-b5d7-4da6-85d2-0c9151ae2769', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:36:08.785727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:08.812476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-070f7f81-4962-4345-84ba-7ab000c01dbf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.447034 Sep 13 16:36:08.813761 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 749/1558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:08 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:08.825158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1a829758-19b8-4b7b-9c1e-f3094a9d5716 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1a829758-19b8-4b7b-9c1e-f3094a9d5716 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action HTTP/1.1 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 285 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:08.833888 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:36:08.839721 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:08.843833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1a829758-19b8-4b7b-9c1e-f3094a9d5716 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:08.843833 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1a829758-19b8-4b7b-9c1e-f3094a9d5716 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action" status: 400 len: 619 microversion: 2.1 time: 0.025940 Sep 13 16:36:08.843833 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 750/1559] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Sep 13 16:36:08 2022] POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:36:08.850330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:08.851353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:08.861269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:08.862040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:08.862684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:08.863572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:08.864191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:08.865091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.207895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:09.221458 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f3a7169-8df9-47f4-8f45-a02681cddba2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.376358 Sep 13 16:36:09.235960 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 751/1560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:08 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:09.247852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:09.260687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:09.261451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:09.262076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.279108 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] Creating event network-changed:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h2-857467-1 Sep 13 16:36:09.290031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:36:09.307176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-11a8d690-722f-4a11-b7b2-bc2acb74793f req-cc6f4395-062a-4a97-a125-2d28e16f9d17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068954 Sep 13 16:36:09.308097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 752/1561] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:09.322491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-010079e0-cda1-4ce8-80fb-bbeeb48d6901 req-07330b80-2f21-450c-8439-5507d23d153b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5793c3-b5e5-4b6c-91cd-62af303c98de", "name": "network-vif-plugged", "status": "completed", "tag": "0ba191e1-13c0-4460-ab74-b400fb91de9d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:09.335238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-010079e0-cda1-4ce8-80fb-bbeeb48d6901 req-07330b80-2f21-450c-8439-5507d23d153b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:09.336083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-010079e0-cda1-4ce8-80fb-bbeeb48d6901 req-07330b80-2f21-450c-8439-5507d23d153b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:09.336672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-010079e0-cda1-4ce8-80fb-bbeeb48d6901 req-07330b80-2f21-450c-8439-5507d23d153b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.354489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-010079e0-cda1-4ce8-80fb-bbeeb48d6901 req-07330b80-2f21-450c-8439-5507d23d153b service nova] Creating event network-vif-plugged:0ba191e1-13c0-4460-ab74-b400fb91de9d for instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de on n-h2-857467-1 Sep 13 16:36:09.363850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-010079e0-cda1-4ce8-80fb-bbeeb48d6901 req-07330b80-2f21-450c-8439-5507d23d153b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053294 Sep 13 16:36:09.365175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 753/1562] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:09.397147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:36:09.397741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:36:09.398804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:36:09.399428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:36:09.399858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:36:09.416456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:09.417331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:09.418023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.418964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:09.421051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:09.435550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.491984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Getting quotas for project 4710b60a7c7e44a78452286123322925. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:09.502375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Getting quotas for user 267bf606323b4178ba0cf7ba1a15440f and project 4710b60a7c7e44a78452286123322925. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:09.537644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:09.539522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:36:09.545451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:36:09.605401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5004d24a-bfd0-4fad-80c6-84778f0dc29f tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:09.607540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5004d24a-bfd0-4fad-80c6-84778f0dc29f tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5004d24a-bfd0-4fad-80c6-84778f0dc29f tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin] Request method failure captured: Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILF4Oc7C7KimOJpnjXIa2bTvuMVCuo69SzyQrlA_Iop7JdknLEs4kFiPvAXh1uytGinvd1vrbQVRfqpjw_GqDGkNSZvES6IuLdCZxVdUHYFwvdLapfrgrr63i-ZXm8itAL5ZQer1u-T-8tHfMFKAIX44NMDeHXGBgG5T_JoqvF6bwVQ Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: aae50865b6ab4eeb863ea0b0566b0209 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aae50865b6ab4eeb863ea0b0566b0209"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aae50865b6ab4eeb863ea0b0566b0209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aae50865b6ab4eeb863ea0b0566b0209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aae50865b6ab4eeb863ea0b0566b0209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: aae50865b6ab4eeb863ea0b0566b0209 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 55cdf9b586b3414380218703c34f3e80 Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid timestamp for date invalid_time Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'invalid_time'} Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:09.619920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:09.624871 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 13 16:36:09.624871 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.625807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5004d24a-bfd0-4fad-80c6-84778f0dc29f tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:09.626869 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5004d24a-bfd0-4fad-80c6-84778f0dc29f tempest-InstanceUsageAuditLogNegativeTestJSON-13972865 tempest-InstanceUsageAuditLogNegativeTestJSON-13972865-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.260247 Sep 13 16:36:09.627713 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 754/1563] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Sep 13 16:36:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:36:09.637476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:09.638593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:09.647604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:09.649478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:09.650212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.650799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e9515f4a-bde9-4f76-a229-cc498b3a5e4b tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.899405 Sep 13 16:36:09.651413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:09.652082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:09.652747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:09.665315 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 810/1564] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:36:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:36:09.882815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c82a6906-222a-44bc-8d11-a7e02e86b829 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:09.885197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c82a6906-222a-44bc-8d11-a7e02e86b829 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a48256946f96408e8ba10e371b37434b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e308f8db434a788af824b1e401529d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c82a6906-222a-44bc-8d11-a7e02e86b829 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Request method failure captured: Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILF3nFEzG19fIbo_TY-HA0rqI5xQqRVB61_3XxPel6tLeTCmSL_O5EMR5eSP96UxvZVdazWDAnLL6dYjGs9-xYzO9s0_HORvO5iOWPEo_EXIFvE3oB7tNzqijVy_UgvGHAkF72zVCH3LcKBsZqgjsHel6A-0OUq-tBHJwYv1MOMZM8Q Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a9e308f8db434a788af824b1e401529d Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e308f8db434a788af824b1e401529d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9e308f8db434a788af824b1e401529d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e308f8db434a788af824b1e401529d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9e308f8db434a788af824b1e401529d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a9e308f8db434a788af824b1e401529d Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a48256946f96408e8ba10e371b37434b Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.887615 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:09.891926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:09.891926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:09.891926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:36:09.891926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:36:09.891926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 13 16:36:09.891926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:09.901294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c82a6906-222a-44bc-8d11-a7e02e86b829 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:09.902321 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c82a6906-222a-44bc-8d11-a7e02e86b829 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.235892 Sep 13 16:36:09.903309 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 811/1565] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:36:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:36:09.917479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-303d537b-eff0-44c3-ab6e-901e67c0116a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:09.920560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-303d537b-eff0-44c3-ab6e-901e67c0116a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:10.024831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-303d537b-eff0-44c3-ab6e-901e67c0116a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:10.033504 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-303d537b-eff0-44c3-ab6e-901e67c0116a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1223 microversion: 2.1 time: 0.128767 Sep 13 16:36:10.037892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 812/1566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:09 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:10.047386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:10.048082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:10.055334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:10.056111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:10.067833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:10.069065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:10.070495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:10.071141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:10.143325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:10.166464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c96bd1f6-54ae-45d8-9d89-7c4956159fc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.536703 Sep 13 16:36:10.167932 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 755/1567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:09 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:10.177079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51d95d8b-1c95-4b97-922e-e14d4bd1063f tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:10.179238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-51d95d8b-1c95-4b97-922e-e14d4bd1063f tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a48256946f96408e8ba10e371b37434b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e308f8db434a788af824b1e401529d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51d95d8b-1c95-4b97-922e-e14d4bd1063f tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Request method failure captured: Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-13%2016:36:09 HTTP/1.1 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILF3nFEzG19fIbo_TY-HA0rqI5xQqRVB61_3XxPel6tLeTCmSL_O5EMR5eSP96UxvZVdazWDAnLL6dYjGs9-xYzO9s0_HORvO5iOWPEo_EXIFvE3oB7tNzqijVy_UgvGHAkF72zVCH3LcKBsZqgjsHel6A-0OUq-tBHJwYv1MOMZM8Q Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a9e308f8db434a788af824b1e401529d Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e308f8db434a788af824b1e401529d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9e308f8db434a788af824b1e401529d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e308f8db434a788af824b1e401529d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9e308f8db434a788af824b1e401529d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a9e308f8db434a788af824b1e401529d Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a48256946f96408e8ba10e371b37434b Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '2022-09-13 16:36:09'} Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:10.181479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:10.185745 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:10.185745 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:10.185745 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:36:10.185745 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:36:10.185745 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 13 16:36:10.185745 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:10.187406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51d95d8b-1c95-4b97-922e-e14d4bd1063f tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:10.188490 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51d95d8b-1c95-4b97-922e-e14d4bd1063f tempest-InstanceUsageAuditLogNegativeTestJSON-463260092 tempest-InstanceUsageAuditLogNegativeTestJSON-463260092-project] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-13 16:36:09" status: 403 len: 128 microversion: 2.1 time: 0.018348 Sep 13 16:36:10.193025 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 756/1568] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 16:36:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-13%2016%3A36%3A09 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:36:10.200718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-852593569", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bc1bb727-bb0d-4c4c-81c3-354c78f5bff0"}], "security_groups": [{"name": "tempest-securitygroup--1782445061"}], "key_name": "tempest-keypair-1135819688", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:10.384181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:10.395118 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-507c8a81-71f5-42fb-a3c8-66cf4b6432f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.354578 Sep 13 16:36:10.406414 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 813/1569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:10 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:10.423950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:10.427070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:10.446061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:10.446985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:10.447955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:10.450340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:10.455138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:10.455974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:10.643151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] validate_networks() for [('bc1bb727-bb0d-4c4c-81c3-354c78f5bff0', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:36:11.289325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:11.311474 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fdb850f3-5a4e-40e4-b387-63c8cc86e2f5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.893759 Sep 13 16:36:11.328916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 814/1570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:10 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:11.328916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:11.328916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:11.328916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:11.328916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:11.328916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:11.332879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:11.334627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:11.339845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:11.548240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:11.561240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf3cc38b-10ed-4e48-9aa9-ce84a00e461d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.247499 Sep 13 16:36:11.564039 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 815/1571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:11 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:11.586579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:11.586921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:11.594606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:11.595327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:11.596018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:11.596925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:11.597538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:11.598236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:11.727665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:11.746920 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-982eec9d-2f8d-476f-9c41-dec92ac99398 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1275 microversion: 2.1 time: 0.180777 Sep 13 16:36:11.747800 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 816/1572] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:11 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:11.773360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1744453451"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:11.776674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:11.785596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:11.786343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:11.787390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:11.792373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:11.793273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:11.794416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.303159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a7cf043-51d8-4811-88a4-650fb350a7d6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action" status: 202 len: 0 microversion: 2.1 time: 0.541363 Sep 13 16:36:12.304212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 817/1573] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:11 2022] POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:36:12.310450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:12.311260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:12.312451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Getting quotas for project 1ef9a16f03094174989a3789f779e920. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:12.331462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.332282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.332427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.333967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.334481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.334925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.342898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Getting quotas for user c5a13c6d9196461eab07a95626c2858b and project 1ef9a16f03094174989a3789f779e920. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:12.382789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:36:12.383631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:36:12.384463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:36:12.385271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:36:12.385937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:36:12.402498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.403738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.404280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.410524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.411519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.412211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.451569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Getting quotas for project 1ef9a16f03094174989a3789f779e920. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:12.458048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Getting quotas for user c5a13c6d9196461eab07a95626c2858b and project 1ef9a16f03094174989a3789f779e920. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:12.472481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:36:12.477587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:36:12.560480 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c49808c-820b-408f-8d4e-e08a2e788933 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.365985 Sep 13 16:36:12.561628 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 757/1574] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:36:10 2022] POST /compute/v2.1/servers => generated 407 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:36:12.577175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-126388694"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:12.581927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:12.604898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.605867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.606561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.607609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.608156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.608822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.644346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:12.651650 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Cannot 'createImage' instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 while it is in task_state image_snapshot Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action HTTP/1.1 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 84 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-126388694"}} Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: exception: Cannot 'createImage' instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 while it is in task_state image_snapshot Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-126388694'}}} Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:36:12.658559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 while it is in task_state image_snapshot Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 while it is in task_state image_snapshot Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 409 to user: Cannot 'createImage' instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 while it is in task_state image_snapshot {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:12.662598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-70ab71b1-f466-462a-b08f-6e0f0612b0aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action" status: 409 len: 159 microversion: 2.1 time: 0.095695 Sep 13 16:36:12.664836 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 758/1575] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:12 2022] POST /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667/action => generated 159 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:36:12.672603 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-444a8e16-c86b-4cbf-9ea8-51871b9a1b5e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.366865 Sep 13 16:36:12.674399 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 818/1576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:12 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:12.678566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd963d10-16b2-443f-89c2-46cad80016b2 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:12.684835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:12.686074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:12.692911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cd963d10-16b2-443f-89c2-46cad80016b2 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:12.695580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.697081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.697973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.698946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:12.699592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:12.701624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:12.787416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd963d10-16b2-443f-89c2-46cad80016b2 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:12.797463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd963d10-16b2-443f-89c2-46cad80016b2 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1269 microversion: 2.1 time: 0.129922 Sep 13 16:36:12.798152 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 759/1577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:12 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:12.818258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88ff37b7-8b55-4eb2-a5c8-293d7753b1f6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '.version_select at 0x7fbeb9819160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:13.080650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:13.093393 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88ff37b7-8b55-4eb2-a5c8-293d7753b1f6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/images/20d0ebee-9c24-4a74-a3b0-e7b461684596" status: 204 len: 0 microversion: 2.1 time: 0.286175 Sep 13 16:36:13.097821 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 760/1578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:12 2022] DELETE /compute/v2.1/images/20d0ebee-9c24-4a74-a3b0-e7b461684596 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:36:13.105902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:13.108674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:13.115774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cb24d65-d5f7-4146-8eed-799e0e4c98c8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.439699 Sep 13 16:36:13.136671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 819/1579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:12 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:13.141572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:13.142804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.143476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.144105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.144908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:13.145796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.148255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.150671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.162358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.163247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.164028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.166868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.170532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.171322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.452346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:13.462618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b106747b-0ec1-4b30-9433-3e00bad49b89 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.363453 Sep 13 16:36:13.464749 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 761/1580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:13 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:13.534377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:13.544222 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd0cb3e1-0b17-4096-99e6-ade4c356b976 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1533 microversion: 2.1 time: 0.406403 Sep 13 16:36:13.544937 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 820/1581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:13 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1533 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:13.703582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:13.704501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:13.715903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.716770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.717174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.717926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.718785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.719523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.746210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:13.821446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:13.822234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:13.829374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.830084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.831174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.832405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:13.833363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:13.834278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:13.886380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:13.896761 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94887cab-8415-4ec2-b20c-2be3c1409188 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1308 microversion: 2.1 time: 0.198567 Sep 13 16:36:13.897349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 762/1582] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:13 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:13.919813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:13.930257 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ee485d6-3bd4-470d-ac6b-2896702a6b4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1273 microversion: 2.1 time: 0.113407 Sep 13 16:36:13.930848 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 821/1583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:13 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:14.146522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:14.147170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:14.157889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.158280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.158964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.159737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.160225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.160611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.468831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:14.482862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a203ef0-5f64-4149-8284-5ee000b1e11b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1535 microversion: 2.1 time: 0.342889 Sep 13 16:36:14.484173 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 763/1584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:14 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1535 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:14.495297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:14.495914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:14.513639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.514370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.515630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.518974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.519712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.520329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.569679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:14.571855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:14.584019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.586372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.587610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.590808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.591673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.592468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.766276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:14.785250 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-735ccd32-7845-4dfe-9ee1-85b28d20acf4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.292870 Sep 13 16:36:14.799155 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 822/1585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:14 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:14.911395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:14.927817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:14.930284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:14.940675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-84dfdff9-43db-4d33-b8bf-71cd8f57ebff tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1533 microversion: 2.1 time: 0.376541 Sep 13 16:36:14.943452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.945797 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 764/1586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:14 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1533 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:14.947826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.948550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.949471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.950566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.951185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.960108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:14.960728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:14.966997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.967831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.968428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.969291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:14.969929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:14.970720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:14.982967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:15.090597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:15.100902 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aadbd251-d817-414b-bca8-6aa2a40a5ab7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1321 microversion: 2.1 time: 0.147074 Sep 13 16:36:15.105181 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 765/1587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:14 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:15.140090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:15.148935 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-389372e9-21c2-4f66-b365-ed039d5d688c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1488 microversion: 2.1 time: 0.231466 Sep 13 16:36:15.149646 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 823/1588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:14 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:15.172012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:15.172567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:15.180063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.180556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.181000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.182267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.182736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.183173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.266340 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39d404e0-7049-4fea-818e-d835abecadfb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de/action" status: 202 len: 0 microversion: 2.1 time: 0.097608 Sep 13 16:36:15.270752 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 766/1589] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:15 2022] POST /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:15.275526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:15.276512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:15.283723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.284121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.284557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.285255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.285936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.286616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.474300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:15.486324 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82ec8cac-2191-4730-a49b-68616f9082fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1493 microversion: 2.1 time: 0.214991 Sep 13 16:36:15.498476 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 824/1590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:15 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1493 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:15.512790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:15.514201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:15.523154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.526940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.528394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.529323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.531873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.533647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.879247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-02b70936-478f-46bc-a9ea-87d0eaa32c05 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Action: 'create', calling method: .version_select at 0x7fbeb50eeca0>, body: {"keypair": {"name": "tempest-keypair-1692815289", "type": "ssh", "user_id": "5ae8bc03e6b24898a4d0eb957a154318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGo2dCpa7qpamOcNXqre09iTBVOTvQ1m1cwMon2hxbPX2WxfBqrxaJIRKD0cBwHptCssrnthT6fEpCabew0a6mPLR8qRsaZlPe6H9Rq4LBt9p5iNpOqhS4MHmRpN87lWA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:15.895932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-02b70936-478f-46bc-a9ea-87d0eaa32c05 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Getting quotas for project ea07446974654f10a068d58a51b0b52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:15.902385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-02b70936-478f-46bc-a9ea-87d0eaa32c05 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Getting quotas for user 11fc7a47a5d44c71a7352794386f2c92 and project ea07446974654f10a068d58a51b0b52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:15.930917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-02b70936-478f-46bc-a9ea-87d0eaa32c05 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.275525 Sep 13 16:36:15.932016 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 825/1591] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:36:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 277 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:36:15.936818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:15.937425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:15.946135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.946623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.947093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.947908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:15.948473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:15.948990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:15.967788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:15.983204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02d941c7-1956-4c50-817f-4a5ea878c91b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1528 microversion: 2.1 time: 0.474642 Sep 13 16:36:15.985015 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 767/1592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:15 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1528 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:15.991849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:15.992837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.004782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.006631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.008746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.009569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.010135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.011177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.098098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid f7305af6-eeb4-43bc-ac65-52988a63a1de {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:16.111897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7ef115c-7461-4483-beab-4cec130fb4fe tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 2423 microversion: 2.25 time: 0.178949 Sep 13 16:36:16.112412 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 826/1593] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:15 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 2423 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:16.117649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0d08d58-f040-4626-bd7b-3a2b268d832a tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Action: 'create', calling method: .version_select at 0x7fbeb520b700>, body: {"keypair": {"name": "tempest-keypair-298367093", "type": "ssh", "user_id": "5ae8bc03e6b24898a4d0eb957a154318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIGXq4siPdzVqQ52GkrK4b5MZ1wgNaAds1aZVXyMRSTWddkjMdStAunmR9STZervbITBRMZKsxBO+d/fc61Caq6UHUQ9mX0VzJ7RFf17Pg/Jgfyi0WZ8kqhkUkoYOA5DQ=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:16.134009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d0d08d58-f040-4626-bd7b-3a2b268d832a tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Getting quotas for project ea07446974654f10a068d58a51b0b52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:16.139371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d0d08d58-f040-4626-bd7b-3a2b268d832a tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Getting quotas for user 11fc7a47a5d44c71a7352794386f2c92 and project ea07446974654f10a068d58a51b0b52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:16.165572 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0d08d58-f040-4626-bd7b-3a2b268d832a tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.051875 Sep 13 16:36:16.166553 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 827/1594] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:36:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:36:16.172074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:16.172994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.180421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.180922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.181608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.182518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.183182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.183808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.342828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:16.344360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:16.353097 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3dfac15f-e584-45a7-b126-9f70e9f08074 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.366640 Sep 13 16:36:16.366002 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32b9a0aa-aa50-4e3f-ab28-c0ce6f856683 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1539 microversion: 2.1 time: 0.187003 Sep 13 16:36:16.366002 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 828/1595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:16 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:16.366002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:16.366002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.367496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 768/1596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:15 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:16.386751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:16.387952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.388687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.389398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.390574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.392175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.392995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.394067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.401189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.401774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.402336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.403188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.403841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.404347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.494200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:16.503680 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4ed4fd8-e02e-446c-8bcc-6c6b36b0e251 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1327 microversion: 2.1 time: 0.134194 Sep 13 16:36:16.504683 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 769/1597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:16 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:16.524588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-857467-1", "block_migration": "auto"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:16.528591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.536398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.537115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.537756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.538775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.539432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.540054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.578679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:16.588703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'flavor' on Instance uuid f7305af6-eeb4-43bc-ac65-52988a63a1de {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:16.594275 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d28e07fd-541d-45d7-a3ac-6592dce5ffca tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1528 microversion: 2.1 time: 0.236204 Sep 13 16:36:16.609859 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 829/1598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:16 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1528 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:16.610955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Going to try to live migrate instance to n-h2-857467-1 {{(pid=122327) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:36:16.614860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-142d7f2d-66e5-4adc-8660-2fe6ca4b41d9 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Calling method '.version_select at 0x7fbeb5e35040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:16.623960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-142d7f2d-66e5-4adc-8660-2fe6ca4b41d9 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1692815289?user_id=5ae8bc03e6b24898a4d0eb957a154318" status: 200 len: 513 microversion: 2.10 time: 0.017328 Sep 13 16:36:16.624625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 830/1599] 10.222.0.61 () {60 vars in 1340 bytes} [Tue Sep 13 16:36:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1692815289?user_id=5ae8bc03e6b24898a4d0eb957a154318 => generated 513 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:36:16.629762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:16.630703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.637642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.638519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.639697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.640688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.641393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.642538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.824012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:16.836071 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3c9667d-92f1-414a-9f54-9aa157370f9f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 200 len: 1473 microversion: 2.1 time: 0.210016 Sep 13 16:36:16.852479 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 831/1600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:16 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 1473 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:16.864658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26ad3543-b789-4ff8-a508-0fd732cceb16 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:16.873700 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-26ad3543-b789-4ff8-a508-0fd732cceb16 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] HTTP exception thrown: Flavor fb9c7619-f0ea-4112-b8b9-d35db649113e could not be found. Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26ad3543-b789-4ff8-a508-0fd732cceb16 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Request method failure captured: Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/flavors/fb9c7619-f0ea-4112-b8b9-d35db649113e HTTP/1.1 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB3-mHkmKAR3aYdGv1nFoHQQdDcupU1gKuTmu7XkXUqCQjC04E0-fMmZgTCXTCZwqJhEkPIxIO5FNgT3Ew5dc1MzComQzvsB0A05Xo6H5UHn_iH4gOhKumMeoNaxn8lU1GI6uWO-G38DPpIpSM0XCBbrDidqV27EvYsnqGH9Dmq8Zs Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 079fa112a5ca49d299e9467bd7d41f63 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-MigrationsAdminTest-1928252783 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/079fa112a5ca49d299e9467bd7d41f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_079fa112a5ca49d299e9467bd7d41f63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/079fa112a5ca49d299e9467bd7d41f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/079fa112a5ca49d299e9467bd7d41f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-MigrationsAdminTest-1928252783 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 079fa112a5ca49d299e9467bd7d41f63 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-MigrationsAdminTest-1928252783 Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-MigrationsAdminTest-1928252783-project-admin Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: e740dd9be55842948d15fd5b6460267d Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-MigrationsAdminTest-1928252783-project-admin Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: exception: Flavor fb9c7619-f0ea-4112-b8b9-d35db649113e could not be found. Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'fb9c7619-f0ea-4112-b8b9-d35db649113e'} Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor fb9c7619-f0ea-4112-b8b9-d35db649113e could not be found. Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor fb9c7619-f0ea-4112-b8b9-d35db649113e could not be found. Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:16.876025 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor fb9c7619-f0ea-4112-b8b9-d35db649113e could not be found. Sep 13 16:36:16.883378 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:16.885602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26ad3543-b789-4ff8-a508-0fd732cceb16 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Returning 404 to user: Flavor fb9c7619-f0ea-4112-b8b9-d35db649113e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:16.886683 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26ad3543-b789-4ff8-a508-0fd732cceb16 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/fb9c7619-f0ea-4112-b8b9-d35db649113e" status: 404 len: 109 microversion: 2.1 time: 0.032891 Sep 13 16:36:16.887447 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 832/1601] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:36:16 2022] DELETE /compute/v2.1/flavors/fb9c7619-f0ea-4112-b8b9-d35db649113e => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:36:16.896964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ff15baa-a08d-4620-ab8e-336fdf284c62 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Action: 'create', calling method: .version_select at 0x7fbeb52ba430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-649332956", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ4NemXSEdAuwinwR2sU4FAtnjz/em35dFq51iTZm/AzsE54v2qOUc2gHE9UMaQUqOGV6DP8zx+WBZt17FdyByUaCX6zijCwAChnE6aWTC/Tr6dED3WMOCYud/ABqIDqQ=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:16.920843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5ff15baa-a08d-4620-ab8e-336fdf284c62 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Getting quotas for project ea07446974654f10a068d58a51b0b52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:16.928243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5ff15baa-a08d-4620-ab8e-336fdf284c62 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Getting quotas for user 11fc7a47a5d44c71a7352794386f2c92 and project ea07446974654f10a068d58a51b0b52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:16.972281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ff15baa-a08d-4620-ab8e-336fdf284c62 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.080103 Sep 13 16:36:16.972998 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 833/1602] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:36:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:36:16.982964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2076120284"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:16.987830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:16.995458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.996079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.996596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:16.998177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:16.998348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:16.998877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:17.270382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8228e72b-70c6-4080-972f-7a9aafab11dd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de/action" status: 202 len: 0 microversion: 2.1 time: 0.296053 Sep 13 16:36:17.271031 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 834/1603] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:16 2022] POST /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:36:17.280116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-01769764-13c2-4780-a023-7b99e3a1c558 req-51a20af4-d0c4-4634-a8b9-0f1860679db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:17.291817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-01769764-13c2-4780-a023-7b99e3a1c558 req-51a20af4-d0c4-4634-a8b9-0f1860679db0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:17.292301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-01769764-13c2-4780-a023-7b99e3a1c558 req-51a20af4-d0c4-4634-a8b9-0f1860679db0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:17.292731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-01769764-13c2-4780-a023-7b99e3a1c558 req-51a20af4-d0c4-4634-a8b9-0f1860679db0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:17.307502 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-01769764-13c2-4780-a023-7b99e3a1c558 req-51a20af4-d0c4-4634-a8b9-0f1860679db0 service nova] Creating event network-changed:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:36:17.313425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-01769764-13c2-4780-a023-7b99e3a1c558 req-51a20af4-d0c4-4634-a8b9-0f1860679db0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037910 Sep 13 16:36:17.314439 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 835/1604] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:17.319805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d9ba253-cebd-4286-a7e0-1d63b9571e7b tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Calling method '.version_select at 0x7fbeb5351310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:17.323772 n-d-857467-1 devstack@n-api.service[122328]: WARNING oslo_db.sqlalchemy.utils [None req-3d9ba253-cebd-4286-a7e0-1d63b9571e7b tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 13 16:36:17.329353 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d9ba253-cebd-4286-a7e0-1d63b9571e7b tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "GET /compute/v2.1/os-keypairs?user_id=5ae8bc03e6b24898a4d0eb957a154318" status: 200 len: 725 microversion: 2.10 time: 0.013609 Sep 13 16:36:17.330203 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 836/1605] 10.222.0.61 () {60 vars in 1259 bytes} [Tue Sep 13 16:36:17 2022] GET /compute/v2.1/os-keypairs?user_id=5ae8bc03e6b24898a4d0eb957a154318 => generated 725 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:36:17.337145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2089123091", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:17.403812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:36:17.669658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:36:17.670439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:36:17.670928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:36:17.671346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:36:17.671758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:36:17.681491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:17.682019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:17.682459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:17.683192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:17.683648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:17.684070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:17.707163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:17.715319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Getting quotas for user 80714f77e8904565bde7dc8e7dce1063 and project fbdc043f15794fe6af24d0816bc6a344. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:17.729655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:36:17.732443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:36:17.744246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:17.782799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-824a7054-7dbc-4baf-8614-18c0516a0304 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450660 Sep 13 16:36:17.790197 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 837/1606] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:36:17.790197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b32d5a8-6506-47cc-a834-b358b933fefc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb52bac10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:17.859950 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b32d5a8-6506-47cc-a834-b358b933fefc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.075133 Sep 13 16:36:17.869847 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 838/1607] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:17 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:17.876314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfcacf57-753f-4f1e-b476-5dc4537f09ba tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Calling method '.version_select at 0x7fbeb50ee940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:17.901112 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfcacf57-753f-4f1e-b476-5dc4537f09ba tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-649332956" status: 204 len: 0 microversion: 2.10 time: 0.029662 Sep 13 16:36:17.902402 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 839/1608] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Sep 13 16:36:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-649332956 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:36:17.908365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:17.909301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:17.918032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:17.918854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:17.919781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:17.921459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:17.922362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:17.923273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.147275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:18.155721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38e1b304-c33d-4466-a1e6-91f17baaedff tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.251978 Sep 13 16:36:18.162453 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 840/1609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:17 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:18.172706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:18.173664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:18.183958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.184467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.185417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.186043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.186517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.187023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.366122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:18.374753 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93f06219-1dd3-4308-bb8d-a72fdb2135e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1539 microversion: 2.1 time: 0.209625 Sep 13 16:36:18.377866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 841/1610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:18 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1539 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:18.383633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:18.384247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:18.390271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.390775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.391211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.391897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.392352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.392773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.550864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:18.559665 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38fd9599-8ab2-4abf-a9c9-5915eab0765f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.180896 Sep 13 16:36:18.568659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 842/1611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:18 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:18.568659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:18.568659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:18.572455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.573004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.573395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.574147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.574624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.575065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.637163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:18.645084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7254bbc-7a68-4286-b204-d3f8eadd62d0 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1217 microversion: 2.1 time: 0.083741 Sep 13 16:36:18.645672 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 843/1612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:18 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:18.650715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-025ad9bd-dc71-4e77-b2e6-91fc9cb3e8a6 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Calling method '.version_select at 0x7fbeb520b550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:18.671676 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-025ad9bd-dc71-4e77-b2e6-91fc9cb3e8a6 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298367093?user_id=5ae8bc03e6b24898a4d0eb957a154318" status: 204 len: 0 microversion: 2.10 time: 0.024622 Sep 13 16:36:18.672332 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 844/1613] 10.222.0.61 () {60 vars in 1340 bytes} [Tue Sep 13 16:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298367093?user_id=5ae8bc03e6b24898a4d0eb957a154318 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:36:18.677393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-7c8492b7-4863-4a64-954c-a6e4ef9bc3e2 req-e0936b3c-4b18-4a05-8cba-5c5be18486c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "name": "network-vif-plugged", "status": "completed", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:18.688629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7c8492b7-4863-4a64-954c-a6e4ef9bc3e2 req-e0936b3c-4b18-4a05-8cba-5c5be18486c9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:18.689203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7c8492b7-4863-4a64-954c-a6e4ef9bc3e2 req-e0936b3c-4b18-4a05-8cba-5c5be18486c9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:18.689864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7c8492b7-4863-4a64-954c-a6e4ef9bc3e2 req-e0936b3c-4b18-4a05-8cba-5c5be18486c9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:18.702578 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-7c8492b7-4863-4a64-954c-a6e4ef9bc3e2 req-e0936b3c-4b18-4a05-8cba-5c5be18486c9 service nova] Creating event network-vif-plugged:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h2-857467-1 Sep 13 16:36:18.707512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-7c8492b7-4863-4a64-954c-a6e4ef9bc3e2 req-e0936b3c-4b18-4a05-8cba-5c5be18486c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033863 Sep 13 16:36:18.708172 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 845/1614] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:18.713489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-539b16e5-ba92-4524-9b3a-9fdeab72cc77 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] Calling method '.version_select at 0x7fbeb5100430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:18.733017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-539b16e5-ba92-4524-9b3a-9fdeab72cc77 tempest-KeyPairsV210TestJSON-2076527213 tempest-KeyPairsV210TestJSON-2076527213-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692815289?user_id=5ae8bc03e6b24898a4d0eb957a154318" status: 204 len: 0 microversion: 2.10 time: 0.023558 Sep 13 16:36:18.733620 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 846/1615] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692815289?user_id=5ae8bc03e6b24898a4d0eb957a154318 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:36:18.877440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-21c01e18-5d83-4b3f-ae86-b59804cf0dc1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb520b1f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:18.937289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-21c01e18-5d83-4b3f-ae86-b59804cf0dc1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.064405 Sep 13 16:36:18.938174 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 847/1616] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:18 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:19.181975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:19.182818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:19.189357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.189880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.190338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.191181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.191690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.192251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.356279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:19.364049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ce4679c-23ae-4a4e-8866-12f7dd512ff8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.188407 Sep 13 16:36:19.364637 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 848/1617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:19 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:19.520308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-5e2ce840-fecc-4a69-b6f1-02e9d50f702e req-f0e4a808-a555-4fe5-98e6-cdaf96a8427a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b07215b-6675-436b-bddf-67b67935c2e9", "tag": "a3a68300-329c-47bc-8752-25c4e745cf8e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:19.531520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5e2ce840-fecc-4a69-b6f1-02e9d50f702e req-f0e4a808-a555-4fe5-98e6-cdaf96a8427a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.532004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5e2ce840-fecc-4a69-b6f1-02e9d50f702e req-f0e4a808-a555-4fe5-98e6-cdaf96a8427a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.532471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5e2ce840-fecc-4a69-b6f1-02e9d50f702e req-f0e4a808-a555-4fe5-98e6-cdaf96a8427a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.544078 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-5e2ce840-fecc-4a69-b6f1-02e9d50f702e req-f0e4a808-a555-4fe5-98e6-cdaf96a8427a service nova] Creating event network-changed:a3a68300-329c-47bc-8752-25c4e745cf8e for instance 8b07215b-6675-436b-bddf-67b67935c2e9 on n-h2-857467-1 Sep 13 16:36:19.549008 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-5e2ce840-fecc-4a69-b6f1-02e9d50f702e req-f0e4a808-a555-4fe5-98e6-cdaf96a8427a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183244 Sep 13 16:36:19.549585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 849/1618] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:19.559138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:19.559863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:19.565960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.566441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.566880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.567579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.568039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.568471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.709324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:19.716707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2020e94-e7b4-43d9-9ea6-f0add589c2a8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1539 microversion: 2.1 time: 0.162971 Sep 13 16:36:19.717682 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 850/1619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:19 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:19.722745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:19.723361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:19.730205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.731020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.731434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.731923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.732442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.733041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.880806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:19.889905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bce1bcbc-ec81-40c8-981b-7118d09d4c4e tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.170880 Sep 13 16:36:19.890494 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 851/1620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:19 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:19.895131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:19.895737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:19.901537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.902065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.902496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.903391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:19.904128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:19.904713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:19.909063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:19.972304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:19.980506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6073cb53-52a4-45e3-8292-a5afa609f2dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1217 microversion: 2.1 time: 0.088953 Sep 13 16:36:19.981093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 852/1621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:19 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:19.986240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9115619-1043-4242-8d0d-aacff75c4c16 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb51581f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:20.045647 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c9115619-1043-4242-8d0d-aacff75c4c16 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.063162 Sep 13 16:36:20.046378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 853/1622] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:19 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:20.389152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:20.390271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:20.398126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.398619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.399179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:20.399883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.400345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.400776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:20.536894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:20.546009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67ac57a4-cd43-49d1-aa28-d80c72974c7e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.161540 Sep 13 16:36:20.546600 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 854/1623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:20 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:20.722201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-147c5c90-ae30-4e77-8004-04a11590bf0a req-53263982-0707-4f88-bb94-837b96a62269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3077469c-eab1-4d60-bc5b-5dd44d7de667", "name": "network-vif-plugged", "status": "completed", "tag": "444fb5da-76b5-4504-b8cb-6ad808423cdf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:20.732369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-147c5c90-ae30-4e77-8004-04a11590bf0a req-53263982-0707-4f88-bb94-837b96a62269 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.732880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-147c5c90-ae30-4e77-8004-04a11590bf0a req-53263982-0707-4f88-bb94-837b96a62269 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.733312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-147c5c90-ae30-4e77-8004-04a11590bf0a req-53263982-0707-4f88-bb94-837b96a62269 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:20.745303 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-147c5c90-ae30-4e77-8004-04a11590bf0a req-53263982-0707-4f88-bb94-837b96a62269 service nova] Creating event network-vif-plugged:444fb5da-76b5-4504-b8cb-6ad808423cdf for instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 on n-h1-857467-1 Sep 13 16:36:20.750117 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-147c5c90-ae30-4e77-8004-04a11590bf0a req-53263982-0707-4f88-bb94-837b96a62269 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031634 Sep 13 16:36:20.750712 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 855/1624] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:36:20.755920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:20.756632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:20.762902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.763384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.763822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:20.764516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.765342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.765771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:20.908918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:20.917366 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dee946ad-f943-4416-a565-bca5c5f9f71d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1539 microversion: 2.1 time: 0.165557 Sep 13 16:36:20.917964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 856/1625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:20 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1539 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:20.932281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:20.933004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:20.939614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.940105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.940536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:20.941236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:20.941686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:20.942213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:21.087540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:21.095343 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c0c9854-f66f-4434-9b5c-7ed2061513ee tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.168352 Sep 13 16:36:21.096023 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 857/1626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:20 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:21.101078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:21.101236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:21.107407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:21.107986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:21.108501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:21.109287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:21.109814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:21.110305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:21.176483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:21.182966 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d24fa862-788e-4912-80b2-5605c879e1b1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1217 microversion: 2.1 time: 0.085830 Sep 13 16:36:21.183717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 858/1627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:21 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:21.188242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1203aaee-0658-438c-9be4-e2392f47d13d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb5b79430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:21.233334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1203aaee-0658-438c-9be4-e2392f47d13d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.048583 Sep 13 16:36:21.233943 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 859/1628] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:21 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:21.459415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f25a3ea-195b-4eb7-8d07-929d680e15f9 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] Action: 'create', calling method: .version_select at 0x7fbeb52a95e0>, body: {"security_group": {"name": "tempest-securitygroup-1513909612", "description": "tempest-description-1084268101"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:21.763705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f25a3ea-195b-4eb7-8d07-929d680e15f9 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.462163 Sep 13 16:36:21.765096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 860/1629] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:36:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:36:21.771903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:21.775585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:21.786267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:21.787128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:21.787754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:21.789462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:21.790411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:21.791136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.167043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:22.177173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8bb7b597-f2ce-43e1-9e40-00cd64af5610 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.408961 Sep 13 16:36:22.178393 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 861/1630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:21 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:22.184758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4bc1b62c-553e-4179-8912-a8fe7d11abb8 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] Action: 'create', calling method: .version_select at 0x7fbeb5ae33a0>, body: {"security_group": {"name": "tempest-securitygroup-1925780879", "description": "tempest-description-1352456655"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:22.430964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:22.519940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4bc1b62c-553e-4179-8912-a8fe7d11abb8 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.339639 Sep 13 16:36:22.520825 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 862/1631] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:36:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:22.525999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:22.526624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:22.528276 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-922285b0-086f-4552-b03c-69cbba015243 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/action" status: 202 len: 0 microversion: 2.25 time: 6.021969 Sep 13 16:36:22.531053 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 770/1632] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:36:16 2022] POST /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/action => generated 0 bytes in 6026 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:36:22.538879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.539583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.540121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.541155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.541726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.542410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.546912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:22.547696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:22.555695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.556198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.556636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.557406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.557889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.558315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.694642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77af5aca-dc62-4c48-9d96-9680693a7c1e tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1810 microversion: 2.1 time: 0.156142 Sep 13 16:36:22.695227 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 771/1633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:22 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:22.697907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:22.699851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:22.700495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:22.706154 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97d1a799-471c-4960-a3b2-955d8a5ce741 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1534 microversion: 2.1 time: 0.184618 Sep 13 16:36:22.706725 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 863/1634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:22 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1534 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:22.711453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:22.712476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:22.716366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.716874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.717318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.718080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.718540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.718927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.719054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.719425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.720050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.720934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:22.721583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:22.722204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:22.785856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:22.793292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:22.795225 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1929aff-f9c6-4026-9079-865c5beeff2c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1265 microversion: 2.1 time: 0.087313 Sep 13 16:36:22.796071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 864/1635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:22 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:22.815281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-579e3427-b775-43a6-9ca4-d6749bf6e69f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb58434c0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:22.879045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-579e3427-b775-43a6-9ca4-d6749bf6e69f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.075677 Sep 13 16:36:22.880466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 865/1636] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:22 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:22.959166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b375c139-f546-4075-82a4-1c60d8489368 tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] Action: 'create', calling method: .version_select at 0x7fbeb520be50>, body: {"security_group": {"name": "tempest-securitygroup-1556172550", "description": "tempest-description-1499713092"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:23.064074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:23.077578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e35ca318-2696-4d47-b0de-8e712b3737ea tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.381126 Sep 13 16:36:23.094765 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 772/1637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:22 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:23.101457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:23.102528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:23.112086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.112939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.114044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.115526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.117162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.119785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.497777 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b375c139-f546-4075-82a4-1c60d8489368 tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.615797 Sep 13 16:36:23.498376 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 866/1638] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:36:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:23.502902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:23.511688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.512200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.512859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.513625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.514224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.514671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.518147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:23.527579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:23.529065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:23.530272 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d1c4c52-3416-4860-aa76-7c16fcbb636d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.433472 Sep 13 16:36:23.530838 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 773/1639] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:23 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:23.535810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:23.536659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:23.541032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb285961-754b-4ec8-9123-fc02b22cd793 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041500 Sep 13 16:36:23.544108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.544779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.546083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.547004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.547639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.548248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.552074 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 867/1640] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:36:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:23.564361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d9ad857-9ce7-430f-a457-a2605a51441d tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] Action: 'create', calling method: .version_select at 0x7fbeb50eee50>, body: {"security_group": {"name": "tempest-securitygroup-834756294", "description": "tempest-description-931039549"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:23.701022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:23.712344 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a927598e-2877-48f7-99f8-fcb61fcc1d36 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.179950 Sep 13 16:36:23.713228 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 774/1641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:23 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:23.730071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:23.730948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:23.750253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.751020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.752767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:23.755867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:23.756945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:23.757878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.007365 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d9ad857-9ce7-430f-a457-a2605a51441d tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.448001 Sep 13 16:36:24.008674 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 868/1642] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:36:23 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:24.021534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.023020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:24.031283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.032176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.032860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.033948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.034638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.035543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.047665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:24.078703 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01f3f1d0-49d9-4b52-a099-c025d8dc2002 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1521 microversion: 2.1 time: 0.353908 Sep 13 16:36:24.081461 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 775/1643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:23 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:24.098094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6a9e108-535f-4385-a2de-68b2f464a3c9 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb98134c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.168308 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6a9e108-535f-4385-a2de-68b2f464a3c9 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.081149 Sep 13 16:36:24.168902 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 776/1644] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:24 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:24.176591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a31736cf-bb02-4906-bd99-5f5d942c802d tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] Calling method '.version_select at 0x7fbeb53f7dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.255400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:24.268326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-731f0748-9479-4dfc-b1a5-a36caf309d5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1271 microversion: 2.1 time: 0.250598 Sep 13 16:36:24.274529 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 869/1645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:24 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:24.290902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.291840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:24.306044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.306815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.308149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.311249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.312575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.313687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.784164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:24.793708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c4c189b1-9bce-4f98-9cac-71b096629539 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.514599 Sep 13 16:36:24.805154 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 870/1646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:24 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:24.814049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:24.826740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:24.839370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.840726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.844366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.845182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:24.846402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:24.846637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:24.891676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:36:25.046996 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd7d82cb-7b7d-4fa6-bf32-6c5b807211aa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 204 len: 0 microversion: 2.1 time: 0.240148 Sep 13 16:36:25.047598 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 871/1647] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:36:24 2022] DELETE /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:36:25.055701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f78072d6-40d4-43ea-85c6-4618eca37679 req-e0be0f4d-10d5-47b2-b657-f74190004282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5793c3-b5e5-4b6c-91cd-62af303c98de", "name": "network-vif-plugged", "status": "completed", "tag": "0ba191e1-13c0-4460-ab74-b400fb91de9d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:25.074717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f78072d6-40d4-43ea-85c6-4618eca37679 req-e0be0f4d-10d5-47b2-b657-f74190004282 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.080231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f78072d6-40d4-43ea-85c6-4618eca37679 req-e0be0f4d-10d5-47b2-b657-f74190004282 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.086317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f78072d6-40d4-43ea-85c6-4618eca37679 req-e0be0f4d-10d5-47b2-b657-f74190004282 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:25.110202 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f78072d6-40d4-43ea-85c6-4618eca37679 req-e0be0f4d-10d5-47b2-b657-f74190004282 service nova] Creating event network-vif-plugged:0ba191e1-13c0-4460-ab74-b400fb91de9d for instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de on n-h2-857467-1 Sep 13 16:36:25.115584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f78072d6-40d4-43ea-85c6-4618eca37679 req-e0be0f4d-10d5-47b2-b657-f74190004282 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066672 Sep 13 16:36:25.116808 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 872/1648] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:25.122564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:25.123560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:25.130486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.131277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.132585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:25.133672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.136868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.137620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:25.509699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:25.524259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:25.527502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:25.533243 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b5cf53d-e4aa-4b8b-8b5e-1e136fb9d866 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.414515 Sep 13 16:36:25.534205 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 873/1649] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:25 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:25.541500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:25.554568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:25.560933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.561712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.562437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:25.563550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.564238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.574542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:25.841190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:25.856710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-beae1ec2-3350-44f5-bc34-8420152b9b6a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.320264 Sep 13 16:36:25.867811 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 874/1650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:25 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:25.867811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:25.867811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:25.871332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.871835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.872463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:25.875125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:25.875727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:25.876336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.128482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:26.142490 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-227908c2-a632-4ddf-9534-47d29b7d5136 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1527 microversion: 2.1 time: 0.283614 Sep 13 16:36:26.144519 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 875/1651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:25 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:26.162020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d3e5600-4e16-496a-ae4e-3bde8d114071 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb56f1f70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:26.224278 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d3e5600-4e16-496a-ae4e-3bde8d114071 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.078462 Sep 13 16:36:26.226667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 876/1652] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:26 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:26.231068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:26.231944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:26.238573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.239216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.239744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.240526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.241201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.242112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.248313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:26.398279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:26.406578 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-419b4d28-a257-491d-9206-82a8cfb22e9d tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 0.179818 Sep 13 16:36:26.407161 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 877/1653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:26 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:26.412049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:26.412701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:26.419298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.419793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.420649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.421381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.422146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.422595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.639899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:26.651860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-939c6dc1-8782-4b7c-a45e-f970bee5d618 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.243108 Sep 13 16:36:26.654513 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 878/1654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:26 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:26.676525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-25c475fa-5f2d-4fd4-a728-fed58906b5be req-141a059f-21f0-40fd-afe3-1585aa3160fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:26.691034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-25c475fa-5f2d-4fd4-a728-fed58906b5be req-141a059f-21f0-40fd-afe3-1585aa3160fa service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.691522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-25c475fa-5f2d-4fd4-a728-fed58906b5be req-141a059f-21f0-40fd-afe3-1585aa3160fa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.692646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-25c475fa-5f2d-4fd4-a728-fed58906b5be req-141a059f-21f0-40fd-afe3-1585aa3160fa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.708010 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-25c475fa-5f2d-4fd4-a728-fed58906b5be req-141a059f-21f0-40fd-afe3-1585aa3160fa service nova] Creating event network-changed:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h1-857467-1 Sep 13 16:36:26.715884 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-25c475fa-5f2d-4fd4-a728-fed58906b5be req-141a059f-21f0-40fd-afe3-1585aa3160fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060122 Sep 13 16:36:26.717372 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 879/1655] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:26.727959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dce999e-1e11-48de-8c7a-2a2311eebbbd", "device": "/dev/xvdb"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:26.731960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:26.739174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.739671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.740112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.740902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.741524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.742251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.764569 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a31736cf-bb02-4906-bd99-5f5d942c802d tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] 10.222.0.61 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13604 microversion: 2.1 time: 2.594579 Sep 13 16:36:26.765154 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 777/1656] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Sep 13 16:36:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13604 bytes in 2596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:36:26.791973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:26.793309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:26.801392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.802117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.802636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.803708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:26.804397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:26.804910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:26.809415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:26.994876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:27.008798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:27.010586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:27.012338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c20af5b-7f7d-467d-95d4-21aa4f78cf7b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.232911 Sep 13 16:36:27.012893 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 778/1657] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:26 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:27.017713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aafcc42a-a0ce-4b41-9687-b308d96e4217 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] Calling method '.version_select at 0x7fbeb967d9d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:27.189910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1855982-2b97-4f7a-9699-ed2a5b40cf52 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "POST /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470875 Sep 13 16:36:27.197149 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 880/1658] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:36:26 2022] POST /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:27.211806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:27.212196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:27.224759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.225951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.232447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.233265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.233752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.234547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.261096 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aafcc42a-a0ce-4b41-9687-b308d96e4217 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.246963 Sep 13 16:36:27.272634 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 779/1659] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Sep 13 16:36:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:27.282814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:27.284216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:27.294762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.295815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.297583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.298585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.299289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.299973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.630368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:27.648484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-18a77a73-39f9-4283-b840-1d86527bbb6b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1527 microversion: 2.1 time: 0.374600 Sep 13 16:36:27.650867 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 780/1660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:27 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:27.658151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-05bc9f83-7851-41c7-8889-0249b2bccbb1 req-8d2951af-963b-4315-a69b-400eaa4907ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "name": "network-vif-plugged", "status": "completed", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:27.675914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-05bc9f83-7851-41c7-8889-0249b2bccbb1 req-8d2951af-963b-4315-a69b-400eaa4907ec service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:27.681482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-05bc9f83-7851-41c7-8889-0249b2bccbb1 req-8d2951af-963b-4315-a69b-400eaa4907ec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:27.682782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-05bc9f83-7851-41c7-8889-0249b2bccbb1 req-8d2951af-963b-4315-a69b-400eaa4907ec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:27.724467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=30 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:27.733677 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-05bc9f83-7851-41c7-8889-0249b2bccbb1 req-8d2951af-963b-4315-a69b-400eaa4907ec service nova] Creating event network-vif-plugged:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:36:27.744986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-05bc9f83-7851-41c7-8889-0249b2bccbb1 req-8d2951af-963b-4315-a69b-400eaa4907ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092559 Sep 13 16:36:27.753127 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 781/1661] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:27.764439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0204e91a-30f6-4b54-89aa-113651cad758 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb967dca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:27.878055 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0204e91a-30f6-4b54-89aa-113651cad758 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.123123 Sep 13 16:36:27.879340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 782/1662] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:27 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:27.896450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3c13f79-3f5d-420e-b2c3-4f0f868f3705 tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] Calling method '.version_select at 0x7fbeb97e40d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.155282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:28.169058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac4298d5-003c-402b-ad3a-6a7e301d89e3 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.969491 Sep 13 16:36:28.171911 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 881/1663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:27 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:28.191568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.192887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:28.204070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.204770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.206166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.210257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.211343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.211976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.617368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:28.626583 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06e690c2-dec1-4f7a-a3e9-aa645943d320 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 0.453286 Sep 13 16:36:28.643178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 882/1664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:28 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:28.648723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.649398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:28.656521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.657017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.657529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.658342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.658804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.659226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.776564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3c13f79-3f5d-420e-b2c3-4f0f868f3705 tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f473b0b4-badf-4362-a9aa-c881fa0f9053" status: 202 len: 0 microversion: 2.1 time: 0.896031 Sep 13 16:36:28.777308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 783/1665] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:36:27 2022] DELETE /compute/v2.1/os-security-groups/f473b0b4-badf-4362-a9aa-c881fa0f9053 => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:28.782875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:28.784010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:28.800875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.801405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.804032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.804935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:28.805421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:28.805883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:28.938645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:28.966523 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a2e7a5da-1863-4c24-a7d5-e52f9028cbc1 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.322161 Sep 13 16:36:28.981470 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 883/1666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:28 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:28.986419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2bfe1fdc-1185-4457-a09c-cc23290a4c9f req-af6d3ca9-1946-4651-98ca-3cf5af50a8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3077469c-eab1-4d60-bc5b-5dd44d7de667", "name": "network-vif-deleted", "tag": "444fb5da-76b5-4504-b8cb-6ad808423cdf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:29.011166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2bfe1fdc-1185-4457-a09c-cc23290a4c9f req-af6d3ca9-1946-4651-98ca-3cf5af50a8ba service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.011676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2bfe1fdc-1185-4457-a09c-cc23290a4c9f req-af6d3ca9-1946-4651-98ca-3cf5af50a8ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.012105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2bfe1fdc-1185-4457-a09c-cc23290a4c9f req-af6d3ca9-1946-4651-98ca-3cf5af50a8ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.034012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2bfe1fdc-1185-4457-a09c-cc23290a4c9f req-af6d3ca9-1946-4651-98ca-3cf5af50a8ba service nova] Creating event network-vif-deleted:444fb5da-76b5-4504-b8cb-6ad808423cdf for instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 on n-h1-857467-1 Sep 13 16:36:29.040530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2bfe1fdc-1185-4457-a09c-cc23290a4c9f req-af6d3ca9-1946-4651-98ca-3cf5af50a8ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067949 Sep 13 16:36:29.041165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 884/1667] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:29.050454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.055897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:29.069601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.070224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.070658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.071381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.071842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.072279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.115617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.116871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.117430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.117910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lazy-loading 'fault' on Instance uuid 3077469c-eab1-4d60-bc5b-5dd44d7de667 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:29.170097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:29.180736 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-88b8b848-f7c9-4247-b9b7-d26dacdbb5ec tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1314 microversion: 2.1 time: 0.138369 Sep 13 16:36:29.182105 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 885/1668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:29 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:29.187135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4032510-413b-4ea6-af5f-8fd0836f6b8f tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] Calling method '.version_select at 0x7fbeb97eb940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.372180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:29.395568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:29.398392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:29.403215 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8174b8c0-9d27-4999-986c-76ada9631360 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.624946 Sep 13 16:36:29.406011 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 784/1669] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:28 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:29.422268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-efa7f547-26eb-4ed8-ac85-9bb5c80afd9b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb967de50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.502180 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-efa7f547-26eb-4ed8-ac85-9bb5c80afd9b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.094812 Sep 13 16:36:29.505504 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 785/1670] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:29 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:29.508441 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4032510-413b-4ea6-af5f-8fd0836f6b8f tempest-SecurityGroupsTestAdminJSON-1941451449 tempest-SecurityGroupsTestAdminJSON-1941451449-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/30cff20e-5a2e-4ce2-b831-7a31cb24e8c7" status: 202 len: 0 microversion: 2.1 time: 0.325088 Sep 13 16:36:29.509520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 886/1671] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:36:29 2022] DELETE /compute/v2.1/os-security-groups/30cff20e-5a2e-4ce2-b831-7a31cb24e8c7 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:29.518540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.519459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4abb4e25-6060-48d6-9c46-5ed3a18b2b1c tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] Calling method '.version_select at 0x7fbeb97dbb80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.523752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:29.550717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.551593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.554324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.557660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.558359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.558996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.846753 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4abb4e25-6060-48d6-9c46-5ed3a18b2b1c tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/8d89c279-7a8f-4a33-ace6-ccc4eb190c0e" status: 202 len: 0 microversion: 2.1 time: 0.331850 Sep 13 16:36:29.852872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 887/1672] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:36:29 2022] DELETE /compute/v2.1/os-security-groups/8d89c279-7a8f-4a33-ace6-ccc4eb190c0e => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:29.913339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.914236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:29.919156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:29.934890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8d52b87-416a-4dd0-bc5c-f7405ce9ebbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.426192 Sep 13 16:36:29.935811 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 786/1673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:29 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:29.944866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-375a99df-6d7f-4c3c-9939-4cc72ecb9872 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] Calling method '.version_select at 0x7fbeb53a9d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:29.960603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.964953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.965730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:29.966737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:29.967426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:29.969140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.156953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:30.168825 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4550a9b2-e502-49e7-b889-3f3e25cf96d3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 0.314458 Sep 13 16:36:30.171810 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 888/1674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:29 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:30.181106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:30.182050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:30.189648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.191280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.191927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.193684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.194937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.195563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.320690 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-375a99df-6d7f-4c3c-9939-4cc72ecb9872 tempest-SecurityGroupsTestAdminJSON-620802145 tempest-SecurityGroupsTestAdminJSON-620802145-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/b1b07070-0b0e-4bcb-8230-7ad2b3b1d3ee" status: 202 len: 0 microversion: 2.1 time: 0.382522 Sep 13 16:36:30.321545 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 787/1675] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:36:29 2022] DELETE /compute/v2.1/os-security-groups/b1b07070-0b0e-4bcb-8230-7ad2b3b1d3ee => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:30.325999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7625e0ff-44b0-4ec1-a28d-fd461e2b240d req-8a8f16df-335b-4efd-8ff6-4d6647609e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b07215b-6675-436b-bddf-67b67935c2e9", "name": "network-vif-plugged", "status": "completed", "tag": "a3a68300-329c-47bc-8752-25c4e745cf8e"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:30.355806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7625e0ff-44b0-4ec1-a28d-fd461e2b240d req-8a8f16df-335b-4efd-8ff6-4d6647609e32 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.357761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7625e0ff-44b0-4ec1-a28d-fd461e2b240d req-8a8f16df-335b-4efd-8ff6-4d6647609e32 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.358608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7625e0ff-44b0-4ec1-a28d-fd461e2b240d req-8a8f16df-335b-4efd-8ff6-4d6647609e32 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.377522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:30.392187 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7625e0ff-44b0-4ec1-a28d-fd461e2b240d req-8a8f16df-335b-4efd-8ff6-4d6647609e32 service nova] Creating event network-vif-plugged:a3a68300-329c-47bc-8752-25c4e745cf8e for instance 8b07215b-6675-436b-bddf-67b67935c2e9 on n-h2-857467-1 Sep 13 16:36:30.392902 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb322e64-f8cc-4ce6-98c9-66966b29cd52 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.219977 Sep 13 16:36:30.395319 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 889/1676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:30 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:30.403595 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7625e0ff-44b0-4ec1-a28d-fd461e2b240d req-8a8f16df-335b-4efd-8ff6-4d6647609e32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080876 Sep 13 16:36:30.403963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:30.404773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:30.406036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 788/1677] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:30.415249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:30.421147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.421908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.422533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.423423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.424050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.424645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.437945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:30.442665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:30.467315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:30.470328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.472790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.473343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.474878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.475982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.476579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.478215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.478891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.479494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.481278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lazy-loading 'fault' on Instance uuid 3077469c-eab1-4d60-bc5b-5dd44d7de667 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:30.585679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:30.602363 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25466016-14e3-41e3-af3d-ea23b26ccebb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1314 microversion: 2.1 time: 0.198005 Sep 13 16:36:30.603446 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 890/1678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:30 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:30.608686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e0bd756-116f-49ea-ac56-6e65b24d6c2b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb97e3430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:30.691799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e0bd756-116f-49ea-ac56-6e65b24d6c2b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.086761 Sep 13 16:36:30.693258 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 891/1679] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:30 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:30.820023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:30.837305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:30.838985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:30.846927 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-223f2e04-3dbd-40a1-9158-43ebee9b46f0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.416128 Sep 13 16:36:30.858940 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 789/1680] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:30 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:30.967526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:30.968935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:30.979428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.980221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.980853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:30.982011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:30.982649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:30.983617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.176355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:31.186132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f0a2e6d-76be-44e2-82fc-831d5d77c8d6 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1323 microversion: 2.1 time: 0.224075 Sep 13 16:36:31.198158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 892/1681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:30 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1323 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:31.198528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:31.199229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:31.212738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.213350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.213965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.214840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.215410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.216599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.423852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:31.424481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:31.430955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:31.441909 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dffc5674-0464-4002-b381-21f62d43a734 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 0.248795 Sep 13 16:36:31.443340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 790/1682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:31 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:31.444765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.445574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.446190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.448060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.448616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.449239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.630950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:31.632380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:31.648272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.651467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.653507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.654541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.656708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.657514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.739212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.740304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.741703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.742671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lazy-loading 'fault' on Instance uuid 3077469c-eab1-4d60-bc5b-5dd44d7de667 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:31.809595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:31.825869 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c73dc3ef-f36b-4e2e-b47e-3bd95c8ba329 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1314 microversion: 2.1 time: 0.199295 Sep 13 16:36:31.826695 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 791/1683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:31 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:31.836070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4445b7c8-7a06-4b7d-993b-f87e12c4c88e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb5625310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:31.923317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4445b7c8-7a06-4b7d-993b-f87e12c4c88e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.094498 Sep 13 16:36:31.923930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 792/1684] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:31 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:31.932080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:31.932939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:31.944580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.945755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.946401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:31.947358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:31.947987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:31.948619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.024779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:32.033957 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a9a6f69-3ab7-414d-8baf-f9eb2cf47b9d tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1395 microversion: 2.1 time: 0.619905 Sep 13 16:36:32.035643 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 893/1685] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:31 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1395 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:32.217817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:32.218850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:32.241664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.242549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.246429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.250096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.252976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.255610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.272435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:32.285456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:32.287891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:32.290240 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5a35a54-b8e9-4b34-8713-5dcecdf408de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.364137 Sep 13 16:36:32.293749 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 793/1686] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:31 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:32.471810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:32.473478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:32.496000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.499836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.501057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.505031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.510657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.511320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.823965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:32.835544 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-67087791-085e-4b7c-b5a3-f6623e5a53dd tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 0.367151 Sep 13 16:36:32.836749 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 794/1687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:32 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:32.854447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:32.855519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:32.870083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.872451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.873176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.874114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.874743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.875368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.898826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:32.911311 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1000d210-9068-492b-9f66-424fa6df0b78 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1517 microversion: 2.1 time: 0.700294 Sep 13 16:36:32.919315 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 894/1688] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:32 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1517 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:32.935039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:32.935707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:32.936153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:32.936618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lazy-loading 'fault' on Instance uuid 3077469c-eab1-4d60-bc5b-5dd44d7de667 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:32.941858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1aebe5ea-b7bd-4db2-833c-a7bca43b23bd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb98018b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:32.995721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:33.007717 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99609e5c-0eb5-4dfd-bc31-7d30ac97b47e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 200 len: 1314 microversion: 2.1 time: 0.158093 Sep 13 16:36:33.008923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 795/1689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:32 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:33.014720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:33.017609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:33.025437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.026282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.027070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.028898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.029536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.030162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.040108 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1aebe5ea-b7bd-4db2-833c-a7bca43b23bd tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.103667 Sep 13 16:36:33.041903 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 895/1690] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:32 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:33.061864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lazy-loading 'flavor' on Instance uuid ce8de958-0446-4468-a7b1-22d86df1bc7d {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:33.067780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:33.069957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:33.078771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.080204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.080660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.081471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.081971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.082411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.349628 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55e9158b-2bdd-4a9c-a06c-5eed0f6dafe0 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action" status: 200 len: 32 microversion: 2.1 time: 0.339073 Sep 13 16:36:33.351659 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 796/1691] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:33 2022] POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:36:33.366788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:33.370259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:33.384676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.394733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.395391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.396267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.397270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.399840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.521282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:33.676869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:33.707941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:33.711224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:33.717682 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-618b5350-a50c-408f-8116-0e223e9954a5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.358721 Sep 13 16:36:33.721347 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 797/1692] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:33 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:33.731530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:33.741425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:33.767851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.768370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.768823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.769553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.770058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.770505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.955523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:33.970671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b60f1599-35cc-4cd7-9aa6-ccbd54c6e042 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.243961 Sep 13 16:36:33.982037 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 798/1693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:33 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:33.982037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:33.982037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:33.996746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.997268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.997975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:33.998772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:33.999503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:33.999984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.024719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:34.152191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:34.164683 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-323a384d-b904-491a-bc88-4db08ba89ea7 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1575 microversion: 2.1 time: 1.106234 Sep 13 16:36:34.165643 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 896/1694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:33 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1575 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:34.179480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:34.181005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:34.200995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:34.201904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:34.210210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.216411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:34.222402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:34.223118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.261457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:34.274464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b2e51d1c-fdbc-4495-bdd7-7b43c7e71550 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 0.298469 Sep 13 16:36:34.275900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:34.282220 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 HTTP/1.1 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667'} Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:34.284170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:36:34.290314 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:36:34.296248 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 799/1695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:33 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:34.303057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da2ae180-c41f-4135-bf36-95060317bbd5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb97ca550>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:34.305668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:36:34.306871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d9938ad-f6c0-4527-8e67-394b558af4e3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 404 len: 111 microversion: 2.1 time: 0.139549 Sep 13 16:36:34.307621 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 897/1696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:34 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:36:34.319898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:34.320382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:34.330791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:34.331583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:34.332203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.333396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:34.334785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:34.336443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.376516 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da2ae180-c41f-4135-bf36-95060317bbd5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.078841 Sep 13 16:36:34.384923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 800/1697] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:34 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:34.389187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47ab6fcd-1a12-4fc7-929c-0d355d780aa7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'create', calling method: .version_select at 0x7fbeb53bcaf0>, body: {"keypair": {"name": "tempest-keypair-1754295719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWvcPgJMB8l75G2rX/Xfbq+RO6NfVtSssLyWdjhfhleT69b1lHDcbChWkan6TAmXaQUP5KfSHlK0ovuzOpyA/xnVmcNsifFCAIug6+cY2qAoHpzNdR27haV9ipF2kvQVA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:34.424423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-47ab6fcd-1a12-4fc7-929c-0d355d780aa7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for project c8d1b8d477d0424b924671970921a5e5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:34.440199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-47ab6fcd-1a12-4fc7-929c-0d355d780aa7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for user fd124267837344e580ca605c2a646736 and project c8d1b8d477d0424b924671970921a5e5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:34.501750 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47ab6fcd-1a12-4fc7-929c-0d355d780aa7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119877 Sep 13 16:36:34.521887 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 801/1698] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:36:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:34.751627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:34.752917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7bf89261-1c59-474d-a461-c5a836c3fc6a tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.441840 Sep 13 16:36:34.753276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:34.753581 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 898/1699] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:36:34 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9/os-interface => generated 284 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:34.774833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:34.778002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:34.778610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.780284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:34.780880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:34.784312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:34.997284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:34.998791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:35.008965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:35.012547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:35.015623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:35.016590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:35.018387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:35.019037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:35.603111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:35.623391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e977247-6eda-491d-86f9-84d16c208fbb tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.630604 Sep 13 16:36:35.629171 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 899/1700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:34 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:35.642540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ce65f777-fded-47c0-835d-423f56a460db req-d4608b09-7018-46d6-aa47-c05678373945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "name": "network-vif-plugged", "status": "completed", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:35.665365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:35.676815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:35.678983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:35.680478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-509a29a3-cc2d-40fb-b941-4d1f18e9e322 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.933467 Sep 13 16:36:35.687805 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 802/1701] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:34 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:36:35.691509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ce65f777-fded-47c0-835d-423f56a460db req-d4608b09-7018-46d6-aa47-c05678373945 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:35.694081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ce65f777-fded-47c0-835d-423f56a460db req-d4608b09-7018-46d6-aa47-c05678373945 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:35.696452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:35.697245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ce65f777-fded-47c0-835d-423f56a460db req-d4608b09-7018-46d6-aa47-c05678373945 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:35.699241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:35.743036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:35.744022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ce65f777-fded-47c0-835d-423f56a460db req-d4608b09-7018-46d6-aa47-c05678373945 service nova] Creating event network-vif-plugged:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h1-857467-1 Sep 13 16:36:35.745949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:35.746612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:35.748238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:35.749014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:35.749640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:35.761337 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ce65f777-fded-47c0-835d-423f56a460db req-d4608b09-7018-46d6-aa47-c05678373945 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129581 Sep 13 16:36:35.767371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 900/1702] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:35.773949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-935e589b-42b4-497f-9ef7-727eb90362b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb5ac98b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:35.875595 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-935e589b-42b4-497f-9ef7-727eb90362b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.106865 Sep 13 16:36:35.876958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 901/1703] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:35 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:36.659228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:36.661386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:36.679378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:36.680128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:36.683130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:36.684397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:36.685035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:36.687190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:36.925229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:36.937489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c206ce0e-694d-434f-9410-2820184bd373 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1313 microversion: 2.1 time: 1.248121 Sep 13 16:36:36.938561 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 803/1704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:35 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1313 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:36.962160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:36.964458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:36.988544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:36.994571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:36.997163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:36.999867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:37.004097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:37.005020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:37.095525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:37.117897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-096af83a-3d6e-43b7-83ae-e27af77e4948 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.460846 Sep 13 16:36:37.120160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 902/1705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:36 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:37.133880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f961fb43-663a-422e-b15c-5238ec30cdbb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb9801550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:37.228125 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f961fb43-663a-422e-b15c-5238ec30cdbb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.106605 Sep 13 16:36:37.228753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 903/1706] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:37 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:37.495561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:37.520601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:37.526331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:37.535470 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b2fe3d4d-0fe1-417b-a2ea-055005c58b79 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.583007 Sep 13 16:36:37.536083 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 804/1707] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:36 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:37.947080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-79c49081-e060-4555-ab36-b2719abb0fe8 req-f988b94b-e75a-45a4-a7f8-ccb1092e023f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b07215b-6675-436b-bddf-67b67935c2e9", "tag": "a3a68300-329c-47bc-8752-25c4e745cf8e"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:37.949199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:37.949860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:37.976937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:37.977465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:37.983269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:37.983983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:37.984450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:37.984889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:37.997392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-79c49081-e060-4555-ab36-b2719abb0fe8 req-f988b94b-e75a-45a4-a7f8-ccb1092e023f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.000023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-79c49081-e060-4555-ab36-b2719abb0fe8 req-f988b94b-e75a-45a4-a7f8-ccb1092e023f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.003302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-79c49081-e060-4555-ab36-b2719abb0fe8 req-f988b94b-e75a-45a4-a7f8-ccb1092e023f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:38.064592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-79c49081-e060-4555-ab36-b2719abb0fe8 req-f988b94b-e75a-45a4-a7f8-ccb1092e023f service nova] Creating event network-changed:a3a68300-329c-47bc-8752-25c4e745cf8e for instance 8b07215b-6675-436b-bddf-67b67935c2e9 on n-h2-857467-1 Sep 13 16:36:38.076329 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-79c49081-e060-4555-ab36-b2719abb0fe8 req-f988b94b-e75a-45a4-a7f8-ccb1092e023f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130621 Sep 13 16:36:38.083295 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 805/1708] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:38.102189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:38.104855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:38.121346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.122913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.123789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:38.127304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.144464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.145664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:38.643213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:38.657643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be492d9e-3b5c-4307-a59d-caa0327fbb83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1463 microversion: 2.1 time: 0.572129 Sep 13 16:36:38.661723 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 806/1709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:38 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1463 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:38.688086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:38.690264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:38.707768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.708434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.708980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:38.712230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.712861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.715408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:38.834021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:38.848962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e8a759e-0b5b-4aab-94e1-3527072982a3 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1575 microversion: 2.1 time: 0.909705 Sep 13 16:36:38.849563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 904/1710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:37 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1575 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:38.862697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d4639344-a2e1-4196-b333-a3a3691d0402 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb56f1ca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:38.957581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d4639344-a2e1-4196-b333-a3a3691d0402 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.102642 Sep 13 16:36:38.958608 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 905/1711] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:38 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:38.979750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:38.980861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:38.993318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.993805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.994514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:38.995987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:38.996650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:38.997560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:39.262270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:39.280223 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6fdbd80b-491c-4e7a-b17b-0c4cf3fe61f5 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.604524 Sep 13 16:36:39.280824 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 807/1712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:38 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:39.315977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:39.318394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:39.331620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:39.334299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:39.334995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:39.337290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:39.342045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:39.342712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:39.663515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:39.687674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:39.691825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:39.702371 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a5ba988e-3d3d-4f1c-b4f5-9c7d7656cab3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.736235 Sep 13 16:36:39.702371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 906/1713] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:38 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:39.710069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbbb7d2e-c48e-40d9-8e45-c503aec9ece8 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1614 microversion: 2.1 time: 0.400898 Sep 13 16:36:39.715010 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 808/1714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:39 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1614 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:39.748099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:39.762621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:39.781468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:39.782206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:39.783038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:39.790970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:39.793994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:39.794771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:39.975249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edeee4a5-30a6-4f4d-8813-212504e0ea06 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb5436af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:40.010404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e740dd9be55842948d15fd5b6460267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079fa112a5ca49d299e9467bd7d41f63', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:40.014247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] flavor_id is None. Assuming migration. {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 13 16:36:40.014890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 16:36:40.046398 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-edeee4a5-30a6-4f4d-8813-212504e0ea06 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.075511 Sep 13 16:36:40.061395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 809/1715] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:39 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:40.320296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:40.322179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:40.357364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:40.360303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:40.360883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:40.366503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:40.367976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:40.371256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:40.661469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97534e60-0c0d-4dfe-913f-2fbd9d964bcf tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac/action" status: 202 len: 0 microversion: 2.1 time: 0.917328 Sep 13 16:36:40.662672 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 907/1716] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:39 2022] POST /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:40.681468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:40.682121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:40.707123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:40.707796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:40.709160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:40.709903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:40.710833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:40.713412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:40.714118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:40.724185 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9f430ac-9820-4f7a-91cc-daea1f922423 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.419029 Sep 13 16:36:40.741531 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 810/1717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:40 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:40.741932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:40.743538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:40.756767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:40.757418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:40.759366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:40.761862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:40.762478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:40.764205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:40.966510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:40.983076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:40.985390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:40.988012 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3eb8846b-7b97-4b3d-abae-cd6c9e9b5a55 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.250559 Sep 13 16:36:40.989167 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 811/1718] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:40 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:41.063800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90416a97-0269-4452-a452-b6ba376a75cb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb53d6940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:41.165002 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90416a97-0269-4452-a452-b6ba376a75cb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.100223 Sep 13 16:36:41.172870 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 812/1719] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:41 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:41.498558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-88401096", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:41.598480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] validate_networks() for [('d6d4f0b9-e6f0-4179-8206-f838ec11e666', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:36:41.692135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:41.740312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-29d5d9f3-2de5-4778-8f54-bef7612394d7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1472 microversion: 2.1 time: 1.060155 Sep 13 16:36:41.748103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 908/1720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:40 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1472 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:41.754819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:41.756469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:41.763893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:41.764670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:41.765338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:41.766884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:41.767861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:41.770564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:42.030025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:42.041339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3981da2a-b867-421a-b9ec-2f18267e583f tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.291870 Sep 13 16:36:42.049673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 909/1721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:41 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:42.061384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:42.065883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:42.081602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:42.082654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:42.083382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:42.085079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:42.086394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:42.088877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:42.177477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:36:42.178342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:36:42.179066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:36:42.179665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:36:42.180255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:36:42.191417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:42.192146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:42.192821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:42.194309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:42.195098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:42.196928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:42.216231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for project c8d1b8d477d0424b924671970921a5e5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:42.223110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for user fd124267837344e580ca605c2a646736 and project c8d1b8d477d0424b924671970921a5e5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:42.245735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:36:42.250632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:36:42.346818 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ee57b8e-92e3-43ff-ab1b-e1845d0b41f4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.852932 Sep 13 16:36:42.348057 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 813/1722] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:36:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:36:42.355050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd34ac3e-5b52-44cf-b7ac-cbdd7163528d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb54a84c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:42.450327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd34ac3e-5b52-44cf-b7ac-cbdd7163528d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.100310 Sep 13 16:36:42.460012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 814/1723] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:42 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:42.466328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75303a45-ed57-406f-a65c-c89227cc51d3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:42.468543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75303a45-ed57-406f-a65c-c89227cc51d3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:42.527237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:42.545649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75303a45-ed57-406f-a65c-c89227cc51d3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:42.546852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:42.551807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:42.555282 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40509630-c0bd-4fdb-b09a-bdce04a74b90 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.504225 Sep 13 16:36:42.555480 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75303a45-ed57-406f-a65c-c89227cc51d3 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1223 microversion: 2.1 time: 0.093916 Sep 13 16:36:42.556299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 815/1724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:42 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:42.569853 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 910/1725] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:42 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:42.774061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:42.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.073553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:43.074916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:43.091358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:43.094900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:43.095644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.096416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:43.101393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:43.102173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.299982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:43.309265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:43.313790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ab3b3d1-a607-4e19-8aed-f6fda746350a tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.245368 Sep 13 16:36:43.325456 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9c16a1f-97c0-460b-826e-e057a12e6234 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1472 microversion: 2.1 time: 0.556462 Sep 13 16:36:43.326459 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 911/1726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:43 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:43.345547 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 816/1727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:42 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1472 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:43.467891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa04aa34-b8e8-42ff-977c-7db4b8636456 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb97a2f70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:43.551523 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa04aa34-b8e8-42ff-977c-7db4b8636456 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.087762 Sep 13 16:36:43.552118 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 912/1728] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:43 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:43.596954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:43.600491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:43.600985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:43.602800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:43.636982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:43.640767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:43.641272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:43.641717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.642473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:43.642939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:43.643377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.649215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:43.649969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.650752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:43.651243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:43.652914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:43.848537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:43.862085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:43.864286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:43.867058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b423210-09f8-4c47-8ef3-aaaeb95c36aa tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.283935 Sep 13 16:36:43.868137 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 913/1729] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:43 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:43.908606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:43.921045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ba5a05a-75f1-4cfe-b4c4-af3a46f19655 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1227 microversion: 2.1 time: 0.337482 Sep 13 16:36:43.938855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 817/1730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:43 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1227 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:44.343513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:44.344227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:44.353041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:44.353680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:44.359866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.360952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.363272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.366221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.366917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.367487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.367724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.372941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.373509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.374317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.374809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.383124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.660782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:44.669288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-88730826-4435-4687-ba5d-20c6f990ab64 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.331776 Sep 13 16:36:44.684829 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 914/1731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:44 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:44.721875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08504ef7-b438-4f93-a8e4-f4ce80dddd1c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb980adc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:44.788883 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08504ef7-b438-4f93-a8e4-f4ce80dddd1c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.084224 Sep 13 16:36:44.789863 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 915/1732] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:44 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:44.892564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:44.893190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:44.900936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.902383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.903391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.904936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:44.905733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.906425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.906874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.926587 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6612274b-0fad-449c-abe0-79050dec8ea1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1472 microversion: 2.1 time: 0.577840 Sep 13 16:36:44.949285 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 818/1733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:44 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1472 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:44.962514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:44.964314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:44.983104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.984434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.986078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:44.987553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:44.992593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:44.993525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:45.252149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:45.281293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:45.285971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:45.298994 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43ae90dd-8297-4459-ade9-a1f9d8490f89 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.403360 Sep 13 16:36:45.303659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 916/1734] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:44 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:45.424862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:45.448160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b6392b8-43b6-4dd0-8f2e-99296f59f255 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1219 microversion: 2.1 time: 0.493050 Sep 13 16:36:45.462479 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 819/1735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:44 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1219 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:45.712373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:45.713934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:45.747991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:45.748781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:45.749423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:45.751714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:45.761603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:45.762577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:45.805345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76e2b64c-6534-4075-bfc3-f89235f8c1b9 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb56b2790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:45.897712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76e2b64c-6534-4075-bfc3-f89235f8c1b9 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.096959 Sep 13 16:36:45.908864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 820/1736] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:45 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:45.966785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:45.968118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:45.994141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:45.996314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:45.997000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:46.000152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:46.000901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:46.001579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:46.226371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:46.238461 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d57e054f-c1ca-4cfa-82dc-c26ee47c1ee9 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.529856 Sep 13 16:36:46.249997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 917/1737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:45 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:46.332871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:46.334427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:46.344211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:46.345016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:46.345705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:46.346859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:46.347754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:46.348421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:46.468312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:46.496020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a8f22fbc-2d4b-4852-b569-30195e4ca846 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1472 microversion: 2.1 time: 0.533133 Sep 13 16:36:46.509185 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 821/1738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:45 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:46.516373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:46.518820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:46.527760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:46.528653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:46.529542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:46.530541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:46.531271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:46.531941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:46.653444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:46.655914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:46.670078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:46.673395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:46.674701 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-48a334ab-cb4f-447b-a1b5-cbc664c0fcae tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.346275 Sep 13 16:36:46.676783 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 918/1739] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:46 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:36:46.716750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:46.732301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-11e4b8ec-3125-46b7-9af7-8232e6a36346 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1275 microversion: 2.1 time: 0.221383 Sep 13 16:36:46.733072 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 822/1740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:46 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:46.915581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58362217-7d5c-4aec-8be7-094f07a7905f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb54a81f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:47.038824 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58362217-7d5c-4aec-8be7-094f07a7905f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.126875 Sep 13 16:36:47.040789 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 823/1741] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:46 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:47.079181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-affad916-2572-4b59-ac8f-e7735451beaf tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Action: 'create', calling method: .version_select at 0x7fbeb96f0700>, body: {"pool": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:47.111264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-82eb5da1-98bb-4530-a26d-55f9061c5873 req-9e5d03d3-0901-4db5-9230-c514e2a3b91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7305af6-eeb4-43bc-ac65-52988a63a1de", "name": "network-vif-unplugged", "status": "completed", "tag": "623fd98d-6910-4803-8c51-595d0e97b6c3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:47.135548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-82eb5da1-98bb-4530-a26d-55f9061c5873 req-9e5d03d3-0901-4db5-9230-c514e2a3b91a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:47.137438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-82eb5da1-98bb-4530-a26d-55f9061c5873 req-9e5d03d3-0901-4db5-9230-c514e2a3b91a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:47.138328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-82eb5da1-98bb-4530-a26d-55f9061c5873 req-9e5d03d3-0901-4db5-9230-c514e2a3b91a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:47.153548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-82eb5da1-98bb-4530-a26d-55f9061c5873 req-9e5d03d3-0901-4db5-9230-c514e2a3b91a service nova] Creating event network-vif-unplugged:623fd98d-6910-4803-8c51-595d0e97b6c3 for instance f7305af6-eeb4-43bc-ac65-52988a63a1de on n-h1-857467-1 Sep 13 16:36:47.160773 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-82eb5da1-98bb-4530-a26d-55f9061c5873 req-9e5d03d3-0901-4db5-9230-c514e2a3b91a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053020 Sep 13 16:36:47.162585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 824/1742] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:47.264160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:47.265217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:47.277760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:47.279193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:47.280119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:47.299916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:47.300907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:47.303951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:48.299842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:48.328976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa6a6917-0fd7-49db-9fc3-e455fbc60c26 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 1.068842 Sep 13 16:36:48.330564 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 825/1743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:47 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:36:48.345693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:48.346673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:48.359616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:48.360451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:48.361200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:48.362173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:48.362918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:48.363566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:48.391905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:48.895337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:48.905782 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-07c7e282-34eb-461f-a023-97bcaef579f4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.573550 Sep 13 16:36:48.909934 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 826/1744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:48 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:48.924397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:48.925028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:48.946628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:48.947132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:48.947572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:48.955525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:48.956118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:48.957745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.118604 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-affad916-2572-4b59-ac8f-e7735451beaf tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.355220 Sep 13 16:36:49.119944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 919/1745] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:36:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:49.126119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:49.127776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:49.148774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.149705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.150611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.151590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.152362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.154485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.250943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:49.260214 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0b21ff8-3eff-4bef-ae3d-8ab6cc8b968f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1281 microversion: 2.1 time: 0.138923 Sep 13 16:36:49.273212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 920/1746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:49 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1281 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:49.278266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f14fee0e-3884-4d1d-8b53-ee1f7bbc95bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb56f1ca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:49.405391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f14fee0e-3884-4d1d-8b53-ee1f7bbc95bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1414 microversion: 2.1 time: 0.130796 Sep 13 16:36:49.408453 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 921/1747] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:49 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:49.421695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:49.422356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:49.440850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.441363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.441810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.442556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.446481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.450157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.500189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:49.534549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:49.535931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:49.537714 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9735dc59-8d78-4639-a548-74fe50a9b78c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.626217 Sep 13 16:36:49.542207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 827/1748] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:48 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:49.575747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d773313-b1c7-4de5-bf04-1cbfb16f043d tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Action: 'create', calling method: .version_select at 0x7fbeb53d6b80>, body: {"pool": null} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:49.791790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2f04278-605f-4497-80c2-4d6de6c6f0c3 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1856 microversion: 2.1 time: 0.381896 Sep 13 16:36:49.793287 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 922/1749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:49 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1856 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:49.844843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-750a5e85-d3c0-4e62-9329-d6d9a8830f2b req-5e3155a4-14eb-4d1e-a6c5-cb418491efec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7305af6-eeb4-43bc-ac65-52988a63a1de", "tag": "623fd98d-6910-4803-8c51-595d0e97b6c3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:49.856113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-750a5e85-d3c0-4e62-9329-d6d9a8830f2b req-5e3155a4-14eb-4d1e-a6c5-cb418491efec service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.857058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-750a5e85-d3c0-4e62-9329-d6d9a8830f2b req-5e3155a4-14eb-4d1e-a6c5-cb418491efec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.857765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-750a5e85-d3c0-4e62-9329-d6d9a8830f2b req-5e3155a4-14eb-4d1e-a6c5-cb418491efec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.882918 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-750a5e85-d3c0-4e62-9329-d6d9a8830f2b req-5e3155a4-14eb-4d1e-a6c5-cb418491efec service nova] Creating event network-changed:623fd98d-6910-4803-8c51-595d0e97b6c3 for instance f7305af6-eeb4-43bc-ac65-52988a63a1de on n-h1-857467-1 Sep 13 16:36:49.894591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-750a5e85-d3c0-4e62-9329-d6d9a8830f2b req-5e3155a4-14eb-4d1e-a6c5-cb418491efec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054275 Sep 13 16:36:49.895547 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 923/1750] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:49.902824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:49.903855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:49.912686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.913563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.914827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:49.915827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:49.916617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:49.917452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:50.187129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:50.203875 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bba516bc-8ec7-4419-b75f-861f60c54e38 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.305857 Sep 13 16:36:50.204974 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 924/1751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:49 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:50.212959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:50.216152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:50.232802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:50.234425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:50.243149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:50.244308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:50.245602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:50.246277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:50.305094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lazy-loading 'flavor' on Instance uuid 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:36:50.343067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Going to try to live migrate instance to n-h1-857467-1 {{(pid=122328) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:36:52.168821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d773313-b1c7-4de5-bf04-1cbfb16f043d tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.598884 Sep 13 16:36:52.170714 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 828/1752] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:36:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:52.188656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:52.190596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:52.202806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.203821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.204622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.205772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.206545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.207205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.208130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:52.291195 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87be3bb4-3419-4d8d-9598-7b63a7b4b5fa tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/action" status: 202 len: 0 microversion: 2.1 time: 2.084546 Sep 13 16:36:52.292862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 925/1753] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:50 2022] POST /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/action => generated 0 bytes in 2087 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:52.308415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:52.309056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:52.323867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.324636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.325283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.326224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.326934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.327608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.510303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.518234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9bfa7b7-457b-4ed4-b5f6-36550d613ab1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.219364 Sep 13 16:36:52.519545 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 926/1754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:52.524961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-639302bc-572b-4a31-8ac1-8bfc7928375b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb98018b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:52.536073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.565995 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0edc710-3638-4606-95f2-e2cc27e77518 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.383640 Sep 13 16:36:52.567398 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 829/1755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:52.574571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:52.575498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:52.593557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-639302bc-572b-4a31-8ac1-8bfc7928375b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1423 microversion: 2.1 time: 0.072754 Sep 13 16:36:52.595165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 927/1756] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1423 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:52.598215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:52.602172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.606136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.606635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.607388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.607827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:52.607969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.608288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.608440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:52.616204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.616692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.617126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.617855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.618875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.619779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.772578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.774417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.781909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.782806 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea6db58f-460d-4078-b370-1f04d6fa6a3c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.185659 Sep 13 16:36:52.783387 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 928/1757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:52.783556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.784612 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c37026fc-e400-4fad-95cd-d799bb3b9187 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.213841 Sep 13 16:36:52.785166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 830/1758] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:52.788567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-08d92efe-6e84-4910-b35f-b3e6e22de912 req-b64f3977-b103-4f22-bb7c-f63712161765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ebce02c-eefa-4082-86de-4185c86906a3", "tag": "3d930354-0626-43fd-b0d8-65dcc9580f6c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:52.790873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e82a3c5a-8737-4434-9c5e-c8027d0bcf7d tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Action: 'create', calling method: .version_select at 0x7fbeb53e1c10>, body: {"pool": null} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:52.804483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-08d92efe-6e84-4910-b35f-b3e6e22de912 req-b64f3977-b103-4f22-bb7c-f63712161765 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.804971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-08d92efe-6e84-4910-b35f-b3e6e22de912 req-b64f3977-b103-4f22-bb7c-f63712161765 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.805475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-08d92efe-6e84-4910-b35f-b3e6e22de912 req-b64f3977-b103-4f22-bb7c-f63712161765 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.817654 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-08d92efe-6e84-4910-b35f-b3e6e22de912 req-b64f3977-b103-4f22-bb7c-f63712161765 service nova] Creating event network-changed:3d930354-0626-43fd-b0d8-65dcc9580f6c for instance 6ebce02c-eefa-4082-86de-4185c86906a3 on n-h2-857467-1 Sep 13 16:36:52.823576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-08d92efe-6e84-4910-b35f-b3e6e22de912 req-b64f3977-b103-4f22-bb7c-f63712161765 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039002 Sep 13 16:36:52.824288 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 929/1759] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:52.830047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:52.830810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:52.838028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.838520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.839085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.839812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:52.840269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:52.840701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:52.979042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:52.987364 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9310487e-26aa-4f3c-858c-377be1da2919 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.161882 Sep 13 16:36:52.987944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 930/1760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:52.993194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d9e6667-6993-4837-81f8-d9b7dd5292e5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb97ebdc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:53.039734 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d9e6667-6993-4837-81f8-d9b7dd5292e5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 200 len: 1423 microversion: 2.1 time: 0.050741 Sep 13 16:36:53.040545 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 931/1761] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:36:52 2022] GET /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 1423 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:53.054655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bb9a2bdb-3c17-4c7c-82dc-138de9042b57 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb9733a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:53.748404 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bb9a2bdb-3c17-4c7c-82dc-138de9042b57 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 204 len: 0 microversion: 2.1 time: 0.698267 Sep 13 16:36:53.749069 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 932/1762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:53 2022] DELETE /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:36:53.754216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:53.754828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:53.762375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:53.762874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:53.763317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:53.764021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:53.764479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:53.765107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:53.903047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:53.911486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd393e11-c5e1-4a22-954d-ffe0afac80f8 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.161114 Sep 13 16:36:53.912475 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 933/1763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:53 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:54.022144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:54.022764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:54.029123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.029612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.030074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.030781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.031239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.031713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.219176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:54.227707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e4074bc-28c3-4c17-873b-db125f705ee5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.314212 Sep 13 16:36:54.228301 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 934/1764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:53 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:54.232836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:54.233398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:54.239559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.240919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.241680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.242953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.243753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.244535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.276339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:36:54.336053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e82a3c5a-8737-4434-9c5e-c8027d0bcf7d tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.549527 Sep 13 16:36:54.336671 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 831/1765] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:36:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:54.341346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:54.341992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:54.351272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.351786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.352310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.352571 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a30652b3-b7c4-4e90-9012-5ea6ca887c24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 204 len: 0 microversion: 2.1 time: 0.122989 Sep 13 16:36:54.353057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.353184 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 935/1766] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:36:54 2022] DELETE /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:36:54.353526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.353986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.359894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:54.359894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:54.365925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.366419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.366852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.367569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.368025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.368447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.506871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:54.514939 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b491b8c-6eba-4526-b32a-ac74f37efb83 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1523 microversion: 2.1 time: 0.177294 Sep 13 16:36:54.515522 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 832/1767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:54 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:54.516786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:54.520178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:54.520784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:54.523855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:54.526762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:54.527454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.527947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.528158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:54.528389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.529088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:54.529544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:54.529739 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-964bfbc1-1137-4c3e-8547-70f4a8ae4d31 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.175192 Sep 13 16:36:54.530005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:54.530652 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 936/1768] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:54 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:54.535126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a6010d1-4a45-4ef7-9b18-caaa743f82d9 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Action: 'create', calling method: .version_select at 0x7fbeb96f0670>, body: {"pool": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:54.665981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:54.674870 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-82299fd5-c8e9-4963-b975-1117f4fb741a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.158345 Sep 13 16:36:54.675469 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 833/1769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:54 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:54.681038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-372546024", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "179fb6ca-f6bf-4d09-a618-632e7e778e62"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:54.737295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] validate_networks() for [('179fb6ca-f6bf-4d09-a618-632e7e778e62', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:36:55.154490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:36:55.154917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:36:55.155389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:36:55.156046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:36:55.156404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:36:55.168921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.169510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.170080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.171112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.171684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.172182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.190723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:36:55.196708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for user 67dc5c1abf0649888b406f5911e5e5dd and project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:36:55.210518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:36:55.213261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:36:55.272926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52bff172-c64a-4e08-948b-53729017df87 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596389 Sep 13 16:36:55.274161 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 834/1770] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:36:55.279388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:55.280433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:55.288843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.289459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.290040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.290912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.291342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.291843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.531058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:55.543521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-18fddf35-b9fc-49e9-8409-1a828dc53704 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.268030 Sep 13 16:36:55.544981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 835/1771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:55 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:55.550050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-cce8c690-0af7-44c1-8cb1-299e9229ee82 req-654653e8-bf88-46d9-b4c8-aa23246d0180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5793c3-b5e5-4b6c-91cd-62af303c98de", "name": "network-vif-unplugged", "status": "completed", "tag": "0ba191e1-13c0-4460-ab74-b400fb91de9d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:55.569867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-cce8c690-0af7-44c1-8cb1-299e9229ee82 req-654653e8-bf88-46d9-b4c8-aa23246d0180 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.570416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-cce8c690-0af7-44c1-8cb1-299e9229ee82 req-654653e8-bf88-46d9-b4c8-aa23246d0180 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.570810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-cce8c690-0af7-44c1-8cb1-299e9229ee82 req-654653e8-bf88-46d9-b4c8-aa23246d0180 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.593302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-cce8c690-0af7-44c1-8cb1-299e9229ee82 req-654653e8-bf88-46d9-b4c8-aa23246d0180 service nova] Creating event network-vif-unplugged:0ba191e1-13c0-4460-ab74-b400fb91de9d for instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de on n-h2-857467-1 Sep 13 16:36:55.599439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-cce8c690-0af7-44c1-8cb1-299e9229ee82 req-654653e8-bf88-46d9-b4c8-aa23246d0180 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052685 Sep 13 16:36:55.600996 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 836/1772] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:55.608363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:55.609022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:55.616984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.617472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.617948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.618836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.619309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.619745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.788852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:55.799493 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f83d1c4e-2473-4e5e-88f0-ae70627ecacb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.196737 Sep 13 16:36:55.800597 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 837/1773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:55 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:55.807197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2951575-9409-4976-a186-bb262a368926 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:55.807890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2951575-9409-4976-a186-bb262a368926 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:55.863761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e2951575-9409-4976-a186-bb262a368926 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:55.872320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2951575-9409-4976-a186-bb262a368926 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1207 microversion: 2.1 time: 0.070148 Sep 13 16:36:55.881935 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 838/1774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:55 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1207 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:55.881935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:55.881935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:55.893055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.893704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.894249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:55.896836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:55.897395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:55.898650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.082647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:56.094702 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-daed3841-4109-4d8b-bd7b-2f7c630fd256 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1503 microversion: 2.1 time: 0.220234 Sep 13 16:36:56.109856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 839/1775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:55 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:56.138240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a6010d1-4a45-4ef7-9b18-caaa743f82d9 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.606413 Sep 13 16:36:56.138854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 937/1776] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:36:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:56.143836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:56.144825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:56.153327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.153856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.154341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.155053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.155520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.155954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.239368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:56.240212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:56.249267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.250058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.250688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.251625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.253787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.254563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.311712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:56.322256 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5485a00-def4-49ba-8078-e8737ea9afbb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.182003 Sep 13 16:36:56.323163 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 938/1777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:56 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:56.328555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60728d99-8efd-4b4e-93c7-c73e75ddc517 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'create', calling method: .version_select at 0x7fbeb97dd670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-492447781", "description": "tempest-description-1959590038"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:56.439287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:56.452224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:56.455308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:56.456738 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-234bf06d-e9b8-44f5-8a1b-a70906c0ade0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.354738 Sep 13 16:36:56.457962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 840/1778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:56 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:56.476554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ca6e45f-4a05-49d9-96c0-42392ac68d4a tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb53d60d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:56.508106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60728d99-8efd-4b4e-93c7-c73e75ddc517 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.183852 Sep 13 16:36:56.508767 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 939/1779] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:36:56 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:56.522729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-492447781"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:56.523278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:56.529945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.530445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.530886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.531590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.532051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.532476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.536757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:36:56.675489 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.network.security_group_api [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Adding security group f787f031-b3cb-41ac-8f5f-00cc842bf9fa to port 0e639888-1523-493f-b4e8-8034350ba559 Sep 13 16:36:56.743647 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ca6e45f-4a05-49d9-96c0-42392ac68d4a tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/63a345f4-2cb9-4a5a-928d-70d492f69858" status: 200 len: 141 microversion: 2.1 time: 0.273221 Sep 13 16:36:56.745363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 841/1780] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:36:56 2022] GET /compute/v2.1/os-floating-ips/63a345f4-2cb9-4a5a-928d-70d492f69858 => generated 141 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:56.750688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:56.751524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:56.758341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.759357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.759357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.759980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:56.760449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:56.760925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:56.905575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:56.914839 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ee986b6-4af8-46f9-bd5a-93b7f142fd31 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.168068 Sep 13 16:36:56.915697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 842/1781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:56 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:56.937515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ccd2584-a975-4003-aa8c-e13fd0fbf767 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb53e14c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:57.102539 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5fe5e676-83fa-4e80-8040-1b62bf883677 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action" status: 202 len: 0 microversion: 2.1 time: 0.584522 Sep 13 16:36:57.103176 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 940/1782] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:56 2022] POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:36:57.109653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:57.111373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:57.126677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:57.127549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:57.128317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:57.129632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:57.132012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:57.132735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:57.456513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:57.466222 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13d7db3e-f12a-436d-8c9c-bc4c39db20e2 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.361759 Sep 13 16:36:57.467038 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 941/1783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:57 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:57.472413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:57.473495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:57.492193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:57.493002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:57.496710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:57.497711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:57.498399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:57.499002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:57.583839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:57.598084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a7285a1b-0de6-436e-a2cb-d9f0e3c94e70 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1265 microversion: 2.1 time: 0.127457 Sep 13 16:36:57.598985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 942/1784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:57 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:57.624509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-492447781"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:57.624776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:57.639185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:57.639680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:57.640131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:57.641008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:57.641485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:57.641941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:57.888964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.network.security_group_api [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Removing security group f787f031-b3cb-41ac-8f5f-00cc842bf9fa from port 0e639888-1523-493f-b4e8-8034350ba559 Sep 13 16:36:58.404157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00566c22-1b57-4340-a4e1-52b92bf0f4a8 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action" status: 202 len: 0 microversion: 2.1 time: 0.789287 Sep 13 16:36:58.406280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 943/1785] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:36:57 2022] POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:58.417395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ddfadd33-f6dd-4085-91c6-8656243fb3c0 req-6365ea9a-ff67-4a75-8739-9b4842acac44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:58.439005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ddfadd33-f6dd-4085-91c6-8656243fb3c0 req-6365ea9a-ff67-4a75-8739-9b4842acac44 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.440996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ddfadd33-f6dd-4085-91c6-8656243fb3c0 req-6365ea9a-ff67-4a75-8739-9b4842acac44 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.442291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ddfadd33-f6dd-4085-91c6-8656243fb3c0 req-6365ea9a-ff67-4a75-8739-9b4842acac44 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.469611 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ccd2584-a975-4003-aa8c-e13fd0fbf767 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/63a345f4-2cb9-4a5a-928d-70d492f69858" status: 202 len: 0 microversion: 2.1 time: 1.536947 Sep 13 16:36:58.481147 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 843/1786] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:36:56 2022] DELETE /compute/v2.1/os-floating-ips/63a345f4-2cb9-4a5a-928d-70d492f69858 => generated 0 bytes in 1565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:36:58.498119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:58.499496 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ddfadd33-f6dd-4085-91c6-8656243fb3c0 req-6365ea9a-ff67-4a75-8739-9b4842acac44 service nova] Creating event network-changed:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:36:58.500646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:58.513437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.515625 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ddfadd33-f6dd-4085-91c6-8656243fb3c0 req-6365ea9a-ff67-4a75-8739-9b4842acac44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106885 Sep 13 16:36:58.515791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.516329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.516767 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 944/1787] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:36:58.518230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.518798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.525935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:58.526573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.527096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:58.545667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.547165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.547972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.549474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.562173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.562173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.847004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:58.856412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8810ff0-90e0-48d3-be92-3a7cf74c0621 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.371425 Sep 13 16:36:58.858982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 844/1788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:58 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:58.863798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:58.866997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:58.888676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.889554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.890291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.891433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:58.892137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:58.892749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:58.912743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:58.922879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:58.927577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:58.934964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f2d24b8-b8d9-4cad-8b46-88f24a51eaec tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.416738 Sep 13 16:36:58.936053 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 945/1789] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:36:58 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:36:58.940778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7df2f18b-e08c-4ca7-9cde-863d4f8acd4e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'create', calling method: .version_select at 0x7fbeb980aaf0>, body: {"pool": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:36:59.266717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:59.278568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cdc43355-ba0d-4f3c-8da6-3c6208f24607 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.418309 Sep 13 16:36:59.279178 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 845/1790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:58 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:59.303240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-946a7136-1c56-4023-a988-a7afba6d8710 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb53a9280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:59.583781 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-946a7136-1c56-4023-a988-a7afba6d8710 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.285715 Sep 13 16:36:59.584551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 846/1791] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Sep 13 16:36:59 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:36:59.591169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:59.592490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:59.601195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:59.601703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:59.602181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:59.602914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:59.603510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:59.603956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:59.791531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:59.801595 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a36775d-a21f-4e5e-91a2-aaa486174559 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.214925 Sep 13 16:36:59.803262 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 847/1792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:59 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:36:59.808928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:36:59.809762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:36:59.816435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:59.817171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:59.817878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:59.818757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:36:59.819413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:36:59.820034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:36:59.974244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:36:59.982402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad8f575b-1aae-4453-9f50-13f657808387 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.177833 Sep 13 16:36:59.982984 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 848/1793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:36:59 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:00.003326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-766a2883-0282-4363-9950-18a9f588ac54 req-0c1f0abb-b4c6-4e6a-83ba-99ccf5fed0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5793c3-b5e5-4b6c-91cd-62af303c98de", "name": "network-vif-deleted", "tag": "0ba191e1-13c0-4460-ab74-b400fb91de9d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:00.013883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-766a2883-0282-4363-9950-18a9f588ac54 req-0c1f0abb-b4c6-4e6a-83ba-99ccf5fed0c8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.014322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-766a2883-0282-4363-9950-18a9f588ac54 req-0c1f0abb-b4c6-4e6a-83ba-99ccf5fed0c8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.014767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-766a2883-0282-4363-9950-18a9f588ac54 req-0c1f0abb-b4c6-4e6a-83ba-99ccf5fed0c8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.026376 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-766a2883-0282-4363-9950-18a9f588ac54 req-0c1f0abb-b4c6-4e6a-83ba-99ccf5fed0c8 service nova] Creating event network-vif-deleted:0ba191e1-13c0-4460-ab74-b400fb91de9d for instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de on n-h2-857467-1 Sep 13 16:37:00.031217 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-766a2883-0282-4363-9950-18a9f588ac54 req-0c1f0abb-b4c6-4e6a-83ba-99ccf5fed0c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036042 Sep 13 16:37:00.031993 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 849/1794] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:00.036925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9d06b71-e752-4254-a627-e3c52591e174 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb9745dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:00.304278 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9d06b71-e752-4254-a627-e3c52591e174 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.271071 Sep 13 16:37:00.314916 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 850/1795] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:37:00 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:00.321398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:00.326687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:00.335381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.336074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.336973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.337922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.338383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.338819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.504042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:00.507836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:00.514084 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a41d509-25ae-468d-9c1c-4e23304423a1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.197498 Sep 13 16:37:00.514911 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 851/1796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:00 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:00.520233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:00.521019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:00.527122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.527749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.528195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.529182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.529892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.530503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.678487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:00.688978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:00.691071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:00.692865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-471745c2-8f8d-444c-9b9c-4899a4aa715b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.176654 Sep 13 16:37:00.694400 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 852/1797] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:00 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:00.707690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:00.709080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:00.717224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.717532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.718124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.718839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:00.719304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:00.719718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:00.874738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:00.884397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2d7ecfae-c513-413f-9f45-8b02f56b6925 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.188007 Sep 13 16:37:00.885347 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 853/1798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:00 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:00.890474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fd4b043e-0d1a-404f-a6fc-439568626cd1 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb54b0af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:01.719487 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7df2f18b-e08c-4ca7-9cde-863d4f8acd4e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.781280 Sep 13 16:37:01.724901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 946/1799] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:36:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:01.735340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-87bb27c1-5d76-47e7-96a8-235d4a986ca6 req-111ed521-2b64-44a5-b219-5a9456b353c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:01.742550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:01.750001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-87bb27c1-5d76-47e7-96a8-235d4a986ca6 req-111ed521-2b64-44a5-b219-5a9456b353c7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:01.750763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-87bb27c1-5d76-47e7-96a8-235d4a986ca6 req-111ed521-2b64-44a5-b219-5a9456b353c7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:01.751476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-87bb27c1-5d76-47e7-96a8-235d4a986ca6 req-111ed521-2b64-44a5-b219-5a9456b353c7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:01.765125 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-87bb27c1-5d76-47e7-96a8-235d4a986ca6 req-111ed521-2b64-44a5-b219-5a9456b353c7 service nova] Creating event network-changed:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:37:01.770586 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-87bb27c1-5d76-47e7-96a8-235d4a986ca6 req-111ed521-2b64-44a5-b219-5a9456b353c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042941 Sep 13 16:37:01.771797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 947/1800] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:01.777525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:01.778671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:01.779916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fd4b043e-0d1a-404f-a6fc-439568626cd1 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/396a31e3-48f9-452b-9acc-26a84cd31901" status: 202 len: 0 microversion: 2.1 time: 0.893064 Sep 13 16:37:01.780525 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 854/1801] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:37:00 2022] DELETE /compute/v2.1/os-floating-ips/396a31e3-48f9-452b-9acc-26a84cd31901 => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:37:01.785657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:01.786851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:01.787296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:01.788939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:01.789608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:01.790563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:01.791235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:01.791925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:01.793246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:01.793752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:01.794237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:01.794966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:01.795435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:01.795906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:01.980831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:01.990027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c7cd82f6-1f82-446e-b020-bb797258f85a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.208134 Sep 13 16:37:01.991346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 855/1802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:01 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:01.996737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1af65b2c-d7a2-4b78-b7a9-cae3da2ac44b req-7374be0a-d5a2-4dec-93f1-616d46b6da17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebce02c-eefa-4082-86de-4185c86906a3", "name": "network-vif-plugged", "status": "completed", "tag": "3d930354-0626-43fd-b0d8-65dcc9580f6c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:02.008738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1af65b2c-d7a2-4b78-b7a9-cae3da2ac44b req-7374be0a-d5a2-4dec-93f1-616d46b6da17 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.009533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1af65b2c-d7a2-4b78-b7a9-cae3da2ac44b req-7374be0a-d5a2-4dec-93f1-616d46b6da17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.010378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1af65b2c-d7a2-4b78-b7a9-cae3da2ac44b req-7374be0a-d5a2-4dec-93f1-616d46b6da17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.024051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1af65b2c-d7a2-4b78-b7a9-cae3da2ac44b req-7374be0a-d5a2-4dec-93f1-616d46b6da17 service nova] Creating event network-vif-plugged:3d930354-0626-43fd-b0d8-65dcc9580f6c for instance 6ebce02c-eefa-4082-86de-4185c86906a3 on n-h2-857467-1 Sep 13 16:37:02.030135 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1af65b2c-d7a2-4b78-b7a9-cae3da2ac44b req-7374be0a-d5a2-4dec-93f1-616d46b6da17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Sep 13 16:37:02.031640 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 856/1803] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:02.040801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:02.041504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:02.048003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.049152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.049152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.049610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.050119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.050798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.183806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:02.200423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45925f3e-335b-4288-892f-b8ae5d83db1b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.427216 Sep 13 16:37:02.201142 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 948/1804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:01 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:02.210572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:02.215921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:02.223104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.224616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.225710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.226821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.227545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.228210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.611281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:02.623166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68aa6b31-f6c7-45bc-a4c9-5b95e271a824 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.590023 Sep 13 16:37:02.624096 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 857/1805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:02 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:02.636067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'action', calling method: .version_select at 0x7fbeb7179790>, body: {"addFloatingIp": {"address": "172.25.7.150"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:02.640329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:02.649370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.649896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.650374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.651101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:02.651570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:02.652009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:02.731984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "refresh_cache-ce8de958-0446-4468-a7b1-22d86df1bc7d" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:37:02.732404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquired lock "refresh_cache-ce8de958-0446-4468-a7b1-22d86df1bc7d" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:37:02.960257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:02.970239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:02.972028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:02.973507 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8daab87a-7994-4f52-956b-cb81ddb821dd tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.771118 Sep 13 16:37:02.986542 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 949/1806] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:02 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:02.998495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b96ed914-e8f4-47b3-9416-be9a93ba99a9 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb97db820>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:03.962092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Building network info cache for instance {{(pid=122327) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:37:04.187433 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b96ed914-e8f4-47b3-9416-be9a93ba99a9 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/ef6f5428-ed7c-4029-9038-921a46639be1" status: 202 len: 0 microversion: 2.1 time: 1.198843 Sep 13 16:37:04.188194 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 950/1807] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:37:02 2022] DELETE /compute/v2.1/os-floating-ips/ef6f5428-ed7c-4029-9038-921a46639be1 => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:37:04.194054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:04.194674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:04.201721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.202292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.202730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.203627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.204086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.204518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.349350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.357495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ff147dd-3745-4d40-89ff-f56f4f6f4c35 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1323 microversion: 2.1 time: 0.167544 Sep 13 16:37:04.358312 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 951/1808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:04 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:04.376932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:04.377563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:04.384671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.384903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.385331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.386076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.386832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.387272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.551518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.553069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Updating instance_info_cache with network_info: [{"id": "0e639888-1523-493f-b4e8-8034350ba559", "address": "fa:16:3e:43:d0:c5", "network": {"id": "6421ed40-b5d7-4da6-85d2-0c9151ae2769", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-432064344-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4710b60a7c7e44a78452286123322925", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e639888-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:37:04.561194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fff33540-414f-4e72-9759-1a69ebff115c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.198810 Sep 13 16:37:04.561922 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 952/1809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:04 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:04.566706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:04.568170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:04.572342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Releasing lock "refresh_cache-ce8de958-0446-4468-a7b1-22d86df1bc7d" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:37:04.574114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b4d9e81f-627c-4fb5-89fb-e9fca3699a2e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action" status: 202 len: 0 microversion: 2.1 time: 1.941357 Sep 13 16:37:04.575145 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 858/1810] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:37:02 2022] POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action => generated 0 bytes in 1944 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:37:04.576405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.577065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.577705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.578692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.579371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.579887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.583422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:04.584175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:04.591243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.592897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.594199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.595120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.595818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.596409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.731818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.742558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a5a9ad85-ba5a-4bd9-93a1-504a5dd9c2e8 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.179347 Sep 13 16:37:04.743901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 953/1811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:04 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:04.746477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.750440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f99804e9-066f-4ed8-a2f7-e6e77e1fae21 req-56014433-d417-4bb1-970a-abc1555f3233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4942170b-e2df-40ac-8f82-89f3e1487d14", "tag": "b34e695c-4015-4d7f-8224-cc521758c7fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:04.756874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-afd80fea-f272-47d3-a87c-6f68b48ba884 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.180311 Sep 13 16:37:04.757633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 859/1812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:04 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:04.760912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f99804e9-066f-4ed8-a2f7-e6e77e1fae21 req-56014433-d417-4bb1-970a-abc1555f3233 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.761795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f99804e9-066f-4ed8-a2f7-e6e77e1fae21 req-56014433-d417-4bb1-970a-abc1555f3233 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.767053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f207cecd-24ae-4114-a622-3c903bf02478 req-af7bbeb0-2208-4300-916b-37168110aeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:04.767529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f99804e9-066f-4ed8-a2f7-e6e77e1fae21 req-56014433-d417-4bb1-970a-abc1555f3233 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.782057 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f99804e9-066f-4ed8-a2f7-e6e77e1fae21 req-56014433-d417-4bb1-970a-abc1555f3233 service nova] Creating event network-changed:b34e695c-4015-4d7f-8224-cc521758c7fb for instance 4942170b-e2df-40ac-8f82-89f3e1487d14 on n-h1-857467-1 Sep 13 16:37:04.782905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f207cecd-24ae-4114-a622-3c903bf02478 req-af7bbeb0-2208-4300-916b-37168110aeb8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.783771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f207cecd-24ae-4114-a622-3c903bf02478 req-af7bbeb0-2208-4300-916b-37168110aeb8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.784573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f207cecd-24ae-4114-a622-3c903bf02478 req-af7bbeb0-2208-4300-916b-37168110aeb8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.788058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f99804e9-066f-4ed8-a2f7-e6e77e1fae21 req-56014433-d417-4bb1-970a-abc1555f3233 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042846 Sep 13 16:37:04.788782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 954/1813] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:04.796728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:04.797432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:04.800291 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f207cecd-24ae-4114-a622-3c903bf02478 req-af7bbeb0-2208-4300-916b-37168110aeb8 service nova] Creating event network-changed:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:37:04.806610 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f207cecd-24ae-4114-a622-3c903bf02478 req-af7bbeb0-2208-4300-916b-37168110aeb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047512 Sep 13 16:37:04.807539 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 860/1814] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:04.807924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.808601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.809143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.810255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:04.810916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:04.811531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:04.814381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-633533cf-437c-4df0-8dfd-24b08daf4888 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] Calling method '.version_select at 0x7fbeb568c310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:04.957622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.968076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.970061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:04.971270 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab48e22b-ef7e-497b-9f20-37dc29640308 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.179730 Sep 13 16:37:04.974228 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 955/1815] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:04 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:04.981481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Action: 'action', calling method: .version_select at 0x7fbeb7177b80>, body: {"removeFloatingIp": {"address": "172.25.7.150"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:05.139946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:05.147629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:05.148131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:05.148638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:05.149422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:05.149961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:05.150371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:05.180064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:05.435287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "refresh_cache-ce8de958-0446-4468-a7b1-22d86df1bc7d" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:37:05.435850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquired lock "refresh_cache-ce8de958-0446-4468-a7b1-22d86df1bc7d" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:37:05.649289 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-633533cf-437c-4df0-8dfd-24b08daf4888 tempest-FloatingIPDetailsTestJSON-1137141120 tempest-FloatingIPDetailsTestJSON-1137141120-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/5b7fdc8f-3320-4e29-8d6a-1c22ddb9edc8" status: 202 len: 0 microversion: 2.1 time: 0.839866 Sep 13 16:37:05.649919 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 861/1816] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:37:04 2022] DELETE /compute/v2.1/os-floating-ips/5b7fdc8f-3320-4e29-8d6a-1c22ddb9edc8 => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:37:05.657856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:05.658875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:05.688793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:05.690195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:05.690826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:05.694133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:05.694943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:05.695629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:05.868980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:06.119143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:06.127363 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1769e69a-42d6-42a3-ac74-3adc96b29b18 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1520 microversion: 2.1 time: 0.474616 Sep 13 16:37:06.128127 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 862/1817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:05 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1520 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:06.133599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:06.134573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:06.142446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:06.143523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:06.144202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:06.145172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:06.146381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:06.146949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:06.888228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:06.897926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c118a07c-569c-43dc-8c63-fd0dcbe74704 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.768176 Sep 13 16:37:06.905200 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 863/1818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:06 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:06.920091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:06.922255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:06.929266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:06.929776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:06.930248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:06.931029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:06.931504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:06.931943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:07.144183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Building network info cache for instance {{(pid=122328) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:37:07.331494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:07.342585 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66402158-f19d-45bd-bb84-0a8ec281230e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.427455 Sep 13 16:37:07.343476 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 864/1819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:06 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:07.354684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:07.355655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:07.368067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:07.370247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:07.372294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:07.373529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:07.374353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:07.375070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:07.703081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:07.715356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4c70670-e0ef-450d-8de3-1589d1bc9d32 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.370178 Sep 13 16:37:07.730622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 865/1820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:07 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:07.737805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:07.738669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:07.762896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:07.771865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:07.772713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:07.773725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:07.774413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:07.774757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.048361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Updating instance_info_cache with network_info: [{"id": "0e639888-1523-493f-b4e8-8034350ba559", "address": "fa:16:3e:43:d0:c5", "network": {"id": "6421ed40-b5d7-4da6-85d2-0c9151ae2769", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-432064344-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4710b60a7c7e44a78452286123322925", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e639888-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122328) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:37:08.059434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Releasing lock "refresh_cache-ce8de958-0446-4468-a7b1-22d86df1bc7d" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:37:08.061537 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3a99c44-6f69-4bc3-b04e-ba1e3a904d50 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action" status: 202 len: 0 microversion: 2.1 time: 3.085094 Sep 13 16:37:08.063005 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 956/1821] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:37:04 2022] POST /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d/action => generated 0 bytes in 3088 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:37:08.068675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:08.069599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:08.078590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.079183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.079689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.080412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.080875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.081496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.115946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:08.125686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:08.127051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:08.128242 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8807e96-eb33-4d8d-a283-b2067cd4d827 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1814 microversion: 2.25 time: 0.396302 Sep 13 16:37:08.137968 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 866/1822] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:07 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1814 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:08.137968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-32e17fc4-3b9b-42ee-92f4-3274cd2fbd5b req-76d61217-1575-4b42-89b1-0c08461a2a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:08.156293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-32e17fc4-3b9b-42ee-92f4-3274cd2fbd5b req-76d61217-1575-4b42-89b1-0c08461a2a20 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.156860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-32e17fc4-3b9b-42ee-92f4-3274cd2fbd5b req-76d61217-1575-4b42-89b1-0c08461a2a20 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.157312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-32e17fc4-3b9b-42ee-92f4-3274cd2fbd5b req-76d61217-1575-4b42-89b1-0c08461a2a20 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.170510 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-32e17fc4-3b9b-42ee-92f4-3274cd2fbd5b req-76d61217-1575-4b42-89b1-0c08461a2a20 service nova] Creating event network-changed:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:37:08.175654 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-32e17fc4-3b9b-42ee-92f4-3274cd2fbd5b req-76d61217-1575-4b42-89b1-0c08461a2a20 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045323 Sep 13 16:37:08.176242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 867/1823] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:08.188408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:08.191140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:08.207020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.207531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.209007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.209859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.210334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.210772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.301624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:08.318568 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc892c1b-303b-49bd-b0bc-5ace656fb611 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1520 microversion: 2.1 time: 0.253027 Sep 13 16:37:08.320056 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 957/1824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:08 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:08.342989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-861651e6-aac9-44fc-8436-678ea08687b4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '.version_select at 0x7fbeb97ddb80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:08.548133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:08.558485 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-736ed29f-5013-47bc-8c13-06ad67b529db tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.375378 Sep 13 16:37:08.574075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 868/1825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:08 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:08.581174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1625666204"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:08.584793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:08.591696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.592456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.593124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.594102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.594831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.595477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.849301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94ad9c05-f6f9-42f0-a786-2166050fbcc9 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3/action" status: 202 len: 0 microversion: 2.1 time: 0.273860 Sep 13 16:37:08.850745 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 869/1826] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:37:08 2022] POST /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:37:08.857599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:08.859134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:08.868567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.869042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.869451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.870331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:08.870986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:08.871415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:08.903574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:09.435476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:09.447339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-212de87a-d7f8-45bc-9b7e-c92950b455c1 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1477 microversion: 2.1 time: 0.594580 Sep 13 16:37:09.454962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 870/1827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:08 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1477 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:09.460744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:09.461857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:09.476229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:09.477008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:09.477458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:09.487465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:09.488250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:09.491680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:09.643480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-861651e6-aac9-44fc-8436-678ea08687b4 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/f0a22f1d-2d78-4400-befc-d8b9c07d085d" status: 202 len: 0 microversion: 2.1 time: 1.303296 Sep 13 16:37:09.649229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 958/1828] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:37:08 2022] DELETE /compute/v2.1/os-floating-ips/f0a22f1d-2d78-4400-befc-d8b9c07d085d => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:37:09.656104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fca9ee0e-dee8-4495-b1e9-962efed7b904 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '.version_select at 0x7fbeb97a2670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:09.829756 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fca9ee0e-dee8-4495-b1e9-962efed7b904 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c" status: 204 len: 0 microversion: 2.1 time: 0.178850 Sep 13 16:37:09.830414 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 959/1829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:09 2022] DELETE /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:37:09.840518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e5237b54-0c02-428a-8170-f0844ebf451a req-558bed5c-9cc8-4873-9c92-33d0b35de99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4942170b-e2df-40ac-8f82-89f3e1487d14", "name": "network-vif-plugged", "status": "completed", "tag": "b34e695c-4015-4d7f-8224-cc521758c7fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:09.853814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e5237b54-0c02-428a-8170-f0844ebf451a req-558bed5c-9cc8-4873-9c92-33d0b35de99b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:09.855067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e5237b54-0c02-428a-8170-f0844ebf451a req-558bed5c-9cc8-4873-9c92-33d0b35de99b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:09.856327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e5237b54-0c02-428a-8170-f0844ebf451a req-558bed5c-9cc8-4873-9c92-33d0b35de99b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:09.873899 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e5237b54-0c02-428a-8170-f0844ebf451a req-558bed5c-9cc8-4873-9c92-33d0b35de99b service nova] Creating event network-vif-plugged:b34e695c-4015-4d7f-8224-cc521758c7fb for instance 4942170b-e2df-40ac-8f82-89f3e1487d14 on n-h1-857467-1 Sep 13 16:37:09.882139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e5237b54-0c02-428a-8170-f0844ebf451a req-558bed5c-9cc8-4873-9c92-33d0b35de99b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046636 Sep 13 16:37:09.882920 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 960/1830] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:09.892490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:09.893213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:09.900651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:09.901378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:09.902113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:09.902988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:09.903683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:09.904420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:09.994958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.008879 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a623d9b9-570a-4b98-bace-cc5aab31de33 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.551832 Sep 13 16:37:10.010693 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 871/1831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:09 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:10.018280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.019127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:10.029202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.029693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.030159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.030863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.031316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.031774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.178572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.187290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.188959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.190221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e507bb89-54b0-4aca-af56-e5c112c981a2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1804 microversion: 2.25 time: 0.306346 Sep 13 16:37:10.190786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 961/1832] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:09 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1804 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:10.196042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c12a439-2c70-4438-8f40-c00f7b51a73c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '.version_select at 0x7fbeb96c9b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.402446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.420539 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b437258-edf5-4a63-b943-3498433b16ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.408323 Sep 13 16:37:10.422088 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 872/1833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:10.430104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2832f38-8991-4f96-b9a9-aade2e630bc4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '.version_select at 0x7fbeb5a6ab80>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.463273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a2832f38-8991-4f96-b9a9-aade2e630bc4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Image not found. Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2832f38-8991-4f96-b9a9-aade2e630bc4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c HTTP/1.1 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '25c70330-9442-4903-9e94-66a4d4b3c72c'} Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 25c70330-9442-4903-9e94-66a4d4b3c72c Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:37:10.467860 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25c70330-9442-4903-9e94-66a4d4b3c72c could not be found. Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2832f38-8991-4f96-b9a9-aade2e630bc4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2832f38-8991-4f96-b9a9-aade2e630bc4 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c" status: 404 len: 62 microversion: 2.1 time: 0.046517 Sep 13 16:37:10.473372 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 873/1834] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:37:10.478850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa36119d-cd30-4fce-846c-63044bb52222 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '.version_select at 0x7fbeb5730940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.480948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa36119d-cd30-4fce-846c-63044bb52222 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.481441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa36119d-cd30-4fce-846c-63044bb52222 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.481967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa36119d-cd30-4fce-846c-63044bb52222 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.482441 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c12a439-2c70-4438-8f40-c00f7b51a73c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f787f031-b3cb-41ac-8f5f-00cc842bf9fa" status: 202 len: 0 microversion: 2.1 time: 0.290430 Sep 13 16:37:10.483753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 962/1835] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:37:10 2022] DELETE /compute/v2.1/os-security-groups/f787f031-b3cb-41ac-8f5f-00cc842bf9fa => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:37:10.493291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.500883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:10.511909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.512591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.513553 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa36119d-cd30-4fce-846c-63044bb52222 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 4479 microversion: 2.25 time: 0.041362 Sep 13 16:37:10.525853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 874/1836] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/os-migrations => generated 4479 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:10.525853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.525853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:10.529948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.530720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.532016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.533158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.533499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.534114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.534416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.534704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.535196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.535472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.689983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.698417 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-802ac6a1-4490-4878-b3e5-6e505551abd7 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1476 microversion: 2.1 time: 0.213559 Sep 13 16:37:10.699013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 963/1837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:10.703835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.704544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:10.710716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.711425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.712093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.713005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.713667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.714323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.730170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:10.743273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:10.834429 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14d510c9-2366-482c-bff8-dfe1db49ed92 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 204 len: 0 microversion: 2.1 time: 0.133452 Sep 13 16:37:10.835460 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 964/1838] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:10 2022] DELETE /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:37:10.842926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.844532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:10.847374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:10.851309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.851872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.852336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.853027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.853485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.853938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.860392 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-733269ed-3a31-4b39-bf06-be460e64d5e5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1532 microversion: 2.1 time: 0.344599 Sep 13 16:37:10.860979 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 875/1839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1532 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:10.866540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "name": "network-vif-unplugged", "status": "completed", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:10.877131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.877850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.878293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.893413 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] Creating event network-vif-unplugged:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h2-857467-1 Sep 13 16:37:10.899845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:37:10.912020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-88144d66-7266-4fa4-b596-629da727842f req-56e43692-8204-4b11-83ff-fa39f7b91369 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049432 Sep 13 16:37:10.912923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 876/1840] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:10.918087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:10.919292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:10.928896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.928896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.928896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:10.928896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:10.928896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:10.928896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.020119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid f7305af6-eeb4-43bc-ac65-52988a63a1de {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:11.034810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf90a296-0b7b-4a75-9b85-66efcfdd220d tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 2423 microversion: 2.25 time: 0.197896 Sep 13 16:37:11.035398 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 965/1841] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 2423 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:11.039954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.040749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.046596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.047085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.047524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.048208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.048663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.049088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.199222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:11.207569 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42c4548f-e365-4314-8a01-396a0077fac7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.171182 Sep 13 16:37:11.209078 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 966/1842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:11 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:11.229149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.229778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.235760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.236281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.236725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.237461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.237952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.238488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.362272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:11.384255 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fa23652-9f45-47b7-ad2a-d2c234cab32c tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1509 microversion: 2.1 time: 0.470126 Sep 13 16:37:11.386966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 877/1843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:10 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:11.415071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid f7305af6-eeb4-43bc-ac65-52988a63a1de {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:11.434276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ac75b95-53fc-417c-8c68-75914485df72 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 2423 microversion: 2.25 time: 0.208756 Sep 13 16:37:11.435965 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 967/1844] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:11 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 2423 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:11.446739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.447668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.454829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.455673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.456586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.457628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.459470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.460811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.539776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.540278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.546308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.546797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.547233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.547927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.548380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.548835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.675933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lazy-loading 'services' on Instance uuid f7305af6-eeb4-43bc-ac65-52988a63a1de {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:11.797104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bc89fd5-ac35-4bce-91c1-f7d27736f732 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments/82caedb5-ed7e-4ce6-9089-824822b66e96" status: 202 len: 0 microversion: 2.25 time: 0.261653 Sep 13 16:37:11.801256 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 968/1845] 10.222.0.61 () {60 vars in 1457 bytes} [Tue Sep 13 16:37:11 2022] DELETE /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments/82caedb5-ed7e-4ce6-9089-824822b66e96 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:37:11.809018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.810315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.817509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.818243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.818690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.819469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.819929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.820417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.862681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:11.883686 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92aaae8a-d17a-481a-b78e-6905a04c39a8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.442371 Sep 13 16:37:11.912597 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 878/1846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:11 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:11.918121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.920314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.928166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.928971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.929722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.930652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.931292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.931907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.968893 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aff081d2-5d85-45d5-ad90-45adb18be694 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.054905 Sep 13 16:37:11.970110 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 879/1847] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:11 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:37:11.975795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:11.976426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:11.982853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.983357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.983871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.984658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:11.985138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:11.985561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:11.985935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:11.995052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe7b5c77-ab6c-46d4-9089-3322314c1e1a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1476 microversion: 2.1 time: 0.191642 Sep 13 16:37:12.001653 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 969/1848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:11 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:12.231806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:12.232594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:12.239487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.240057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.241120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.241896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.242493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.242915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.339182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:12.357353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01e578af-d795-4114-bd63-88073dfe0d84 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1538 microversion: 2.1 time: 0.385976 Sep 13 16:37:12.358152 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 880/1849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:11 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1538 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:12.411859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:12.414205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:12.425861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.426407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.427167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.428269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.429016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.429455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.561377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:12.571321 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1f101f0-11ea-4283-a3fc-f515a15cf535 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.343432 Sep 13 16:37:12.572495 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 970/1850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:12 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:12.760446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:12.777467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d88c41ca-c7bf-435a-80b8-33ead92c354e tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1509 microversion: 2.1 time: 0.369091 Sep 13 16:37:12.778798 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 881/1851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:12 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:12.907716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:12.909062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:12.916765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.917189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.917623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.918345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.919083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.919509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.936932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:12.951743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:12.952240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:12.952684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:12.969461 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] Creating event network-changed:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h2-857467-1 Sep 13 16:37:12.979004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:37:13.008013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9c592e96-4a24-4081-92ac-d0cc209127e0 req-67d8d568-afe8-4689-9acb-bf6b41e76295 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077102 Sep 13 16:37:13.015017 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 882/1852] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:37:13.027716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:13.039234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:13.041676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:13.077353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.077883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.091433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.100619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.116730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.117656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.163456 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1fb66d1e-cbd7-40e0-b614-d18315518cd1 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146919 Sep 13 16:37:13.166903 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 883/1853] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:13 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:37:13.178293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:13.179197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:13.195402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.197818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.202190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.203033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.203531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.203973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.330698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:13.346653 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1174d86d-9599-4501-bc1d-1819f19243ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1307 microversion: 2.1 time: 0.442694 Sep 13 16:37:13.349082 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 971/1854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:12 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:13.381935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:13.382788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:13.396660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.397165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.397613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.398684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.399146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.399571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.473030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:13.481928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa1ae8a1-000c-49fe-b118-8e4f4afa5950 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1474 microversion: 2.1 time: 0.312837 Sep 13 16:37:13.482713 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 884/1855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:13 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1474 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:13.600498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:13.601599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:13.608689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.613088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.619376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.620305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.621228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.621680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:13.621865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.631438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e3a4476-0943-48ab-8f2b-2a2492d281b5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1538 microversion: 2.1 time: 0.254723 Sep 13 16:37:13.638225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 972/1856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:13 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1538 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:13.815361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:13.816328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:13.825552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.826213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.826869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.827909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:13.828396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:13.828881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:13.829998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:13.848632 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea6a9af4-7198-438d-bba4-d10ffb5a353a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.252556 Sep 13 16:37:13.858894 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 885/1857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:13 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:14.182477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:14.185659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:14.195063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.195935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.196592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.197515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.198665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.199310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.241933 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36551723-e606-48e3-9554-d3b1cd2ba5f5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065633 Sep 13 16:37:14.247340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 886/1858] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:14 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:37:14.377684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:14.378849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:14.390206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.391462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.392337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.393278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.393925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.394515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.546303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:14.558651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67089628-8d48-46ad-abab-92737bd79dbc tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1509 microversion: 2.1 time: 0.752589 Sep 13 16:37:14.568495 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 973/1859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:13 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1509 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:14.580726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:14.581359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:14.600150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.600656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.601097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.601881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.602515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.603452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.616058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:14.627028 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f1bc34c-f590-4baf-ab57-ea35fbd9bece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1487 microversion: 2.1 time: 0.252345 Sep 13 16:37:14.627630 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 887/1860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:14 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1487 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:14.650968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f9976af-a885-4c48-8119-c1f2651b9bca tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:14.658364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f9976af-a885-4c48-8119-c1f2651b9bca tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.659116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f9976af-a885-4c48-8119-c1f2651b9bca tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.659754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f9976af-a885-4c48-8119-c1f2651b9bca tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.755160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f9976af-a885-4c48-8119-c1f2651b9bca tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Going to try to stop instance {{(pid=122327) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:37:14.816373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:14.843891 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f9976af-a885-4c48-8119-c1f2651b9bca tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14/action" status: 202 len: 0 microversion: 2.1 time: 0.196647 Sep 13 16:37:14.845512 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 888/1861] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:37:14 2022] POST /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:37:14.851407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:14.853593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:14.863790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.865327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.866035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.866917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.867614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.868291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.958645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:14.969731 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9a2183f-b3b3-442f-bc18-b15d51d97298 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1474 microversion: 2.1 time: 0.399955 Sep 13 16:37:14.970372 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 974/1862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:14 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:14.979108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:14.979780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:14.986107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.986862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.987493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:14.988770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:14.989441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:14.990076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.122956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:15.133204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0b58ec1-870c-47d0-8ff9-c85d259b8445 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1538 microversion: 2.1 time: 0.286192 Sep 13 16:37:15.134422 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 889/1863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:14 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1538 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:15.139834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.140745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:15.147656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.148609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.148918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.149740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.150336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.151019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.339503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:15.351841 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-daab8ab3-fdd5-4786-a2e5-116d187ceceb tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.215924 Sep 13 16:37:15.365958 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 890/1864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:15 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:15.391165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:15.423191 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-481f304f-b659-4f8d-8df7-09e4306511ab tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.450574 Sep 13 16:37:15.423790 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 975/1865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:14 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:15.432368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.436180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:15.460896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.462008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.466584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.467817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.468534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.469328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.527594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb023356-d0d9-4a2d-867d-9647207f968f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101683 Sep 13 16:37:15.533100 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 976/1866] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:15 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:37:15.541280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cf57924a-8100-4649-a97d-edf3f7489de0 req-dc80ef84-26ac-4ad0-9c9d-ba42fa674f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebce02c-eefa-4082-86de-4185c86906a3", "name": "network-vif-plugged", "status": "completed", "tag": "3d930354-0626-43fd-b0d8-65dcc9580f6c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:15.553985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cf57924a-8100-4649-a97d-edf3f7489de0 req-dc80ef84-26ac-4ad0-9c9d-ba42fa674f0b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.554617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cf57924a-8100-4649-a97d-edf3f7489de0 req-dc80ef84-26ac-4ad0-9c9d-ba42fa674f0b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.554998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cf57924a-8100-4649-a97d-edf3f7489de0 req-dc80ef84-26ac-4ad0-9c9d-ba42fa674f0b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.571276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cf57924a-8100-4649-a97d-edf3f7489de0 req-dc80ef84-26ac-4ad0-9c9d-ba42fa674f0b service nova] Creating event network-vif-plugged:3d930354-0626-43fd-b0d8-65dcc9580f6c for instance 6ebce02c-eefa-4082-86de-4185c86906a3 on n-h2-857467-1 Sep 13 16:37:15.577483 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cf57924a-8100-4649-a97d-edf3f7489de0 req-dc80ef84-26ac-4ad0-9c9d-ba42fa674f0b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044207 Sep 13 16:37:15.579094 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 977/1867] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:15.586616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d2256a4c-9ba4-4b7a-b423-d691a0c974ea req-30e0b72b-7d81-4de4-be02-9d83dd6752ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8de958-0446-4468-a7b1-22d86df1bc7d", "name": "network-vif-deleted", "tag": "0e639888-1523-493f-b4e8-8034350ba559"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:15.601393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d2256a4c-9ba4-4b7a-b423-d691a0c974ea req-30e0b72b-7d81-4de4-be02-9d83dd6752ea service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.602395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d2256a4c-9ba4-4b7a-b423-d691a0c974ea req-30e0b72b-7d81-4de4-be02-9d83dd6752ea service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.602999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af810501-b752-4c99-9755-424dc3f3dc12 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] 10.222.0.61 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.247496 Sep 13 16:37:15.603216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d2256a4c-9ba4-4b7a-b423-d691a0c974ea req-30e0b72b-7d81-4de4-be02-9d83dd6752ea service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.605952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 891/1868] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Sep 13 16:37:15 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 16:37:15.614445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.616368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:15.630257 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d2256a4c-9ba4-4b7a-b423-d691a0c974ea req-30e0b72b-7d81-4de4-be02-9d83dd6752ea service nova] Creating event network-vif-deleted:0e639888-1523-493f-b4e8-8034350ba559 for instance ce8de958-0446-4468-a7b1-22d86df1bc7d on n-h1-857467-1 Sep 13 16:37:15.631141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.631774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.632332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.633426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.634116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.634651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.640334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d2256a4c-9ba4-4b7a-b423-d691a0c974ea req-30e0b72b-7d81-4de4-be02-9d83dd6752ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057719 Sep 13 16:37:15.641250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 978/1869] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:15.654865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-104cc563-8cfd-4e23-b498-ddd321dc7a56 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Calling method '.version_select at 0x7fbeb95d65e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.706788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:15.707559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:15.709517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:15.710253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lazy-loading 'fault' on Instance uuid ce8de958-0446-4468-a7b1-22d86df1bc7d {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:15.718606 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-104cc563-8cfd-4e23-b498-ddd321dc7a56 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] HTTP exception thrown: Image not found. Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-104cc563-8cfd-4e23-b498-ddd321dc7a56 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Request method failure captured: Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILG6lhotJSs_KIGNKFIbL_C9mlrzsK1S6Se29AyNnL-mTBEE62mwVdCwWWjmnwl1VsVtrIkWF9LDa-y6xyrYvYoY902YSWhrjjAhnNH8JH1yTclZbGUCHr-palKRGywx7p16SYzJo6BBiaMOa2BgErmmfS6Nrhbu4KJB0MoJyhiGzeU Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: faa11c81dbe14c13aad97aed1bda703c Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '-1'} Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.722019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:37:15.728967 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.732389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-104cc563-8cfd-4e23-b498-ddd321dc7a56 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:15.733542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-104cc563-8cfd-4e23-b498-ddd321dc7a56 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] 10.222.0.61 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.090365 Sep 13 16:37:15.734664 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 979/1870] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Sep 13 16:37:15 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:37:15.747477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c876d396-5c62-4631-a15a-aa4fd5ad668b tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Calling method '.version_select at 0x7fbeb95d1430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.789486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c876d396-5c62-4631-a15a-aa4fd5ad668b tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] HTTP exception thrown: Image not found. Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c876d396-5c62-4631-a15a-aa4fd5ad668b tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Request method failure captured: Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/c69f3ed1-d2ad-42cb-bf01-04c0d32b4cfj HTTP/1.1 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILG6lhotJSs_KIGNKFIbL_C9mlrzsK1S6Se29AyNnL-mTBEE62mwVdCwWWjmnwl1VsVtrIkWF9LDa-y6xyrYvYoY902YSWhrjjAhnNH8JH1yTclZbGUCHr-palKRGywx7p16SYzJo6BBiaMOa2BgErmmfS6Nrhbu4KJB0MoJyhiGzeU Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: faa11c81dbe14c13aad97aed1bda703c Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'c69f3ed1-d2ad-42cb-bf01-04c0d32b4cfj'} Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c69f3ed1-d2ad-42cb-bf01-04c0d32b4cfj to delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c69f3ed1-d2ad-42cb-bf01-04c0d32b4cfj could not be found. Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.791963 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:37:15.796718 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.802050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c876d396-5c62-4631-a15a-aa4fd5ad668b tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:15.803489 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c876d396-5c62-4631-a15a-aa4fd5ad668b tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] 10.222.0.61 "DELETE /compute/v2.1/images/c69f3ed1-d2ad-42cb-bf01-04c0d32b4cfj" status: 404 len: 62 microversion: 2.1 time: 0.062360 Sep 13 16:37:15.804810 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 980/1871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:15 2022] DELETE /compute/v2.1/images/c69f3ed1-d2ad-42cb-bf01-04c0d32b4cfj => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:37:15.816820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a48fab1c-9020-4b69-ab63-e8a296d35902 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Calling method '.version_select at 0x7fbeb95d6670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.841181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267bf606323b4178ba0cf7ba1a15440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710b60a7c7e44a78452286123322925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:15.843750 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a48fab1c-9020-4b69-ab63-e8a296d35902 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] HTTP exception thrown: Image not found. Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a48fab1c-9020-4b69-ab63-e8a296d35902 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Request method failure captured: Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/13dd80ec-bfe9-4153-acaf-43880d442cf31 HTTP/1.1 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILG6lhotJSs_KIGNKFIbL_C9mlrzsK1S6Se29AyNnL-mTBEE62mwVdCwWWjmnwl1VsVtrIkWF9LDa-y6xyrYvYoY902YSWhrjjAhnNH8JH1yTclZbGUCHr-palKRGywx7p16SYzJo6BBiaMOa2BgErmmfS6Nrhbu4KJB0MoJyhiGzeU Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: faa11c81dbe14c13aad97aed1bda703c Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '13dd80ec-bfe9-4153-acaf-43880d442cf31'} Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 13dd80ec-bfe9-4153-acaf-43880d442cf31 to delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13dd80ec-bfe9-4153-acaf-43880d442cf31 could not be found. Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.846870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a48fab1c-9020-4b69-ab63-e8a296d35902 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a48fab1c-9020-4b69-ab63-e8a296d35902 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] 10.222.0.61 "DELETE /compute/v2.1/images/13dd80ec-bfe9-4153-acaf-43880d442cf31" status: 404 len: 62 microversion: 2.1 time: 0.037502 Sep 13 16:37:15.858180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 981/1872] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:15 2022] DELETE /compute/v2.1/images/13dd80ec-bfe9-4153-acaf-43880d442cf31 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:37:15.859891 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f43e6c4-e419-43b1-bce9-0253003f18f1 tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 200 len: 1313 microversion: 2.1 time: 0.241667 Sep 13 16:37:15.859891 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 892/1873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:15 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:15.865022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d56c88c1-6771-47f4-b9d9-8bed7551a9a6 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Calling method '.version_select at 0x7fbeb96c9160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.890426 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d56c88c1-6771-47f4-b9d9-8bed7551a9a6 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] HTTP exception thrown: Image not found. Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d56c88c1-6771-47f4-b9d9-8bed7551a9a6 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Request method failure captured: Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/tempest-invalid-1428518174 HTTP/1.1 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILG6lhotJSs_KIGNKFIbL_C9mlrzsK1S6Se29AyNnL-mTBEE62mwVdCwWWjmnwl1VsVtrIkWF9LDa-y6xyrYvYoY902YSWhrjjAhnNH8JH1yTclZbGUCHr-palKRGywx7p16SYzJo6BBiaMOa2BgErmmfS6Nrhbu4KJB0MoJyhiGzeU Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: faa11c81dbe14c13aad97aed1bda703c Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'tempest-invalid-1428518174'} Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1428518174 to delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1428518174 could not be found. Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.892352 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d56c88c1-6771-47f4-b9d9-8bed7551a9a6 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:15.897702 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d56c88c1-6771-47f4-b9d9-8bed7551a9a6 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] 10.222.0.61 "DELETE /compute/v2.1/images/tempest-invalid-1428518174" status: 404 len: 62 microversion: 2.1 time: 0.037740 Sep 13 16:37:15.907350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9312bdc-60c5-4515-b330-dbee800312b2 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Calling method '.version_select at 0x7fbeb53e14c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:15.916033 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 982/1874] 10.222.0.61 () {58 vars in 1206 bytes} [Tue Sep 13 16:37:15 2022] DELETE /compute/v2.1/images/tempest-invalid-1428518174 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:37:15.940983 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d9312bdc-60c5-4515-b330-dbee800312b2 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] HTTP exception thrown: Image not found. Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9312bdc-60c5-4515-b330-dbee800312b2 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Request method failure captured: Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/images/6b78a809-5573-4eb2-8ae6-bac127b7ce6b HTTP/1.1 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILG6lhotJSs_KIGNKFIbL_C9mlrzsK1S6Se29AyNnL-mTBEE62mwVdCwWWjmnwl1VsVtrIkWF9LDa-y6xyrYvYoY902YSWhrjjAhnNH8JH1yTclZbGUCHr-palKRGywx7p16SYzJo6BBiaMOa2BgErmmfS6Nrhbu4KJB0MoJyhiGzeU Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/11148448c00045dcadb2d6fcd38f75a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 11148448c00045dcadb2d6fcd38f75a8 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304 Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: faa11c81dbe14c13aad97aed1bda703c Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1447013304-project Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6b78a809-5573-4eb2-8ae6-bac127b7ce6b'} Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b78a809-5573-4eb2-8ae6-bac127b7ce6b to delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b78a809-5573-4eb2-8ae6-bac127b7ce6b could not be found. Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.945335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9312bdc-60c5-4515-b330-dbee800312b2 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9312bdc-60c5-4515-b330-dbee800312b2 tempest-ImagesDeleteNegativeTestJSON-1447013304 tempest-ImagesDeleteNegativeTestJSON-1447013304-project] 10.222.0.61 "DELETE /compute/v2.1/images/6b78a809-5573-4eb2-8ae6-bac127b7ce6b" status: 404 len: 62 microversion: 2.1 time: 0.045047 Sep 13 16:37:15.950183 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 893/1875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:15 2022] DELETE /compute/v2.1/images/6b78a809-5573-4eb2-8ae6-bac127b7ce6b => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:37:16.003134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:16.005682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:16.017498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.019135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.021653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.024105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.024914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.026246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.056317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:16.161064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:16.161934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:16.171953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.173376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.174814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.175958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.176836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.177797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.283061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:16.314794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5196f69e-21e0-451b-840a-e68a46b19dbc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1474 microversion: 2.1 time: 0.318250 Sep 13 16:37:16.333247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 983/1876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:15 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:16.380562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:16.382050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:16.390451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.390956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.391402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.392314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.392777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.393211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.475445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:16.484981 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ca26c9c-b561-4643-a39e-38ffcf18c1c0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1538 microversion: 2.1 time: 0.329131 Sep 13 16:37:16.499429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 894/1877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:16 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1538 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:16.507967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:16.508998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:16.515276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.516058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.516752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.517704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.518579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.519231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.701293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:16.711217 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c706b02e-ae50-4f79-ae41-bc0a859c53db tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.336299 Sep 13 16:37:16.712510 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 984/1878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:16 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:16.729920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:16.733572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:16.742226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:16.743108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.743915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.744825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.746954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.747636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.748618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.755432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-baa721f4-f7be-4c0b-9894-e5b7a5bfe040 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.254280 Sep 13 16:37:16.755916 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 895/1879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:16 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:16.797750 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-05b75221-3d49-40e8-a3c9-4aefeab15b6b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083742 Sep 13 16:37:16.799787 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 985/1880] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:16 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:37:16.879391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:16.880170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] [instance: ce8de958-0446-4468-a7b1-22d86df1bc7d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:16.887792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.888441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.888961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.889916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:16.890562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:16.891189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:16.912573 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] HTTP exception thrown: Instance ce8de958-0446-4468-a7b1-22d86df1bc7d could not be found. Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Request method failure captured: Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d HTTP/1.1 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILF3XIUljYA0xI8nDuII5-grtqTBhMJiFahrNSaAOwN8G6HH0v2DKv_evIY_PoHh8ds08Dc5qEz0m464uyznJ0efaGMmXd3h9CjT-GN-0fFKVFJa4spAoYoUHT73HSOi5u3si4sXOJriWB98y4eKSKYLCWNVOh7V5QXipN9fE8L1akY Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 4710b60a7c7e44a78452286123322925 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-847133101 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4710b60a7c7e44a78452286123322925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4710b60a7c7e44a78452286123322925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4710b60a7c7e44a78452286123322925"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4710b60a7c7e44a78452286123322925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-847133101 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 4710b60a7c7e44a78452286123322925 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-847133101 Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerRescueTestJSONUnderV235-847133101-project Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 267bf606323b4178ba0cf7ba1a15440f Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-847133101-project Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ce8de958-0446-4468-a7b1-22d86df1bc7d could not be found. Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ce8de958-0446-4468-a7b1-22d86df1bc7d'} Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce8de958-0446-4468-a7b1-22d86df1bc7d could not be found. Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce8de958-0446-4468-a7b1-22d86df1bc7d could not be found. Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:16.914500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce8de958-0446-4468-a7b1-22d86df1bc7d could not be found. Sep 13 16:37:16.919826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:37:16.927986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] Returning 404 to user: Instance ce8de958-0446-4468-a7b1-22d86df1bc7d could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:16.927986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-660d51af-d490-4e45-b54c-1ca9e31ab32d tempest-ServerRescueTestJSONUnderV235-847133101 tempest-ServerRescueTestJSONUnderV235-847133101-project] 10.222.0.61 "GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d" status: 404 len: 111 microversion: 2.1 time: 0.048152 Sep 13 16:37:16.927986 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 896/1881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:16 2022] GET /compute/v2.1/servers/ce8de958-0446-4468-a7b1-22d86df1bc7d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:37:17.350721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:17.351709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:17.370106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.370979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.371649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.372581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.373246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.373914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.516669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:17.517309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:17.532577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.539559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.540155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.541134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.541633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.543922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.653134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:17.663728 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b394a0d-b929-41c8-a9c0-1e35b42deb0b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1474 microversion: 2.1 time: 0.316893 Sep 13 16:37:17.665012 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 986/1882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:17 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:17.698953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af1ff17-c9a7-4884-a14f-cf19ab92e5e9", "name": "network-vif-unplugged", "status": "completed", "tag": "b85d6229-5594-4441-8f64-63c4a4b3c750"}, {"name": "network-changed", "server_uuid": "1af1ff17-c9a7-4884-a14f-cf19ab92e5e9", "tag": "b85d6229-5594-4441-8f64-63c4a4b3c750"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:17.717591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.718310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.718534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.742578 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] Creating event network-vif-unplugged:b85d6229-5594-4441-8f64-63c4a4b3c750 for instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 on n-h2-857467-1 Sep 13 16:37:17.744599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] Creating event network-changed:b85d6229-5594-4441-8f64-63c4a4b3c750 for instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 on n-h2-857467-1 Sep 13 16:37:17.756917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-764c1424-7467-4cee-a0c1-94c57d4b0995 req-e9a27ae5-1839-4548-8df6-318049a52ddf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.074782 Sep 13 16:37:17.760182 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 987/1883] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:37:17.772990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:17.774199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:17.786149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.788191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.788922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.790744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.791477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:17.793464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:17.976029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:17.984953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5831f964-531f-4ee8-9533-b66a964b6c25 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.220937 Sep 13 16:37:17.985731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 988/1884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:17 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:17.991010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:17.992398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:17.992923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:17.998896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:17.999671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:18.000673 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ca3ee38-c953-4512-bf84-0eed91ac8f4e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1538 microversion: 2.1 time: 0.488844 Sep 13 16:37:18.001750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 897/1885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:17 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1538 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:18.007095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:18.009590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:18.015861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:18.016585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:18.017211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:18.018133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:18.018789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:18.019831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:18.037658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:18.043236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:18.043734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:18.044181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:18.074281 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db95bd23-9cc0-44ba-bd8a-b75371265612 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064309 Sep 13 16:37:18.076885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 898/1886] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:18 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:37:18.233423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:18.243040 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30041954-dbc2-4c46-a779-722e5af3fd8f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.256008 Sep 13 16:37:18.256408 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 989/1887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:17 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:18.690247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:18.690860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:18.699152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:18.699604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:18.700045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:18.700976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:18.701445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:18.701886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.010844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:19.011469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:19.018537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.019037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.019485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.021434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.021964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.022393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.175503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:19.184697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-018c7f31-2d8c-4792-833c-caf7a5f9df8e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.177711 Sep 13 16:37:19.198296 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 990/1888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:19 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:19.204676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:19.205675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:19.213248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.213920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.214450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.215251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.215800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.216344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.398528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:19.406733 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c81b38e-0de1-41f3-816b-e884d7732665 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1538 microversion: 2.1 time: 0.207167 Sep 13 16:37:19.407327 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 991/1889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:19 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1538 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:19.412950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:19.415322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:19.421582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.422097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.423310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.423310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.423671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.424095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.454555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70db57f0-77bd-490a-ac66-cc2f8a79d1c2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.045985 Sep 13 16:37:19.455493 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 992/1890] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:37:19 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:19.458854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:19.471094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:19.471850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:19.474282 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f6ef3af-df68-4322-98f0-9d976baf166b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1471 microversion: 2.1 time: 0.787885 Sep 13 16:37:19.480176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.480761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.481170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.481698 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 899/1891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:18 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1471 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:19.482296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.482760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.483681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.507215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:19.508390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:19.521290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.523799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.524602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.526394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.527235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.531909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.694523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc4c8de5-fcec-4eb4-aa38-4b51c14160ee tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "POST /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac/action" status: 202 len: 0 microversion: 2.1 time: 0.194719 Sep 13 16:37:19.695609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 900/1892] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:37:19 2022] POST /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:37:19.696241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:19.704328 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c05aad65-a1ae-43f2-977b-3ef2dbaccc13 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.247554 Sep 13 16:37:19.704921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 993/1893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:19 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:19.705569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:19.706571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:19.714919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.715742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.716431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:19.717374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:19.718554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:19.719210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.219704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:20.221402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:20.232804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.233712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.234502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.235493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.236301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.237509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.313330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:20.324323 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-947a8f9d-d2f8-4c31-922a-b9131deb55a9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.624315 Sep 13 16:37:20.327831 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 901/1894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:19 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:20.430616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:20.432507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:20.444028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.451596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.452235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.453367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.454173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.454961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.472103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:20.481263 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64a5caf3-a4f1-41d5-94ce-e264f0c4be08 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.270664 Sep 13 16:37:20.494298 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 994/1895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:20 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:20.728672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:20.729293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:20.735373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.742771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.743481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.744510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.745141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.745746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.921631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:20.931094 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c1a52f2-2521-4862-a873-ba31ed25fb75 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1520 microversion: 2.1 time: 0.504415 Sep 13 16:37:20.932271 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 902/1896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:20 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:20.963969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:20.964723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:20.976599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.977996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.979500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:20.982242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:20.984096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:20.984732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.046034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:21.138280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:21.149012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e775b9a-837d-4b06-91c6-1bc0a5db5c1d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.424179 Sep 13 16:37:21.163967 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 995/1897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:20 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:21.175568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:21.222936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a70e051c-e620-4a57-ac99-bcd67cb62caa tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 204 len: 0 microversion: 2.1 time: 0.264624 Sep 13 16:37:21.226975 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 903/1898] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:20 2022] DELETE /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:37:21.236890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:21.238366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:21.248944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:21.249879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:21.250531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.251446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:21.252083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:21.252689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.361741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:21.362863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:21.403543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:21.407857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:21.408635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.413281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:21.418515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:21.419867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.568781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:21.579948 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b7bfeb0-fa1d-4cb8-9972-8198e4d3fca0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1526 microversion: 2.1 time: 0.346870 Sep 13 16:37:21.581072 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 996/1899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:21 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:21.602517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:21.603470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:21.612892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:21.613665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:21.614656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.623277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:21.624034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:21.624652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:21.932914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:21.941276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10450d66-6d7f-47c7-98e4-2b554e06b77e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.357138 Sep 13 16:37:21.943358 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 997/1900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:21 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:21.992168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:22.006568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14e0de75-198e-48ea-94a5-ca6188cfb010 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.653176 Sep 13 16:37:22.009167 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 904/1901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:21 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:22.175670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:22.177000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:22.187100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.190325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.190783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:22.194187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.195082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.196576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:22.343139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "name": "network-vif-plugged", "status": "completed", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:22.369641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.370478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.371295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:22.399777 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] Creating event network-vif-plugged:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h2-857467-1 Sep 13 16:37:22.408282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:37:22.435236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-48cc0106-6e06-431e-9cf1-4886e021cdd1 req-1004e3c2-51d1-4e1c-bd45-65b2f334477f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100485 Sep 13 16:37:22.445049 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 905/1902] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:22.613447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:22.616995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:22.646888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.647399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.648114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:22.649018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.649497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.649987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:22.780797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:22.797857 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0eb2b828-09ad-4bfe-ba60-4d27e9556084 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.627759 Sep 13 16:37:22.799640 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 998/1903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:22 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:22.971507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:22.972434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:22.983971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.986256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.987331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:22.988840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:22.989912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:22.990562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:23.017645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:23.029458 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-322e432d-e788-4f41-85ea-b78908865af5 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1526 microversion: 2.1 time: 0.424167 Sep 13 16:37:23.030696 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 906/1904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:22 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1526 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:23.035505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:23.036544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:23.043011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:23.044026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:23.045275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:23.046233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:23.046863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:23.047473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:23.449300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:23.480783 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bbf97b8-5b2b-4ab7-92f9-9f93fef399ec tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.443028 Sep 13 16:37:23.482295 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 907/1905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:23 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:23.828885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:23.830071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:23.836925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:23.849244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:23.849761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:23.850229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:23.850945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:23.851408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:23.851837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:23.875935 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ae632c5b-d2c2-4a8f-b1b7-ad9282f79971 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.904406 Sep 13 16:37:23.884795 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 999/1906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:22 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:24.055497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:24.056686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:24.073333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:24.074414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:24.075462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:24.081995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:24.086652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:24.088479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:24.456230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:24.459826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:24.478577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-451be4bc-d96e-4eaf-9950-e32fcd0b87de tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1526 microversion: 2.1 time: 0.421422 Sep 13 16:37:24.479635 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1000/1907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:24 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1526 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:24.507315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:24.507947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:24.531613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:24.532060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:24.532513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:24.533249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:24.533721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:24.534189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:24.944870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:24.958602 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-034056bf-2c9b-42bc-9fea-c6dd2b403492 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.456496 Sep 13 16:37:24.962353 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1001/1908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:24 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:24.967655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c39651a3-37d7-4429-ac66-95e1cf2ab7d5 req-d700586f-4e3a-4785-a83b-1b5534699af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebce02c-eefa-4082-86de-4185c86906a3", "name": "network-vif-unplugged", "status": "completed", "tag": "3d930354-0626-43fd-b0d8-65dcc9580f6c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:24.989602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:25.005742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c39651a3-37d7-4429-ac66-95e1cf2ab7d5 req-d700586f-4e3a-4785-a83b-1b5534699af1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:25.006591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c39651a3-37d7-4429-ac66-95e1cf2ab7d5 req-d700586f-4e3a-4785-a83b-1b5534699af1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:25.007229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c39651a3-37d7-4429-ac66-95e1cf2ab7d5 req-d700586f-4e3a-4785-a83b-1b5534699af1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:25.024787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:25.036667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c39651a3-37d7-4429-ac66-95e1cf2ab7d5 req-d700586f-4e3a-4785-a83b-1b5534699af1 service nova] Creating event network-vif-unplugged:3d930354-0626-43fd-b0d8-65dcc9580f6c for instance 6ebce02c-eefa-4082-86de-4185c86906a3 on n-h2-857467-1 Sep 13 16:37:25.041968 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8278233f-0cc9-421c-921b-b9f7385a1142 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 1.221341 Sep 13 16:37:25.043798 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c39651a3-37d7-4429-ac66-95e1cf2ab7d5 req-d700586f-4e3a-4785-a83b-1b5534699af1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079969 Sep 13 16:37:25.044734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1002/1909] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:25.052121 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 908/1910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:23 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:25.052458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:25.053259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:25.075375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:25.076469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:25.077144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:25.079820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:25.080523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:25.082191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:25.507446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:25.508082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:25.518745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:25.537446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:25.537446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:25.537446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:25.537446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:25.537861 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-74bf2bc6-695e-47d0-9136-1ba5345dc82e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.486610 Sep 13 16:37:25.537974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:25.537974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:25.551943 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1003/1911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:25 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:25.794268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:25.809465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9cbc3ec-d936-470f-987c-de603bde531f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1526 microversion: 2.1 time: 0.307218 Sep 13 16:37:25.833217 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 909/1912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:25 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1526 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:25.987290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:25.987290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:25.995675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bc9a1903-cd78-4124-b9f8-94579ddf471f req-81d9db38-8fe5-4459-8ae4-8ded8339ae7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebce02c-eefa-4082-86de-4185c86906a3", "name": "network-vif-deleted", "tag": "3d930354-0626-43fd-b0d8-65dcc9580f6c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:26.000099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.001135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.002354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.003124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.006485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.006853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.009735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bc9a1903-cd78-4124-b9f8-94579ddf471f req-81d9db38-8fe5-4459-8ae4-8ded8339ae7f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.010466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bc9a1903-cd78-4124-b9f8-94579ddf471f req-81d9db38-8fe5-4459-8ae4-8ded8339ae7f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.011089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bc9a1903-cd78-4124-b9f8-94579ddf471f req-81d9db38-8fe5-4459-8ae4-8ded8339ae7f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.055564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bc9a1903-cd78-4124-b9f8-94579ddf471f req-81d9db38-8fe5-4459-8ae4-8ded8339ae7f service nova] Creating event network-vif-deleted:3d930354-0626-43fd-b0d8-65dcc9580f6c for instance 6ebce02c-eefa-4082-86de-4185c86906a3 on n-h2-857467-1 Sep 13 16:37:26.062316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bc9a1903-cd78-4124-b9f8-94579ddf471f req-81d9db38-8fe5-4459-8ae4-8ded8339ae7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071083 Sep 13 16:37:26.063491 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 910/1913] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:37:26.076407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:26.077464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:26.089034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.092068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.094180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.095281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.096146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.099159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.382620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:26.392473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a844f878-d353-4a04-9909-2e9bcbe75146 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.324274 Sep 13 16:37:26.398755 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 911/1914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:26 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:26.459638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:26.471542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2ff1232b-1c3f-47be-a84f-445adf7875e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.490558 Sep 13 16:37:26.472603 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1004/1915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:25 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:26.557228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:26.558198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:26.569627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.571623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.574363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.576484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.578936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.580713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.849291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:26.852377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:26.876627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:26.884714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.887047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.887820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.888750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:26.889183 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f319078a-c551-4e3b-8f1b-7915418b5313 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.334985 Sep 13 16:37:26.890065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:26.891911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:26.892609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 912/1916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:26 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:27.085747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:27.098965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6da694dd-e715-4f77-a152-a9a3f96801a7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1308 microversion: 2.1 time: 0.264060 Sep 13 16:37:27.103488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1005/1917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:26 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:27.420924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:27.422592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:27.447647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:27.452571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:27.453344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:27.456530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:27.457326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:27.461502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:27.498726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:27.506926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:27.535824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:27.536593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:27.537805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:27.539870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:27.540499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:27.542114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:28.034374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:28.062358 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-255dfc97-0c52-4a66-8098-fc3b1b194344 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.648208 Sep 13 16:37:28.067453 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 913/1918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:27 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:28.078231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:28.089995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:28.129530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:28.138945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:28.139589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:28.142181 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0780c343-62ac-4a10-8ff9-6ac64ac9a750 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.649093 Sep 13 16:37:28.142363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:28.146149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:28.148822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:28.150478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:28.158824 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1006/1919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:27 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:28.174940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:28.175487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:28.189174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:28.189895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:28.190404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:28.210427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:28.214166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:28.214646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:28.380304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:28.384197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:28.385849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:28.386720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lazy-loading 'fault' on Instance uuid 6ebce02c-eefa-4082-86de-4185c86906a3 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:28.617221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:28.631722 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe139377-512c-4f02-b692-6bf4c2766eef tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 200 len: 1313 microversion: 2.1 time: 0.470790 Sep 13 16:37:28.634731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1007/1920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:28 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:29.040400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:29.059212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75d3dce4-1820-4af4-9b96-94849ad8657c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.990102 Sep 13 16:37:29.067617 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 914/1921] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:28 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:29.094041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:29.094663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:29.110330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:29.111648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:29.115663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:29.118049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:29.118780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:29.119604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:29.393986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:29.412840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-469e14e2-6ece-40ca-b7fb-06b4b8c11540 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.321513 Sep 13 16:37:29.426428 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1008/1922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:29 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:29.443980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:29.448893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:29.465582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:29.469952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:29.470466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:29.471241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:29.471730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:29.472617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:29.532434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-954391057", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "7d1c8ccf-e099-4090-a78f-bad26808f126"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:29.667836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] validate_networks() for [('7d1c8ccf-e099-4090-a78f-bad26808f126', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:37:29.892601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:29.905596 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c313aa7a-0d2e-46a7-ad57-bc78726724b3 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.473975 Sep 13 16:37:29.906225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1009/1923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:29 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:29.918924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:29.920027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:29.940721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:29.945476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:29.947868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:29.948775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:29.949886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:29.953098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:29.994517 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 HTTP/1.1 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6ebce02c-eefa-4082-86de-4185c86906a3'} Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:29.997998 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:37:30.004516 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:30.005919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:30.007558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e008416-efdb-430b-8c68-058f1e10bc36 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 404 len: 111 microversion: 2.1 time: 0.095423 Sep 13 16:37:30.010819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1010/1924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:29 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:37:30.092492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:30.093227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:30.105361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:30.112966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:30.113930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:30.114907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:30.117780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:30.121280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:30.632730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:30.648341 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ced8c44e-dbac-4c94-94a6-b55a041899f8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.559992 Sep 13 16:37:30.653246 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1011/1925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:30 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:30.678427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-547496469", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:30.794874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] validate_networks() for [('d6d4f0b9-e6f0-4179-8206-f838ec11e666', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:37:31.567447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:37:31.568771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:37:31.569515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:37:31.570211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:37:31.571090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:37:31.581715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:31.582803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:31.584445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:31.586112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:31.586843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:31.587826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:31.633278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Getting quotas for project 05bb10d7bc8d4ebca70eb4aa9537c44a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:31.647777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Getting quotas for user 1322a8be50b44f14a7b92ab9ebf44c2a and project 05bb10d7bc8d4ebca70eb4aa9537c44a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:31.679513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:37:31.685638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:37:31.804096 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2287f20d-6b2a-4bc9-a148-3ec80e46bace tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.681237 Sep 13 16:37:31.804776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 915/1926] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:37:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:37:31.816977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:31.818018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:31.839490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:31.839997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:31.840442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:31.841246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:31.841717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:31.842185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.148426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:32.158279 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fc5ebb9-61eb-44cb-84b7-4914285e6f53 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.346073 Sep 13 16:37:32.174639 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 916/1927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:31 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:32.183176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:32.184227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:32.194321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.195201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.195889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.196831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.197766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.198470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.286690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:37:32.287793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:37:32.288492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:37:32.289132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:37:32.290071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:37:32.328017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.328637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.330051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.333846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.335682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.337073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.393786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for project c8d1b8d477d0424b924671970921a5e5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:32.408869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Getting quotas for user fd124267837344e580ca605c2a646736 and project c8d1b8d477d0424b924671970921a5e5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:32.442056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:37:32.450108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:37:32.572518 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7af486e8-6b63-4a5e-bc10-39a4baac7215 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.908017 Sep 13 16:37:32.574609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:32.578031 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1012/1928] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:37:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:37:32.584430 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5fa07723-fda3-4d1d-9b42-b183cee8c8e4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.408685 Sep 13 16:37:32.592229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "name": "network-vif-unplugged", "status": "completed", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:32.602999 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 917/1929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:32 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:32.609679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:32.610719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:32.618551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.619348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.620134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.620516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.620643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.621065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.621859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:32.623269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:32.624117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:32.655378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] Creating event network-vif-unplugged:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h1-857467-1 Sep 13 16:37:32.665923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:37:32.698678 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-87ce5549-79fa-498d-89b1-edf23709ac5d req-f06d842d-e439-4dcd-8f97-6e1db77083a1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116811 Sep 13 16:37:32.699419 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1013/1930] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:32.705238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6bec53d-762a-42fd-a4f5-f487ca63044a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:32.715212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6bec53d-762a-42fd-a4f5-f487ca63044a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:32.819160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f6bec53d-762a-42fd-a4f5-f487ca63044a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:32.828486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6bec53d-762a-42fd-a4f5-f487ca63044a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1215 microversion: 2.1 time: 0.127133 Sep 13 16:37:32.833106 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1014/1931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:32 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:32.840292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8bdce29f-b35a-43f7-95f8-8a1a04c8ec10 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:32.847120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8bdce29f-b35a-43f7-95f8-8a1a04c8ec10 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:32.968593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8bdce29f-b35a-43f7-95f8-8a1a04c8ec10 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:32.981789 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8bdce29f-b35a-43f7-95f8-8a1a04c8ec10 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1224 microversion: 2.1 time: 0.142426 Sep 13 16:37:32.983325 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1015/1932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:32 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:33.186743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:33.188123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:33.201407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:33.202274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:33.202731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:33.203469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:33.203930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:33.204375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:33.698941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:33.722878 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e18eaaa-b337-4dcf-923c-3d31fc4c3acc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.540439 Sep 13 16:37:33.723715 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1016/1933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:33 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:33.735028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:33.739190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:33.744479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:33.753480 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76f9b4db-9e6f-48d2-ae91-c7f3a8910752 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 1.149041 Sep 13 16:37:33.773066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 918/1934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:32 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:33.773936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:33.778372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:33.778867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:33.779883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:33.780364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:33.780802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:33.859332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:33.859967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:33.867103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:33.868191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:33.868799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:33.869775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:33.870834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:33.871443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.173555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:34.186203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0519bd74-fb95-42f7-8836-0a377c97d9bf tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.454803 Sep 13 16:37:34.186962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1017/1935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:33 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:34.192283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:34.193195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:34.200206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.201012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.201673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.202924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.203602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.204298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.265606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:34.284504 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac36d17f-d71b-4ab0-8753-ebdd1adb25a3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1267 microversion: 2.1 time: 0.429780 Sep 13 16:37:34.294428 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 919/1936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:33 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1267 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:34.317904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:34.334748 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf8bec8e-de45-4e09-8f82-76fa010f778a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1220 microversion: 2.1 time: 0.146158 Sep 13 16:37:34.335995 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1018/1937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:34 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:34.755328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:34.756932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:34.757572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:34.779521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.781404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.785530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.787878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.789480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.789961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.792106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.792586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.796608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.837550 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] Creating event network-changed:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h1-857467-1 Sep 13 16:37:34.871404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 16:37:34.907690 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3fe5244d-02ea-41e7-bcaa-c8e779cbd5be req-3856a41f-7294-4924-8f0e-905d2852ec3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161696 Sep 13 16:37:34.908315 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 920/1938] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:34.915779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:34.916662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:34.923709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.924530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.925178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:34.927099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:34.927825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:34.928637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.306637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.326229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a212fc23-d600-4f4b-87c3-0a75162625e0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.577482 Sep 13 16:37:35.328272 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1019/1939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:34 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:35.338558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:35.341944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:35.357663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.360370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.368501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.369901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.370794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.371558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.751332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.774287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a95aa913-3b3a-4a4d-bfe8-7f46239b61e9 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.444851 Sep 13 16:37:35.797516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1020/1940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:35 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:35.817214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:35.818171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:35.831046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.832488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.833196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.834318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:35.835026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:35.836846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:35.872388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:35.978985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:35.992235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8de48155-4a30-4d12-99cb-a331b614da06 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 1.080882 Sep 13 16:37:36.010031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 921/1941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:34 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:36.015521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:36.016143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:36.037359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:36.039120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.039629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.040063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.040777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.041238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.041668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.093349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:36.190591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.206445 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e69b049-815e-46d4-83ef-f0070a71c52a tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1273 microversion: 2.1 time: 0.402546 Sep 13 16:37:36.209899 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1021/1942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:35 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:36.266979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.276046 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d4c7282-54a2-433f-a489-3fffb892fcf0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1294 microversion: 2.1 time: 0.264873 Sep 13 16:37:36.276981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 922/1943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:36 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1294 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:36.354268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:36.354891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:36.362309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.363125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.364241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.364963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.365603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.366236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.578989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:36.589246 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc2a9a1d-c22a-4612-a26e-b5b5b3b91cdf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.239359 Sep 13 16:37:36.590544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1022/1944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:36 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:36.813076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:36.813940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:36.829516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.832357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.834035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:36.836355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:36.839454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:36.841292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.016534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:37.017156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:37.024412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.030142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.036104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.036891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.037374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.037815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.174448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:37.187722 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12a2a9ea-3fb7-4dbd-8f31-16eaf40aa229 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1470 microversion: 2.1 time: 0.382276 Sep 13 16:37:37.188319 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 923/1945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:36 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:37.236477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:37.239681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:37.264506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.265116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.270019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.271597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.272832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.272832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.888012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:37.903651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b43a1406-b9cb-4884-b979-0ea342d42c41 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.890832 Sep 13 16:37:37.904843 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1023/1946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:37 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:37.924227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:37.925212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:37.935623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.942603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.946041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:37.949760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:37.950548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:37.952612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.024299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:38.046028 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71523b74-de7c-4472-ac0c-1cabd8f58d64 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.811265 Sep 13 16:37:38.048982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 924/1947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:37 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:38.080131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:38.080791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:38.095788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.096241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.096696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.097516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.112273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.112842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.197411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:38.207495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28245c12-fa47-4bec-a86f-636453248f61 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1282 microversion: 2.1 time: 0.301367 Sep 13 16:37:38.210530 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1024/1948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:37 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1282 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:38.217177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:38.225137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:38.240184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.241120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.242006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.243142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.243851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.244524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.618879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:38.634666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea6fb4a4-5eda-45d2-9a69-f8db17609b08 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.584527 Sep 13 16:37:38.641222 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 925/1949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:38 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:38.932062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:38.932734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:38.940451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.940991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.941717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:38.942515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:38.942989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:38.943429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.096430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:39.110017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3fdfc77e-bfd6-4e02-a2e7-c6689856cf25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1463 microversion: 2.1 time: 0.897460 Sep 13 16:37:39.115572 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1025/1950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:38 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1463 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:39.127247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:39.129230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:39.143954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.146405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:39.147070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.156620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.158340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:39.161581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.255174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:39.283263 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc96e54c-3ba5-486d-a181-f8984d6b78f6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1715 microversion: 2.1 time: 0.355596 Sep 13 16:37:39.287002 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 926/1951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:38 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1715 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:39.576450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:39.577268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:39.586598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.587544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:39.588177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.589212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.590003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:39.590721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:39.952867 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc995322-0bfc-48e0-8dab-230fc046fcc7 tempest-MigrationsAdminTest-1928252783 tempest-MigrationsAdminTest-1928252783-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1614 microversion: 2.1 time: 0.660522 Sep 13 16:37:39.966214 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 927/1952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:39 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1614 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:39.979688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:39.986119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:39.997534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:39.997743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:40.005095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.005566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.006466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.006846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.007271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.009778 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-277f28ee-ba7d-47e5-a61d-6a4354a7de97 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.890596 Sep 13 16:37:40.030520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1026/1953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:39 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:40.036984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:40.037886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:40.045102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.046809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.047427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.048327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.048956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.049859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.291950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:40.310180 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9dfe6262-b163-42e9-8463-62f529ae1d4b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.344687 Sep 13 16:37:40.310822 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 928/1954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:39 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:40.323956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c960ac30-d196-427a-9fd2-8c053682a426 req-51a115db-26e1-4ae0-b3b5-9719e141a295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9b81b0-379e-4779-a21d-6b2ab2e12f78", "tag": "df87f319-2477-4c5e-b24a-fb52f921656d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:40.337263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c960ac30-d196-427a-9fd2-8c053682a426 req-51a115db-26e1-4ae0-b3b5-9719e141a295 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.337523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c960ac30-d196-427a-9fd2-8c053682a426 req-51a115db-26e1-4ae0-b3b5-9719e141a295 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.338014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c960ac30-d196-427a-9fd2-8c053682a426 req-51a115db-26e1-4ae0-b3b5-9719e141a295 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.359212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c960ac30-d196-427a-9fd2-8c053682a426 req-51a115db-26e1-4ae0-b3b5-9719e141a295 service nova] Creating event network-changed:df87f319-2477-4c5e-b24a-fb52f921656d for instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 on n-h2-857467-1 Sep 13 16:37:40.365427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c960ac30-d196-427a-9fd2-8c053682a426 req-51a115db-26e1-4ae0-b3b5-9719e141a295 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053397 Sep 13 16:37:40.366824 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 929/1955] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:40.375121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:40.378831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:40.389228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.389806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.390686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.391624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.392320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.392962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.453094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:40.518037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:40.533821 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6d6c591a-276d-490d-a56d-f20353e37da6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.502071 Sep 13 16:37:40.534605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1027/1956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:40 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:40.539724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-8dfc2e40-c26c-4cf6-8279-e0707908de95 req-bd8991d9-7d67-40aa-a3a9-4d369c0cdc01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "name": "network-vif-plugged", "status": "completed", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:40.568995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8dfc2e40-c26c-4cf6-8279-e0707908de95 req-bd8991d9-7d67-40aa-a3a9-4d369c0cdc01 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.577197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8dfc2e40-c26c-4cf6-8279-e0707908de95 req-bd8991d9-7d67-40aa-a3a9-4d369c0cdc01 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.577858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8dfc2e40-c26c-4cf6-8279-e0707908de95 req-bd8991d9-7d67-40aa-a3a9-4d369c0cdc01 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.599381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8dfc2e40-c26c-4cf6-8279-e0707908de95 req-bd8991d9-7d67-40aa-a3a9-4d369c0cdc01 service nova] Creating event network-vif-plugged:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h1-857467-1 Sep 13 16:37:40.618001 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a3b9e3d-879c-43b0-9560-2b5936b939f5 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 204 len: 0 microversion: 2.1 time: 0.244182 Sep 13 16:37:40.618001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 930/1957] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:40 2022] DELETE /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:37:40.623117 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-8dfc2e40-c26c-4cf6-8279-e0707908de95 req-bd8991d9-7d67-40aa-a3a9-4d369c0cdc01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085973 Sep 13 16:37:40.623802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:40.624640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:40.633006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1028/1958] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:40.633163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.633688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.634150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.634866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.635329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.636150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.643381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:40.644786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:40.657470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.659185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.661475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.664064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.667727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.668524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.811711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:40.824878 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3dbacbe1-c94d-4de9-b3df-579daca0d671 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1705 microversion: 2.1 time: 0.206162 Sep 13 16:37:40.825610 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 931/1959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:40 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1705 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:40.848697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c64631b-0894-48c4-bf56-59449a2f856b tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '.version_select at 0x7fbeb4e40670>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:40.852683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c64631b-0894-48c4-bf56-59449a2f856b tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.853302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c64631b-0894-48c4-bf56-59449a2f856b tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.853892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c64631b-0894-48c4-bf56-59449a2f856b tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.868237 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c64631b-0894-48c4-bf56-59449a2f856b tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3889 microversion: 2.1 time: 0.024240 Sep 13 16:37:40.869215 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 932/1960] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:37:40 2022] GET /compute/v2.1/os-migrations => generated 3889 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:40.885386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:40.886050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:40.892259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.892764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.893212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:40.893959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:40.894471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:40.894904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.061721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff266dde-512e-480f-a9d5-38bb9aa59da2 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1856 microversion: 2.1 time: 0.179933 Sep 13 16:37:41.070651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 933/1961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:40 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1856 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:41.074532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:41.076870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:41.077744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:41.083936 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4eea66d1-8eab-48d2-8b63-85881b20f040 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1469 microversion: 2.1 time: 0.448089 Sep 13 16:37:41.097923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.097923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.097923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.097923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.097923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.097923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.099711 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1029/1962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:40 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1469 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:41.104901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:41.105735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:41.112247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.113450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.114186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.115058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.115673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.116269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.247614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:41.257901 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2472f88-3cdb-42ea-baa1-fb45b6d33074 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.185497 Sep 13 16:37:41.259076 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 934/1963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:41 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:41.336487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:41.337119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:41.351442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.353007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.353472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.354276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.354953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.355572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.495778 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba7ba082-1d41-48f9-9ef9-31ca682dc78f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1856 microversion: 2.1 time: 0.394437 Sep 13 16:37:41.501154 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1030/1964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:41 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1856 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:41.557645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:41.559198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:41.574584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.574584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.575180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.576185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.576845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.578836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.585580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:41.596102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ef8afd1-3488-48d4-80a7-ad0968bc184c tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.265296 Sep 13 16:37:41.609862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 935/1965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:41 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:41.650320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:41.651010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:41.652994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:41.661453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:41.667547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.668246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.668688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.671139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:41.671618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:41.674567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:41.879457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lazy-loading 'services' on Instance uuid 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:42.006915 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71af596a-0538-4acb-9da2-05512f4d7cef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments/0dce999e-1e11-48de-8c7a-2a2311eebbbd" status: 202 len: 0 microversion: 2.1 time: 0.360364 Sep 13 16:37:42.007548 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 936/1966] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:37:41 2022] DELETE /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments/0dce999e-1e11-48de-8c7a-2a2311eebbbd => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:37:42.016816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:42.019143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:42.024584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:42.025894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.026518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.026822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.027530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.028230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.028571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.036357 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad0433a9-a5f6-4f6e-b2b3-8f868e730072 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1497 microversion: 2.1 time: 0.482217 Sep 13 16:37:42.054353 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1031/1967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:41 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1497 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:42.063427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24cd70c5-903d-47b5-aa44-5e1c167106a4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051118 Sep 13 16:37:42.064357 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 937/1968] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:42 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:37:42.112465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:42.114277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:42.123040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.123721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.124272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.125103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.125675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.126380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.289917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:42.291137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:42.301410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.302241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.302687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.303409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.303875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.304313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.309156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:42.360069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:42.490859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:42.505537 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7625d1f5-b296-4596-a5b1-eafefc7dfb15 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1469 microversion: 2.1 time: 0.397273 Sep 13 16:37:42.507412 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1032/1969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:42 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:42.515539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-241b1de1-5daf-4493-9d66-3c27d9ad570f req-93fec642-a8c1-45f8-b192-b232b2319ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85c8c5f-e1c9-4ab0-9777-28472cc8058a", "tag": "f26fa614-a097-4e7f-abb3-54bf603d278c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:42.564098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-241b1de1-5daf-4493-9d66-3c27d9ad570f req-93fec642-a8c1-45f8-b192-b232b2319ae4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.564248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:42.566141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-241b1de1-5daf-4493-9d66-3c27d9ad570f req-93fec642-a8c1-45f8-b192-b232b2319ae4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.567082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-241b1de1-5daf-4493-9d66-3c27d9ad570f req-93fec642-a8c1-45f8-b192-b232b2319ae4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.578945 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fde306f5-1311-4dbc-b20d-bd7bbc3d9d27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.295561 Sep 13 16:37:42.579562 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 938/1970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:42 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:42.594416 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-241b1de1-5daf-4493-9d66-3c27d9ad570f req-93fec642-a8c1-45f8-b192-b232b2319ae4 service nova] Creating event network-changed:f26fa614-a097-4e7f-abb3-54bf603d278c for instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a on n-h2-857467-1 Sep 13 16:37:42.600752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-241b1de1-5daf-4493-9d66-3c27d9ad570f req-93fec642-a8c1-45f8-b192-b232b2319ae4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088729 Sep 13 16:37:42.601493 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1033/1971] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:42.622866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:42.623716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:42.630794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.631281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.631713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.632636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:42.633115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:42.633698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:42.797945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:42.809428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51619ba4-e52f-44b7-a198-bc140b2f7c34 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.190198 Sep 13 16:37:42.822007 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 939/1972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:42 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:43.071189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:43.072295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:43.078839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:43.083539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:43.084742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=10 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:43.087908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.088896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.089685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.090612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.091253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.091856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.100511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.102443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.103962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.106318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.106858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.107929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.170967 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec962c23-0f73-4a4e-afb4-b8c480804ac0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098019 Sep 13 16:37:43.172044 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 940/1973] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:43 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:43.535005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:43.535937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:43.544234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.544437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.544830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.545972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.546299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.564506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.775941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:43.811107 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6a68fc1-c272-4d38-9a1a-9659a6b61e2f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 200 len: 1474 microversion: 2.1 time: 0.751089 Sep 13 16:37:43.818403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1034/1974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:43 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 1474 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:43.821569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:43.826841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:43.855993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.861946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.865217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:43.866122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:43.867320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:43.874944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.063278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:45.076662 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b27a3811-5b76-442c-97d3-b648080fd3ea tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 1.261810 Sep 13 16:37:45.091794 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1035/1975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:43 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:45.105528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:45.106396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:45.115138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.116052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.116727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.117618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.118306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.118966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.156568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:45.181215 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33d9bea2-b16b-44ae-a41f-285040fd2e83 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 200 len: 1469 microversion: 2.1 time: 1.636863 Sep 13 16:37:45.184028 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 941/1976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:43 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 1469 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:45.193196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2058090691"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:45.200334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:45.215124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.219248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.220019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.221020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.221795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.223127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.782836 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ba8492e-4372-4f87-97d9-a01db55d8710 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14/action" status: 202 len: 0 microversion: 2.1 time: 0.596729 Sep 13 16:37:45.790667 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 942/1977] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:37:45 2022] POST /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:37:45.808571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:45.811636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:45.829412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.832786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.833597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.834642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.835783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.836481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.902408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:45.915814 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c71342f-d101-40fa-a459-5e754cffc4b9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119147 Sep 13 16:37:45.916319 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ecb5193a-2c3d-44b1-b261-21c9d1deb558 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.823024 Sep 13 16:37:45.917922 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 943/1978] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:45 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:45.930092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2388cfa2-a91d-43ae-99ab-bdd0b35fdba6 req-d0dd86a8-17b0-469a-905a-0af3e3eedba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc02d5-e79f-453b-aace-3b2c355d87ac", "name": "network-vif-deleted", "tag": "878faba6-a992-4a37-b043-7b5db8aa3f31"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:45.933761 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1036/1979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:45 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:45.952338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6d98f846-5d94-4178-b1a1-3118d5a78e45 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4ac6310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:45.961341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2388cfa2-a91d-43ae-99ab-bdd0b35fdba6 req-d0dd86a8-17b0-469a-905a-0af3e3eedba4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:45.962086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2388cfa2-a91d-43ae-99ab-bdd0b35fdba6 req-d0dd86a8-17b0-469a-905a-0af3e3eedba4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:45.962713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2388cfa2-a91d-43ae-99ab-bdd0b35fdba6 req-d0dd86a8-17b0-469a-905a-0af3e3eedba4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:45.994397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2388cfa2-a91d-43ae-99ab-bdd0b35fdba6 req-d0dd86a8-17b0-469a-905a-0af3e3eedba4 service nova] Creating event network-vif-deleted:878faba6-a992-4a37-b043-7b5db8aa3f31 for instance dfcc02d5-e79f-453b-aace-3b2c355d87ac on n-h1-857467-1 Sep 13 16:37:46.009396 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2388cfa2-a91d-43ae-99ab-bdd0b35fdba6 req-d0dd86a8-17b0-469a-905a-0af3e3eedba4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087965 Sep 13 16:37:46.010424 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 944/1980] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:46.052501 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6d98f846-5d94-4178-b1a1-3118d5a78e45 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.116299 Sep 13 16:37:46.054134 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1037/1981] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:45 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:46.107427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:46.108132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:46.119672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.120162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.120598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.121312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.121768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.122234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.214601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:46.215800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: dfcc02d5-e79f-453b-aace-3b2c355d87ac] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:46.225068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.226063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.226679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.228571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.229232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.230144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.269720 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] HTTP exception thrown: Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac could not be found. Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Request method failure captured: Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac HTTP/1.1 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB0s-dlmKeY1xQDRxDQFzpSWDsmNDNeUI6T_w_jcC1GHPuIkQ6qSIBEh93wdebys45i_5KTEVUe2X6k1BrmhoatKm7lYxBHXfV9GUtS7wd8-xHNr9qoQ55TvJFWwK3ajleWQe9rcibGGSPiZgF802yG0m7jpO8ONdOaY7VIdBJ9Obc Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-MigrationsAdminTest-266729152 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-MigrationsAdminTest-266729152-project Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80714f77e8904565bde7dc8e7dce1063 Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-MigrationsAdminTest-266729152-project Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac could not be found. Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'dfcc02d5-e79f-453b-aace-3b2c355d87ac'} Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac could not be found. Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac could not be found. Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:46.273101 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac could not be found. Sep 13 16:37:46.278623 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:46.280428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Returning 404 to user: Instance dfcc02d5-e79f-453b-aace-3b2c355d87ac could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:46.283136 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4721f412-7847-4cd4-93f6-948d1d02e70b tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac" status: 404 len: 111 microversion: 2.1 time: 0.074483 Sep 13 16:37:46.286505 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1038/1982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:46 2022] GET /compute/v2.1/servers/dfcc02d5-e79f-453b-aace-3b2c355d87ac => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:37:46.368454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:46.384329 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34738980-c289-4213-bf99-84c557b97930 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.280998 Sep 13 16:37:46.385268 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 945/1983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:46 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:46.396283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:46.397060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:46.415744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.416521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.417132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.418059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.418697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.419336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.438046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-388585214", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:46.514145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:46.542315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] validate_networks() for [('a2d67f00-3d76-4c01-9d44-ba2cf66dba91', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:37:46.679850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4389c27d-5117-46ce-a9fe-0edd5b13c71e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 204 len: 0 microversion: 2.1 time: 0.292910 Sep 13 16:37:46.681017 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 946/1984] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:46 2022] DELETE /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:37:46.692912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:46.693702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:46.700641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.701385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.702836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.703910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.704542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.705150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.913681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:46.926916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a589ea0f-7c72-463d-b8d9-08510ea5684c tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1534 microversion: 2.1 time: 0.241878 Sep 13 16:37:46.930169 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 947/1985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:46 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1534 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:46.939121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:46.948112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:46.963303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.965375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.966065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:46.966996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:46.969995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:46.970622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.056920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fbb09ec0-0b97-4ff2-bba8-1b96de23771e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125447 Sep 13 16:37:47.069567 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 948/1986] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:46 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:47.075142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:47.076012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:47.083343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.084091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.084710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.085659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.086331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.086931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.164503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:37:47.165336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:37:47.166162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:37:47.166909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:37:47.167553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:37:47.182994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.183854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.184599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.185693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.186444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.187130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.214097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for project 1ce4b7f916b64240af037c66c8665c53. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:47.223688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for user 780658a6bd6649bf889299f03d80c145 and project 1ce4b7f916b64240af037c66c8665c53. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:47.228990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:47.244784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:37:47.252432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:37:47.346666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:47.365461 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8846e651-4aa4-489e-b10e-dc357dde8d36 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.077611 Sep 13 16:37:47.369200 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e9726a3-6be2-4885-aa22-340dd0da1506 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.297127 Sep 13 16:37:47.385872 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 949/1987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:47 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:47.385872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ff902fe-0e4a-4f65-9b6b-3cf7cb71ea07 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4e561f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:47.390919 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1039/1988] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:37:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:37:47.402855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d22cd205-5bc6-492b-8ccb-b87764f633b4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:47.403636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d22cd205-5bc6-492b-8ccb-b87764f633b4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:47.468783 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ff902fe-0e4a-4f65-9b6b-3cf7cb71ea07 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.097188 Sep 13 16:37:47.470508 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 950/1989] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:47 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:47.480186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:47.484063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:47.494636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.495144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.495592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.496476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.497300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.497300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.510889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d22cd205-5bc6-492b-8ccb-b87764f633b4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:47.527747 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d22cd205-5bc6-492b-8ccb-b87764f633b4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1221 microversion: 2.1 time: 0.126111 Sep 13 16:37:47.531264 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1040/1990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:47 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:47.602831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1862047719", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:47.712486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] validate_networks() for [('a2d67f00-3d76-4c01-9d44-ba2cf66dba91', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:37:47.762299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:47.774439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5e51ec1-2467-49bd-8b92-9753105cd44f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.302498 Sep 13 16:37:47.790549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 951/1991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:47 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:47.953581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:47.954235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:47.962237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.963127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.963752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:47.964769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:47.966481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:47.967163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.241050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:48.253469 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0bffb800-cfcc-4031-85d7-f44c7f6c5b4e tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1534 microversion: 2.1 time: 0.302804 Sep 13 16:37:48.254990 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 952/1992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:47 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1534 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:48.260746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:48.268869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:48.293452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.294044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.294442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.295163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.295631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.296073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.330203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:48.367337 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-909d7824-e172-4a1d-92e5-9d9903a6dae2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110940 Sep 13 16:37:48.368984 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 953/1993] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:48 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:48.400270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:48.401173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:48.411615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.413034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.413604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.416312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.418443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.420632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.432641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:37:48.433168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:37:48.433900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:37:48.436039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:37:48.436687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:37:48.455183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.455877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.456583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.457533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.459298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.459972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.538526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for project 1ce4b7f916b64240af037c66c8665c53. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:48.555016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for user 780658a6bd6649bf889299f03d80c145 and project 1ce4b7f916b64240af037c66c8665c53. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:48.593293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:37:48.598700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:37:48.727718 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1541b1d3-6cc1-4f26-bc9d-e1bddeaa4173 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.130028 Sep 13 16:37:48.728741 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1041/1994] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:37:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:37:48.734582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa449388-f269-40db-9093-3d215d3bf589 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb95d6e50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:48.756300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:48.803659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d7093406-3d8f-4030-9826-39a83a7b2c2f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.408484 Sep 13 16:37:48.846761 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 954/1995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:48 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:48.851999 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa449388-f269-40db-9093-3d215d3bf589 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.121351 Sep 13 16:37:48.852856 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1042/1996] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:48 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:48.858075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:48.859011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:48.870353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fc15a3c-6a48-43aa-abe6-edf72129a090 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:48.882195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.883372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.885047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:48.886105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3fc15a3c-6a48-43aa-abe6-edf72129a090 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:48.888230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:48.891492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:48.893292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.090562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fc15a3c-6a48-43aa-abe6-edf72129a090 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:49.109592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fc15a3c-6a48-43aa-abe6-edf72129a090 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1222 microversion: 2.1 time: 0.255084 Sep 13 16:37:49.112923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 955/1997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:48 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:49.126235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bffaae03-f90c-43d7-bd91-912924240ff4 req-f0743b01-d528-45f0-b130-e2385921cf12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9b81b0-379e-4779-a21d-6b2ab2e12f78", "name": "network-vif-plugged", "status": "completed", "tag": "df87f319-2477-4c5e-b24a-fb52f921656d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:49.197594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bffaae03-f90c-43d7-bd91-912924240ff4 req-f0743b01-d528-45f0-b130-e2385921cf12 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.199210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bffaae03-f90c-43d7-bd91-912924240ff4 req-f0743b01-d528-45f0-b130-e2385921cf12 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.200550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bffaae03-f90c-43d7-bd91-912924240ff4 req-f0743b01-d528-45f0-b130-e2385921cf12 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.236094 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bffaae03-f90c-43d7-bd91-912924240ff4 req-f0743b01-d528-45f0-b130-e2385921cf12 service nova] Creating event network-vif-plugged:df87f319-2477-4c5e-b24a-fb52f921656d for instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 on n-h2-857467-1 Sep 13 16:37:49.257669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:49.270344 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4104fc04-bc3b-4f19-8a02-e67f4aaadb87 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.415707 Sep 13 16:37:49.287097 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1043/1998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:48 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:49.287744 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bffaae03-f90c-43d7-bd91-912924240ff4 req-f0743b01-d528-45f0-b130-e2385921cf12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171897 Sep 13 16:37:49.288354 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 956/1999] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:49.296447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:49.296933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:49.307185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.308034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.308891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.310691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.311441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.312378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.354363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:49.381645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:49.384301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:49.430392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.438360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.439157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.440201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.440983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.441641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.567062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f8dccae7-c821-405e-ac6d-169674f5967e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190058 Sep 13 16:37:49.576409 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 957/2000] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:49 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:49.695357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:49.722540 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9835b5ef-998d-4cba-b1a6-533fd5faf5fc tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1534 microversion: 2.1 time: 0.430078 Sep 13 16:37:49.729883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1044/2001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:49 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1534 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:49.859431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:49.860149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:49.868738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e20b3f4a-0dc7-4b2a-be02-cc3ef0e8fc40 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4aeac10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:49.871700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.874605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.887704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.899896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:49.900632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:49.906629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:49.986022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e20b3f4a-0dc7-4b2a-be02-cc3ef0e8fc40 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.120739 Sep 13 16:37:49.996519 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1045/2002] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:49 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:50.134560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:50.135226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:50.151271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.151785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.152233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.158265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.158848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.159304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.281206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:50.296172 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60d66e2f-972e-47a7-af0a-ed35cfb7432a tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.440756 Sep 13 16:37:50.297336 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 958/2003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:49 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:50.313687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:50.314728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:50.332011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.335954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.336753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.339127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.342386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.343153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.407555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:50.416564 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7ab6207-63b9-4a9b-ac9e-c9fa518b7a13 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1218 microversion: 2.1 time: 0.285992 Sep 13 16:37:50.422826 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1046/2004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:50 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1218 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:50.850016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:50.853079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:50.879838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.880440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:50.880935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.881046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.881734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.882256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.884190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.894862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-31776439-2d0b-4616-bb1e-29da1027fb6b tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.595421 Sep 13 16:37:50.910721 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 959/2005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:50 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:50.919542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:50.923821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:50.936330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.938407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.939099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:50.942556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:50.943265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:50.943919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.011159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3c59447-13a5-4dcc-a2f5-c5c928b97d93 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.425227 Sep 13 16:37:51.012178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1047/2006] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:50 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 197 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:51.017004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-861b02e3-a3e8-4cba-af30-b5862bfedaf5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4aff940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:51.098582 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-861b02e3-a3e8-4cba-af30-b5862bfedaf5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.085078 Sep 13 16:37:51.099741 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1048/2007] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:51 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:51.219291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:51.233580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad341b10-9f7f-4f39-a82e-69ce2b4f7176 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1534 microversion: 2.1 time: 0.316597 Sep 13 16:37:51.235998 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 960/2008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:50 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1534 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:51.325306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:51.326543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:51.341332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.359430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.360843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.365198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.368292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.370517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.447789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:51.448684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:51.459948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.460453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.460896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.461612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.465962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.466506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.588528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:51.598706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eba3381a-4eab-49ad-9a06-bd62d9e9d851 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1282 microversion: 2.1 time: 0.156290 Sep 13 16:37:51.616620 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 961/2009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:51 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:51.723617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-87370006", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e0e29954-773d-492f-aa39-e96119d607b1"}], "block_device_mapping_v2": [{"uuid": "b493a714-68ab-4c78-97ca-7b078662c2ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:51.796268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] validate_networks() for [('e0e29954-773d-492f-aa39-e96119d607b1', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:37:51.884179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:51.895082 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-964a4c93-0976-4309-92c6-bc251e93ac9b tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.574647 Sep 13 16:37:51.904408 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1049/2010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:51 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:51.925762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:51.926582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:51.934212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.935656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.936727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:51.937514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:51.938073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:51.938572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.286777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:37:52.289768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:37:52.290319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:37:52.290745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:37:52.291172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:37:52.302003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.302118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.302495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.303657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.304777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.305459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.324665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:37:52.334646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Getting quotas for user 792d76dbc4394c77bee09f600364cb74 and project 5c837d5c9bef44cc86e125db0fcfcfb5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:37:52.352315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:52.415453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:37:52.417792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b493a714-68ab-4c78-97ca-7b078662c2ae',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:37:52.593653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb456b8b-451f-434e-9873-83189bbff6e7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.875458 Sep 13 16:37:52.595125 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 962/2011] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:37:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 16:37:52.601427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:52.604335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:52.613451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.614128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.614635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.616564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.617383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.617947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.657005 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c13ad20c-a2e8-4966-aa13-f7a840f5031c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059537 Sep 13 16:37:52.657800 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 963/2012] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:37:52 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:37:52.664009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0aaa0d24-7669-47a9-85c3-4ae9bc2a66d7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4de38b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:52.715237 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0aaa0d24-7669-47a9-85c3-4ae9bc2a66d7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.055696 Sep 13 16:37:52.724128 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 964/2013] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:52 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:52.724128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:52.724128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:52.730217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.730720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.731448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.731877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.732342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.733886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.877911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:52.894920 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13eac0cf-ef6c-43df-8545-082faeae88f7 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1315 microversion: 2.1 time: 0.975923 Sep 13 16:37:52.898304 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1050/2014] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:51 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:52.915198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-14a9534f-85c1-4df2-a1ca-d0403f399d3a req-7492bcc2-7592-4f0c-a200-f092f8de7367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4942170b-e2df-40ac-8f82-89f3e1487d14", "name": "network-vif-plugged", "status": "completed", "tag": "b34e695c-4015-4d7f-8224-cc521758c7fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:52.931355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-14a9534f-85c1-4df2-a1ca-d0403f399d3a req-7492bcc2-7592-4f0c-a200-f092f8de7367 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:52.932026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-14a9534f-85c1-4df2-a1ca-d0403f399d3a req-7492bcc2-7592-4f0c-a200-f092f8de7367 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:52.933327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-14a9534f-85c1-4df2-a1ca-d0403f399d3a req-7492bcc2-7592-4f0c-a200-f092f8de7367 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:52.970411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-14a9534f-85c1-4df2-a1ca-d0403f399d3a req-7492bcc2-7592-4f0c-a200-f092f8de7367 service nova] Creating event network-vif-plugged:b34e695c-4015-4d7f-8224-cc521758c7fb for instance 4942170b-e2df-40ac-8f82-89f3e1487d14 on n-h1-857467-1 Sep 13 16:37:52.982931 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-14a9534f-85c1-4df2-a1ca-d0403f399d3a req-7492bcc2-7592-4f0c-a200-f092f8de7367 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083231 Sep 13 16:37:52.983523 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1051/2015] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:52.986899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:52.992629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80018434-d465-4d50-811f-a2fb42c00199 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:52.993330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80018434-d465-4d50-811f-a2fb42c00199 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:52.997157 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72bbeaa4-c33f-4925-9e26-7d858dd122bb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1534 microversion: 2.1 time: 0.279951 Sep 13 16:37:53.011478 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 965/2016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:52 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1534 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:53.028028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:53.028028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:53.043905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.044536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.045474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.047390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.047876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.057758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.212528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:53.215643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80018434-d465-4d50-811f-a2fb42c00199 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:53.222984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7746d7eb-8dcc-4828-862b-fe1a8ca4cd30 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1280 microversion: 2.1 time: 0.210398 Sep 13 16:37:53.230001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 966/2017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:53 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:53.244575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80018434-d465-4d50-811f-a2fb42c00199 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:53.244575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80018434-d465-4d50-811f-a2fb42c00199 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:53.244575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80018434-d465-4d50-811f-a2fb42c00199 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1102 microversion: 2.25 time: 0.254454 Sep 13 16:37:53.244575 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1052/2018] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:52 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1102 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:53.250753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:53.251331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:53.260122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.260648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.261349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.262713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.263503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.264138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.364562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-81c3a2df-d033-4cc2-b2bc-249213e6ff4a req-af9e3938-4c7e-48d7-93b7-8790db35a687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f525d6-432c-44f5-bad7-5a4fb595de88", "name": "network-vif-deleted", "tag": "4b8fa505-9d8d-4268-b475-9947e2f17619"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:53.398920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81c3a2df-d033-4cc2-b2bc-249213e6ff4a req-af9e3938-4c7e-48d7-93b7-8790db35a687 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.399431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81c3a2df-d033-4cc2-b2bc-249213e6ff4a req-af9e3938-4c7e-48d7-93b7-8790db35a687 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.399882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81c3a2df-d033-4cc2-b2bc-249213e6ff4a req-af9e3938-4c7e-48d7-93b7-8790db35a687 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.432467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-81c3a2df-d033-4cc2-b2bc-249213e6ff4a req-af9e3938-4c7e-48d7-93b7-8790db35a687 service nova] Creating event network-vif-deleted:4b8fa505-9d8d-4268-b475-9947e2f17619 for instance a1f525d6-432c-44f5-bad7-5a4fb595de88 on n-h2-857467-1 Sep 13 16:37:53.444331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-81c3a2df-d033-4cc2-b2bc-249213e6ff4a req-af9e3938-4c7e-48d7-93b7-8790db35a687 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087232 Sep 13 16:37:53.446722 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 967/2019] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:53.732549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9f79246-2356-4091-bf90-f5d4c22fd2b0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb95d0b80>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:53.763607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:53.778107 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30fd4cd7-f468-4068-981c-577d7ab867b0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.537315 Sep 13 16:37:53.782066 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1053/2020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:53 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:53.809976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9f79246-2356-4091-bf90-f5d4c22fd2b0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.082059 Sep 13 16:37:53.811023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 968/2021] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:53 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:53.918906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:53.920374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:53.929569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.930666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.936627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:53.940405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:53.941639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:53.942956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.043330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:54.044306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:54.052945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.055892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.056889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.058065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.061119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.061866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.144288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.145151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.146386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.147205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lazy-loading 'fault' on Instance uuid a1f525d6-432c-44f5-bad7-5a4fb595de88 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:54.200449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:54.211072 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d57519a8-50ed-49ad-8d2c-6bce2bcc6746 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1369 microversion: 2.1 time: 0.175118 Sep 13 16:37:54.226425 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 969/2022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:54 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:54.258885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:54.259511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:54.272456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.273248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.273901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.274803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.284053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.285589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.376748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:54.391740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2d430a8-043a-4939-974c-2ede17a60a3f tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1504 microversion: 2.1 time: 0.477555 Sep 13 16:37:54.395112 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1054/2023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:53 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1504 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:54.417886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:54.418173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:54.431765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.444803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.445305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.446512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.448707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.449093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.573653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:54.586049 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf7bd197-0b3c-41f6-b41f-825244fdfbae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.330922 Sep 13 16:37:54.588710 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 970/2024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:54 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:37:54.602156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:54.603025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:54.614402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.615322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.616013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.616741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.617716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.618339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.679600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:37:54.748492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:54.770298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:54.774575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:54.775748 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c087bbdd-c384-4742-992c-208f056bc24b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1231 microversion: 2.25 time: 0.371011 Sep 13 16:37:54.798409 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1055/2025] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:54 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1231 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:54.816865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:54.820720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:54.829634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c1eda0d-65f1-4d5b-bc66-7c8722c83330 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 204 len: 0 microversion: 2.1 time: 0.239184 Sep 13 16:37:54.831009 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 971/2026] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:37:54 2022] DELETE /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:37:54.838454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.839205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.839851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:54.840749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:54.842440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6410d221-7b6d-4d22-b6b5-7172368d5677 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4dbd820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:54.843247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:54.844114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.268646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:55.291212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0bb43807-1a9c-4a72-a2fc-9bc6df1013a6 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.491353 Sep 13 16:37:55.291822 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1056/2027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:54 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:55.310719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:55.312758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:55.321645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:55.322478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:55.323127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.324256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:55.327461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:55.328519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.714363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:55.723416 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8efd685-db6a-4233-b5ff-3e50ec0ed92d tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1510 microversion: 2.1 time: 0.420044 Sep 13 16:37:55.724014 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1057/2028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:55 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:55.742406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-bdd7d567-c78d-486b-b033-c50c969f2e26 req-40972ed1-4cd4-44b2-9d1f-3813b6b9b856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85c8c5f-e1c9-4ab0-9777-28472cc8058a", "name": "network-vif-plugged", "status": "completed", "tag": "f26fa614-a097-4e7f-abb3-54bf603d278c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:55.762027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bdd7d567-c78d-486b-b033-c50c969f2e26 req-40972ed1-4cd4-44b2-9d1f-3813b6b9b856 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:55.762691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bdd7d567-c78d-486b-b033-c50c969f2e26 req-40972ed1-4cd4-44b2-9d1f-3813b6b9b856 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:55.763298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bdd7d567-c78d-486b-b033-c50c969f2e26 req-40972ed1-4cd4-44b2-9d1f-3813b6b9b856 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.792763 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-bdd7d567-c78d-486b-b033-c50c969f2e26 req-40972ed1-4cd4-44b2-9d1f-3813b6b9b856 service nova] Creating event network-vif-plugged:f26fa614-a097-4e7f-abb3-54bf603d278c for instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a on n-h2-857467-1 Sep 13 16:37:55.822411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-bdd7d567-c78d-486b-b033-c50c969f2e26 req-40972ed1-4cd4-44b2-9d1f-3813b6b9b856 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085725 Sep 13 16:37:55.825942 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1058/2029] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:55.834828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:55.835678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:55.843278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:55.844140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:55.845515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.847139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:55.847996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:55.848753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.921127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:55.923461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:55.924183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:55.924982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lazy-loading 'fault' on Instance uuid a1f525d6-432c-44f5-bad7-5a4fb595de88 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:56.032409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:56.042198 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a5ef714-dfcb-4ce8-a39b-235788f7abf4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 200 len: 1369 microversion: 2.1 time: 0.212555 Sep 13 16:37:56.071518 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1059/2030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:55 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:56.076593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:56.077436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:56.085322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:56.086112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:56.086814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:56.088148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:56.088788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:56.089426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:56.534359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:56.547936 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-522aea2e-4d42-41df-9081-570984fd7034 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.473384 Sep 13 16:37:56.551993 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1060/2031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:56 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:56.561774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-06c31e85-9d10-4676-a39e-a8a7ea92fdce req-370ea325-b512-409e-a43f-9732255d5bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384c0e9c-0bc9-41bb-a17f-7986492880d5", "tag": "55c2916e-ebd6-4dcc-b800-4cf6381fe6b6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:56.605633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06c31e85-9d10-4676-a39e-a8a7ea92fdce req-370ea325-b512-409e-a43f-9732255d5bad service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:56.607269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06c31e85-9d10-4676-a39e-a8a7ea92fdce req-370ea325-b512-409e-a43f-9732255d5bad service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:56.608555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06c31e85-9d10-4676-a39e-a8a7ea92fdce req-370ea325-b512-409e-a43f-9732255d5bad service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:56.682112 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-06c31e85-9d10-4676-a39e-a8a7ea92fdce req-370ea325-b512-409e-a43f-9732255d5bad service nova] Creating event network-changed:55c2916e-ebd6-4dcc-b800-4cf6381fe6b6 for instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 on n-h1-857467-1 Sep 13 16:37:56.698114 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-06c31e85-9d10-4676-a39e-a8a7ea92fdce req-370ea325-b512-409e-a43f-9732255d5bad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143172 Sep 13 16:37:56.698114 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1061/2032] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:56.703239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:56.710336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:56.724659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:56.725595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:56.725595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:56.726340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:56.726799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:56.727235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:57.485686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:57.495089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:57.506594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:57.508097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06fa440d-deed-4c18-a7c6-32ca527b93c8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1249 microversion: 2.25 time: 0.809192 Sep 13 16:37:57.508864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1062/2033] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:56 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1249 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:57.515338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:57.543783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:57.567805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:57.568599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:57.569216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:57.570153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:57.570802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:57.571403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.234164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:58.242884 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ea256ac-6b48-476b-a81d-3083980038b1 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1324 microversion: 2.1 time: 0.731175 Sep 13 16:37:58.243483 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1063/2034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:57 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1324 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:58.255585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:58.258016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:58.281774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.282584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.283208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.284185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.284819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.285863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.370254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.370748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.371181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.371637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lazy-loading 'fault' on Instance uuid 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:37:58.496030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:58.614697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1322a8be50b44f14a7b92ab9ebf44c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bb10d7bc8d4ebca70eb4aa9537c44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:58.630099 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a1bd49f-c7fa-4c00-9e54-223c1d115628 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 200 len: 1305 microversion: 2.1 time: 0.382181 Sep 13 16:37:58.642588 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1064/2035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:58 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 1305 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:58.676325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:58.690426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: a1f525d6-432c-44f5-bad7-5a4fb595de88] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:58.713759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.714230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.714671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.715392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.715862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.716400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.770629 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] HTTP exception thrown: Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 could not be found. Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Request method failure captured: Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 HTTP/1.1 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB0s-dlmKeY1xQDRxDQFzpSWDsmNDNeUI6T_w_jcC1GHPuIkQ6qSIBEh93wdebys45i_5KTEVUe2X6k1BrmhoatKm7lYxBHXfV9GUtS7wd8-xHNr9qoQ55TvJFWwK3ajleWQe9rcibGGSPiZgF802yG0m7jpO8ONdOaY7VIdBJ9Obc Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-MigrationsAdminTest-266729152 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-MigrationsAdminTest-266729152-project Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80714f77e8904565bde7dc8e7dce1063 Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-MigrationsAdminTest-266729152-project Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 could not be found. Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'a1f525d6-432c-44f5-bad7-5a4fb595de88'} Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 could not be found. Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 could not be found. Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:37:58.774646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 could not be found. Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Returning 404 to user: Instance a1f525d6-432c-44f5-bad7-5a4fb595de88 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:37:58.783043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-04527670-4919-44e0-ba7b-c58a3e0c4adb tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88" status: 404 len: 111 microversion: 2.1 time: 0.132306 Sep 13 16:37:58.790765 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1065/2036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:58 2022] GET /compute/v2.1/servers/a1f525d6-432c-44f5-bad7-5a4fb595de88 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:37:58.818362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:58.819160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:58.836431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.837288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.842804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.843921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:58.844849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:58.845965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:58.865072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:37:59.209012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:59.217399 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28fd5b62-877e-47c3-992d-b78f78f69363 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.425476 Sep 13 16:37:59.223060 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1066/2037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:58 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:37:59.232104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-861c2b3f-3d77-4ab6-8a58-52abba3cf422 req-672f5e4b-4920-4ebe-a30a-8aed6da8e44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9b81b0-379e-4779-a21d-6b2ab2e12f78", "name": "network-vif-deleted", "tag": "df87f319-2477-4c5e-b24a-fb52f921656d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:59.267684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-861c2b3f-3d77-4ab6-8a58-52abba3cf422 req-672f5e4b-4920-4ebe-a30a-8aed6da8e44c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:59.268192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-861c2b3f-3d77-4ab6-8a58-52abba3cf422 req-672f5e4b-4920-4ebe-a30a-8aed6da8e44c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:59.304133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-861c2b3f-3d77-4ab6-8a58-52abba3cf422 req-672f5e4b-4920-4ebe-a30a-8aed6da8e44c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:59.345803 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-861c2b3f-3d77-4ab6-8a58-52abba3cf422 req-672f5e4b-4920-4ebe-a30a-8aed6da8e44c service nova] Creating event network-vif-deleted:df87f319-2477-4c5e-b24a-fb52f921656d for instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 on n-h2-857467-1 Sep 13 16:37:59.359960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-861c2b3f-3d77-4ab6-8a58-52abba3cf422 req-672f5e4b-4920-4ebe-a30a-8aed6da8e44c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134914 Sep 13 16:37:59.361049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1067/2038] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:59.379350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:59.381955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:59.398741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:59.401377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:59.405626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:59.407425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:59.408110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:59.408767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:59.698380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:59.714106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:59.722333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:37:59.724104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17754a45-3a0e-46ba-b367-e1de82eb7878 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1291 microversion: 2.25 time: 0.356985 Sep 13 16:37:59.724958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1068/2039] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:37:59 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1291 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:37:59.736743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-631381ff-b32c-4fc8-b131-59d25a24909e req-5028a2c2-72c9-4dff-ae82-ea9e32e9a3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e565faab-08c0-45f9-bf95-00526c197668", "tag": "1b19af59-b1ea-4217-b7ff-9214db2d2ffd"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:37:59.754778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-631381ff-b32c-4fc8-b131-59d25a24909e req-5028a2c2-72c9-4dff-ae82-ea9e32e9a3a7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:59.755661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-631381ff-b32c-4fc8-b131-59d25a24909e req-5028a2c2-72c9-4dff-ae82-ea9e32e9a3a7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:59.756980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-631381ff-b32c-4fc8-b131-59d25a24909e req-5028a2c2-72c9-4dff-ae82-ea9e32e9a3a7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:59.770401 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-631381ff-b32c-4fc8-b131-59d25a24909e req-5028a2c2-72c9-4dff-ae82-ea9e32e9a3a7 service nova] Creating event network-changed:1b19af59-b1ea-4217-b7ff-9214db2d2ffd for instance e565faab-08c0-45f9-bf95-00526c197668 on n-h1-857467-1 Sep 13 16:37:59.776646 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-631381ff-b32c-4fc8-b131-59d25a24909e req-5028a2c2-72c9-4dff-ae82-ea9e32e9a3a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050003 Sep 13 16:37:59.777909 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1069/2040] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:37:59.784845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1b83c08-d073-4693-b402-3622f59c9e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '.version_select at 0x7fbeb4adff70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:59.819176 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1b83c08-d073-4693-b402-3622f59c9e5f tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226846906" status: 202 len: 0 microversion: 2.1 time: 0.039801 Sep 13 16:37:59.821458 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1070/2041] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:37:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226846906 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:37:59.836491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:37:59.843124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:37:59.858237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:59.859159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:59.862145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:37:59.863833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:37:59.868121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:37:59.868973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:00.327549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:00.337421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1436d9c9-abbb-4ccd-b055-bf7644622988 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1522 microversion: 2.1 time: 0.514099 Sep 13 16:38:00.354413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1071/2042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:37:59 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:00.377093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:00.377746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:00.392212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:00.392718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:00.393165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:00.400919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:00.401497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:00.403321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:00.434745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 HTTP/1.1 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5b9b81b0-379e-4779-a21d-6b2ab2e12f78'} Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:00.436366 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cbf746ae-49ba-495a-9f74-3cce5f6222ca tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 404 len: 111 microversion: 2.1 time: 0.082328 Sep 13 16:38:00.442308 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1072/2043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:00 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:00.459284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:00.459887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:00.468167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:00.469057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:00.469504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:00.470261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:00.470728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:00.471161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.124454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:01.143054 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd08465d-65a7-4567-aaa1-0179bd1854fb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.700304 Sep 13 16:38:01.150446 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1073/2044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:00 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:01.155958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:01.156787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:01.165677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.166461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.167234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.168134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.169035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.169637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.204387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:38:01.337129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:01.352179 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30f2a272-5603-46ef-93d6-a76dca78118f tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 204 len: 0 microversion: 2.1 time: 0.200068 Sep 13 16:38:01.353745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1074/2045] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:01 2022] DELETE /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:01.362123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-647797926", "metadata": {"image_type": "test"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:01.366705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:01.375212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.376021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.376869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.378189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.378828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.379763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.407730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78/action HTTP/1.1 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 111 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-647797926", "metadata": {"image_type": "test"}}} Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5b9b81b0-379e-4779-a21d-6b2ab2e12f78', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-647797926', 'metadata': {'image_type': 'test'}}}} Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:38:01.410586 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2128d8c0-6637-40be-a5cd-bc2de73a9a27 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "POST /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78/action" status: 404 len: 111 microversion: 2.1 time: 0.057045 Sep 13 16:38:01.416937 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1075/2046] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Sep 13 16:38:01 2022] POST /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:01.425399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:01.426531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:01.434999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.435591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.436326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.437553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.437695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.438407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.769138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:01.787944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:01.790220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:01.792587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c1affe44-7d38-4742-a1a7-7c549e17a578 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1291 microversion: 2.25 time: 0.378016 Sep 13 16:38:01.793645 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1076/2047] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:01 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1291 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:01.799346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:01.800740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:01.817598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.818215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.818683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.821225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:01.822002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:01.822436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:01.857144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:38:02.008004 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d76198bc-e80a-4eea-a947-d9c7d1dcc568 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 204 len: 0 microversion: 2.1 time: 0.210157 Sep 13 16:38:02.008737 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1077/2048] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:01 2022] DELETE /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:02.024348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:02.025183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:02.036015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.036542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.037072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:02.037902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.039026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.039671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:02.313939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:02.322879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:02.338717 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eead403c-65f5-4613-aa47-539080545fce tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1528 microversion: 2.1 time: 0.323778 Sep 13 16:38:02.346545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:02.361856 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1078/2049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:02 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:02.361856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11b5d351-f134-4511-a466-6b57529d6b72 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1847372323", "metadata": {"image_type": "test"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:02.368356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-11b5d351-f134-4511-a466-6b57529d6b72 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Failed to fetch instance by id tempest-invalid-1263377704 {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:38:02.371499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-11b5d351-f134-4511-a466-6b57529d6b72 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance tempest-invalid-1263377704 could not be found. Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11b5d351-f134-4511-a466-6b57529d6b72 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/tempest-invalid-1263377704/action HTTP/1.1 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 112 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1847372323", "metadata": {"image_type": "test"}}} Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance tempest-invalid-1263377704 could not be found. Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'tempest-invalid-1263377704', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1847372323', 'metadata': {'image_type': 'test'}}}} Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1263377704 could not be found. Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:02.373316 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1263377704 could not be found. Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1263377704 could not be found. Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11b5d351-f134-4511-a466-6b57529d6b72 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance tempest-invalid-1263377704 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:02.379755 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11b5d351-f134-4511-a466-6b57529d6b72 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "POST /compute/v2.1/servers/tempest-invalid-1263377704/action" status: 404 len: 101 microversion: 2.1 time: 0.026274 Sep 13 16:38:02.380895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1079/2050] 10.222.0.61 () {60 vars in 1249 bytes} [Tue Sep 13 16:38:02 2022] POST /compute/v2.1/servers/tempest-invalid-1263377704/action => generated 101 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:02.400947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e5764566-92f1-47c8-9902-16479b7ed80a req-062ae3f0-28f6-4122-8524-f4181a589ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e6ef02-b609-4ab1-8243-f5edaa26853a", "tag": "09b632a7-4797-475c-94b8-697071578c72"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:02.454281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e5764566-92f1-47c8-9902-16479b7ed80a req-062ae3f0-28f6-4122-8524-f4181a589ab2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.457603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e5764566-92f1-47c8-9902-16479b7ed80a req-062ae3f0-28f6-4122-8524-f4181a589ab2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.459680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e5764566-92f1-47c8-9902-16479b7ed80a req-062ae3f0-28f6-4122-8524-f4181a589ab2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:02.485585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e5764566-92f1-47c8-9902-16479b7ed80a req-062ae3f0-28f6-4122-8524-f4181a589ab2 service nova] Creating event network-changed:09b632a7-4797-475c-94b8-697071578c72 for instance 51e6ef02-b609-4ab1-8243-f5edaa26853a on n-h2-857467-1 Sep 13 16:38:02.501082 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e5764566-92f1-47c8-9902-16479b7ed80a req-062ae3f0-28f6-4122-8524-f4181a589ab2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115173 Sep 13 16:38:02.505525 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1080/2051] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:02.516292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:02.540456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:02.556130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.556672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.557187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:02.557921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.558569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.559066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:02.857883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:02.868541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-169c2cf4-c9f2-41a4-9178-c9f579928a96 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1469 microversion: 2.1 time: 0.361628 Sep 13 16:38:02.883913 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1081/2052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:02 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:02.895284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:02.895915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:02.904415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.905592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.905862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:02.907076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:02.907769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:02.908206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.114354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:03.123962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d9b8a6c4-819e-4952-8e01-e97fb9769553 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.237624 Sep 13 16:38:03.127117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1082/2053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:02 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:03.136655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07f61c73-b956-45c0-a0e2-94c528740ed1 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1799726322"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:03.140436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07f61c73-b956-45c0-a0e2-94c528740ed1 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:38:03.140436 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-07f61c73-b956-45c0-a0e2-94c528740ed1 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07f61c73-b956-45c0-a0e2-94c528740ed1 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 57 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: {"createImage": {"name": "tempest-test-snap-1799726322"}} Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1799726322'}}} Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.144893 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07f61c73-b956-45c0-a0e2-94c528740ed1 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07f61c73-b956-45c0-a0e2-94c528740ed1 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018411 Sep 13 16:38:03.150710 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1083/2054] 10.222.0.61 () {60 vars in 1275 bytes} [Tue Sep 13 16:38:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:03.155279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:03.155898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:03.169155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.169760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.171918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.172977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.173468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.173957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.237410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=16 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:03.529563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:03.539479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:03.544410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:03.549121 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cddc5b0-6a96-4ea7-91fc-ef61f057cfa6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1291 microversion: 2.25 time: 0.400259 Sep 13 16:38:03.554624 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1084/2055] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:03 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1291 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:03.559809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b9b9ed8-5f30-42a3-b79b-13793c5de165 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-772772040"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:03.567554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b9b9ed8-5f30-42a3-b79b-13793c5de165 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:38:03.573748 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9b9b9ed8-5f30-42a3-b79b-13793c5de165 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b9b9ed8-5f30-42a3-b79b-13793c5de165 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 56 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: {"createImage": {"name": "tempest-test-snap-772772040"}} Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-772772040'}}} Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.576272 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 13 16:38:03.584862 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.588155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b9b9ed8-5f30-42a3-b79b-13793c5de165 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:03.589043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b9b9ed8-5f30-42a3-b79b-13793c5de165 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.033148 Sep 13 16:38:03.589642 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1085/2056] 10.222.0.61 () {60 vars in 1281 bytes} [Tue Sep 13 16:38:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:03.598889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:03.599514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:03.606952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.607456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.607908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.608625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.609095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.609531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.849918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:03.852182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:03.860221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d689df05-7d8c-4e83-bba9-f906a125bd7d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1528 microversion: 2.1 time: 0.269470 Sep 13 16:38:03.860819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1086/2057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:03 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1528 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:03.874113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:03.874626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:03.894514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.895026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.895469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.896198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.896655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.897093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.924751 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 HTTP/1.1 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5b9b81b0-379e-4779-a21d-6b2ab2e12f78'} Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:03.926362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2003bc7b-c2fc-4624-8670-c56ae1f57ba3 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 404 len: 111 microversion: 2.1 time: 0.066020 Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1087/2058] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:03 2022] DELETE /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:03.936380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:03.940008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.941087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.941638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:03.942303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:03.942750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:03.943185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:04.745768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:04.759749 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca0de51c-ba17-4d51-8e38-28b0dc55ff17 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1469 microversion: 2.1 time: 0.830025 Sep 13 16:38:04.761716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1088/2059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:03 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1469 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:04.772678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:04.783029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] [instance: 5b9b81b0-379e-4779-a21d-6b2ab2e12f78] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:04.784872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:04.805644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:04.810225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:04.820166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:04.822129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:04.822702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:04.825974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:04.830189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:04.899645 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] HTTP exception thrown: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Request method failure captured: Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 HTTP/1.1 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHIF7IxegR2xSy9Y9yf_6yckLCYP1KjR3PHFG-wd6BV7_xIo2VnW8D13CLUpTzuiq8rTvoG1DP4y2QXVeG_mQIEkH82MpFrrvEerFzDMhhof6hyE1t-vwVrO1EHykY2uxnNceid9bQo5sWYhS-M_ZaUPdCkYqaFxljZOPEv_CD489M Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/05bb10d7bc8d4ebca70eb4aa9537c44a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 05bb10d7bc8d4ebca70eb4aa9537c44a Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-333608370 Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1322a8be50b44f14a7b92ab9ebf44c2a Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesNegativeTestJSON-333608370-project Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5b9b81b0-379e-4779-a21d-6b2ab2e12f78'} Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:04.905606 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. Sep 13 16:38:04.910569 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:04.919972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] Returning 404 to user: Instance 5b9b81b0-379e-4779-a21d-6b2ab2e12f78 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:04.921231 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-719f8bfc-76c8-41cb-9ab0-b11f8ac58fb9 tempest-ImagesNegativeTestJSON-333608370 tempest-ImagesNegativeTestJSON-333608370-project] 10.222.0.61 "GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78" status: 404 len: 111 microversion: 2.1 time: 0.158350 Sep 13 16:38:04.928124 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1089/2060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:04 2022] GET /compute/v2.1/servers/5b9b81b0-379e-4779-a21d-6b2ab2e12f78 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:04.954012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:04.956544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:04.974353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:04.974863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:04.975318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:04.976053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:04.978526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:04.978526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:05.430801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:05.454435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ff56e85-bb12-4515-ac7e-33ffab1becf2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.524655 Sep 13 16:38:05.457921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1090/2061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:04 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:05.463738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:05.464548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:05.476577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:05.477321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:05.480098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:05.483282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:05.484854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:05.487727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:05.728069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:05.743623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:05.745437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:05.748729 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-107d438e-c538-4d34-8349-1edbe55c41ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1279 microversion: 2.25 time: 0.289608 Sep 13 16:38:05.750668 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1091/2062] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:05 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1279 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:05.766960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:05.769044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:05.785246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:05.794816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:05.795569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:05.796761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:05.798463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:05.800398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:06.350294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd124267837344e580ca605c2a646736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d1b8d477d0424b924671970921a5e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:06.359705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-811663de-6156-4eb6-818c-2c36dd016ea7 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 200 len: 1486 microversion: 2.1 time: 0.606779 Sep 13 16:38:06.375730 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1092/2063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:05 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 1486 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:06.375730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2a9e90cb-66d2-4fad-9fbd-b10aa5b10a99 req-1a6a1f26-f3e9-46b3-88b9-c0dfc82ff9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c0e9c-0bc9-41bb-a17f-7986492880d5", "name": "network-vif-plugged", "status": "completed", "tag": "55c2916e-ebd6-4dcc-b800-4cf6381fe6b6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:06.379883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2a9e90cb-66d2-4fad-9fbd-b10aa5b10a99 req-1a6a1f26-f3e9-46b3-88b9-c0dfc82ff9a4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:06.380375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2a9e90cb-66d2-4fad-9fbd-b10aa5b10a99 req-1a6a1f26-f3e9-46b3-88b9-c0dfc82ff9a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:06.380793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2a9e90cb-66d2-4fad-9fbd-b10aa5b10a99 req-1a6a1f26-f3e9-46b3-88b9-c0dfc82ff9a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:06.394742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2a9e90cb-66d2-4fad-9fbd-b10aa5b10a99 req-1a6a1f26-f3e9-46b3-88b9-c0dfc82ff9a4 service nova] Creating event network-vif-plugged:55c2916e-ebd6-4dcc-b800-4cf6381fe6b6 for instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 on n-h1-857467-1 Sep 13 16:38:06.401328 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2a9e90cb-66d2-4fad-9fbd-b10aa5b10a99 req-1a6a1f26-f3e9-46b3-88b9-c0dfc82ff9a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039126 Sep 13 16:38:06.402216 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1093/2064] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:06.407568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e95c1882-6d2e-4754-abf6-a282ab8556de req-ca3b32b1-8746-4945-a257-a7cc5ca8a318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85c8c5f-e1c9-4ab0-9777-28472cc8058a", "name": "network-vif-deleted", "tag": "f26fa614-a097-4e7f-abb3-54bf603d278c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:06.422668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e95c1882-6d2e-4754-abf6-a282ab8556de req-ca3b32b1-8746-4945-a257-a7cc5ca8a318 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:06.423236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e95c1882-6d2e-4754-abf6-a282ab8556de req-ca3b32b1-8746-4945-a257-a7cc5ca8a318 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:06.423672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e95c1882-6d2e-4754-abf6-a282ab8556de req-ca3b32b1-8746-4945-a257-a7cc5ca8a318 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:06.439228 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e95c1882-6d2e-4754-abf6-a282ab8556de req-ca3b32b1-8746-4945-a257-a7cc5ca8a318 service nova] Creating event network-vif-deleted:f26fa614-a097-4e7f-abb3-54bf603d278c for instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a on n-h2-857467-1 Sep 13 16:38:06.446390 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e95c1882-6d2e-4754-abf6-a282ab8556de req-ca3b32b1-8746-4945-a257-a7cc5ca8a318 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042703 Sep 13 16:38:06.447230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1094/2065] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:06.453367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:06.454344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:06.461627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:06.462561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:06.463186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:06.464056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:06.464694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:06.465288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:06.778620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:06.792233 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed062479-ffdb-4f05-be12-3315f9205b0a tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 200 len: 1427 microversion: 2.1 time: 0.343436 Sep 13 16:38:06.794940 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1095/2066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:06 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 1427 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:06.805594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:06.806532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:06.828766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:06.831214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:06.832662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:06.845609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:06.847131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:06.852296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:07.146832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:07.163002 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-320a1ac6-ee6d-43ca-8c23-98f77ea0eb7f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.365308 Sep 13 16:38:07.170219 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1096/2067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:06 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:07.191660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:07.196147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:07.220718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:07.223662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:07.224522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:07.226320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:07.226978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:07.227634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:07.595056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:07.610024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:07.613113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:07.614693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d011e3f7-611b-4794-bbc4-0e28af304c9f tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1279 microversion: 2.25 time: 0.443344 Sep 13 16:38:07.615473 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1097/2068] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:07 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1279 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:07.620783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:07.621705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: f85c8c5f-e1c9-4ab0-9777-28472cc8058a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:07.630970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:07.631888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:07.632927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:07.633962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:07.634812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:07.635794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:07.666027 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a could not be found. Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a HTTP/1.1 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a could not be found. Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'f85c8c5f-e1c9-4ab0-9777-28472cc8058a'} Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a could not be found. Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a could not be found. Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:07.669461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a could not be found. Sep 13 16:38:07.674507 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:07.676784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance f85c8c5f-e1c9-4ab0-9777-28472cc8058a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:07.678978 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eef4e349-6830-48af-bf5e-e3d3b27968e0 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a" status: 404 len: 111 microversion: 2.1 time: 0.062299 Sep 13 16:38:07.682352 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1098/2069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:07 2022] GET /compute/v2.1/servers/f85c8c5f-e1c9-4ab0-9777-28472cc8058a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:07.692440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-461da05f-2fcc-4d67-b2b4-f1918ef3cf37 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '.version_select at 0x7fbeb4b2b1f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:12.422797 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-461da05f-2fcc-4d67-b2b4-f1918ef3cf37 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Image not found. Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-461da05f-2fcc-4d67-b2b4-f1918ef3cf37 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c HTTP/1.1 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '25c70330-9442-4903-9e94-66a4d4b3c72c'} Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 25c70330-9442-4903-9e94-66a4d4b3c72c to delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25c70330-9442-4903-9e94-66a4d4b3c72c could not be found. Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:12.426926 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:38:12.432681 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.438407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-461da05f-2fcc-4d67-b2b4-f1918ef3cf37 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:12.439474 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-461da05f-2fcc-4d67-b2b4-f1918ef3cf37 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c" status: 404 len: 62 microversion: 2.1 time: 4.754870 Sep 13 16:38:12.445128 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1099/2070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:07 2022] DELETE /compute/v2.1/images/25c70330-9442-4903-9e94-66a4d4b3c72c => generated 62 bytes in 4761 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:38:12.460183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:12.461322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: 7abc1103-ca94-4e9c-84e1-64c65215f6e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:12.477038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.477975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.479124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.480021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.480571 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6410d221-7b6d-4d22-b6b5-7172368d5677 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 17.647527 Sep 13 16:38:12.488716 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 972/2071] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:37:54 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 17649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:12.488716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:12.488716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:12.492102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.493317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.506655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.510450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.511466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.512352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.513712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.514113 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] HTTP exception thrown: Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 could not be found. Sep 13 16:38:12.516686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Request method failure captured: Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 HTTP/1.1 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILB0s-dlmKeY1xQDRxDQFzpSWDsmNDNeUI6T_w_jcC1GHPuIkQ6qSIBEh93wdebys45i_5KTEVUe2X6k1BrmhoatKm7lYxBHXfV9GUtS7wd8-xHNr9qoQ55TvJFWwK3ajleWQe9rcibGGSPiZgF802yG0m7jpO8ONdOaY7VIdBJ9Obc Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-MigrationsAdminTest-266729152 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-MigrationsAdminTest-266729152-project Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80714f77e8904565bde7dc8e7dce1063 Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-MigrationsAdminTest-266729152-project Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 could not be found. Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '7abc1103-ca94-4e9c-84e1-64c65215f6e7'} Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 could not be found. Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 could not be found. Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:12.516959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 could not be found. Sep 13 16:38:12.523416 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:12.526299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Returning 404 to user: Instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:12.527484 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0820c34b-eb66-4868-89dd-2ae874729017 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7" status: 404 len: 111 microversion: 2.1 time: 0.081077 Sep 13 16:38:12.528841 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1100/2072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:12 2022] GET /compute/v2.1/servers/7abc1103-ca94-4e9c-84e1-64c65215f6e7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:12.549966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c627a57d-d650-434c-ad5a-72386118021a req-6c497657-046e-47fc-a141-20c44f0384ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abc1103-ca94-4e9c-84e1-64c65215f6e7", "name": "network-vif-deleted", "tag": "aa019033-acdd-499a-b7ba-87e4de3dc483"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:12.593614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c627a57d-d650-434c-ad5a-72386118021a req-6c497657-046e-47fc-a141-20c44f0384ed service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.594711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c627a57d-d650-434c-ad5a-72386118021a req-6c497657-046e-47fc-a141-20c44f0384ed service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.595647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c627a57d-d650-434c-ad5a-72386118021a req-6c497657-046e-47fc-a141-20c44f0384ed service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.624332 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c627a57d-d650-434c-ad5a-72386118021a req-6c497657-046e-47fc-a141-20c44f0384ed service nova] Creating event network-vif-deleted:aa019033-acdd-499a-b7ba-87e4de3dc483 for instance 7abc1103-ca94-4e9c-84e1-64c65215f6e7 on n-h2-857467-1 Sep 13 16:38:12.635353 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c627a57d-d650-434c-ad5a-72386118021a req-6c497657-046e-47fc-a141-20c44f0384ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104879 Sep 13 16:38:12.637397 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1101/2073] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:12.646119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:12.652655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:12.670080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.673130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.673582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.678369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.680845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.681321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.796795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:12.808801 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f68abe8-63fa-40f5-a814-6235160db1c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.325597 Sep 13 16:38:12.823051 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 973/2074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:12 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:12.832039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:12.845273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:12.847113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Searching by: {'deleted': False, 'project_id': '1ef9a16f03094174989a3789f779e920'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:38:12.853974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.855013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.855700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.856657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.857349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.858103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.887727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:38:12.939513 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9594e1e-0fd8-4421-b2c9-9d4a5d90d500 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.114094 Sep 13 16:38:12.940600 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 974/2075] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:38:12 2022] GET /compute/v2.1/servers => generated 333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:12.952529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-528a6e65-00b8-4bc4-8f95-3216374b3980 req-c106d3a4-6a1f-4fd6-b60c-3402df09b071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e565faab-08c0-45f9-bf95-00526c197668", "name": "network-vif-plugged", "status": "completed", "tag": "1b19af59-b1ea-4217-b7ff-9214db2d2ffd"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:12.957899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:12.974917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-528a6e65-00b8-4bc4-8f95-3216374b3980 req-c106d3a4-6a1f-4fd6-b60c-3402df09b071 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:12.975728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-528a6e65-00b8-4bc4-8f95-3216374b3980 req-c106d3a4-6a1f-4fd6-b60c-3402df09b071 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:12.976341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-528a6e65-00b8-4bc4-8f95-3216374b3980 req-c106d3a4-6a1f-4fd6-b60c-3402df09b071 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:12.980451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:12.982584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:12.983849 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4602da15-2fb4-437a-b1d0-fa300559e66c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1279 microversion: 2.25 time: 0.343275 Sep 13 16:38:12.984430 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1102/2076] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:12 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1279 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:12.997336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.007336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:13.010990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-528a6e65-00b8-4bc4-8f95-3216374b3980 req-c106d3a4-6a1f-4fd6-b60c-3402df09b071 service nova] Creating event network-vif-plugged:1b19af59-b1ea-4217-b7ff-9214db2d2ffd for instance e565faab-08c0-45f9-bf95-00526c197668 on n-h1-857467-1 Sep 13 16:38:13.017028 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-528a6e65-00b8-4bc4-8f95-3216374b3980 req-c106d3a4-6a1f-4fd6-b60c-3402df09b071 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072452 Sep 13 16:38:13.017320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.018022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 975/2077] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:13.018555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.019508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.020940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.021602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.022337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.024553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.025155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:13.036495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.036996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.037444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.038195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.038661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.039092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.057276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 HTTP/1.1 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6ebce02c-eefa-4082-86de-4185c86906a3'} Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:13.068228 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.073599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:13.075602 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7bc35999-bd11-4f49-ab6f-86a64943443e tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 404 len: 111 microversion: 2.1 time: 0.089833 Sep 13 16:38:13.078939 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1103/2078] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:12 2022] DELETE /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:13.090182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.096862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:13.097972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Searching by: {'deleted': False, 'project_id': '1ef9a16f03094174989a3789f779e920'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:38:13.108387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.108986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.109432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.110394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.110868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.111440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.119792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:38:13.146976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:38:13.216134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:13.228741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.229170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.229594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.328468 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7b2921e2-8798-472b-aa9a-0ea7259eaaa4 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 204 len: 0 microversion: 2.1 time: 0.306323 Sep 13 16:38:13.331154 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 976/2079] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:13 2022] DELETE /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:13.341891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.348151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 6ebce02c-eefa-4082-86de-4185c86906a3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:13.363521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.364066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.364479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.365215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.371042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.371689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.409236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 HTTP/1.1 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6ebce02c-eefa-4082-86de-4185c86906a3'} Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.418934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. Sep 13 16:38:13.425072 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:13.427419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance 6ebce02c-eefa-4082-86de-4185c86906a3 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:13.428518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a383c8d-61d7-4b7d-9ba1-00d3dd517a44 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3" status: 404 len: 111 microversion: 2.1 time: 0.096219 Sep 13 16:38:13.429344 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 977/2080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:13 2022] GET /compute/v2.1/servers/6ebce02c-eefa-4082-86de-4185c86906a3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:13.434893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.435868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:13.444118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.444973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.446038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.446835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.447591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.448268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.601341 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3befb6b-598b-4492-84bd-0948152af334 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.523747 Sep 13 16:38:13.626084 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1104/2081] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:38:13 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:13.638607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bfcfd67f-a8fc-414d-bc20-61c57334628d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '.version_select at 0x7fbeb4b3b1f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.684724 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bfcfd67f-a8fc-414d-bc20-61c57334628d tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754295719" status: 202 len: 0 microversion: 2.1 time: 0.057270 Sep 13 16:38:13.685745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1105/2082] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754295719 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:13.699273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23955da1-049a-48ad-ba8e-976a514ce2dc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb95cd550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.763633 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23955da1-049a-48ad-ba8e-976a514ce2dc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1414 microversion: 2.1 time: 0.076467 Sep 13 16:38:13.765174 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1106/2083] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:13 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:13.776927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d60f575c-e152-4bad-a749-a1c3eed2527b tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.793450 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d60f575c-e152-4bad-a749-a1c3eed2527b tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026186 Sep 13 16:38:13.799317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1107/2084] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:38:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:13.808274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:13.822205 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bfd59db-36d7-4fdd-89a3-01e94014af25 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1468 microversion: 2.1 time: 0.391407 Sep 13 16:38:13.832608 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 978/2085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:13 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1468 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:13.845852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:13.845852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:13.862898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.863608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.864873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:13.866657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:13.870058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:13.870779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.015847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.016741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:14.030281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.031861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.035693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.038734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.039897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.041930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.257767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:14.268988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e80daeb-6705-40df-8661-5b470bcf0b64 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.432988 Sep 13 16:38:14.269813 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1108/2086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:13 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:14.277683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.282737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:14.300189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.302270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.302953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.306362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.307325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.308735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.353071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:38:14.429213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:14.447498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:14.450083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:14.451541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c515961-65d5-4bec-8c37-b3477dc299ef tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1279 microversion: 2.25 time: 0.441670 Sep 13 16:38:14.452668 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 979/2087] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:14 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1279 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:14.551192 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8ef2618c-2be7-436a-bf39-c63b4d85f073 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 204 len: 0 microversion: 2.1 time: 0.276387 Sep 13 16:38:14.552389 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1109/2088] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:14 2022] DELETE /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:14.563488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.564388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:14.572064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.572850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.573455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.574525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.575200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.575796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.781683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c8170e3-04c2-4b0b-995c-45465ed3439d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb9759040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.812584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:14.824943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0af61c3-8877-445b-82a0-996fdb9c59da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1699 microversion: 2.1 time: 0.266479 Sep 13 16:38:14.834008 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 980/2089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:14 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1699 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:14.850677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c8170e3-04c2-4b0b-995c-45465ed3439d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1423 microversion: 2.1 time: 0.074239 Sep 13 16:38:14.852016 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1110/2090] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:14 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:14.856827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.857442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:14.866866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb5e324f-a6f6-4232-9581-db3848ad0e66 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4aa0040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.873278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.874069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.874772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.875660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:14.876284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:14.877017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:14.933375 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb5e324f-a6f6-4232-9581-db3848ad0e66 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 200 len: 1423 microversion: 2.1 time: 0.071529 Sep 13 16:38:14.934288 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1111/2091] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:14 2022] GET /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 1423 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:14.939436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd5eef9c-8596-4e44-9adf-b8c0903defdb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '.version_select at 0x7fbeb95d13a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:14.965084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-bd5eef9c-8596-4e44-9adf-b8c0903defdb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Image not found. Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd5eef9c-8596-4e44-9adf-b8c0903defdb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/20d0ebee-9c24-4a74-a3b0-e7b461684596 HTTP/1.1 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '20d0ebee-9c24-4a74-a3b0-e7b461684596'} Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 20d0ebee-9c24-4a74-a3b0-e7b461684596 to delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20d0ebee-9c24-4a74-a3b0-e7b461684596 could not be found. Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:14.967295 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:38:14.972589 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:14.976339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd5eef9c-8596-4e44-9adf-b8c0903defdb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:14.977221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd5eef9c-8596-4e44-9adf-b8c0903defdb tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/images/20d0ebee-9c24-4a74-a3b0-e7b461684596" status: 404 len: 62 microversion: 2.1 time: 0.041801 Sep 13 16:38:14.977793 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1112/2092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:14 2022] DELETE /compute/v2.1/images/20d0ebee-9c24-4a74-a3b0-e7b461684596 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:38:14.983954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7e6d9a8-1f17-4338-a06e-cf03aa714210 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4a9d0d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:15.240833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:15.254356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a484af8b-322a-4969-b4ae-a8ca68bbf348 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1468 microversion: 2.1 time: 0.401461 Sep 13 16:38:15.270773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 981/2093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:14 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1468 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:15.278016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:15.278772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:15.287712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:15.288395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:15.289217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:15.290270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:15.293625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:15.294375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:15.311870 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 HTTP/1.1 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667'} Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:15.314194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:15.319294 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:15.326911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:15.326911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-57fb9ed8-7139-4469-9765-bc3a7f5fa295 tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 404 len: 111 microversion: 2.1 time: 0.050610 Sep 13 16:38:15.326911 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 982/2094] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:15 2022] DELETE /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:15.333903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:15.334844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:15.348158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:15.349247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:15.350001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:15.351684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:15.352385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:15.353073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:15.905408 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7e6d9a8-1f17-4338-a06e-cf03aa714210 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 204 len: 0 microversion: 2.1 time: 0.924431 Sep 13 16:38:15.908198 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1113/2095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:14 2022] DELETE /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:15.915262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:15.916308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] [instance: 3077469c-eab1-4d60-bc5b-5dd44d7de667] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:15.941109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:15.945419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:15.946729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:15.954841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:15.957454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:15.959065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.000447 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] HTTP exception thrown: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Request method failure captured: Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 HTTP/1.1 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFbW0ukCCoJ3jXXT-ODJva3WR8GjgZh1KwKDT8y_xk8iAEYNMOipizNgp-J1y0Z5O6FQYWkN_xAlvOM2KbFJSYw_m66ghtBCpZTRHG_hzXRYtYoGK0kAEX0nNGaIm_v4a_bmoamPdhctVEPX3w8cdsqkwHcHTG9i2Vcigvv1-PlXy8 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c8d1b8d477d0424b924671970921a5e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c8d1b8d477d0424b924671970921a5e5 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fd124267837344e580ca605c2a646736 Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167632992-project Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3077469c-eab1-4d60-bc5b-5dd44d7de667'} Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:16.007645 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] Returning 404 to user: Instance 3077469c-eab1-4d60-bc5b-5dd44d7de667 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:16.012298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d0ac0a1-09f1-43f3-afbc-7b5cd7588cbf tempest-ImagesOneServerNegativeTestJSON-1167632992 tempest-ImagesOneServerNegativeTestJSON-1167632992-project] 10.222.0.61 "GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667" status: 404 len: 111 microversion: 2.1 time: 0.099063 Sep 13 16:38:16.016131 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1114/2096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:15 2022] GET /compute/v2.1/servers/3077469c-eab1-4d60-bc5b-5dd44d7de667 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:16.036536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:16.037179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:16.077619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.078080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.078535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.079277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.081499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.081969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.159128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:16.300017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:16.308720 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c613734e-e743-4ba2-a2a7-062abcf67205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1322 microversion: 2.1 time: 0.979514 Sep 13 16:38:16.309655 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 983/2097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:15 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1322 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:16.315346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7149da63-09e0-485e-94cd-7389c10ecb64 req-36f4ab3e-8074-426c-a5ee-0063ba0f4351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e6ef02-b609-4ab1-8243-f5edaa26853a", "name": "network-vif-plugged", "status": "completed", "tag": "09b632a7-4797-475c-94b8-697071578c72"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:16.326086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7149da63-09e0-485e-94cd-7389c10ecb64 req-36f4ab3e-8074-426c-a5ee-0063ba0f4351 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.326832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7149da63-09e0-485e-94cd-7389c10ecb64 req-36f4ab3e-8074-426c-a5ee-0063ba0f4351 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.327282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7149da63-09e0-485e-94cd-7389c10ecb64 req-36f4ab3e-8074-426c-a5ee-0063ba0f4351 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.359162 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7149da63-09e0-485e-94cd-7389c10ecb64 req-36f4ab3e-8074-426c-a5ee-0063ba0f4351 service nova] Creating event network-vif-plugged:09b632a7-4797-475c-94b8-697071578c72 for instance 51e6ef02-b609-4ab1-8243-f5edaa26853a on n-h2-857467-1 Sep 13 16:38:16.374183 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7149da63-09e0-485e-94cd-7389c10ecb64 req-36f4ab3e-8074-426c-a5ee-0063ba0f4351 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058091 Sep 13 16:38:16.374842 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 984/2098] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:16.387773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:16.388536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:16.404061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.411447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.412325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.414910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.416779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.417992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.670719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:16.687691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:16.692666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:16.693880 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e873939-cb79-4d78-8654-a9ae3f2f06a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1279 microversion: 2.25 time: 0.675045 Sep 13 16:38:16.694513 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1115/2099] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:16 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1279 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:16.725613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:16.729574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:16.737363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.738395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.739055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.739966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:16.741231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:16.742046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:16.805952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:38:17.015358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61756ef9-e0c7-408c-81c5-de65002d61bb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 204 len: 0 microversion: 2.1 time: 0.303158 Sep 13 16:38:17.019344 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1116/2100] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:38:16 2022] DELETE /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:17.039924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:17.041283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:17.065344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:17.069093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:17.069759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:17.070716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:17.071350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:17.071948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:17.178334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:17.178730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:17.179485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:17.180121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lazy-loading 'fault' on Instance uuid f0272cbd-8228-4707-9a6b-8781acb6cde6 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:17.207134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:17.228620 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7565851c-1a39-409d-8227-322a4ceb2308 tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1699 microversion: 2.1 time: 0.852352 Sep 13 16:38:17.229227 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 985/2101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:16 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1699 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:17.262841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-390146b6-753a-457a-8ee6-3272e68679f5 req-cc15b031-2000-44c7-aa48-8776ff7f8e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0272cbd-8228-4707-9a6b-8781acb6cde6", "name": "network-vif-deleted", "tag": "3e05a151-0e1f-45e9-b3a0-919f9626ba5c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:17.277471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:17.294726 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a0ca077-ae7d-472f-81ac-a5a59a637f49 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1302 microversion: 2.1 time: 0.272716 Sep 13 16:38:17.295308 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1117/2102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:17 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1302 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:17.313662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-390146b6-753a-457a-8ee6-3272e68679f5 req-cc15b031-2000-44c7-aa48-8776ff7f8e28 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:17.335386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:17.336008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:17.336522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-390146b6-753a-457a-8ee6-3272e68679f5 req-cc15b031-2000-44c7-aa48-8776ff7f8e28 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:17.337315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-390146b6-753a-457a-8ee6-3272e68679f5 req-cc15b031-2000-44c7-aa48-8776ff7f8e28 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:17.347658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:17.348137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:17.348579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:17.349300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:17.349757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:17.351885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:17.395320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-390146b6-753a-457a-8ee6-3272e68679f5 req-cc15b031-2000-44c7-aa48-8776ff7f8e28 service nova] Creating event network-vif-deleted:3e05a151-0e1f-45e9-b3a0-919f9626ba5c for instance f0272cbd-8228-4707-9a6b-8781acb6cde6 on n-h1-857467-1 Sep 13 16:38:17.410638 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-390146b6-753a-457a-8ee6-3272e68679f5 req-cc15b031-2000-44c7-aa48-8776ff7f8e28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159044 Sep 13 16:38:17.411369 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 986/2103] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:17.434905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-52998524", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "179fb6ca-f6bf-4d09-a618-632e7e778e62"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:17.568972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] validate_networks() for [('179fb6ca-f6bf-4d09-a618-632e7e778e62', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:17.924579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:17.942398 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-efde8bd5-e55d-4a00-ac91-c1eb1d691deb tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1516 microversion: 2.1 time: 0.611975 Sep 13 16:38:17.943161 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1118/2104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:17 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1516 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:17.967484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:17.970404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:18.005095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:18.005609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:18.006077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:18.006797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:18.007253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:18.007877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:18.277099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:18.290562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:18.292564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:18.293943 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ddc039cb-0529-40d7-86ab-106350998664 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1279 microversion: 2.25 time: 0.347873 Sep 13 16:38:18.295776 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1119/2105] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:17 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1279 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:18.320745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:18.328540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:18.343046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:18.343599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:18.344048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:18.352599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:18.355337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:18.355800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:18.436041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'flavor' on Instance uuid e565faab-08c0-45f9-bf95-00526c197668 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:18.718665 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87e9b20b-0b82-4085-a8fb-f9c135bc5d96 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action" status: 200 len: 32 microversion: 2.1 time: 0.419734 Sep 13 16:38:18.718665 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1120/2106] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:18 2022] POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:38:18.728535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:18.733285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:18.735758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:18.755565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:18.756225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:18.758588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:18.763673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:18.765082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:18.772167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:19.127623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5a13c6d9196461eab07a95626c2858b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef9a16f03094174989a3789f779e920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:19.139167 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42e5c12d-f41e-4cee-bbd5-7aa5623f720f tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 200 len: 1631 microversion: 2.1 time: 0.418877 Sep 13 16:38:19.143470 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1121/2107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:18 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 1631 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:19.162449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:19.163074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:19.194235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:19.199098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:19.199509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:19.200312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:19.200785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:19.205058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:19.284052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:19.294765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:19.295404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:19.296005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lazy-loading 'fault' on Instance uuid f0272cbd-8228-4707-9a6b-8781acb6cde6 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:19.418547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80714f77e8904565bde7dc8e7dce1063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdc043f15794fe6af24d0816bc6a344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:19.428403 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32c9a08f-51f4-423a-a22b-e07da8268729 tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 200 len: 1302 microversion: 2.1 time: 0.282400 Sep 13 16:38:19.438183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1122/2108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:19 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 1302 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:19.444075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:19.445308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:19.459746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:19.460351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:19.460892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:19.461689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:19.462688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:19.465957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:20.578401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:20.594648 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bb7e5acd-501d-4eaa-9ae0-ef8b1e893de3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 1.155191 Sep 13 16:38:20.595502 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1123/2109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:19 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:20.614860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a8374620-7a20-4c93-9804-458eafb7d00e req-492a959f-a35d-4ec6-8c30-d7fc554c179b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4942170b-e2df-40ac-8f82-89f3e1487d14", "name": "network-vif-unplugged", "status": "completed", "tag": "b34e695c-4015-4d7f-8224-cc521758c7fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:20.631501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a8374620-7a20-4c93-9804-458eafb7d00e req-492a959f-a35d-4ec6-8c30-d7fc554c179b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:20.640950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a8374620-7a20-4c93-9804-458eafb7d00e req-492a959f-a35d-4ec6-8c30-d7fc554c179b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:20.641676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a8374620-7a20-4c93-9804-458eafb7d00e req-492a959f-a35d-4ec6-8c30-d7fc554c179b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:20.666454 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a8374620-7a20-4c93-9804-458eafb7d00e req-492a959f-a35d-4ec6-8c30-d7fc554c179b service nova] Creating event network-vif-unplugged:b34e695c-4015-4d7f-8224-cc521758c7fb for instance 4942170b-e2df-40ac-8f82-89f3e1487d14 on n-h1-857467-1 Sep 13 16:38:20.679777 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a8374620-7a20-4c93-9804-458eafb7d00e req-492a959f-a35d-4ec6-8c30-d7fc554c179b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082104 Sep 13 16:38:20.680415 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1124/2110] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:20.690792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:20.693267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:20.715417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:20.716165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:20.716799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:20.717709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:20.718374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:20.718975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.162749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:21.164050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:21.168619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:21.169415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:21.173420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:21.174637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:21.180216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:21.181839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:21.189847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9bafdc90-7504-4ecd-9bac-fae747cda48d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1475 microversion: 2.25 time: 0.506120 Sep 13 16:38:21.190870 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1125/2111] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:20 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1475 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:21.194686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.195202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.195650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.199214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.199785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.200238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.206021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c5d97b16-a007-4d6b-b3ed-49e173369532 req-5e42c096-71f3-4f56-95a2-75029ba602cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b07215b-6675-436b-bddf-67b67935c2e9", "name": "network-vif-deleted", "tag": "a3a68300-329c-47bc-8752-25c4e745cf8e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:21.229789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c5d97b16-a007-4d6b-b3ed-49e173369532 req-5e42c096-71f3-4f56-95a2-75029ba602cf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.231900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:21.234114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c5d97b16-a007-4d6b-b3ed-49e173369532 req-5e42c096-71f3-4f56-95a2-75029ba602cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.234766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c5d97b16-a007-4d6b-b3ed-49e173369532 req-5e42c096-71f3-4f56-95a2-75029ba602cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.243976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for user 67dc5c1abf0649888b406f5911e5e5dd and project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:21.290554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:38:21.293314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:38:21.409783 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fbb5945b-127c-4961-b8e2-5935200a4dbc tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.967251 Sep 13 16:38:21.418084 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 987/2112] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:38:21.428741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:21.429395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] [instance: 8b07215b-6675-436b-bddf-67b67935c2e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:21.451285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.451891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.452360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.453139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.453614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.454105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.485353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] HTTP exception thrown: Instance 8b07215b-6675-436b-bddf-67b67935c2e9 could not be found. Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Request method failure captured: Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 HTTP/1.1 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILF1vqPUnw7cv8bnFvjyPwKJvKSR3cbjtNAZvpFr4yqWkBoSgtHSOO06RD9m_8BVAJFukx3Z4YV4DsOp_ldU_hoZG8x-8tAzjE962PDDV2-P5RNLsi_JHkL-yON7fNRuMOuwjpzRpwl6P8J1ARvHreFX1CNwP6OYiMFA0FCUboGm5Bg Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1ef9a16f03094174989a3789f779e920 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-134068725 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef9a16f03094174989a3789f779e920"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ef9a16f03094174989a3789f779e920"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef9a16f03094174989a3789f779e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ef9a16f03094174989a3789f779e920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-134068725 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1ef9a16f03094174989a3789f779e920 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-134068725 Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-134068725-project Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c5a13c6d9196461eab07a95626c2858b Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-134068725-project Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8b07215b-6675-436b-bddf-67b67935c2e9 could not be found. Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8b07215b-6675-436b-bddf-67b67935c2e9'} Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b07215b-6675-436b-bddf-67b67935c2e9 could not be found. Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b07215b-6675-436b-bddf-67b67935c2e9 could not be found. Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.488347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:21.494925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:21.494925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:21.494925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:21.494925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:21.494925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b07215b-6675-436b-bddf-67b67935c2e9 could not be found. Sep 13 16:38:21.494925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.498119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Returning 404 to user: Instance 8b07215b-6675-436b-bddf-67b67935c2e9 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:21.503368 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d13aa3a7-f076-4462-9050-5344a1adb7da tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9" status: 404 len: 111 microversion: 2.1 time: 0.088688 Sep 13 16:38:21.531406 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 988/2113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:21 2022] GET /compute/v2.1/servers/8b07215b-6675-436b-bddf-67b67935c2e9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:21.545922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:21.547383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] [instance: f0272cbd-8228-4707-9a6b-8781acb6cde6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:21.563740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.566533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.567150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.572938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:21.573893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:21.574612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:21.624341 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] HTTP exception thrown: Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 could not be found. Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Request method failure captured: Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 HTTP/1.1 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILB0s-dlmKeY1xQDRxDQFzpSWDsmNDNeUI6T_w_jcC1GHPuIkQ6qSIBEh93wdebys45i_5KTEVUe2X6k1BrmhoatKm7lYxBHXfV9GUtS7wd8-xHNr9qoQ55TvJFWwK3ajleWQe9rcibGGSPiZgF802yG0m7jpO8ONdOaY7VIdBJ9Obc Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbdc043f15794fe6af24d0816bc6a344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MigrationsAdminTest-266729152 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: fbdc043f15794fe6af24d0816bc6a344 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MigrationsAdminTest-266729152 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MigrationsAdminTest-266729152-project Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 80714f77e8904565bde7dc8e7dce1063 Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MigrationsAdminTest-266729152-project Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 could not be found. Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f0272cbd-8228-4707-9a6b-8781acb6cde6'} Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 could not be found. Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 could not be found. Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:21.635308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 could not be found. Sep 13 16:38:21.640107 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:21.642242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] Returning 404 to user: Instance f0272cbd-8228-4707-9a6b-8781acb6cde6 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:21.644675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abc7a7ec-c027-48fd-8a97-c320fc0ddcfe tempest-MigrationsAdminTest-266729152 tempest-MigrationsAdminTest-266729152-project] 10.222.0.61 "GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6" status: 404 len: 111 microversion: 2.1 time: 0.111767 Sep 13 16:38:21.645696 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 989/2114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:21 2022] GET /compute/v2.1/servers/f0272cbd-8228-4707-9a6b-8781acb6cde6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:21.947728 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c5d97b16-a007-4d6b-b3ed-49e173369532 req-5e42c096-71f3-4f56-95a2-75029ba602cf service nova] Creating event network-vif-deleted:a3a68300-329c-47bc-8752-25c4e745cf8e for instance 8b07215b-6675-436b-bddf-67b67935c2e9 on n-h2-857467-1 Sep 13 16:38:21.967287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c5d97b16-a007-4d6b-b3ed-49e173369532 req-5e42c096-71f3-4f56-95a2-75029ba602cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.771309 Sep 13 16:38:21.969510 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1126/2115] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:21.980706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4bf2128e-c3e8-4836-b63a-5d7391b7d6f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:21.981460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4bf2128e-c3e8-4836-b63a-5d7391b7d6f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:22.229595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:22.230295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:22.248145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:22.258248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:22.258756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:22.265983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:22.266494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:22.272740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:22.460296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4bf2128e-c3e8-4836-b63a-5d7391b7d6f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:22.473213 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4bf2128e-c3e8-4836-b63a-5d7391b7d6f0 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1206 microversion: 2.1 time: 0.497459 Sep 13 16:38:22.475220 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1127/2116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:21 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1206 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:22.495888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-71ccc7da-2aa0-4a7a-9409-69e9886e4a4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] Calling method '.version_select at 0x7fbeb4b3b8b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:22.558831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-71ccc7da-2aa0-4a7a-9409-69e9886e4a4c tempest-ServersTestJSON-134068725 tempest-ServersTestJSON-134068725-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135819688" status: 202 len: 0 microversion: 2.1 time: 0.081259 Sep 13 16:38:22.560987 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1128/2117] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135819688 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:22.576512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:22.578997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:22.595259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:22.597554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:22.598454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:22.600783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:22.602930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:22.614088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.128520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:23.170261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 51e6ef02-b609-4ab1-8243-f5edaa26853a {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:23.208480 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9c1cbaf-174b-4d18-a93f-2ba6f8bcc2ed tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1966 microversion: 2.25 time: 1.560229 Sep 13 16:38:23.224288 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 990/2118] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:21 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1966 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:23.229025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2ef6eb4d-1cec-4604-9f84-4150b1e23bae req-b9b33ad9-4877-4c2c-95d5-438d42713d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4942170b-e2df-40ac-8f82-89f3e1487d14", "name": "network-vif-deleted", "tag": "b34e695c-4015-4d7f-8224-cc521758c7fb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:23.245025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:23.256272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4a61289-c5b8-4ad7-b75b-c9f568adfa01 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 0.693893 Sep 13 16:38:23.262193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1129/2119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:22 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:23.274925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:23.275553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:23.294464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2ef6eb4d-1cec-4604-9f84-4150b1e23bae req-b9b33ad9-4877-4c2c-95d5-438d42713d3a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.295070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2ef6eb4d-1cec-4604-9f84-4150b1e23bae req-b9b33ad9-4877-4c2c-95d5-438d42713d3a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.295387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2ef6eb4d-1cec-4604-9f84-4150b1e23bae req-b9b33ad9-4877-4c2c-95d5-438d42713d3a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.307545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.310428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.312910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.314813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.315490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.316653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.342821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2ef6eb4d-1cec-4604-9f84-4150b1e23bae req-b9b33ad9-4877-4c2c-95d5-438d42713d3a service nova] Creating event network-vif-deleted:b34e695c-4015-4d7f-8224-cc521758c7fb for instance 4942170b-e2df-40ac-8f82-89f3e1487d14 on n-h1-857467-1 Sep 13 16:38:23.356233 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2ef6eb4d-1cec-4604-9f84-4150b1e23bae req-b9b33ad9-4877-4c2c-95d5-438d42713d3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130539 Sep 13 16:38:23.361362 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 991/2120] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:23.499850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:23.500557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:23.517735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.518614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.519071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.519781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.520239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.520669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.764017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:23.776648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 51e6ef02-b609-4ab1-8243-f5edaa26853a {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:23.806444 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-83257e4d-6280-4381-a527-6f6fd7292649 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1966 microversion: 2.25 time: 0.542882 Sep 13 16:38:23.807822 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1130/2121] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:23 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1966 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:23.834129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:23.839119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.839660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.840348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.842524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.844031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.844940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.875355 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9eaffc7-f10a-43a9-80fa-1a146786f990 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046599 Sep 13 16:38:23.876379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1131/2122] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Sep 13 16:38:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:38:23.892985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": "auto"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:23.897924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:23.906255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.907126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.909352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.911970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:23.912668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:23.913290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:23.981678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'flavor' on Instance uuid 51e6ef02-b609-4ab1-8243-f5edaa26853a {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:23.993436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:24.008160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-23c74b74-9ba0-4df8-9154-1a2f0bdad0bf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1258 microversion: 2.1 time: 0.511485 Sep 13 16:38:24.011841 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 992/2123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:23 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1258 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:24.026486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Going to try to live migrate instance to n-h1-857467-1 {{(pid=122328) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:38:24.287515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:24.288388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:24.304231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:24.304817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:24.305155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:24.320653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:24.321415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:24.327396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:24.347902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:25.271704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:25.292645 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33d12e89-63a6-43fc-ab9e-5d651cb8a90e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 1.010008 Sep 13 16:38:25.320981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 993/2124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:24 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:25.358790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-816597394", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8a9524ad-1d46-4f6a-be0d-1f61259b0753"}], "block_device_mapping_v2": [{"uuid": "6118ac48-08ad-4e85-8c3c-b6cae9fc2a34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:25.539281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] validate_networks() for [('8a9524ad-1d46-4f6a-be0d-1f61259b0753', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:27.687339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ab6603c-9486-47af-b643-00485ef4e443 tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a/action" status: 202 len: 0 microversion: 2.25 time: 3.798795 Sep 13 16:38:27.688314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1132/2125] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:38:23 2022] POST /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a/action => generated 0 bytes in 3800 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:38:27.693912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:27.694550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:27.708348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:27.710947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:27.711417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:27.713333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:27.714780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:27.715249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:27.890719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:27.903779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c77f95e6-cd43-476e-85af-debb46c271ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1264 microversion: 2.1 time: 0.213826 Sep 13 16:38:27.905037 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1133/2126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:27 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:27.912655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:27.914165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:27.922434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:27.924945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:27.925919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:27.927288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:27.928417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:27.929094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:28.180125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:28.180645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:28.181176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:28.181596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:28.183217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:28.222865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:28.229390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:28.229960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:28.232881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:28.238972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:28.239494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:28.304554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:28.311802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Getting quotas for user 1fdc6602945c46fa98eebf50ea85a86e and project aadc29bce0b24edc80de72d3e6337c10. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:28.430533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:38:28.433852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6118ac48-08ad-4e85-8c3c-b6cae9fc2a34',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:38:28.701272 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6b7a20c-3152-49b1-b6e3-815ae1827534 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.378073 Sep 13 16:38:28.709230 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 994/2127] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:38:28.721748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:28.726580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:28.758303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:28.758933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:28.759236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:28.760040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:28.760507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:28.760955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:29.267046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:29.295203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-237a3539-e6fa-4b5e-9c7f-2a9d3d937f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 1.383842 Sep 13 16:38:29.296095 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1134/2128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:27 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:29.313465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49f31b8f-8eff-486f-8372-7323f2401154 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:29.314162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-49f31b8f-8eff-486f-8372-7323f2401154 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:29.478601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-49f31b8f-8eff-486f-8372-7323f2401154 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:29.515546 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-49f31b8f-8eff-486f-8372-7323f2401154 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1052 microversion: 2.1 time: 0.197369 Sep 13 16:38:29.532849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1135/2129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:29 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1052 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:29.539810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:29.542013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:29.549743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:29.550545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:29.552353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:29.553509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:29.554296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:29.555025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:29.589238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:29.606509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:29.611085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:29.617161 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9188f046-95e2-4cad-a88c-b3a89607aa94 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.901484 Sep 13 16:38:29.621130 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 995/2130] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:28 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:29.826342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4da9790>, body: {"quota_set": {"ram": "5120"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:29.929325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:29.930564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:29.932232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:29.933420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:29.934287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:29.934938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:29.962931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:29.974657 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f87cdd22-65f0-4cc6-b8c4-555b0b1b7df5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.440489 Sep 13 16:38:29.976810 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1136/2131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:29 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:30.018052 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-84926ef3-d5ab-41f5-9e90-15ad98bd6eb5 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48" status: 200 len: 240 microversion: 2.36 time: 0.395472 Sep 13 16:38:30.019423 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 996/2132] 10.222.0.61 () {62 vars in 1303 bytes} [Tue Sep 13 16:38:29 2022] PUT /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48 => generated 240 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:38:30.030123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Calling method '.version_select at 0x7fbeb4a55af0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:30.118259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.118822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.119285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.120069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.120551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.121280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.147289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcad59fa-d0f1-46d9-9553-2dc7934b5436 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48/detail" status: 200 len: 672 microversion: 2.36 time: 0.120830 Sep 13 16:38:30.161623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1137/2133] 10.222.0.61 () {60 vars in 1304 bytes} [Tue Sep 13 16:38:30 2022] GET /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48/detail => generated 672 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:38:30.327478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:30.328680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:30.340430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.341538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.352802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.353423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4aa0430>, body: {"quota_set": {"ram": "2048"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:30.353911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.354283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.354730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.454795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.456196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.456955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.458075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.458761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.459688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.510607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.511168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.511863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.512776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.513256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.513930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.603792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e19bb678-1f90-46a9-bbc7-2936330a1323 tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48?user_id=93a5fd1316424fd4b6a26dfbe7b9002c" status: 200 len: 240 microversion: 2.36 time: 0.254504 Sep 13 16:38:30.605571 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1138/2134] 10.222.0.61 () {62 vars in 1384 bytes} [Tue Sep 13 16:38:30 2022] PUT /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48?user_id=93a5fd1316424fd4b6a26dfbe7b9002c => generated 240 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:38:30.619128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:30.619772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:30.628830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.629533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.629934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.630910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.631383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.631874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.717554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:30.727964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10d362ab-c219-42d1-8809-7dcb931ed8d5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1150 microversion: 2.1 time: 0.121073 Sep 13 16:38:30.740638 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1139/2135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:30 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:30.754535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-406b5832-7ee7-445b-bb82-59a9368190bc tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] Calling method '.version_select at 0x7fbeb95d1310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:30.865526 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-406b5832-7ee7-445b-bb82-59a9368190bc tempest-QuotasAdminTestV236-1382881663 tempest-QuotasAdminTestV236-1382881663-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48?user_id=93a5fd1316424fd4b6a26dfbe7b9002c" status: 200 len: 282 microversion: 2.36 time: 0.123132 Sep 13 16:38:30.875550 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1140/2136] 10.222.0.61 () {60 vars in 1364 bytes} [Tue Sep 13 16:38:30 2022] GET /compute/v2.1/os-quota-sets/5d71267cc69749898cf435b8b81fbd48?user_id=93a5fd1316424fd4b6a26dfbe7b9002c => generated 282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:38:30.883905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:30.884999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:30.894055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.895494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.896214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.898378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:30.899142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:30.900040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:30.909481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:30.927440 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f963c3d5-5323-41a5-b4c9-78e8a7e77862 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 0.604133 Sep 13 16:38:30.929262 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 997/2137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:30 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:31.069933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e69b9749-a2a1-4add-a7c5-59f4678903b3 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4d91790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1604530096", "description": "tempest-description-904479090"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:31.201695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:31.215646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:31.217533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:31.219391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79f391a3-687a-4211-b520-13480149c59b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.341988 Sep 13 16:38:31.220856 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1141/2138] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:30 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:31.241719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:31.243031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:31.249746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:31.250830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:31.251549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:31.254075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:31.254714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:31.255422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:31.419753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:31.431661 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fb06619e-ce80-4f6b-90c0-57de5b72b045 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.209378 Sep 13 16:38:31.432796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1142/2139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:31 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:31.756165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:31.757067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:31.769198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:31.770291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:31.771196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:31.772147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:31.773701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:31.774758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:31.949571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:31.971918 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-37ea4e26-6e7c-45fc-9bb1-39b02f0a3d71 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1168 microversion: 2.1 time: 0.220226 Sep 13 16:38:31.972556 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1143/2140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:31 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1168 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:31.997143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:31.997858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:32.006629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:32.007147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:32.007649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:32.008501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:32.009213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:32.009685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:32.445975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:32.465481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-74a94a6a-04fe-42e6-8a51-33eb8d5b6139 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 0.472721 Sep 13 16:38:32.466825 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1144/2141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:31 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:32.480201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:32.482419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:32.500075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:32.504834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:32.506176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:32.507158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:32.510365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:32.512629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:32.734808 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e69b9749-a2a1-4add-a7c5-59f4678903b3 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.803283 Sep 13 16:38:32.736741 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 998/2142] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:32.742848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:32.743714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:32.764025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:32.766322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:32.767053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:32.769694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:32.770461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:32.772363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:32.958234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:32.970816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:32.972275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:32.973463 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-24029f85-d83d-4e8a-ad48-1b535b95f6a8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.505304 Sep 13 16:38:32.976213 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1145/2143] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:32 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:32.997890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9c987301-e8d9-462e-9c43-a4b23e3d89a1 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb95d1ee0>, body: {"security_group_rule": {"parent_group_id": "d610a774-6907-4390-a35a-641a7d3e16e4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:33.459687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:33.477373 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f2c3c28-b7ea-4e9b-b51d-9c82cb8bb3b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.738688 Sep 13 16:38:33.480445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 999/2144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:32 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:33.499198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:33.500163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:33.506699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:33.525575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:33.527652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:33.529536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:33.532647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:33.534345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:33.537396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:33.758234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:33.769903 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-017ca42f-79d1-45a6-8095-e0c8417a04f3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1168 microversion: 2.1 time: 0.287790 Sep 13 16:38:33.774306 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1000/2145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:33 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:33.796341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:33.799980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:33.820588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:33.822642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:33.824423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:33.826841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:33.827963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:33.833940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9c987301-e8d9-462e-9c43-a4b23e3d89a1 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.856255 Sep 13 16:38:33.835558 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1146/2146] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:38:32 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:33.836017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:33.852193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd19874a-4bee-45b8-adb8-867ede6d3e57 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4a55790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-138504787", "description": "tempest-description-1065005084"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:35.096284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:35.114675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b192f819-caba-4dea-8dec-f12b004d52a6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 1.334101 Sep 13 16:38:35.133274 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1001/2147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:33 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:35.138755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:35.147644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:35.193014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:35.195363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:35.197012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:35.198196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:35.200899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:35.201635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:35.232735 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd19874a-4bee-45b8-adb8-867ede6d3e57 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.386744 Sep 13 16:38:35.234511 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1147/2148] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:35.240276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-810128bc-2f50-4bd7-84c4-84c24ac60705 req-660bb225-efa5-41cf-9337-70e4179a01e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5acb43c-b494-4f96-bafe-5c7a5abe2da7", "tag": "1b050886-148d-4c64-8575-77ab36441284"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:35.265816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-810128bc-2f50-4bd7-84c4-84c24ac60705 req-660bb225-efa5-41cf-9337-70e4179a01e7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:35.268168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-810128bc-2f50-4bd7-84c4-84c24ac60705 req-660bb225-efa5-41cf-9337-70e4179a01e7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:35.271377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-810128bc-2f50-4bd7-84c4-84c24ac60705 req-660bb225-efa5-41cf-9337-70e4179a01e7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:35.294285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-810128bc-2f50-4bd7-84c4-84c24ac60705 req-660bb225-efa5-41cf-9337-70e4179a01e7 service nova] Creating event network-changed:1b050886-148d-4c64-8575-77ab36441284 for instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 on n-h2-857467-1 Sep 13 16:38:35.309510 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-810128bc-2f50-4bd7-84c4-84c24ac60705 req-660bb225-efa5-41cf-9337-70e4179a01e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072785 Sep 13 16:38:35.315300 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1148/2149] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:35.331089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:35.332214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:35.351828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:35.352913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:35.353892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:35.354911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:35.357990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:35.362710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:35.925250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:35.934964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:35.945973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:35.947564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e03c7e7d-d9cc-41c7-9d30-ea4c8296f44d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.812900 Sep 13 16:38:35.949667 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1002/2150] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:35 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:35.959572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:35.988603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:36.016234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:36.030265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:36.031201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:36.032526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:36.033219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:36.034287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:36.549499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:36.562425 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff7ed550-d543-4135-9f21-6fd64b2d21bc tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1210 microversion: 2.1 time: 0.607962 Sep 13 16:38:36.568408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1003/2151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:35 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1210 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:36.573459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-25fbeb54-9fbc-4074-8c7a-ac8b92cf816a tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbbee0>, body: {"security_group_rule": {"parent_group_id": "98f5e5e8-3397-485b-893e-7d85112e7155", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:36.617640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:36.635617 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-05650dac-0790-4870-b847-7dc7230bc76c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 1.318588 Sep 13 16:38:36.636599 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1149/2152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:35 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:36.641736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:36.642395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:36.659440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:36.659965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:36.660452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:36.661114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:36.661585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:36.662067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:37.294422 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-25fbeb54-9fbc-4074-8c7a-ac8b92cf816a tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.724555 Sep 13 16:38:37.295168 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1004/2153] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:38:36 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:37.301987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:37.306750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:37.325080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:37.327370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:37.329811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:37.333371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:37.336766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:37.339733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:37.652633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:37.677573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:37.687849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:37.689404 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d52bed60-4047-4a26-8e22-93f93e0bbda3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.392843 Sep 13 16:38:37.692496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1005/2154] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:37 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:37.701790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ec7284d-3b87-4702-88a3-59d85634b019 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbbc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1625397448", "description": "tempest-description-1043458534"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:37.818690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:37.845099 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd6f00f2-d1ab-4b3b-ae73-f7b2a12b706b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 1.207290 Sep 13 16:38:37.845718 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1150/2155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:36 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:37.867716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:37.868350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:37.883184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:37.883695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:37.884140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:37.884855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:37.885322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:37.885761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:37.920241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:38.116134 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ec7284d-3b87-4702-88a3-59d85634b019 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.421066 Sep 13 16:38:38.116644 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1006/2156] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:37 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:38.138463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:38.144358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:38.158920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.159981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.160278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:38.161226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.163008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.163499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:38.314107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:38.335723 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2de0c886-b991-4e4a-ba77-0957456ecb89 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1210 microversion: 2.1 time: 0.476657 Sep 13 16:38:38.339110 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1151/2157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:37 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1210 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:38.347816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-efd69be9-f218-4d8f-b545-c47005947c13 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb96fb310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1889290548", "description": "tempest-description-2103755855"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:38.392087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:38.415932 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2384675-0d09-499a-a3ec-d6e4c1061dcf tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.295812 Sep 13 16:38:38.416544 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1007/2158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:38 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:38.425641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1434378c-e1a8-469b-b31a-cac896012a9f req-11656e7f-def7-4680-a5f5-cff35626d6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa012e4d-50f0-4820-b7fe-39152d3710c5", "tag": "f1cdf295-3265-4032-9f1e-693658cfcee9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:38.447275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1434378c-e1a8-469b-b31a-cac896012a9f req-11656e7f-def7-4680-a5f5-cff35626d6fd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.452410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1434378c-e1a8-469b-b31a-cac896012a9f req-11656e7f-def7-4680-a5f5-cff35626d6fd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.454634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1434378c-e1a8-469b-b31a-cac896012a9f req-11656e7f-def7-4680-a5f5-cff35626d6fd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:38.475015 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1434378c-e1a8-469b-b31a-cac896012a9f req-11656e7f-def7-4680-a5f5-cff35626d6fd service nova] Creating event network-changed:f1cdf295-3265-4032-9f1e-693658cfcee9 for instance fa012e4d-50f0-4820-b7fe-39152d3710c5 on n-h2-857467-1 Sep 13 16:38:38.480389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1434378c-e1a8-469b-b31a-cac896012a9f req-11656e7f-def7-4680-a5f5-cff35626d6fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062624 Sep 13 16:38:38.486558 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1008/2159] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:38.726208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:38.727969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:38.746715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.747207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.748807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:38.749847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.750321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.750809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:38.935867 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-efd69be9-f218-4d8f-b545-c47005947c13 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.592986 Sep 13 16:38:38.943920 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1152/2160] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:38 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:38.956597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:38.957781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:38.965687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:38.968357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.969452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.970174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:38.971998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:38.972873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:38.973315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:39.439490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:39.450872 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66bbc5c9-92dd-417c-bbeb-0884e61400d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 0.505538 Sep 13 16:38:39.465509 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1153/2161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:38 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:39.479284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b60d4de-67a4-432e-8012-b25183a0e2ed tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb97a20d0>, body: {"security_group_rule": {"parent_group_id": "6b7abbb1-a908-40e0-b811-2f7f76dce84d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c0b81103-37d9-496c-b4a1-33c3ab57a584"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:39.882391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:39.901683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:39.904092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:39.906031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ce933f1-7da4-4193-8933-4e3e14973171 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 1.185121 Sep 13 16:38:39.919133 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1009/2162] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:38 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:38:39.932222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:39.933087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:39.940908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:39.941727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:39.942376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:39.943289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:39.943966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:39.944606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:39.949734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:40.007332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=20 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:40.366617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:40.383713 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee82a02a-0351-45f9-85e3-fef71d4a273a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1210 microversion: 2.1 time: 0.463075 Sep 13 16:38:40.384642 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1010/2163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:39 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1210 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:40.402298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:40.403212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:40.418239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:40.419002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:40.419646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:40.420618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:40.421251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:40.421882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:40.531643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=9 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:40.663100 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b60d4de-67a4-432e-8012-b25183a0e2ed tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.191351 Sep 13 16:38:40.665108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1154/2164] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:38:39 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:40.859104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=24 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:40.979428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab09f402-cabe-4871-895b-876fa944220b tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Calling method '.version_select at 0x7fbeb95d1ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:41.104597 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab09f402-cabe-4871-895b-876fa944220b tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 371 microversion: 2.1 time: 0.436473 Sep 13 16:38:41.110096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1155/2165] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:38:40 2022] GET /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:41.121624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:41.122916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:41.137935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:41.138765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:41.141006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:41.144262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:41.144946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:41.145611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:41.316891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:41.332637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb9229dc-8d65-4a20-b5e7-153f61dfc202 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.946544 Sep 13 16:38:41.345851 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1011/2166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:40 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:41.352974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18dd4ac8-1aac-4fac-a03f-d2b6aa1d73de tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbb8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-764320686", "description": "tempest-description-2020500984"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:41.907340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:41.926964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55fdff76-e39f-49a1-a0fd-97e733c782a3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1522 microversion: 2.1 time: 0.815262 Sep 13 16:38:41.928036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1156/2167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:41 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:41.946610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:41.947908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:41.969120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:41.969634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:41.970105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:41.970834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:41.975082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:41.975541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:42.185201 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-18dd4ac8-1aac-4fac-a03f-d2b6aa1d73de tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.850486 Sep 13 16:38:42.190292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1012/2168] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:42.197992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4d42af0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:42.382233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:42.383512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:42.390876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:42.401121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:42.402607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:42.404147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:42.490617 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d45b7946-7ed3-4707-9cda-94841f7612bd tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 328 microversion: 2.1 time: 0.297847 Sep 13 16:38:42.506206 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1013/2169] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:42 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 328 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:42.512526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:42.513517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:42.521930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:42.523832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:42.524486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:42.525451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:42.526374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:42.527003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:42.742261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:42.759426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:42.761368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:42.764481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0e76550-abeb-48d5-af22-0c85533d21bb tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.834693 Sep 13 16:38:42.789525 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1157/2170] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:41 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:42.799895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23a05437-61a6-44df-a950-feaa7b67e32d tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4afc0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-590829518", "description": "tempest-description-1607165755"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:42.827573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:42.864608 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db56fff2-882c-4316-9f6d-3af2cdd862fd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1210 microversion: 2.1 time: 0.354230 Sep 13 16:38:42.866446 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1014/2171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:42 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1210 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:42.882422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:42.888394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:42.914098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:42.914699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:42.915215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:42.916011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:42.916548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:42.917078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:43.209402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:43.224889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15ab11db-de6a-420c-a2f3-ae4b2b3e06de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.350423 Sep 13 16:38:43.225778 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1015/2172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:42 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:43.248126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23a05437-61a6-44df-a950-feaa7b67e32d tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.455022 Sep 13 16:38:43.250537 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1158/2173] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:43.259961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:43.260658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:43.285672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:43.291157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:43.291869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:43.293239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:43.293725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:43.296143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:43.578083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:43.626171 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3cefa70-dd1f-4986-9b71-9042e8c28e57 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1502 microversion: 2.1 time: 0.371498 Sep 13 16:38:43.630981 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1159/2174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:43 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1502 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:43.638180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-854dd597-c45d-4f70-81de-dee0f22ea4c2 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4b59b80>, body: {"security_group_rule": {"parent_group_id": "3673d6fb-95f1-43d5-a4e5-3376a260e349", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c7dd9059-efea-43e2-a719-910d6f2af38f"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:43.765410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2059592366", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:43.861623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:44.518888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:44.519583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:44.520114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:44.520811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:44.521324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:44.546877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.547659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.548455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.552122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.552940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.553845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.568215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-854dd597-c45d-4f70-81de-dee0f22ea4c2 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.935185 Sep 13 16:38:44.569928 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1160/2175] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:38:43 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:44.577133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:44.581107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:44.605376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.605937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.611052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Getting quotas for project 0e8ef724015d443ba938a5bc4279c2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:44.611656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.614957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.616879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.622290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.629891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Getting quotas for user da3962c0913144328cbe17a8e1599f5c and project 0e8ef724015d443ba938a5bc4279c2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:44.657373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.utils [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] cores quota exceeded for 0e8ef724015d443ba938a5bc4279c2dd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122327) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 13 16:38:44.658663 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Request method failure captured: Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 145 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIOFJBzU50aW8P7P6t1zMIdoDLDit231mPCCSnClNeYR2PdOU-Idp_Ny_tQeInUyizouu5kmJ6G4sqA12Ue3OC7GVegZZHBCbz8gjt0hp_KpjIDLI5U_xzb3EvnhbOaHKVHUYwTVfrQiqNOXF4qoT6555uEpVV0-aX8ER2Hbt6umeQ Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: da3962c0913144328cbe17a8e1599f5c Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2059592366", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2059592366', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452'}}} Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:38:44.674634 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:44.682222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33b8692f-ada1-45d2-95e9-74ea88962242 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.453976 Sep 13 16:38:44.693140 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1016/2176] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:43 2022] POST /compute/v2.1/servers => generated 111 bytes in 1458 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:44.694639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:44.701260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:44.717769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.718622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.719184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.722468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.728524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.729133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.766585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:44.894420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:44.911222 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bcf5599d-65ad-4b0e-a70c-68e15f0b1f4b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1514 microversion: 2.1 time: 0.339394 Sep 13 16:38:44.912585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1161/2177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:44 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:44.924257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:44.925063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:44.943014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.944292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.946287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.948346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:44.949930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:44.950714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:44.963536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:44.974614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:44.976226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:44.977968 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b36c872-3c26-458e-8200-4ea3d16939af tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.292028 Sep 13 16:38:44.988302 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1017/2178] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:44 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:45.002761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:45.003488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:45.012890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:45.013580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:45.014218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:45.015214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:45.015839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:45.016439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:45.227925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:45.238846 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9cdfef4-8dcf-483c-8dbb-3d8c4644d670 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.249136 Sep 13 16:38:45.239967 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1018/2179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:44 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:45.281563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:45.292503 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cff0904e-d02a-46a8-9b1d-cf5b70223d7e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1210 microversion: 2.1 time: 0.378385 Sep 13 16:38:45.306071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1162/2180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:44 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1210 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:45.310969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-abc00bde-03b8-49a7-9ae2-bdd55d00fae9 req-adbc0fa8-0270-4064-802b-8244f114cdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5acb43c-b494-4f96-bafe-5c7a5abe2da7", "name": "network-vif-plugged", "status": "completed", "tag": "1b050886-148d-4c64-8575-77ab36441284"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:45.339257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-abc00bde-03b8-49a7-9ae2-bdd55d00fae9 req-adbc0fa8-0270-4064-802b-8244f114cdf0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:45.343404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-abc00bde-03b8-49a7-9ae2-bdd55d00fae9 req-adbc0fa8-0270-4064-802b-8244f114cdf0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:45.344829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-abc00bde-03b8-49a7-9ae2-bdd55d00fae9 req-adbc0fa8-0270-4064-802b-8244f114cdf0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:45.381574 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-abc00bde-03b8-49a7-9ae2-bdd55d00fae9 req-adbc0fa8-0270-4064-802b-8244f114cdf0 service nova] Creating event network-vif-plugged:1b050886-148d-4c64-8575-77ab36441284 for instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 on n-h2-857467-1 Sep 13 16:38:45.403708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-abc00bde-03b8-49a7-9ae2-bdd55d00fae9 req-adbc0fa8-0270-4064-802b-8244f114cdf0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096225 Sep 13 16:38:45.404563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1163/2181] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:45.410698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13b2c261-e622-4cb6-a78b-612e62e26f46 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4a55550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:45.728783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9b1248c-320f-43da-bbe9-a1cd572cf184 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb4db7dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1392909994", "description": "tempest-description-1858454973"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:45.840413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13b2c261-e622-4cb6-a78b-612e62e26f46 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/c7dd9059-efea-43e2-a719-910d6f2af38f" status: 202 len: 0 microversion: 2.1 time: 0.434483 Sep 13 16:38:45.844938 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1164/2182] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:45 2022] DELETE /compute/v2.1/os-security-groups/c7dd9059-efea-43e2-a719-910d6f2af38f => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:45.857172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb9759c10>, body: {"quota_set": {"cores": 20}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:46.134540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.135035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.135475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.136494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.136962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.137388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.228052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23465a09-4321-4c31-b585-003e0aedfe6c tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 329 microversion: 2.1 time: 0.381913 Sep 13 16:38:46.236137 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1165/2183] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:45 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 329 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:46.241231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2405798d-e9a9-46d8-9b60-8e42c224edf7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:46.244108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2405798d-e9a9-46d8-9b60-8e42c224edf7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 55127076-cb2d-41e6-9521-e2412bf1bff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:46.260806 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2405798d-e9a9-46d8-9b60-8e42c224edf7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Instance 55127076-cb2d-41e6-9521-e2412bf1bff5 could not be found. Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2405798d-e9a9-46d8-9b60-8e42c224edf7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/55127076-cb2d-41e6-9521-e2412bf1bff5/action HTTP/1.1 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 14 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: {"rescue": {}} Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 55127076-cb2d-41e6-9521-e2412bf1bff5 could not be found. Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '55127076-cb2d-41e6-9521-e2412bf1bff5', 'body': {'rescue': {}}} Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55127076-cb2d-41e6-9521-e2412bf1bff5 could not be found. Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55127076-cb2d-41e6-9521-e2412bf1bff5 could not be found. Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:46.267916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:46.272822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:46.272822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:46.272822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:46.272822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:46.272822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55127076-cb2d-41e6-9521-e2412bf1bff5 could not be found. Sep 13 16:38:46.272822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:46.275841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2405798d-e9a9-46d8-9b60-8e42c224edf7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 404 to user: Instance 55127076-cb2d-41e6-9521-e2412bf1bff5 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:46.276960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2405798d-e9a9-46d8-9b60-8e42c224edf7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/55127076-cb2d-41e6-9521-e2412bf1bff5/action" status: 404 len: 111 microversion: 2.1 time: 0.046947 Sep 13 16:38:46.282704 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1166/2184] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:46 2022] POST /compute/v2.1/servers/55127076-cb2d-41e6-9521-e2412bf1bff5/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:46.289701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd310872-85b4-4951-90ea-d74deaa34071 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4afc550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:46.347712 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd310872-85b4-4951-90ea-d74deaa34071 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/3673d6fb-95f1-43d5-a4e5-3376a260e349" status: 200 len: 247 microversion: 2.1 time: 0.062807 Sep 13 16:38:46.358035 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9b1248c-320f-43da-bbe9-a1cd572cf184 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.111429 Sep 13 16:38:46.358997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1167/2185] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:38:46 2022] GET /compute/v2.1/os-security-groups/3673d6fb-95f1-43d5-a4e5-3376a260e349 => generated 247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:46.363595 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1019/2186] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:45 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:46.366583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:46.368816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1809ad9a-33ca-454b-a061-5f6cdfc3e7e8 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Calling method '.version_select at 0x7fbeb4d30af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:46.370045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:46.387564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.388075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.388632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.391694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.392221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.392684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.537364 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1809ad9a-33ca-454b-a061-5f6cdfc3e7e8 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 371 microversion: 2.1 time: 0.169378 Sep 13 16:38:46.543469 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1020/2187] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:38:46 2022] GET /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:46.551496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:46.552436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:46.562622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.563650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.564310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.565983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.566632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.567250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.722737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:46.732451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:46.735938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:46.739095 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82c6f1c3-b7b1-4554-8832-65096e7bf08d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.378360 Sep 13 16:38:46.741416 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1168/2188] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:46 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:46.748006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:46.752789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:46.774768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.775739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.776265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.777111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.777658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.778204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.785974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:46.795916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e90b0788-fa24-4e01-aec1-be88ffd8e013 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1306 microversion: 2.1 time: 0.251533 Sep 13 16:38:46.797477 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1021/2189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:46 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1306 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:46.803796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:46.805608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:46.813101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.813902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.814561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.815781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:46.816459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:46.817180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:46.918177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-efb1d76e-a659-4c09-828e-ff9f9dcbaf9b tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action" status: 202 len: 0 microversion: 2.1 time: 0.173240 Sep 13 16:38:46.923119 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1169/2190] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:46 2022] POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:46.930063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4dcf5da6-d2e2-4fb1-a59a-892b490952b7 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb9759d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1873675680", "description": "tempest-description-649614889"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:47.107885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:47.120215 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b1eb80b-329b-4a4f-99ba-d284e88db0ef tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1210 microversion: 2.1 time: 0.321141 Sep 13 16:38:47.124202 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1022/2191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:46 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1210 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:47.134937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b47926c2-360a-4851-9d8b-ea0b52c231c5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb4d92670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-180676388", "description": "tempest-description-1219111835"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:47.354538 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4dcf5da6-d2e2-4fb1-a59a-892b490952b7 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.429468 Sep 13 16:38:47.365921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1170/2192] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:47.374777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb96ca040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:47.472210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:47.474899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:47.475357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:47.476137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:47.477217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:47.477862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:47.625695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-821ae4c8-3108-49c9-903a-e6bbad9a7cc3 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 328 microversion: 2.1 time: 0.256725 Sep 13 16:38:47.627863 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1171/2193] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:47 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:47.636435 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b47926c2-360a-4851-9d8b-ea0b52c231c5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.510919 Sep 13 16:38:47.637535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:47.638623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:47.646674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1023/2194] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:38:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:47.649355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:47.650925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:47.651542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:47.659634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf0438dc-1ab3-4f05-a57d-5302156522ae tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbb820>, body: {"security_group_rule": {"parent_group_id": "435f7d00-07a7-4797-91f6-a3713825ea5e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:47.661580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:47.662399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:47.663054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:47.926457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:47.935430 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d566300e-4709-4d85-b21e-027f7a2c9c46 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1499 microversion: 2.1 time: 0.304800 Sep 13 16:38:47.936548 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1172/2195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:47 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1499 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:47.942388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:47.943237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:47.958181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:47.958695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:47.959143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:47.959871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:47.960338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:47.960771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:48.152945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:48.175898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:48.178374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:48.182241 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ec160ba-e767-4866-b106-1762e1ce3dc6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.244370 Sep 13 16:38:48.183762 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1173/2196] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:47 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:48.190838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-967757924", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "2daf86d7-598d-4b98-a079-651359bfdcee"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:48.266309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] validate_networks() for [('2daf86d7-598d-4b98-a079-651359bfdcee', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:48.401137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf0438dc-1ab3-4f05-a57d-5302156522ae tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.753123 Sep 13 16:38:48.402231 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1024/2197] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:38:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:48.408264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:48.409923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:48.431545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:48.432733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:48.436724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:48.437772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:48.438534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:48.439203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:48.788944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:48.803521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2771c33c-04af-4b11-958e-a5db05ad3c7d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1486 microversion: 2.1 time: 0.398953 Sep 13 16:38:48.817854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1025/2198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:48 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:48.817854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1204906450", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:48.876319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:48.877100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:48.878433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:48.879899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:48.880741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:48.881086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:48.897361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:48.898385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:48.899261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:48.910905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:48.916361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:48.917359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:48.937128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Getting quotas for project 2677cc7ad9fa426aa14de85453b4b368. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:48.943566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Getting quotas for user 4f79b99f0e814aaebc8e60ab612a58d4 and project 2677cc7ad9fa426aa14de85453b4b368. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:48.960718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:38:48.963201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:38:49.024058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8228dd9c-f7e2-4c00-ad05-b6c3615a394c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838683 Sep 13 16:38:49.030574 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1174/2199] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:38:49.030797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:49.033191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:49.042365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.042873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.043617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.044557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.046086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.047168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.092587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'flavor' on Instance uuid 384c0e9c-0bc9-41bb-a17f-7986492880d5 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:49.108805 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Cannot 'rescue' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state paused Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action HTTP/1.1 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 14 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: {"rescue": {}} Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'rescue' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state paused Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '384c0e9c-0bc9-41bb-a17f-7986492880d5', 'body': {'rescue': {}}} Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 in vm_state paused. Cannot rescue while the instance is in this state. Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state paused Sep 13 16:38:49.115111 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state paused Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 409 to user: Cannot 'rescue' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state paused {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:49.120434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd335cea-a3aa-4be2-9691-f955e615cb15 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action" status: 409 len: 144 microversion: 2.1 time: 0.090286 Sep 13 16:38:49.122312 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1175/2200] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:49 2022] POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action => generated 144 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:38:49.125871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:49.126482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:49.133047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.133527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.133994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.134725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.135276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.135570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.319151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:49.334738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3fe31538-6fd1-44c6-a9f7-a04710b536e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.212264 Sep 13 16:38:49.351782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1176/2201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:49 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:49.357397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22eab455-67b1-4668-9491-c0167432ad50 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Action: 'create', calling method: .version_select at 0x7fbeb4a609d0>, body: {"security_group_rule": {"parent_group_id": "435f7d00-07a7-4797-91f6-a3713825ea5e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:49.475760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:49.476190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:49.476668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:49.477077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:49.477494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:49.493438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.504967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.505810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.517598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.518754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.519375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.558943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Getting quotas for project 0e8ef724015d443ba938a5bc4279c2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:49.565446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Getting quotas for user da3962c0913144328cbe17a8e1599f5c and project 0e8ef724015d443ba938a5bc4279c2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:49.580739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.utils [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] instances quota exceeded for 0e8ef724015d443ba938a5bc4279c2dd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122327) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 13 16:38:49.581318 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Request method failure captured: Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 145 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIOFJBzU50aW8P7P6t1zMIdoDLDit231mPCCSnClNeYR2PdOU-Idp_Ny_tQeInUyizouu5kmJ6G4sqA12Ue3OC7GVegZZHBCbz8gjt0hp_KpjIDLI5U_xzb3EvnhbOaHKVHUYwTVfrQiqNOXF4qoT6555uEpVV0-aX8ER2Hbt6umeQ Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: da3962c0913144328cbe17a8e1599f5c Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1204906450", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1204906450', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452'}}} Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:38:49.583635 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 13 16:38:49.588978 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:49.593875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:49.595429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90468069-e18a-4421-a65e-9e6bb34d0d12 tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.789164 Sep 13 16:38:49.596770 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1026/2202] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:48 2022] POST /compute/v2.1/servers => generated 119 bytes in 792 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:49.603128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:49.606948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:49.617062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.618426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.619197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.620405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.621375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.622189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.706571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lazy-loading 'flavor' on Instance uuid b5acb43c-b494-4f96-bafe-5c7a5abe2da7 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:49.745103 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22eab455-67b1-4668-9491-c0167432ad50 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.387678 Sep 13 16:38:49.746273 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1177/2203] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Sep 13 16:38:49 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:49.764934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca5a7c5c-e199-4ee9-a6e9-7893e4dc8871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:49.767757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca5a7c5c-e199-4ee9-a6e9-7893e4dc8871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:49.850611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca5a7c5c-e199-4ee9-a6e9-7893e4dc8871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:49.855323 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0fd1037c-a874-4a7d-a3bd-56413df5fd24 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7/action" status: 202 len: 0 microversion: 2.1 time: 0.256379 Sep 13 16:38:49.856977 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1027/2204] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:49 2022] POST /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:49.864431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:49.865404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:49.876241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.877102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.878665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.881806 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca5a7c5c-e199-4ee9-a6e9-7893e4dc8871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1215 microversion: 2.1 time: 0.125293 Sep 13 16:38:49.882639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.883476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.884181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.884489 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1178/2205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:49 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:49.891483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:49.892362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:49.902191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.903232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.903854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.905115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:49.905603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:49.906072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:49.993809 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4c9146d-330d-4594-a6ea-a519fa3e39ae tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action" status: 202 len: 0 microversion: 2.1 time: 0.134854 Sep 13 16:38:49.995387 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1028/2206] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:49 2022] POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:50.002171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4dab8b0>, body: {"quota_set": {"instances": 10}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:50.101284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.101990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.102703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.103856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.104553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.105239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.106902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:50.117490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:50.120352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:50.122096 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3024afa-6591-44b0-b269-176bd836d50c tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.236134 Sep 13 16:38:50.123192 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1179/2207] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:49 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:50.130440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab7bdf67-b4ea-4944-b056-1fd6ab139109 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb97599d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:50.184487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-889d31a9-b8e3-49cb-836c-e76c4335e44e tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 329 microversion: 2.1 time: 0.187616 Sep 13 16:38:50.185786 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1029/2208] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:49 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 329 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:50.194943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:50.196920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:50.199994 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab7bdf67-b4ea-4944-b056-1fd6ab139109 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/435f7d00-07a7-4797-91f6-a3713825ea5e" status: 200 len: 664 microversion: 2.1 time: 0.074963 Sep 13 16:38:50.200897 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1180/2209] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:38:50 2022] GET /compute/v2.1/os-security-groups/435f7d00-07a7-4797-91f6-a3713825ea5e => generated 664 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:50.220397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.223036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.223672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.224104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:50.225019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:50.225885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.226587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.227382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.282473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.284659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.289230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.290359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.291157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.294163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.320372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:50.464227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:50.475404 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df3251ae-5aa9-46d7-bd17-9513ad1dfcd8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1494 microversion: 2.1 time: 0.288134 Sep 13 16:38:50.477109 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1030/2210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:50 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1494 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:50.500108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4db7d5f4-7441-491c-b153-5440409685be tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Calling method '.version_select at 0x7fbeb5a00280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:50.604586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:50.609949 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4db7d5f4-7441-491c-b153-5440409685be tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 371 microversion: 2.1 time: 0.131516 Sep 13 16:38:50.610544 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1031/2211] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:38:50 2022] GET /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:50.615859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a274b896-a049-4fa8-b0fa-0d9193507de6 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4dbb430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:50.698072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:50.710374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fee48f1-cd5e-4335-b8d4-4097eec9737d tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1506 microversion: 2.1 time: 0.507750 Sep 13 16:38:50.712418 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1181/2212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:50 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:50.726455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:50.726794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:50.733718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.734352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.734822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.735643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.736175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.736635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.871670 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a274b896-a049-4fa8-b0fa-0d9193507de6 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/c5bcba7f-556a-4b62-be32-28243e2a1a45" status: 202 len: 0 microversion: 2.1 time: 0.259817 Sep 13 16:38:50.874666 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1032/2213] 10.222.0.61 () {58 vars in 1287 bytes} [Tue Sep 13 16:38:50 2022] DELETE /compute/v2.1/os-security-group-rules/c5bcba7f-556a-4b62-be32-28243e2a1a45 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:50.887388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4dbb820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:50.987655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.988848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.989638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:50.990736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:50.991537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:50.992156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.016792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:51.055448 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0fbdfecb-ba1b-4167-a655-b2aa25fbf36f tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 325 microversion: 2.1 time: 0.180388 Sep 13 16:38:51.056753 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1033/2214] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:50 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:51.061816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fcead03-3791-48eb-959c-4fd927d18089 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4dabe50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.067917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9b4a5c3-7cb4-451c-83c2-382a5bc1527c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.345751 Sep 13 16:38:51.087944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1182/2215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:50 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:51.099192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.100161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:51.108564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.109964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.110774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.112982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.114039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.115026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.229678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:51.243701 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c19d4dc7-7dbf-4763-acf0-09d4320feffb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1211 microversion: 2.1 time: 0.152703 Sep 13 16:38:51.245450 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1183/2216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:51 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:51.252570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-746729050", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:51.323234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:51.348334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fcead03-3791-48eb-959c-4fd927d18089 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/435f7d00-07a7-4797-91f6-a3713825ea5e" status: 202 len: 0 microversion: 2.1 time: 0.290111 Sep 13 16:38:51.351702 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1034/2217] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:51 2022] DELETE /compute/v2.1/os-security-groups/435f7d00-07a7-4797-91f6-a3713825ea5e => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:51.358521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.359361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:51.370961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.372024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.372901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.373904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.374686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.375473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.557525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:51.573199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:51.575267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:51.577406 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-57c87279-6ed0-43d2-be87-9c93294a91a3 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.224420 Sep 13 16:38:51.596860 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1035/2218] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:51 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:51.596860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4dab280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.627954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:38:51.628567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Neutron security group c7dd9059-efea-43e2-a719-910d6f2af38f not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:38:51.629637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] HTTP exception thrown: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.629637 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Request method failure captured: Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/c7dd9059-efea-43e2-a719-910d6f2af38f HTTP/1.1 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIG_nqhTgfioPDQduRxvC3XKboc2aGLQZx9F-P_RF3WWAsxFLnjP1yAK-jkVfzNgufJClbPezxzGCH52ZBiRfVb_dQcXZQ4_rmqn57ocMOBa3IOYQoLgSGlKuoUGevoL93DI27S23rAl2ow2jGhpI7VzUEuJQRytroZxQnzonJmxUs Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 8f10faf03a3645c29dc93ff77b00e018 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-568770484 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f10faf03a3645c29dc93ff77b00e018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f10faf03a3645c29dc93ff77b00e018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f10faf03a3645c29dc93ff77b00e018"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f10faf03a3645c29dc93ff77b00e018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupRulesTestJSON-568770484 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 8f10faf03a3645c29dc93ff77b00e018 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-568770484 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupRulesTestJSON-568770484-project Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 7011d412d8ed4e949807368acfc35600 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupRulesTestJSON-568770484-project Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c7dd9059-efea-43e2-a719-910d6f2af38f'} Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:38:51.632180 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Returning 404 to user: Security group c7dd9059-efea-43e2-a719-910d6f2af38f does not exist Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-455167dd-627a-4908-9f6c-be48de3968d8'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1aabc956-d967-42cf-8984-b0dcbc4f6226 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/c7dd9059-efea-43e2-a719-910d6f2af38f" status: 404 len: 194 microversion: 2.1 time: 0.043153 Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1036/2219] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:51 2022] DELETE /compute/v2.1/os-security-groups/c7dd9059-efea-43e2-a719-910d6f2af38f => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:51.640887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.651410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:51.651410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.651410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.651410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.651410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.651946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.652491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.679338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:51.680978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:51.681925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:51.685277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:51.686549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:51.713019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.717738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.718629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.719683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.720527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.722048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.749145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Getting quotas for project 0e8ef724015d443ba938a5bc4279c2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:51.759395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Getting quotas for user da3962c0913144328cbe17a8e1599f5c and project 0e8ef724015d443ba938a5bc4279c2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:51.773568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:51.779498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.utils [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] ram quota exceeded for 0e8ef724015d443ba938a5bc4279c2dd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122328) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 13 16:38:51.780369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Request method failure captured: Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 144 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIOFJBzU50aW8P7P6t1zMIdoDLDit231mPCCSnClNeYR2PdOU-Idp_Ny_tQeInUyizouu5kmJ6G4sqA12Ue3OC7GVegZZHBCbz8gjt0hp_KpjIDLI5U_xzb3EvnhbOaHKVHUYwTVfrQiqNOXF4qoT6555uEpVV0-aX8ER2Hbt6umeQ Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: da3962c0913144328cbe17a8e1599f5c Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-746729050", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-746729050', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452'}}} Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:38:51.784719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 13 16:38:51.790177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:38:51.794915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:51.796257 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46ebf195-fce1-4b5e-9a87-1d2913e69adb tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.549453 Sep 13 16:38:51.797360 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1184/2220] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:51 2022] POST /compute/v2.1/servers => generated 110 bytes in 551 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:51.806477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bdd3880-22b0-4968-8a0e-84ef0296ca6e tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb96fb430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.866355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:51.878245 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51f80e7c-fded-4ef2-9c13-0f5efefa1398 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 200 len: 1477 microversion: 2.1 time: 0.241210 Sep 13 16:38:51.879772 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1037/2221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:51 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:51.893508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:51.894352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:51.903044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.903937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.904389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:51.905111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:51.909993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:51.911265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.107533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:52.118226 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6b99454-c719-427f-9fdd-9e24824feeba tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1506 microversion: 2.1 time: 0.237015 Sep 13 16:38:52.128686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1038/2222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:51 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:52.128686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb7436940>, body: {"quota_set": {"ram": 51200}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:52.206184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.207018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.207467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.208403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.209018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.209446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.275861 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bdd3880-22b0-4968-8a0e-84ef0296ca6e tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/3673d6fb-95f1-43d5-a4e5-3376a260e349" status: 202 len: 0 microversion: 2.1 time: 0.477156 Sep 13 16:38:52.279692 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1185/2223] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:51 2022] DELETE /compute/v2.1/os-security-groups/3673d6fb-95f1-43d5-a4e5-3376a260e349 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:52.285283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-5260743"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:52.288131 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ea5a941-7dff-4e26-90b6-8412f1d65548 tempest-QuotasAdminNegativeTest-590315500 tempest-QuotasAdminNegativeTest-590315500-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 200 len: 329 microversion: 2.1 time: 0.168189 Sep 13 16:38:52.288715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:52.296636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.297387 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1039/2224] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:52 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 329 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:52.297598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.298258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.299182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.300463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.301098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.306530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:52.313304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:52.341126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.342046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.342604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.344495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.345077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.345617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.560591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:52.569726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-948540c8-2b8b-4297-a7bb-75e9f545e77d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.270880 Sep 13 16:38:52.570335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1040/2225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:52 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:52.586263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:52.589780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:52.608008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.609910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.612374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.613404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.615234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.616720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.625217 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a2c3bfd6-b1b6-4764-afd8-501ef8ec7ece tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7/action" status: 202 len: 0 microversion: 2.1 time: 0.344028 Sep 13 16:38:52.626175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1186/2226] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:52 2022] POST /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:38:52.639939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17ffe133-a31e-48d1-bea8-db2de6e5adfb tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb96fbdc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:52.719601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:52.724106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:52.733094 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ae419e8-d9b0-4b81-bce1-91e774b133a7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1211 microversion: 2.1 time: 0.155171 Sep 13 16:38:52.733688 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1041/2227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:52 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1211 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:52.739355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e647fb8-0834-4ab3-bca2-dc9fa68a124e tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Action: 'update', calling method: .version_select at 0x7fbeb4db73a0>, body: {"quota_set": {"ram": 0}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:52.745429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e647fb8-0834-4ab3-bca2-dc9fa68a124e tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'da3962c0913144328cbe17a8e1599f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8ef724015d443ba938a5bc4279c2dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e647fb8-0834-4ab3-bca2-dc9fa68a124e tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Request method failure captured: Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd HTTP/1.1 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 25 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIOFJBzU50aW8P7P6t1zMIdoDLDit231mPCCSnClNeYR2PdOU-Idp_Ny_tQeInUyizouu5kmJ6G4sqA12Ue3OC7GVegZZHBCbz8gjt0hp_KpjIDLI5U_xzb3EvnhbOaHKVHUYwTVfrQiqNOXF4qoT6555uEpVV0-aX8ER2Hbt6umeQ Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e8ef724015d443ba938a5bc4279c2dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 0e8ef724015d443ba938a5bc4279c2dd Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1874072604 Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: da3962c0913144328cbe17a8e1599f5c Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-QuotasAdminNegativeTest-1874072604-project Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: {"quota_set": {"ram": 0}} Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '0e8ef724015d443ba938a5bc4279c2dd', 'body': {'quota_set': {'ram': 0}}} Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:38:52.748006 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 13 16:38:52.754716 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:38:52.756815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e647fb8-0834-4ab3-bca2-dc9fa68a124e tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:38:52.757841 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e647fb8-0834-4ab3-bca2-dc9fa68a124e tempest-QuotasAdminNegativeTest-1874072604 tempest-QuotasAdminNegativeTest-1874072604-project] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd" status: 403 len: 116 microversion: 2.1 time: 0.022785 Sep 13 16:38:52.758792 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1042/2228] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:38:52 2022] PUT /compute/v2.1/os-quota-sets/0e8ef724015d443ba938a5bc4279c2dd => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:38:52.765342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:52.766036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:52.776344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.776939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.777481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.778519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:52.779059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:52.779563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:52.995150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:53.010662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:53.012418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:53.015060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e15296e-1dc8-49a8-b38f-394ad5a0fbf7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.254212 Sep 13 16:38:53.015723 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1043/2229] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:52 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:53.028561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d22fc50-5c06-427b-80f1-4aaa8097c3a1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4dabe50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:53.124006 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d22fc50-5c06-427b-80f1-4aaa8097c3a1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.106518 Sep 13 16:38:53.125349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1044/2230] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:53 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:53.146442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:53.148756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:53.164198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:53.164198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:53.164198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:53.164989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:53.165666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:53.166194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:53.339203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17ffe133-a31e-48d1-bea8-db2de6e5adfb tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/c0b81103-37d9-496c-b4a1-33c3ab57a584" status: 202 len: 0 microversion: 2.1 time: 0.711499 Sep 13 16:38:53.340442 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1187/2231] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:52 2022] DELETE /compute/v2.1/os-security-groups/c0b81103-37d9-496c-b4a1-33c3ab57a584 => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:53.349666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c683acb-9352-4f30-a740-815a43b379b7 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb96ca040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:53.478592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:53.508285 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dff3c921-4569-42f2-bc6e-f89421c7c452 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1506 microversion: 2.1 time: 0.350450 Sep 13 16:38:53.509804 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1045/2232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:53 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:53.607452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:53.608452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:53.636094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:53.637004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:53.641228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:53.646876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:53.649846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:53.650478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:53.883133 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c683acb-9352-4f30-a740-815a43b379b7 tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/6b7abbb1-a908-40e0-b811-2f7f76dce84d" status: 202 len: 0 microversion: 2.1 time: 0.537742 Sep 13 16:38:53.885372 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1188/2233] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:53 2022] DELETE /compute/v2.1/os-security-groups/6b7abbb1-a908-40e0-b811-2f7f76dce84d => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:38:53.891455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:53.892708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:53.902075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:53.910690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:53.911598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:53.913250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:53.914077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:53.914762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:54.023945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:54.038303 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebea41f3-189c-4985-9126-5fcc239db1f1 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1211 microversion: 2.1 time: 0.151459 Sep 13 16:38:54.039079 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1189/2234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:53 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:54.214078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-803409467", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:54.279995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:38:54.293428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:54.302372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d9817d0-a5d9-4fc4-8cfb-31c15a1a2ebd tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.709093 Sep 13 16:38:54.303272 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1046/2235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:53 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:54.319530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34688981-bdfc-46a0-a5e7-f32ff7411f6a tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4cd2ca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:54.560010 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34688981-bdfc-46a0-a5e7-f32ff7411f6a tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/98f5e5e8-3397-485b-893e-7d85112e7155" status: 202 len: 0 microversion: 2.1 time: 0.255590 Sep 13 16:38:54.561092 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1047/2236] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:54 2022] DELETE /compute/v2.1/os-security-groups/98f5e5e8-3397-485b-893e-7d85112e7155 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:54.567361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:54.568438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:54.587486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:54.589303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:54.590106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:54.591121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:54.591819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:54.592894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:54.788319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:54.797320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:54.805346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:54.807145 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4dd31f86-adcc-4853-a9a5-3c60390e5529 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.244510 Sep 13 16:38:54.808294 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1048/2237] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:54 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:54.813609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2abd7f8-6c6a-412c-987a-7bab5f6e10fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cd2d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:54.867899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2abd7f8-6c6a-412c-987a-7bab5f6e10fa tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.057844 Sep 13 16:38:54.869149 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1049/2238] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:54 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:54.874326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:54.875186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:54.883161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:54.884007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:54.884521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:54.885309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:54.885858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:54.886384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.067160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:55.068341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:55.068928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:55.069468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:55.070021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:55.083176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.083776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.084320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.085169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.086024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.086555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.105897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:55.106076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:55.111437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:55.115887 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2113d4d6-57ce-4636-81b9-4b29daa208d9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1506 microversion: 2.1 time: 0.245447 Sep 13 16:38:55.130081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:38:55.130081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:38:55.135747 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1050/2239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:54 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:55.140561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f343367f-8b9d-48e0-9f7f-074864e110fa tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] Calling method '.version_select at 0x7fbeb4d92670>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:55.182459 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1871b2f5-51bf-4d13-a95c-573ef211fb86 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.142012 Sep 13 16:38:55.183112 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1190/2240] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:38:55.187974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:55.188877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:55.197903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.198755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.199483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.200513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.201159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.201702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.302937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:55.322389 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f5b214a5-96e6-4a6f-90bb-1992b209598e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1211 microversion: 2.1 time: 0.131572 Sep 13 16:38:55.325462 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1191/2241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:55 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:55.363843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4007d540-adf2-410f-a358-2f78ab074ed6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:55.364481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4007d540-adf2-410f-a358-2f78ab074ed6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:55.423793 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f343367f-8b9d-48e0-9f7f-074864e110fa tempest-SecurityGroupRulesTestJSON-568770484 tempest-SecurityGroupRulesTestJSON-568770484-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/d610a774-6907-4390-a35a-641a7d3e16e4" status: 202 len: 0 microversion: 2.1 time: 0.286662 Sep 13 16:38:55.429416 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1051/2242] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:38:55 2022] DELETE /compute/v2.1/os-security-groups/d610a774-6907-4390-a35a-641a7d3e16e4 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:38:55.437634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:55.441487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:55.460007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.460686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.461685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.462501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.463101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.465675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.491513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4007d540-adf2-410f-a358-2f78ab074ed6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:55.499752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4007d540-adf2-410f-a358-2f78ab074ed6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1214 microversion: 2.1 time: 0.145095 Sep 13 16:38:55.500361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1192/2243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:55 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:55.805065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:55.818578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0e5331a7-7328-46c8-a81f-88dda8585d42 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.387381 Sep 13 16:38:55.836372 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1052/2244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:55 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:55.837148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:55.837788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:55.848597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.850082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.851952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.854626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:55.856161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:55.858495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:55.885191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c10b1cf-4a62-4ac3-b8c4-0b5b9833dbb7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cd7dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:55.982976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c10b1cf-4a62-4ac3-b8c4-0b5b9833dbb7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.101039 Sep 13 16:38:55.984362 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1053/2245] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:55 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:56.146054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:56.146853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:56.163818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.164854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.165554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.166817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.167709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.168680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.272104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:56.304717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:56.312262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:56.317198 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0ae0ac6-2f83-4823-9e6d-25bbfd74ac62 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.483572 Sep 13 16:38:56.319684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1193/2246] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:55 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:56.349471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:56.350645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:56.358995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.359500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.361456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.365675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.367420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.368728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.465511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:56.476220 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ead5bfe-0f63-48c7-8907-fd49e45f9209 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1514 microversion: 2.1 time: 0.336644 Sep 13 16:38:56.477095 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1054/2247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:56 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:56.528802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:56.529439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:56.557621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.560138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.562168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.566799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.568156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.569467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.603633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:56.620678 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-036dfe88-2829-4bd6-9f51-18a08cd5b8d8 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1267 microversion: 2.1 time: 0.275916 Sep 13 16:38:56.622033 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1194/2248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:56 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:56.684518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:56.711097 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e741487-b6fc-499f-aa59-9f601cbef714 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1218 microversion: 2.1 time: 0.183905 Sep 13 16:38:56.714337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1055/2249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:56 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:56.860097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:56.861535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:56.876330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.877204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.878429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:56.880359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:56.881386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:56.882281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.000638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74df9d33-a785-4116-b708-4e3aac28cc05 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4dbb0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:57.072679 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74df9d33-a785-4116-b708-4e3aac28cc05 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.075745 Sep 13 16:38:57.083325 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1056/2250] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:56 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:57.353717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:57.354460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:57.371833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:57.372398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:57.373227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.379020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:57.380562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:57.381315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.585426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:57.598740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46df68ba-c4e3-4ebf-9926-2c1a7ae11cc3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.754257 Sep 13 16:38:57.619502 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1195/2251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:56 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:57.648081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:57.652055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:57.665673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:57.669295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:57.670609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:57.671061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.671787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:57.672256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:57.672686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.679483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:57.681868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:57.683533 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a308e5d-a30c-4c6b-9148-05a200e5cfd6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.335310 Sep 13 16:38:57.686442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1057/2252] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:57 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:38:57.746017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:57.747688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:57.757847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:57.759827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:57.760539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.761624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:57.762299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:57.762904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:57.915056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:57.927597 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6b014b4b-90ea-4c3d-9fc0-03c34a0aa2eb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1210 microversion: 2.1 time: 0.187821 Sep 13 16:38:57.934144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1058/2253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:57 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:58.063399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:58.079824 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e5e68a25-f3ae-4226-a2dd-2c2774556047 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1267 microversion: 2.1 time: 0.438493 Sep 13 16:38:58.090701 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1196/2254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:57 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1267 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:58.105679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-688676ce-6c0c-43d1-9939-85d7b77ef62d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4c8adc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:58.226450 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-688676ce-6c0c-43d1-9939-85d7b77ef62d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.132188 Sep 13 16:38:58.238098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1059/2255] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:58 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:38:58.572598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-badbdaf8-baa9-4293-855a-35383ad2119e req-16515159-f067-42f9-a890-a574c4f5909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5acb43c-b494-4f96-bafe-5c7a5abe2da7", "name": "network-vif-plugged", "status": "completed", "tag": "1b050886-148d-4c64-8575-77ab36441284"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:58.616708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-badbdaf8-baa9-4293-855a-35383ad2119e req-16515159-f067-42f9-a890-a574c4f5909d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:58.617789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-badbdaf8-baa9-4293-855a-35383ad2119e req-16515159-f067-42f9-a890-a574c4f5909d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:58.618921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-badbdaf8-baa9-4293-855a-35383ad2119e req-16515159-f067-42f9-a890-a574c4f5909d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:58.656704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-badbdaf8-baa9-4293-855a-35383ad2119e req-16515159-f067-42f9-a890-a574c4f5909d service nova] Creating event network-vif-plugged:1b050886-148d-4c64-8575-77ab36441284 for instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 on n-h2-857467-1 Sep 13 16:38:58.671851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-badbdaf8-baa9-4293-855a-35383ad2119e req-16515159-f067-42f9-a890-a574c4f5909d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107254 Sep 13 16:38:58.674333 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1060/2256] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:58.685109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-377243380", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:58.698815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:58.702273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:58.717866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:58.719048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:58.720005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:58.722797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:58.724105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:58.724937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:58.785169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:38:58.785967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:38:58.786651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:38:58.787283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:38:58.788155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:38:58.812784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:58.813256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:58.813700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:58.816138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:58.816853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:58.818508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:58.875577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Getting quotas for project 1fdea39ffdbe456aad11cdf230aa139c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:38:58.896286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Getting quotas for user dd5bc66cc7084c91b41feb66c1a8b442 and project 1fdea39ffdbe456aad11cdf230aa139c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:38:58.916232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:38:58.919191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:38:58.948131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:58.960697 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66d38723-5ee7-4add-9a77-752c14bacfe6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.284795 Sep 13 16:38:58.962000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1061/2257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:58 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:58.966941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-89279077-0340-43a1-9f29-5f2266691b34 req-b8f5350e-1b34-4eda-8a18-0cc31eb94409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e6ef02-b609-4ab1-8243-f5edaa26853a", "name": "network-vif-unplugged", "status": "completed", "tag": "09b632a7-4797-475c-94b8-697071578c72"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:58.991415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89279077-0340-43a1-9f29-5f2266691b34 req-b8f5350e-1b34-4eda-8a18-0cc31eb94409 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:58.992109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89279077-0340-43a1-9f29-5f2266691b34 req-b8f5350e-1b34-4eda-8a18-0cc31eb94409 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:58.992739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89279077-0340-43a1-9f29-5f2266691b34 req-b8f5350e-1b34-4eda-8a18-0cc31eb94409 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.006048 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-accc7422-8f01-403f-b47d-b2dba9de489c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.677306 Sep 13 16:38:59.008141 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1197/2258] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:38:59.016185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:59.017233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:59.026139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.026956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.027597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.028546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.029219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.030039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.032207 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-89279077-0340-43a1-9f29-5f2266691b34 req-b8f5350e-1b34-4eda-8a18-0cc31eb94409 service nova] Creating event network-vif-unplugged:09b632a7-4797-475c-94b8-697071578c72 for instance 51e6ef02-b609-4ab1-8243-f5edaa26853a on n-h2-857467-1 Sep 13 16:38:59.040160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-89279077-0340-43a1-9f29-5f2266691b34 req-b8f5350e-1b34-4eda-8a18-0cc31eb94409 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076645 Sep 13 16:38:59.041878 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1062/2259] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:38:59.090288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:59.091426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:59.101965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.106119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.106922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.107936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.110514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.110968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.282193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.282193 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-125b5c16-bbc0-49c8-91ec-306c793d3edf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1284 microversion: 2.1 time: 0.226139 Sep 13 16:38:59.282193 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1063/2260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:59 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:59.294949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c543aa0-e081-44c9-a1e4-04d88cad0b13 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:59.295093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2c543aa0-e081-44c9-a1e4-04d88cad0b13 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:59.387578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c543aa0-e081-44c9-a1e4-04d88cad0b13 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.397553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c543aa0-e081-44c9-a1e4-04d88cad0b13 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.405278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c543aa0-e081-44c9-a1e4-04d88cad0b13 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.419911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c543aa0-e081-44c9-a1e4-04d88cad0b13 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1452 microversion: 2.91 time: 0.147844 Sep 13 16:38:59.420645 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1064/2261] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:59 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:38:59.430320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:59.430865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:59.451207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.451714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.452159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.452879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.453342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.453766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.620503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.631585 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a20a525-fff9-44ec-9153-a17a3876d037 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1273 microversion: 2.1 time: 0.209444 Sep 13 16:38:59.632187 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1065/2262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:59 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:59.656996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac0e96c9-bf86-4060-bcd2-f8325114af9d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4d30820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:59.745594 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac0e96c9-bf86-4060-bcd2-f8325114af9d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.100729 Sep 13 16:38:59.746314 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1066/2263] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:38:59 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:38:59.761194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:38:59.769111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:38:59.777360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.777984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.778406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.779143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:38:59.779641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:38:59.780082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:38:59.810633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'flavor' on Instance uuid 384c0e9c-0bc9-41bb-a17f-7986492880d5 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:38:59.951076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:38:59.958410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.972620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.981804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:38:59.983576 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4e778e0-d2dc-4ba4-90f3-d79215c766d6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action" status: 200 len: 32 microversion: 2.1 time: 0.230131 Sep 13 16:38:59.984050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1067/2264] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:38:59 2022] POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:38:59.994752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:38:59.995492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:00.000995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcdad56d-afc9-4108-acc1-9c8169fb6ebe tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.974022 Sep 13 16:39:00.003842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.004431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.005118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.007746 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1198/2265] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:38:59 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:00.019895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.020402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.020853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.024200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:00.025022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:00.036991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.040247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.041085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.041883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.047698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.048119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.369118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:00.382087 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71a7cd72-c0f2-4067-90fb-39e8bf945916 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.395740 Sep 13 16:39:00.382706 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1068/2266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:38:59 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:00.411595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:00.412604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:00.428275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.433017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.433498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.435122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.437966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.438442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.570431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:00.581874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e6b8815-fccf-472d-8b09-9ee2f4b01229 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1272 microversion: 2.1 time: 0.193213 Sep 13 16:39:00.590342 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1069/2267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:00 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:00.598685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:00.602647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:00.616558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.617342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.617930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.618825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.619543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.620218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.791577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:00.804868 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-029e0ba0-abf6-4513-aaf5-198a5ba770fa tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.795725 Sep 13 16:39:00.808065 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1199/2268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:00 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:00.811897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:00.838172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:00.838343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:00.839158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:00.847259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:00.848827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.849515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.850963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.852051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:00.852683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:00.853468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:00.870249 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-281bab6d-ccae-4cfb-bcad-4aa656969fcb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1504 microversion: 2.91 time: 0.276821 Sep 13 16:39:00.873742 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1070/2269] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:00 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:00.881597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae51d7c8-257c-4849-8e70-d59aaa903581 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cd7160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:00.962348 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae51d7c8-257c-4849-8e70-d59aaa903581 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.087363 Sep 13 16:39:00.964349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1071/2270] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:00 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:01.025254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e7d59cbf-2343-45bb-ae33-a229994b2219 req-66f2d503-93b7-4e4c-9aa1-b896dd46a511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa012e4d-50f0-4820-b7fe-39152d3710c5", "name": "network-vif-plugged", "status": "completed", "tag": "f1cdf295-3265-4032-9f1e-693658cfcee9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:01.039730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e7d59cbf-2343-45bb-ae33-a229994b2219 req-66f2d503-93b7-4e4c-9aa1-b896dd46a511 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.041229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e7d59cbf-2343-45bb-ae33-a229994b2219 req-66f2d503-93b7-4e4c-9aa1-b896dd46a511 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.041922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e7d59cbf-2343-45bb-ae33-a229994b2219 req-66f2d503-93b7-4e4c-9aa1-b896dd46a511 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.061327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e7d59cbf-2343-45bb-ae33-a229994b2219 req-66f2d503-93b7-4e4c-9aa1-b896dd46a511 service nova] Creating event network-vif-plugged:f1cdf295-3265-4032-9f1e-693658cfcee9 for instance fa012e4d-50f0-4820-b7fe-39152d3710c5 on n-h2-857467-1 Sep 13 16:39:01.068559 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e7d59cbf-2343-45bb-ae33-a229994b2219 req-66f2d503-93b7-4e4c-9aa1-b896dd46a511 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050381 Sep 13 16:39:01.069592 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1072/2271] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:01.076914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:01.078856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:01.091961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.093574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.094576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.099465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.100290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.100968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.374944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:01.388139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0cc1b44-854a-4a82-9b42-a9671ef16624 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1273 microversion: 2.1 time: 0.572419 Sep 13 16:39:01.388740 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1200/2272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:00 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1273 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:01.416030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:01.416669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:01.437013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.437872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.444515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.447416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.450264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.452313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.604961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:01.619784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:01.621603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:01.623773 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15adc676-42c6-472f-b4e8-036f80201f33 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.552700 Sep 13 16:39:01.624622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1073/2273] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:01 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:01.644947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:01.647173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:01.654161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.666622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.667269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.668140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.668716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.669261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.808048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:01.822660 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-245ddab3-efb0-4418-9e34-fe8524199b88 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1272 microversion: 2.1 time: 0.196621 Sep 13 16:39:01.840229 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1074/2274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:01 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:01.863814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2d0081e7-c62f-4339-b3fa-b5649ac5efd0 req-7e9c82f6-bb08-4698-844d-7ea954b89c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e6ef02-b609-4ab1-8243-f5edaa26853a", "tag": "09b632a7-4797-475c-94b8-697071578c72"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:01.883617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d0081e7-c62f-4339-b3fa-b5649ac5efd0 req-7e9c82f6-bb08-4698-844d-7ea954b89c2c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.884419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d0081e7-c62f-4339-b3fa-b5649ac5efd0 req-7e9c82f6-bb08-4698-844d-7ea954b89c2c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.885085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d0081e7-c62f-4339-b3fa-b5649ac5efd0 req-7e9c82f6-bb08-4698-844d-7ea954b89c2c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.901864 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2d0081e7-c62f-4339-b3fa-b5649ac5efd0 req-7e9c82f6-bb08-4698-844d-7ea954b89c2c service nova] Creating event network-changed:09b632a7-4797-475c-94b8-697071578c72 for instance 51e6ef02-b609-4ab1-8243-f5edaa26853a on n-h2-857467-1 Sep 13 16:39:01.907981 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2d0081e7-c62f-4339-b3fa-b5649ac5efd0 req-7e9c82f6-bb08-4698-844d-7ea954b89c2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063023 Sep 13 16:39:01.909815 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1075/2275] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:01.915640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:01.917150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:01.926462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.927364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.928040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.929713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:01.943631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:01.944506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:01.992126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:02.010950 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73e90db0-cd88-40e9-83f2-46fc459fdb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.598702 Sep 13 16:39:02.011976 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1201/2276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:01 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:02.017612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:02.018382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:02.040360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.041060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.041776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:02.042917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.043396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.043842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:02.175387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:02.185340 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b2fecfb-05ad-4c08-ac38-823a0c196403 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.273967 Sep 13 16:39:02.186738 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1076/2277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:01 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:02.192430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40e5de0f-0de7-4bee-8c05-3b21fac6541f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cd2940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:02.217988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:02.273528 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40e5de0f-0de7-4bee-8c05-3b21fac6541f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.084873 Sep 13 16:39:02.274873 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1077/2278] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:02 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:02.381218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:02.410841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:02.416913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:02.417184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:02.417802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:02.419401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:02.427896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.428732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.430389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:02.431273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.432821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.436630 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-71250a93-fab2-4f47-a951-3397e0edecde tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1510 microversion: 2.91 time: 0.423613 Sep 13 16:39:02.437114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:02.439295 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1202/2279] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:02 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:02.661225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:02.662644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:02.684933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.685455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.685941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:02.686697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.687173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.687611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:02.937343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:02.946848 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f118eab-e175-4d9e-ab02-21a362896e0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.534134 Sep 13 16:39:02.954221 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1078/2280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:02 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:02.967533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:02.968171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:02.990870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:02.997211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:02.997739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:02.998734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.003427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.004197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.007303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.122974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.136218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.144287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.149433 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-815fed15-0156-4e9e-8f21-2296dc839c60 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.498835 Sep 13 16:39:03.156322 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1203/2281] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:02 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:03.171579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:03.173660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:03.193612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.196045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.197025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.198439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.201310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.201926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.313589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.327112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12d6e26b-00c8-4d1e-9b03-b76c3c6b42be tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.367610 Sep 13 16:39:03.328391 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1079/2282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:02 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:03.342545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:03.344982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:03.360276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.361153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.365464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.366540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.368649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.369372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.592247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.608012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e238397a-12d0-4474-8c64-c703ff3bca43 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1198 microversion: 2.1 time: 0.450284 Sep 13 16:39:03.609958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1204/2283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:03 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1198 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:03.626243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abb30498-56ef-4339-8766-6f9a503a161e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4b59940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:03.705406 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abb30498-56ef-4339-8766-6f9a503a161e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.094028 Sep 13 16:39:03.710144 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1205/2284] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:03 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:03.720866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:03.726562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:03.732585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.740651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.741150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.741594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.744444 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49a5d0d2-148b-42db-85a8-08c5b3132ab8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.411531 Sep 13 16:39:03.754411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.754411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.754411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.760303 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1080/2285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:03 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:03.912200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.923169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.935022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:03.940780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3fb11254-05c1-4a1f-b988-d85d511b8a76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1510 microversion: 2.91 time: 0.229160 Sep 13 16:39:03.941394 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1206/2286] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:03 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:03.980642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:03.981271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:03.989493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.990160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.990629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:03.991326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:03.992379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:03.992830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.197852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:04.201081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:04.242886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.245403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.245908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.251154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.262539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.267632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.429328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:04.464844 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14edbabd-2412-4bff-8a00-d8de35a007ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.486564 Sep 13 16:39:04.469258 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1081/2287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:03 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:04.489366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:04.493355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:04.508596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.509888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.510368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.511103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.516437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.517818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.743341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:04.771993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:04.776266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:04.781960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76e5bc6e-f876-4ef4-ae57-7b558e41f0de tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.591961 Sep 13 16:39:04.783103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1207/2288] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:04 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:04.804404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:04.805699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:04.823598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:04.825712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.826436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.827018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.827861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.828525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.829096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.839748 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2d4a8440-821f-4f5f-9b89-e48f42cc9b53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.369134 Sep 13 16:39:04.840345 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1082/2289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:04 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:04.864260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bdcddee0-9f4a-4202-b9a2-08aee794ac9a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cbddc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:04.939993 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bdcddee0-9f4a-4202-b9a2-08aee794ac9a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.098588 Sep 13 16:39:04.941613 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1083/2290] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:04 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:04.959970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:04.960710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:04.977002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.977475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.977913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:04.978648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:04.979120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:04.979550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:05.302724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:05.313301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-67d488df-6e46-41a4-a755-7c5baf166a7e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.370536 Sep 13 16:39:05.317022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1084/2291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:04 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:05.334255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:05.334884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:05.346861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:05.360728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:05.361312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:05.361754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:05.363060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:05.363698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:05.363807 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d59a785-c102-47b1-9c94-0d95b917efc9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1380 microversion: 2.1 time: 0.578568 Sep 13 16:39:05.364111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:05.364672 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1208/2292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:04 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1380 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:05.617930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:05.618747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:05.633360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:05.634130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:05.634740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:05.635625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:05.636191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:05.636529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:05.682243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:05.696962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:05.698661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:05.710379 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-493c7334-f673-4969-b211-e7848131d45f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1510 microversion: 2.91 time: 0.392125 Sep 13 16:39:05.732830 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1085/2293] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:05 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:05.748464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:05.752885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:05.770912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:05.771958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:05.773293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:05.774733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:05.776344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:05.778392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:06.251421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87edc670-c841-4aa0-83c6-946dee14fa07 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1531 microversion: 2.1 time: 0.862989 Sep 13 16:39:06.252021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1209/2294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:05 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1531 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:06.265591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-07275fed-61be-4bd9-8a23-252f0cc0db43 req-26ed1d10-c2f3-4cc0-841a-7d81ce2092bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3675b4ed-f67e-4b6d-8637-fa28b6d848d8", "tag": "1b0c2f2f-223b-45b9-9927-448cdd44cf52"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:06.291285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-07275fed-61be-4bd9-8a23-252f0cc0db43 req-26ed1d10-c2f3-4cc0-841a-7d81ce2092bd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:06.293626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-07275fed-61be-4bd9-8a23-252f0cc0db43 req-26ed1d10-c2f3-4cc0-841a-7d81ce2092bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:06.294108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-07275fed-61be-4bd9-8a23-252f0cc0db43 req-26ed1d10-c2f3-4cc0-841a-7d81ce2092bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:06.319671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-07275fed-61be-4bd9-8a23-252f0cc0db43 req-26ed1d10-c2f3-4cc0-841a-7d81ce2092bd service nova] Creating event network-changed:1b0c2f2f-223b-45b9-9927-448cdd44cf52 for instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 on n-h1-857467-1 Sep 13 16:39:06.325076 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-07275fed-61be-4bd9-8a23-252f0cc0db43 req-26ed1d10-c2f3-4cc0-841a-7d81ce2092bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069011 Sep 13 16:39:06.326131 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1210/2295] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:06.336848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:06.337882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:06.345341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:06.346084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:06.347411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:06.348510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:06.349233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:06.349859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:06.596562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:06.616928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33d54c4a-a36c-42a0-a85c-d49f2165d871 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.880199 Sep 13 16:39:06.619754 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1086/2296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:05 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:06.635829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:06.637085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:06.663418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:06.664196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:06.664862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:06.666591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:06.667346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:06.667925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.015755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.027995 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c4b5d2d-c520-45ea-8ad7-5660fb284cf0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.405740 Sep 13 16:39:07.028841 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1087/2297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:06 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:07.044448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76541b8c-93dc-49e1-8d0a-2e22eaaa020a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4d429d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:07.158443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76541b8c-93dc-49e1-8d0a-2e22eaaa020a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.127258 Sep 13 16:39:07.160824 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1088/2298] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:07 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:07.172113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:07.172831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:07.189529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.191945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.192713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.194283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.197319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.197888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.349172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.364478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.370545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.379552 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53077b54-1073-4345-bcb5-68ee0f36d147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 1.043981 Sep 13 16:39:07.384000 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1211/2299] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:06 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:07.396594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:07.398611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:07.416629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.417364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.419095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.423059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.423643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.424093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.597487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:07.608408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b838c31-cc96-4547-b488-164108218a6f tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1531 microversion: 2.1 time: 0.446782 Sep 13 16:39:07.609317 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1089/2300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:07 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1531 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:07.619941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:07.620771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:07.638698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.639422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.640161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.641108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.641724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.645395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.822186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.839985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.841640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:07.849336 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fb62f4d1-9ac0-4e35-bed7-e7fbb448250c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1510 microversion: 2.91 time: 0.238734 Sep 13 16:39:07.850542 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1090/2301] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:07 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:07.862180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:07.870202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.870870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.871473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.872365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.872975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.873652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.969984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb325260-3644-4eee-90ca-62ce5c270592 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.117650 Sep 13 16:39:07.971002 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1091/2302] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:39:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:07.977220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:07.977526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:07.987790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.988494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.988992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:07.990413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:07.990891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:07.991322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:08.188404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:08.204696 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4af1be2-9d47-48d4-adb0-4983bb3dcaff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.817394 Sep 13 16:39:08.221863 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1212/2303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:07 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:08.234284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": false, "disk_over_commit": false}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:08.238106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:08.265924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:08.269859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:08.280413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:08.283437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:08.284102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:08.292045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:08.361557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lazy-loading 'flavor' on Instance uuid fa012e4d-50f0-4820-b7fe-39152d3710c5 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:08.386959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Going to try to live migrate instance to n-h1-857467-1 {{(pid=122328) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:39:08.841885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:08.911901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=46 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:08.915549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:08.924275 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29912bf8-5af7-4372-b964-7a3fc0147370 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.951947 Sep 13 16:39:08.925348 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1092/2304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:07 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:08.937752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:08.938843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:08.963026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:08.966355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:08.966983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:08.968330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:08.969611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:08.970599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.208981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.222312 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1561df36-a8f4-4aa3-af0f-4f5cc44eb02c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.286577 Sep 13 16:39:09.222312 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1093/2305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:08 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:09.242871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91643bd7-9703-488e-80c1-dbbd56fd7717 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cd2af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:09.345438 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91643bd7-9703-488e-80c1-dbbd56fd7717 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.122122 Sep 13 16:39:09.346500 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1094/2306] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:09 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:09.367787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5a66a072-4c5d-4d1b-aa01-fe6a05cf2daf req-3b930311-81bd-4c85-980a-5791b759d79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3951324b-72cd-43d4-8a55-42c110f05a47", "tag": "d509c56c-868c-423d-afea-beb49d0ac369"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:09.396816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=50 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:09.399485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5a66a072-4c5d-4d1b-aa01-fe6a05cf2daf req-3b930311-81bd-4c85-980a-5791b759d79a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.403497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5a66a072-4c5d-4d1b-aa01-fe6a05cf2daf req-3b930311-81bd-4c85-980a-5791b759d79a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.404131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5a66a072-4c5d-4d1b-aa01-fe6a05cf2daf req-3b930311-81bd-4c85-980a-5791b759d79a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.426710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5a66a072-4c5d-4d1b-aa01-fe6a05cf2daf req-3b930311-81bd-4c85-980a-5791b759d79a service nova] Creating event network-changed:d509c56c-868c-423d-afea-beb49d0ac369 for instance 3951324b-72cd-43d4-8a55-42c110f05a47 on n-h1-857467-1 Sep 13 16:39:09.434111 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5a66a072-4c5d-4d1b-aa01-fe6a05cf2daf req-3b930311-81bd-4c85-980a-5791b759d79a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078816 Sep 13 16:39:09.442842 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1095/2307] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:09.450902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:09.453765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:09.465412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.466215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.473548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.474866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.475622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.477258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.679567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.692230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.694131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.695541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73d9817e-f16e-4817-8125-f64e04b4db47 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.249867 Sep 13 16:39:09.696312 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1096/2308] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:09 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:09.701479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:09.702485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:09.709214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.710224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.710874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.712052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.712924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.713565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.813746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.828007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.829758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:09.835475 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e313c7e3-ceba-4b56-9c99-16ae21971e76 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1531 microversion: 2.91 time: 0.137762 Sep 13 16:39:09.846911 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1097/2309] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:09 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1531 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:09.868266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:09.869411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:09.877516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.879303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.880231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:09.882163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:09.882880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:09.883505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:10.118248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:10.130349 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-38b03a6c-97b8-4eab-95ab-8cfa15cd7fa2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.278545 Sep 13 16:39:10.159550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1098/2310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:09 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:10.444155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:10.444979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:10.457880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:10.458399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:10.458948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:10.459947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:10.460419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:10.460986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:10.664226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lazy-loading 'services' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:10.694964 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b4ac375-b26c-4df2-a0e2-8c5b63d8205c tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1936 microversion: 2.91 time: 0.533661 Sep 13 16:39:10.696215 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1099/2311] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:10 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1936 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:10.702817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:10.703784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:10.719865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:10.720738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:10.721441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:10.723243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:10.723773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:10.724218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.016021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:11.027252 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d66012c5-58ba-4183-b386-b34079b17f21 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.329456 Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1100/2312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:10 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.044969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.336412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:11.360013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ccbc55a-bbe5-4b0b-8cbe-1a8403ad4403 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.330640 Sep 13 16:39:11.363461 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1101/2313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:11 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:11.378504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15cd57b8-c186-4881-b8ab-40445efcd07e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4c1aca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:11.458236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15cd57b8-c186-4881-b8ab-40445efcd07e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.092973 Sep 13 16:39:11.459323 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1102/2314] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:11 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:11.481327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:11.482173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:11.506240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.509209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.509780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.510674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.513661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.514363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.745427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:11.757600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:11.761982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:11.763281 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f52e0485-c9c1-4787-92f5-389e94d18edc tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.302933 Sep 13 16:39:11.764233 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1103/2315] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:11 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:11.770527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:11.772120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:11.783527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.784797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.785450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.787156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.787964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.788584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.922389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lazy-loading 'services' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:11.958164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9eb2799b-75c4-4fa7-8b3f-3d6ef6c17eaf tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1936 microversion: 2.91 time: 0.192521 Sep 13 16:39:11.959299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1104/2316] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:11 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1936 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:11.964592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:11.965375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:11.972648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.973321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.973942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:11.974788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:11.975386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:11.975980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.184632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:12.197402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-593c2a94-0725-4ceb-b097-6b69c96b274a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.235845 Sep 13 16:39:12.210879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1105/2317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:11 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:12.220331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:12.225629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:12.226433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:12.226645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.227457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:12.228086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:12.228338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.266904 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a9ef4b5-14fa-4438-a01f-8183c31d4e57 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.054733 Sep 13 16:39:12.267680 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1106/2318] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Sep 13 16:39:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:39:12.292444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:12.293170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:12.300625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:12.301508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:12.303074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.304491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:12.305224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:12.307534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.559911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:12.576144 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2eb39800-d653-4b65-ad1b-1272cd9bee3b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.307305 Sep 13 16:39:12.601706 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1107/2319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:12 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:12.611675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:12.615864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:12.625125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:12.626352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:12.627130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.629425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:12.631066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:12.632739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:12.692917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lazy-loading 'flavor' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:12.760613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:12.992667 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d956350-6f79-4bad-ac95-960812db5fab tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action" status: 202 len: 0 microversion: 2.91 time: 0.389345 Sep 13 16:39:12.993455 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1108/2320] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:39:12 2022] POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:39:13.013255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:13.014006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:13.023277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.024094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.024217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.025349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.025349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.025747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.286650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.307312 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b93d0304-ccf4-490e-ba46-f68b62b9ba7c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.311243 Sep 13 16:39:13.310031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1109/2321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:12 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:13.326065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d080654a-01b9-401c-aae6-ccca637ea03e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4b86e50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:13.426729 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d080654a-01b9-401c-aae6-ccca637ea03e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.114753 Sep 13 16:39:13.434922 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1110/2322] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:13 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:13.442021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:13.443051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:13.449789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.451640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.452241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.453277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.453917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.454360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.741498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.753893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.755677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.756902 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b12b5f0b-e388-4192-81db-01e1cc42fc41 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.328027 Sep 13 16:39:13.774073 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1111/2323] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:13 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:13.801283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:13.809584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:13.820988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.821811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.822633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.823563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.824223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.824937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.934434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.950204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.954293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:13.961377 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58a99ac2-654a-4036-afa6-fac648466f44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.183871 Sep 13 16:39:13.962599 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1112/2324] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:13 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:13.967602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:13.968655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:13.975312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.977401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.977905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:13.979036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:13.979648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:13.980217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:14.218783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:14.228356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-41120b68-2470-49a2-ab15-a4e3668c7ab4 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.264425 Sep 13 16:39:14.229510 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1113/2325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:13 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:14.234935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:14.235558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:14.242823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:14.243313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:14.243754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:14.246116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:14.246625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:14.247059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:14.439875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:14.452434 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62d40265-df1c-43bd-a8ad-b2ab12851a76 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.221071 Sep 13 16:39:14.453469 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1114/2326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:14 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:14.459680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:14.460303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:14.467301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:14.467825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:14.468433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:14.469165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:14.469641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:14.470088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:15.271754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.279774 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e96e8fa1-a13c-4b8c-9ad3-cbf845607c34 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.825051 Sep 13 16:39:15.280563 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1115/2327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:14 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:15.287627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0399f82-8cb6-4248-afe0-6adc131d7efb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4ba81f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:15.356445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e0399f82-8cb6-4248-afe0-6adc131d7efb tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.074941 Sep 13 16:39:15.357218 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1116/2328] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:15 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:15.361580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:15.370348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:15.378786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:15.379623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:15.380209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:15.381507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:15.387315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:15.387945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:15.587298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.616948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.618957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.620193 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72b86f11-2db3-48fe-9dc7-05592a43e749 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.262236 Sep 13 16:39:15.630973 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1117/2329] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:15 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:15.651876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:15.655599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:15.673852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:15.674617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:15.675462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:15.676412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:15.677021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:15.677595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:15.821755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.832203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.842257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:15.857858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98ff311a-a04c-420d-af5e-1f9748dda6c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.225605 Sep 13 16:39:15.884504 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1118/2330] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:15 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:15.908776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:15.909712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:15.929764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:15.930568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:15.931177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:15.932153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:15.932825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:15.933466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:16.236853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:16.254368 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89890c37-1c3f-44bc-9220-11e27a0ad823 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.364339 Sep 13 16:39:16.255962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1119/2331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:15 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:16.268045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:16.277656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:16.285323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:16.286234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:16.287052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:16.288283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:16.291058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:16.293295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:16.626587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:16.645713 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1a40a52-fb39-4d1c-8b0c-0ffbbb0830e0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.385089 Sep 13 16:39:16.646855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1120/2332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:16 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:16.653785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:16.654536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:16.664650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:16.665640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:16.665837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:16.666736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:16.667132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:16.667779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.053098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.067019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be36ce45-b9d6-4510-81cd-3783fc0ffec9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.417089 Sep 13 16:39:17.068101 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1121/2333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:16 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:17.108183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13c1ed0e-fe40-49c1-829b-e6e82f7cd57f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cbd700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:17.168325 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13c1ed0e-fe40-49c1-829b-e6e82f7cd57f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.067202 Sep 13 16:39:17.179232 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1122/2334] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:17 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:17.179232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:17.179232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:17.199406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.199921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.201737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.202828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.203274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.203718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.427700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.445982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.447964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.450699 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15814b3e-d7c4-4267-bd4f-c29c420f4969 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.278856 Sep 13 16:39:17.451395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1123/2335] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:17 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:17.457233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8781c360-39ac-4342-a8cc-258cd3973323 req-9ce6b7d6-4ef3-41e8-9b52-44a1403a67dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3675b4ed-f67e-4b6d-8637-fa28b6d848d8", "name": "network-vif-plugged", "status": "completed", "tag": "1b0c2f2f-223b-45b9-9927-448cdd44cf52"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:17.472336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8781c360-39ac-4342-a8cc-258cd3973323 req-9ce6b7d6-4ef3-41e8-9b52-44a1403a67dc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.473280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8781c360-39ac-4342-a8cc-258cd3973323 req-9ce6b7d6-4ef3-41e8-9b52-44a1403a67dc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.473873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8781c360-39ac-4342-a8cc-258cd3973323 req-9ce6b7d6-4ef3-41e8-9b52-44a1403a67dc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.512817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8781c360-39ac-4342-a8cc-258cd3973323 req-9ce6b7d6-4ef3-41e8-9b52-44a1403a67dc service nova] Creating event network-vif-plugged:1b0c2f2f-223b-45b9-9927-448cdd44cf52 for instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 on n-h1-857467-1 Sep 13 16:39:17.518540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8781c360-39ac-4342-a8cc-258cd3973323 req-9ce6b7d6-4ef3-41e8-9b52-44a1403a67dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065821 Sep 13 16:39:17.520231 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1124/2336] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:17.528112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:17.528968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:17.542843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.543879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.544742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.545560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.548376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.549997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.688109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.697720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.699365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.705652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7cc9420f-0984-44fb-b502-96e590b22948 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.183229 Sep 13 16:39:17.717856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1125/2337] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:17 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:17.717856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:17.717856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.729356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.914360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:17.929047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df0ede78-dddf-4025-bfce-8d8a4da45c40 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1500 microversion: 2.1 time: 0.217066 Sep 13 16:39:17.932347 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1126/2338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:17 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1500 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:17.943834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:17.946974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:17.956476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.957421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.958170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:17.959234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:17.959983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:17.960615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.192975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:18.202817 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7946572-494d-4ea3-b0b9-082e29f5ebe6 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5/action" status: 202 len: 0 microversion: 2.1 time: 9.994045 Sep 13 16:39:18.203947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1213/2339] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:39:08 2022] POST /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5/action => generated 0 bytes in 9998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:18.217056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4af71746-1ae5-41e5-b7c9-69f4ccad0da8"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:18.228705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:18.231013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78363ae1-a19d-485e-b255-e9a3c06fd955 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.297065 Sep 13 16:39:18.244511 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1127/2340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:17 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:18.244511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:18.244511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:18.250848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.250848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.250848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.252544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.255871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.256729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.262829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.264169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.268485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.275022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.275980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.276796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.282024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:18.319125 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Cannot 'attach_volume' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state rescued Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/os-volume_attachments HTTP/1.1 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 74 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: {"volumeAttachment": {"volumeId": "4af71746-1ae5-41e5-b7c9-69f4ccad0da8"}} Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'attach_volume' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state rescued Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '384c0e9c-0bc9-41bb-a17f-7986492880d5', 'body': {'volumeAttachment': {'volumeId': '4af71746-1ae5-41e5-b7c9-69f4ccad0da8'}}} Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 16:39:18.332502 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state rescued Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state rescued Sep 13 16:39:18.336385 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:18.340265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 409 to user: Cannot 'attach_volume' instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 while it is in vm_state rescued {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:18.341173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ade6d732-4365-4d7d-abec-bf6c97ec84ed tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.135026 Sep 13 16:39:18.344026 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1214/2341] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:39:18 2022] POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/os-volume_attachments => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:39:18.352094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8ca641f1-60ce-44f4-bc8c-ae769f70240a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb980d9d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:18.424461 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8ca641f1-60ce-44f4-bc8c-ae769f70240a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.078785 Sep 13 16:39:18.426945 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1215/2342] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:18 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:18.432189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:18.433411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:18.447584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.448257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.452211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.453498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.454151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.454808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.528553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:18.541502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf3abdcd-7268-4f63-b9e6-340f57c1f381 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.307016 Sep 13 16:39:18.542674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1128/2343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:18 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:18.549255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:18.550542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:18.564974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.566571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.567314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.568485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.569063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.569569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.703087 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b782c6d-7fd1-4510-963d-99ef62b323f0 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action" status: 202 len: 0 microversion: 2.1 time: 0.158808 Sep 13 16:39:18.703885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1129/2344] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:39:18 2022] POST /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:18.712461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:18.713182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:18.732942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.733436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.733985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.734714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:18.735254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:18.735610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:18.986892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.003563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ff532a1-7e39-45e8-b7c7-881a9e98a229 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.574795 Sep 13 16:39:19.009051 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1216/2345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:18 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:19.018444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:19.019415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:19.029997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.030504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.030953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.031674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.032218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.032873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.074092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.091577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.093937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.095643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bef5baf7-8334-4e4d-8175-ddd3fe958a4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1485 microversion: 2.25 time: 0.387748 Sep 13 16:39:19.098054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1130/2346] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:18 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1485 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:19.104312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:19.105246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:19.113544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.114429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.115115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.116548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.117137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.117676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.233817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.267047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.274169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.285116 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b42ba70-8ff3-430e-857c-e4a32f567010 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.185029 Sep 13 16:39:19.298575 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1131/2347] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:19 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:19.309337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:19.309337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:19.329918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.329918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.329918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.329918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.329918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.329918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.486378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.500386 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3f3d2e3-0d86-4b01-99ac-ce6e003f781c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1508 microversion: 2.1 time: 0.489756 Sep 13 16:39:19.504260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1217/2348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:19 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1508 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:19.514769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55a14279-2cee-4e2e-97e1-50700890679c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb97dd8b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:19.613621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55a14279-2cee-4e2e-97e1-50700890679c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1437 microversion: 2.1 time: 0.110271 Sep 13 16:39:19.617386 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1218/2349] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:19 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1437 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:19.642070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e7fb8356-4929-4e88-bbc4-88b7dd0787d9 req-48402c35-e88e-4ce1-b685-cb4810160aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3951324b-72cd-43d4-8a55-42c110f05a47", "name": "network-vif-plugged", "status": "completed", "tag": "d509c56c-868c-423d-afea-beb49d0ac369"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:19.645055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.664133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e7fb8356-4929-4e88-bbc4-88b7dd0787d9 req-48402c35-e88e-4ce1-b685-cb4810160aa1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.665246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e7fb8356-4929-4e88-bbc4-88b7dd0787d9 req-48402c35-e88e-4ce1-b685-cb4810160aa1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.665717 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-366a1610-5106-44d1-b440-918a1d01bb26 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1315 microversion: 2.1 time: 0.365463 Sep 13 16:39:19.666073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e7fb8356-4929-4e88-bbc4-88b7dd0787d9 req-48402c35-e88e-4ce1-b685-cb4810160aa1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.696844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e7fb8356-4929-4e88-bbc4-88b7dd0787d9 req-48402c35-e88e-4ce1-b685-cb4810160aa1 service nova] Creating event network-vif-plugged:d509c56c-868c-423d-afea-beb49d0ac369 for instance 3951324b-72cd-43d4-8a55-42c110f05a47 on n-h1-857467-1 Sep 13 16:39:19.703662 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1132/2350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:19 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:19.706981 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e7fb8356-4929-4e88-bbc4-88b7dd0787d9 req-48402c35-e88e-4ce1-b685-cb4810160aa1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086109 Sep 13 16:39:19.709125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:19.709743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:19.713077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1219/2351] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:19.729674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.730373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.730716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.731470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:19.731949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:19.734289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:19.983296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:19.997774 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2d68875b-ef87-405a-983c-e9ee83bdc233 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.292854 Sep 13 16:39:19.999371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1133/2352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:19 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:20.049634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.057768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.076609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.077485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.078209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.079288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.079979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.080626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.124165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.124802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.140273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.142374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.143005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.145145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.145849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.146465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.326955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.342498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.344026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.345231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-062c7ed6-5584-4fdc-90a2-b2366d9166ff tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1475 microversion: 2.25 time: 0.226321 Sep 13 16:39:20.357853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1134/2353] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:39:20.357853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.357853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.383798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.384364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.386251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.387030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.387501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.387947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.471561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.482900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.484045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.490820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3c1ff8d-7106-44c9-9e56-3669073641b9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.143951 Sep 13 16:39:20.491658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1135/2354] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:20.509337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1796e307-abd2-4548-88da-bfb5957f2dce tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '.version_select at 0x7fbeb4c0e4c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.516822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1796e307-abd2-4548-88da-bfb5957f2dce tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.518530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1796e307-abd2-4548-88da-bfb5957f2dce tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.519220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1796e307-abd2-4548-88da-bfb5957f2dce tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.534762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1796e307-abd2-4548-88da-bfb5957f2dce tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3870 microversion: 2.25 time: 0.034350 Sep 13 16:39:20.535789 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1136/2355] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/os-migrations => generated 3870 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:20.539967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.540578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.546814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.547759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.547899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.548573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.549037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.549471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.694663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.702795 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cea7a181-10de-4d4d-8e60-006155d4b300 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1508 microversion: 2.1 time: 0.166421 Sep 13 16:39:20.703365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1137/2356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:20.707785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.708388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.714168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.714940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.715095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.715978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.716436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.716865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.743968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:20.752756 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-661bcd89-424e-4826-a160-3863dc7d4ac5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.708709 Sep 13 16:39:20.753513 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1220/2357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:20.758497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-438e2640-96fa-47c6-99a3-be38c0bd0252 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb9801b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.806063 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-438e2640-96fa-47c6-99a3-be38c0bd0252 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1446 microversion: 2.1 time: 0.051441 Sep 13 16:39:20.815673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1221/2358] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1446 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:20.815673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.815673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.819156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.819655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.820107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.820811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.821274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.821769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.878674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] Lazy-loading 'services' on Instance uuid 51e6ef02-b609-4ab1-8243-f5edaa26853a {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:20.894382 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0579af51-0c78-4d3a-b10e-3990498ab38e tempest-LiveAutoBlockMigrationV225Test-511037028 tempest-LiveAutoBlockMigrationV225Test-511037028-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1966 microversion: 2.25 time: 0.189335 Sep 13 16:39:20.895194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1138/2359] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1966 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:20.899789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd5caa15-4230-443f-9ec0-c5f6a0381f4c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4cd2a60>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.954007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd5caa15-4230-443f-9ec0-c5f6a0381f4c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 200 len: 1446 microversion: 2.1 time: 0.057857 Sep 13 16:39:20.954886 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1139/2360] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 1446 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:20.959835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:20.960409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:20.967272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.967681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.968121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:20.968822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:20.969283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:20.969714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:21.004753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:39:21.045709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:21.063467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8f53dad-5413-4d9f-ae83-e2793bd320d5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1504 microversion: 2.1 time: 0.255763 Sep 13 16:39:21.064996 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1222/2361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:20 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:21.076231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f7c604b-66a4-48c5-9040-ea6397cb5577 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb95d1dc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:21.123735 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1c8b258-f1b0-4608-b0b3-6879e92b3bd7 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "DELETE /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 204 len: 0 microversion: 2.25 time: 0.167540 Sep 13 16:39:21.124742 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1140/2362] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:39:20 2022] DELETE /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:39:21.132154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:21.132876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:21.142431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:21.142935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:21.144609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:21.146167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:21.147447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:21.148685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:21.352715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:21.361298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65908524-214d-4437-9bcb-0648b0a2a419 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1314 microversion: 2.1 time: 0.235340 Sep 13 16:39:21.376557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1141/2363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:21 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:21.382467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1392909994"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:21.383874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:21.392185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:21.392689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:21.393137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:21.395764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:21.396242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:21.396694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:21.569859 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.network.security_group_api [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Adding security group 5d6b8f58-cde5-40c9-bb49-429acc15eff3 to port 1b0c2f2f-223b-45b9-9927-448cdd44cf52 Sep 13 16:39:22.084769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03739402-9060-4569-981e-7dfdf96acf19 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8/action" status: 202 len: 0 microversion: 2.1 time: 0.710103 Sep 13 16:39:22.088997 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1142/2364] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:39:21 2022] POST /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:22.095160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:22.096099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:22.115604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.116206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.116563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.117304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.117777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.118497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.158769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f7c604b-66a4-48c5-9040-ea6397cb5577 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 204 len: 0 microversion: 2.1 time: 1.088540 Sep 13 16:39:22.160424 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1223/2365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:21 2022] DELETE /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:39:22.167450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:22.168535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:22.179817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:22.186620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.187521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.188411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.189770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.190982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.191713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.239733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:22.239937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:22.369100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.373486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:22.382210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.383798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.385132 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e040744-0323-4356-99a1-838aff211a83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1481 microversion: 2.25 time: 0.294961 Sep 13 16:39:22.385776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1143/2366] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:22 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1481 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:22.395362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:22.396283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:22.405309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.406140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.406884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.407871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.408807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.409961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.418071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.430316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.432232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.439858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97e5d09a-1e48-4523-8b9e-94f6e2698ec2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.277967 Sep 13 16:39:22.441183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1224/2367] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:22 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:22.447329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:22.448610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:22.455295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.456026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.457303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.458241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.458865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.459443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.656044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.682418 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d68d70ea-4d7c-42d5-aa11-f65647aaa9e2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1508 microversion: 2.1 time: 0.295195 Sep 13 16:39:22.698335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1144/2368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:22 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:22.703649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-180676388"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:22.705217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:22.712967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.713766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.714580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.715757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.716704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.717358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.794549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:22.817364 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8449ddc-b706-441d-8c1c-c315999d3ce6 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.374641 Sep 13 16:39:22.819854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1225/2369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:22 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:22.825054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e89bf00e-1bff-4255-83e1-465f8d98e7b8 req-67c33711-2bad-481f-bf85-9448ccbfdea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3675b4ed-f67e-4b6d-8637-fa28b6d848d8", "tag": "1b0c2f2f-223b-45b9-9927-448cdd44cf52"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:22.836002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e89bf00e-1bff-4255-83e1-465f8d98e7b8 req-67c33711-2bad-481f-bf85-9448ccbfdea2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.836933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e89bf00e-1bff-4255-83e1-465f8d98e7b8 req-67c33711-2bad-481f-bf85-9448ccbfdea2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.837607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e89bf00e-1bff-4255-83e1-465f8d98e7b8 req-67c33711-2bad-481f-bf85-9448ccbfdea2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.858740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e89bf00e-1bff-4255-83e1-465f8d98e7b8 req-67c33711-2bad-481f-bf85-9448ccbfdea2 service nova] Creating event network-changed:1b0c2f2f-223b-45b9-9927-448cdd44cf52 for instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 on n-h1-857467-1 Sep 13 16:39:22.865796 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e89bf00e-1bff-4255-83e1-465f8d98e7b8 req-67c33711-2bad-481f-bf85-9448ccbfdea2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044523 Sep 13 16:39:22.866465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1226/2370] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:22.876763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:22.877611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:22.886715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.887389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.887956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.888790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:22.890375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:22.890852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:22.932606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:39:22.954525 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.network.security_group_api [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Adding security group aab6ba2f-aff3-4980-9d3d-9b7803a53000 to port 1b0c2f2f-223b-45b9-9927-448cdd44cf52 Sep 13 16:39:23.051661 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be4f23c1-2d27-47f5-96a1-9b570dab3dd4 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 204 len: 0 microversion: 2.1 time: 0.183412 Sep 13 16:39:23.052773 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1227/2371] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:39:22 2022] DELETE /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:39:23.084860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:23.085866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:23.093465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:23.094020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:23.094473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:23.095200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:23.095675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:23.096113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:23.513441 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ef96222-cfa9-4d9b-b125-271a58442b02 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8/action" status: 202 len: 0 microversion: 2.1 time: 0.813767 Sep 13 16:39:23.514096 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1145/2372] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:39:22 2022] POST /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:23.521126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1744642012", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "179fb6ca-f6bf-4d09-a618-632e7e778e62"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:23.590389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] validate_networks() for [('179fb6ca-f6bf-4d09-a618-632e7e778e62', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:39:23.676084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:23.724558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5425f56f-a073-48b2-839a-d4296e1c7f7d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1502 microversion: 2.1 time: 0.669248 Sep 13 16:39:23.725453 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1228/2373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:23 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1502 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:23.734303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:23.735112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:23.758906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:23.759658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:23.765280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:23.767564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:23.768282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:23.769528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.203215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:39:24.203664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:39:24.204154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:39:24.204844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:39:24.205285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:39:24.218483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.219188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.219651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.220411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.220881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.221319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.222872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:24.231368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:24.240799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:24.242268 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67081faf-37a5-4789-8e7e-ac60f3e3d49a tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1481 microversion: 2.25 time: 0.514503 Sep 13 16:39:24.253855 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1229/2374] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:23 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1481 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:24.253855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:24.253855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:24.256413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.257071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.257654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.258648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.259246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.259812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.263796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:39:24.272153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Getting quotas for user 67dc5c1abf0649888b406f5911e5e5dd and project be598c0e112c40dc894a680a37eefb38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:39:24.289169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:39:24.292001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:39:24.374231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b53d53ba-5762-4ab3-a9d9-a73b6c5382af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857003 Sep 13 16:39:24.376903 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1146/2375] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:39:24.383613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:24.384306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:24.401281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.401959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.402524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.403407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.404412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.405899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.497657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:24.512884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:24.516275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:24.530874 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12d2edb6-7bba-4b9e-b324-5b3e483b1915 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.282601 Sep 13 16:39:24.532224 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1230/2376] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:24 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:24.542487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:24.543464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:24.555776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.556480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.556709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.559949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.561255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.562320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.713431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9093bbb7-2e6e-4eea-878f-21c0d2d1c9c0 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.335088 Sep 13 16:39:24.714252 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1147/2377] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Sep 13 16:39:24 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8/os-security-groups => generated 1158 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:24.719112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:24.719620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:24.738956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.739657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.740243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.741126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.741731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.742337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.774362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:39:24.953292 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6869008e-b0fb-4575-872c-1c09d484b0ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 204 len: 0 microversion: 2.1 time: 0.237486 Sep 13 16:39:24.957641 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1148/2378] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:39:24 2022] DELETE /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:39:24.964176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:24.965129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:24.976431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.977269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.978003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:24.978925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:24.979581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:24.980259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.100092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.111852 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa16e21a-2537-4a72-a68e-f4c46bddfc35 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1508 microversion: 2.1 time: 0.577659 Sep 13 16:39:25.124623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1231/2379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:24 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:25.141621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-522e5abf-4d03-4442-a60f-5c75c1dc32c6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:25.143258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-522e5abf-4d03-4442-a60f-5c75c1dc32c6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:25.291392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.307332 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c274bf39-ccf5-44c4-a530-e24425a6669f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.347323 Sep 13 16:39:25.308582 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1149/2380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:24 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:25.319533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5655c2a-c5f2-4411-9a8f-52c182c9eff3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbba60>, body: {"security_group": {"name": " tempest-securitygroup -879939938 ", "description": "tempest-description-1711615020"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:25.362517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-522e5abf-4d03-4442-a60f-5c75c1dc32c6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.381577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-522e5abf-4d03-4442-a60f-5c75c1dc32c6 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1208 microversion: 2.1 time: 0.253767 Sep 13 16:39:25.382999 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1232/2381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:25 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1208 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:25.400432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f4ad6dce-a811-4ece-af97-3bb6eca79ab0 req-2a1d4f54-6118-4282-9598-71315c3f715c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3675b4ed-f67e-4b6d-8637-fa28b6d848d8", "tag": "1b0c2f2f-223b-45b9-9927-448cdd44cf52"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:25.423535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f4ad6dce-a811-4ece-af97-3bb6eca79ab0 req-2a1d4f54-6118-4282-9598-71315c3f715c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.424699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f4ad6dce-a811-4ece-af97-3bb6eca79ab0 req-2a1d4f54-6118-4282-9598-71315c3f715c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.425808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f4ad6dce-a811-4ece-af97-3bb6eca79ab0 req-2a1d4f54-6118-4282-9598-71315c3f715c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.453733 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f4ad6dce-a811-4ece-af97-3bb6eca79ab0 req-2a1d4f54-6118-4282-9598-71315c3f715c service nova] Creating event network-changed:1b0c2f2f-223b-45b9-9927-448cdd44cf52 for instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 on n-h1-857467-1 Sep 13 16:39:25.460681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f4ad6dce-a811-4ece-af97-3bb6eca79ab0 req-2a1d4f54-6118-4282-9598-71315c3f715c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076084 Sep 13 16:39:25.462204 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1233/2382] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:25.468538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:25.469431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:25.481692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.482481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.483138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.484218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.484903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.486765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.742525 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5655c2a-c5f2-4411-9a8f-52c182c9eff3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.432507 Sep 13 16:39:25.743851 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1150/2383] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:39:25 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:25.749031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2419a77e-7653-4c20-a5cb-32f9362d6e31 req-7d78ac7e-a159-459a-a954-621a7e72108a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5acb43c-b494-4f96-bafe-5c7a5abe2da7", "name": "network-vif-unplugged", "status": "completed", "tag": "1b050886-148d-4c64-8575-77ab36441284"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:25.775650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2419a77e-7653-4c20-a5cb-32f9362d6e31 req-7d78ac7e-a159-459a-a954-621a7e72108a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.776366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2419a77e-7653-4c20-a5cb-32f9362d6e31 req-7d78ac7e-a159-459a-a954-621a7e72108a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.778595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2419a77e-7653-4c20-a5cb-32f9362d6e31 req-7d78ac7e-a159-459a-a954-621a7e72108a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.806676 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2419a77e-7653-4c20-a5cb-32f9362d6e31 req-7d78ac7e-a159-459a-a954-621a7e72108a service nova] Creating event network-vif-unplugged:1b050886-148d-4c64-8575-77ab36441284 for instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 on n-h2-857467-1 Sep 13 16:39:25.821427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2419a77e-7653-4c20-a5cb-32f9362d6e31 req-7d78ac7e-a159-459a-a954-621a7e72108a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075944 Sep 13 16:39:25.822658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1151/2384] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:25.830368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:25.832972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:25.844147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.845258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.848609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.850133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:25.851635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:25.852391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:25.968697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.983132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.986728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:25.989220 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5c937af-36b7-4a67-9d41-3344ef392305 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1439 microversion: 2.25 time: 0.165013 Sep 13 16:39:26.001854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1152/2385] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:25 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1439 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:26.027341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:26.029506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:26.051857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.052625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.053094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.054043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.055173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.055632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.236867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:26.255648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:26.257381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:26.263055 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-84df4c92-3d75-4c71-b39b-8d9289609a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.271316 Sep 13 16:39:26.273877 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1153/2386] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:25 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:26.290997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a6684bc-8387-4c5b-84d0-ea8dff8dc017 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4c0e430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:26.362173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:26.372289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c94af38-5b71-4c7e-8e69-3b69509f5383 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1508 microversion: 2.1 time: 0.908627 Sep 13 16:39:26.372891 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1234/2387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:25 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1508 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:26.387902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:26.388790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:26.403985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.406483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.407136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.408063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.411272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.413133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.431007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a6684bc-8387-4c5b-84d0-ea8dff8dc017 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361" status: 200 len: 223 microversion: 2.1 time: 0.156020 Sep 13 16:39:26.431831 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1154/2388] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:39:26 2022] GET /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:26.441736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5bec3137-85b5-44b5-93de-86b7bf3c4d06 req-d61b6789-0163-4ae7-9e9a-061e165cd23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e6ef02-b609-4ab1-8243-f5edaa26853a", "name": "network-vif-deleted", "tag": "09b632a7-4797-475c-94b8-697071578c72"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:26.483454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5bec3137-85b5-44b5-93de-86b7bf3c4d06 req-d61b6789-0163-4ae7-9e9a-061e165cd23f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.488126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5bec3137-85b5-44b5-93de-86b7bf3c4d06 req-d61b6789-0163-4ae7-9e9a-061e165cd23f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.491321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5bec3137-85b5-44b5-93de-86b7bf3c4d06 req-d61b6789-0163-4ae7-9e9a-061e165cd23f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.562457 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5bec3137-85b5-44b5-93de-86b7bf3c4d06 req-d61b6789-0163-4ae7-9e9a-061e165cd23f service nova] Creating event network-vif-deleted:09b632a7-4797-475c-94b8-697071578c72 for instance 51e6ef02-b609-4ab1-8243-f5edaa26853a on n-h1-857467-1 Sep 13 16:39:26.575412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5bec3137-85b5-44b5-93de-86b7bf3c4d06 req-d61b6789-0163-4ae7-9e9a-061e165cd23f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138687 Sep 13 16:39:26.579429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1155/2389] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:26.590618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:26.592821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:26.600861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.601387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.601872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.609873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.610517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.611039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.900681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:26.915476 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3047937a-88e1-4589-8961-3b4435f3b944 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1508 microversion: 2.1 time: 0.536085 Sep 13 16:39:26.917560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1235/2390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:26 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:26.929087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:26.930017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:26.938814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.942022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.946483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:26.949084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:26.949736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:26.950443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.037093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.046896 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-666fb17b-c7d4-4cb4-98e3-ae2689d39063 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.466137 Sep 13 16:39:27.063368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.068439 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1156/2391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:26 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:27.073933 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e991d5d-d2df-4ae9-a9b0-190eedfd322f tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1260 microversion: 2.1 time: 0.154044 Sep 13 16:39:27.075931 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1236/2392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:26 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:27.087882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:27.088923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:27.100702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92301942-ab58-4168-a7b7-53e7d24a3b5d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4da9160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:27.118075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.118586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.122027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.123061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.124923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.127213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.233598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.243817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.245295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.246515 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0177061-7bac-412a-b3f6-263e7980c71e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1439 microversion: 2.25 time: 0.169263 Sep 13 16:39:27.247457 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1237/2393] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:27 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1439 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:27.297508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:27.298182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:27.306091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.306733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.307092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.307898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.308369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.308815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.395180 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92301942-ab58-4168-a7b7-53e7d24a3b5d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361" status: 202 len: 0 microversion: 2.1 time: 0.323967 Sep 13 16:39:27.396215 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1157/2394] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:39:27 2022] DELETE /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:27.401411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:27.402412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:27.418952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.419094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.419732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.420464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.420936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.421378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.465417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.483698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.507753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:27.539932 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-445b473c-8dba-4bb4-bdec-c9bac075e7a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.247414 Sep 13 16:39:27.565296 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1238/2395] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:27 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:27.607326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb5843670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:27.741304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:39:27.742141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.security_group_api [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group e614fdbc-0ac6-45c7-afb6-87d349702361 not found {{(pid=122328) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:39:27.742838 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.742838 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361 HTTP/1.1 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: exception: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e614fdbc-0ac6-45c7-afb6-87d349702361'} Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:39:27.745916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] Sep 13 16:39:27.749643 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:27.754463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:39:27.754463 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-25f00397-f550-405e-b3d4-6efb94c5108e'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:27.755427 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fb7cd6ab-166d-4e15-aac4-113e034f187d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361" status: 404 len: 194 microversion: 2.1 time: 0.188265 Sep 13 16:39:27.756457 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1239/2396] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:39:27 2022] GET /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361 => generated 194 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:27.779684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-328b16ea-23e3-415b-ba1f-4dc59a87968c req-cffa022e-0839-4ba2-8b59-86cdbd08b11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5acb43c-b494-4f96-bafe-5c7a5abe2da7", "name": "network-vif-deleted", "tag": "1b050886-148d-4c64-8575-77ab36441284"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:27.794982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-328b16ea-23e3-415b-ba1f-4dc59a87968c req-cffa022e-0839-4ba2-8b59-86cdbd08b11b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:27.795731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-328b16ea-23e3-415b-ba1f-4dc59a87968c req-cffa022e-0839-4ba2-8b59-86cdbd08b11b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:27.796399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-328b16ea-23e3-415b-ba1f-4dc59a87968c req-cffa022e-0839-4ba2-8b59-86cdbd08b11b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:27.812328 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-328b16ea-23e3-415b-ba1f-4dc59a87968c req-cffa022e-0839-4ba2-8b59-86cdbd08b11b service nova] Creating event network-vif-deleted:1b050886-148d-4c64-8575-77ab36441284 for instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 on n-h2-857467-1 Sep 13 16:39:27.818672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-328b16ea-23e3-415b-ba1f-4dc59a87968c req-cffa022e-0839-4ba2-8b59-86cdbd08b11b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054965 Sep 13 16:39:27.820044 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1240/2397] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:27.825995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f95ea14-b42d-4182-9b71-997990af5e9c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb9801670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-956834634", "description": "tempest-description-1325288572"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:28.214090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:28.226137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06049350-90af-44e4-bb4d-2071f1450221 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1508 microversion: 2.1 time: 0.828591 Sep 13 16:39:28.228445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1158/2398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:27 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1508 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:28.263944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:28.264633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:28.274812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.275313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.288174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:28.289195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.289622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.291718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:28.452684 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f95ea14-b42d-4182-9b71-997990af5e9c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.630793 Sep 13 16:39:28.453608 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1241/2399] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:39:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:28.464627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:28.465777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:28.490480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.493647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.494433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:28.495411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:28.496081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:28.497859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.188030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:29.216977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ead638c-941a-47a2-8eca-355c33314357 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1514 microversion: 2.1 time: 0.975832 Sep 13 16:39:29.220035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1159/2400] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:28 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1514 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:29.235240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:29.237123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:29.256315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.256824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.257270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.258027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.258494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.258929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.476698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:29.493016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d4ed517-8e14-4c92-8060-371160629dd1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 1.029561 Sep 13 16:39:29.513717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1242/2401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:28 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:29.529786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:29.530964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:29.549899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.551690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.553470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.556097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.557916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.559201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.667812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:29.685865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49b97c76-a202-407e-95e6-aa3672471d38 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1266 microversion: 2.1 time: 0.460374 Sep 13 16:39:29.700725 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1160/2402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:29 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1266 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:29.716761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a0f75ff-c094-427a-9c5d-c73b16999ae3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb4db73a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-446799861", "description": "tempest-description-1493718131"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:29.763316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:29.787795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:29.790711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:29.797773 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-83c488a5-6d69-4c96-b395-90ced7ae28b2 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1264 microversion: 2.25 time: 0.281547 Sep 13 16:39:29.799134 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1243/2403] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:29 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1264 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:29.812867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:29.815760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:29.830423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.832029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.832804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.833548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:29.838044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:29.838531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:29.922919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:30.202250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:30.219717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:30.223811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:30.238931 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d2090b4-c0a9-443a-8297-a4de19a77ef3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.435852 Sep 13 16:39:30.241232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1244/2404] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:29 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:30.255393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:30.256323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:30.262616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:30.263228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:30.263885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:30.264634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:30.265157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:30.265814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:30.427982 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a0f75ff-c094-427a-9c5d-c73b16999ae3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.724446 Sep 13 16:39:30.429439 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1161/2405] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:39:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:30.444324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-486d0512-23ff-43c5-83c2-687aee878769 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb4d68280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1272193624", "description": "tempest-description-1834176425"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:31.372017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-486d0512-23ff-43c5-83c2-687aee878769 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.932333 Sep 13 16:39:31.376116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1162/2406] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:39:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:39:31.383253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:31.384277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:31.408804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:31.416006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:31.418045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:31.419451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:31.420723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:31.421518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:31.632840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:31.643046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85a29229-3de9-4f0d-b57d-851562055965 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1508 microversion: 2.1 time: 1.399844 Sep 13 16:39:31.648964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1245/2407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:30 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1508 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:31.653928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:31.658601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:31.675291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:31.676250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:31.678886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:31.679812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:31.685011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:31.685478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:31.966299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:31.983211 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4375850-1f3d-4d69-b45c-d5a14ebb09c7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.604967 Sep 13 16:39:31.985907 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1163/2408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:31 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:32.000193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:32.001718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:32.022739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.027868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.030991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:32.036734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.042442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.047806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:32.284530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.304516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.308501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.310751 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b66de232-ea75-437e-9b0d-fcf4c5147697 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1264 microversion: 2.25 time: 0.323267 Sep 13 16:39:32.318581 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1164/2409] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:31 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1264 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:32.361954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:32.363705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:32.391947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.392610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.393058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:32.397468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.398143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.401971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:32.612234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.658711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.661479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.679873 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-390ebffa-10b7-44a9-aafd-1b3cc22f042b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.359006 Sep 13 16:39:32.695106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1165/2410] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:32 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:32.709780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a132a14-b870-4eb7-b169-dffd4dc5ad7a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4d92ee0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:32.865377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:32.887695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e378f91-a14d-4d1e-bf5b-5d88750d7e74 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 1.237351 Sep 13 16:39:32.897862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1246/2411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:31 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:32.897862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1325cdca-22ec-4242-8919-a508f60dfe33 req-d1993d46-749c-47d0-9c7c-09e4ae3e4c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3951324b-72cd-43d4-8a55-42c110f05a47", "name": "network-vif-deleted", "tag": "d509c56c-868c-423d-afea-beb49d0ac369"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:32.910790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1325cdca-22ec-4242-8919-a508f60dfe33 req-d1993d46-749c-47d0-9c7c-09e4ae3e4c84 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.911661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1325cdca-22ec-4242-8919-a508f60dfe33 req-d1993d46-749c-47d0-9c7c-09e4ae3e4c84 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.912111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1325cdca-22ec-4242-8919-a508f60dfe33 req-d1993d46-749c-47d0-9c7c-09e4ae3e4c84 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:32.926489 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1325cdca-22ec-4242-8919-a508f60dfe33 req-d1993d46-749c-47d0-9c7c-09e4ae3e4c84 service nova] Creating event network-vif-deleted:d509c56c-868c-423d-afea-beb49d0ac369 for instance 3951324b-72cd-43d4-8a55-42c110f05a47 on n-h1-857467-1 Sep 13 16:39:32.931898 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1325cdca-22ec-4242-8919-a508f60dfe33 req-d1993d46-749c-47d0-9c7c-09e4ae3e4c84 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041617 Sep 13 16:39:32.933452 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1247/2412] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:32.939223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:32.939905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:32.947323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.948384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.949578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:32.950382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:32.951069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:32.951524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:33.060796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:33.063190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:33.063989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:33.064683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'fault' on Instance uuid 3951324b-72cd-43d4-8a55-42c110f05a47 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:33.423499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:33.433565 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53b8447a-4614-4052-b94f-5426d4ef9109 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 200 len: 1304 microversion: 2.1 time: 0.498241 Sep 13 16:39:33.439792 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1248/2413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:32 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 1304 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:33.453743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:33.456145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:33.471082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:33.471589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:33.474747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:33.475553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:33.478659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:33.479322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:33.864038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:33.878653 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a4ea46e-ebf5-415e-97bb-7e62b60165ab tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.434825 Sep 13 16:39:33.896370 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1249/2414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:33 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:33.906416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:33.907472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:33.918335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:33.919077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:33.920320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:33.921900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:33.922690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:33.924052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.011070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.026372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.029142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.031580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc8579c1-644e-4391-a006-ce1472be38f6 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1264 microversion: 2.25 time: 0.131504 Sep 13 16:39:34.032268 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1250/2415] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:33 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:34.038601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:34.039432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:34.047009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.047799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.048485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.049322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.050286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.051496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.134302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a132a14-b870-4eb7-b169-dffd4dc5ad7a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 1.431184 Sep 13 16:39:34.135416 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1166/2416] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:39:32 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:34.151344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:34.152165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:34.155877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:34.161952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.162577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.163030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.163757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.164360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.164740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.190065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.192062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:34.203645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.205151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.214123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13241acf-697f-4404-8c2e-4b70a3315314 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.180092 Sep 13 16:39:34.230388 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1251/2417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:34 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:34.235725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:34.250698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26c04024-9edd-49dc-938a-00df85495e0d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb98015e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:34.280991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:34.451608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:34.475534 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-318f7b63-eccc-40a3-a1f7-1ee7d6ee26e7 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 0.337796 Sep 13 16:39:34.479214 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1167/2418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:34 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:34.485618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4d4109f1-c1f8-4c16-8c4d-4a3225b43375 req-56adb756-1cbf-4660-9833-1ee8557db882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d055443-8621-42d4-b259-aea93fc37245", "tag": "495f1050-c242-435c-9639-4ad73725e092"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:34.507168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4d4109f1-c1f8-4c16-8c4d-4a3225b43375 req-56adb756-1cbf-4660-9833-1ee8557db882 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.507942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4d4109f1-c1f8-4c16-8c4d-4a3225b43375 req-56adb756-1cbf-4660-9833-1ee8557db882 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.508523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4d4109f1-c1f8-4c16-8c4d-4a3225b43375 req-56adb756-1cbf-4660-9833-1ee8557db882 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.529306 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4d4109f1-c1f8-4c16-8c4d-4a3225b43375 req-56adb756-1cbf-4660-9833-1ee8557db882 service nova] Creating event network-changed:495f1050-c242-435c-9639-4ad73725e092 for instance 5d055443-8621-42d4-b259-aea93fc37245 on n-h2-857467-1 Sep 13 16:39:34.537597 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4d4109f1-c1f8-4c16-8c4d-4a3225b43375 req-56adb756-1cbf-4660-9833-1ee8557db882 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056921 Sep 13 16:39:34.539066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1168/2419] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:34.549906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:34.552121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:34.560047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.560754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.561483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.562536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:34.563222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:34.564770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:34.583248 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 HTTP/1.1 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3951324b-72cd-43d4-8a55-42c110f05a47'} Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:34.586407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:39:34.590386 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.590818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:34.591838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f392368-ea29-480e-85ee-de9c61026724 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 404 len: 111 microversion: 2.1 time: 0.051254 Sep 13 16:39:34.596440 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1169/2420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:34 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:34.719586 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26c04024-9edd-49dc-938a-00df85495e0d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8" status: 202 len: 0 microversion: 2.1 time: 0.487706 Sep 13 16:39:34.721071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1252/2421] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:39:34 2022] DELETE /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:34.730573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4d689d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:34.769789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:39:34.770531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 44c1db99-0df1-4712-9f83-d00e359376f8 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:39:34.771173 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.771173 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8 HTTP/1.1 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '44c1db99-0df1-4712-9f83-d00e359376f8'} Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:39:34.773236 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] Sep 13 16:39:34.777066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:34.779764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:39:34.779764 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f26f06ac-11a0-4faf-8358-c1badcb3ba93'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:34.781256 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf1cc049-d813-414f-a261-bdf9950f5d23 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8" status: 404 len: 194 microversion: 2.1 time: 0.055875 Sep 13 16:39:34.785105 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1170/2422] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:39:34 2022] GET /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:34.791070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c993d9b-f15b-4512-90a5-a37aabc637c7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb97dd5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:34.832784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1456699335", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:34.897150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:39:35.099938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c993d9b-f15b-4512-90a5-a37aabc637c7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01" status: 202 len: 0 microversion: 2.1 time: 0.312951 Sep 13 16:39:35.100888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1253/2423] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:39:34 2022] DELETE /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:35.106140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:35.107004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:35.123947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.125458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.126005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.127117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.129029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.130052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.325060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.341038 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-84d7a7d5-91a6-4239-862d-373511b2b8e3 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.238572 Sep 13 16:39:35.342753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1254/2424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:35 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:35.349237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:35.350577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:35.357073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.357663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.358283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.359087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.359630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.360143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.379228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:35.439132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.449089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.450840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.452866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38cae247-66bb-4c17-bef7-7ac5a23341d8 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1264 microversion: 2.25 time: 0.108608 Sep 13 16:39:35.455883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1255/2425] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:35 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1264 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:35.461568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb96f0700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:35.494391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:39:35.495844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.security_group_api [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 not found {{(pid=122328) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:39:35.499448 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.499448 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01 HTTP/1.1 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: exception: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '340ff24a-4e42-4b0e-be25-1cdcb018be01'} Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:39:35.504993 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] Sep 13 16:39:35.509031 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:39:35.513344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:39:35.513344 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-5ac41d11-eb76-447d-9dea-980fbe28147a'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:35.516248 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4fa7ab06-8464-46fe-9928-a35de8f3ee4e tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01" status: 404 len: 194 microversion: 2.1 time: 0.057643 Sep 13 16:39:35.518848 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1256/2426] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:39:35 2022] GET /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:35.529277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:35.531651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:35.548170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.549811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.552182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.553905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.554602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.555215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.686055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:39:35.686583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:39:35.686962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:39:35.687383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:39:35.687822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:39:35.705912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.706506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.709057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.709057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.709057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.709057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.736796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.745582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:39:35.751431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:39:35.754823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.757195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:35.765676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:39:35.767147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-037952cd-161c-43e9-a4fd-0bb1aced8d49 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.246538 Sep 13 16:39:35.767954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:39:35.769252 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1257/2427] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:35 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:35.775311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:35.776234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:35.784367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.786093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.786917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.790233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:35.792341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:35.795732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:35.835496 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae07a8be-3a3d-4d71-ad9c-a1a554c31ff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007428 Sep 13 16:39:35.836962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1171/2428] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:39:35.844396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5789e7c8-80cc-4026-9313-b9e1357721e5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4d68700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.030902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:36.049215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43bedc03-9085-42e7-8fe9-55d3c425d6b5 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 0.278374 Sep 13 16:39:36.052300 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1258/2429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:35 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:36.057692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d203efaf-9893-4475-83d2-fc71d4694bdd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'create', calling method: .version_select at 0x7fbeb52a9b80>, body: {"keypair": {"name": "tempest-keypair-1147636200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHY+6BQrqcMgRIbWarfWeFXannBmmKXAUMNrL5zCMA3m3WO1fDbFgTfx/TTNWSisX+7JzXjpAHTaMuUwYPgtLL0aK4rb3wSPbvArm1+31p1y2brbLCR8+aK+O/YZdMFig=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:36.099472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d203efaf-9893-4475-83d2-fc71d4694bdd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for project 1ce4b7f916b64240af037c66c8665c53. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:39:36.112866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d203efaf-9893-4475-83d2-fc71d4694bdd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for user 780658a6bd6649bf889299f03d80c145 and project 1ce4b7f916b64240af037c66c8665c53. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:39:36.165911 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d203efaf-9893-4475-83d2-fc71d4694bdd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112279 Sep 13 16:39:36.174215 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1259/2430] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:39:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:36.183497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea8921de-a7f2-4a2e-b617-8c8a2b33275e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.197005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea8921de-a7f2-4a2e-b617-8c8a2b33275e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:36.250336 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5789e7c8-80cc-4026-9313-b9e1357721e5 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048" status: 202 len: 0 microversion: 2.1 time: 0.411559 Sep 13 16:39:36.255045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1172/2431] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:39:35 2022] DELETE /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:39:36.260189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4df1790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.297683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea8921de-a7f2-4a2e-b617-8c8a2b33275e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:36.312591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea8921de-a7f2-4a2e-b617-8c8a2b33275e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1215 microversion: 2.1 time: 0.136331 Sep 13 16:39:36.313644 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1260/2432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:36 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:36.330162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:39:36.332119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 01ae8d72-5657-4925-ae1a-d7876edf6048 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:39:36.332119 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.332119 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048 HTTP/1.1 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '01ae8d72-5657-4925-ae1a-d7876edf6048'} Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:39:36.334821 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-a3f24994-4119-4ed7-8691-321fdbf877a0'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12421f7b-a349-4538-993b-f3ba1df52839 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048" status: 404 len: 194 microversion: 2.1 time: 0.079525 Sep 13 16:39:36.339872 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1173/2433] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:39:36 2022] GET /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:39:36.344513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-459a8ff2-1c12-45ad-b278-9eced28c16e2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb97a2a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.367724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.368532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:36.382360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:36.382901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:36.383414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:36.384165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:36.384704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:36.385083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:36.896818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:36.915885 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-270e72fe-20f5-4ed8-854a-b146a9f932e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.551141 Sep 13 16:39:36.917106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1174/2434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:36 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:36.924715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.926232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:36.936039 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-459a8ff2-1c12-45ad-b278-9eced28c16e2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.595232 Sep 13 16:39:36.937112 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1261/2435] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:39:36 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:36.939633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:36.940708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:36.941360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:36.956891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:36.957305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:36.958214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:36.958763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:36.964307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:36.983992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:36.984523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:36.986531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:36.987325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:36.989456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:36.990509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:37.067829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:37.070449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:37.071213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:37.074050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lazy-loading 'fault' on Instance uuid 51e6ef02-b609-4ab1-8243-f5edaa26853a {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:39:37.152701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:37.170798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:37.172718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:37.196592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:37.201286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40dfe7bc-55d5-4bf3-9399-3198d1b58c57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.260884 Sep 13 16:39:37.204101 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1262/2436] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:36 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:37.214551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b396d7e9-9311-4737-80a5-27006fca0390 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb5ae3b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-297309388", "description": "tempest-description-2077524073"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:37.572135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b396d7e9-9311-4737-80a5-27006fca0390 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.366210 Sep 13 16:39:37.573505 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1263/2437] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:39:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:37.580330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:37.581631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:37.593098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:37.594100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:37.595032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:37.596316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:37.602556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:37.606434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:37.935818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:37.946774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67fe1cdf-a6f3-4a3e-bee7-4d390519412c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 0.371212 Sep 13 16:39:37.947985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1264/2438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:37 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:37.953218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:37.954130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:37.964091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:37.964847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:37.965510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:37.966323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:37.967083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:37.967981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:38.020932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.031588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.033417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.035734 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f8d41f9-d77d-40c2-9435-35446ddaf23d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 200 len: 1269 microversion: 2.25 time: 1.116668 Sep 13 16:39:38.057353 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1175/2439] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:36 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 1269 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:38.063038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48606136-8fa0-4ea8-a18a-3c2189308e46 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb4ba83a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-712369328", "description": "tempest-description-534421638"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:38.098555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.112091 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-137d5a7d-5c80-46d9-bbef-78a9929655de tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1211 microversion: 2.1 time: 0.161931 Sep 13 16:39:38.117249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1265/2440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:37 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1211 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:38.124551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:38.125797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:38.138326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:38.139605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:38.140288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:38.141205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:38.142088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:38.142966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:38.461341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.475953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-209976d5-39df-4184-a8b8-3389b233f6ff tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.357074 Sep 13 16:39:38.478077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1266/2441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:38 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:38.532528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:38.535828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:38.554819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:38.555469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:38.556037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:38.556966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:38.557552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:38.558447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:38.699331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.713016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.715406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:38.724449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c3dfa93-4494-4fde-ab2d-f5f9aa53ae32 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.231611 Sep 13 16:39:38.726165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1267/2442] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:38 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:38.973747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:38.974785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:38.991215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:38.996098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:38.998406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:39.000092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:39.004645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:39.005493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:39.022103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:39.055451 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48606136-8fa0-4ea8-a18a-3c2189308e46 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.996523 Sep 13 16:39:39.057156 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1176/2443] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:39:38 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:39.087958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:39.091868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 51e6ef02-b609-4ab1-8243-f5edaa26853a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:39.124985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:39.125502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:39.129472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:39.131777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:39.132297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:39.132743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:39.195316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] HTTP exception thrown: Instance 51e6ef02-b609-4ab1-8243-f5edaa26853a could not be found. Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Request method failure captured: Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a HTTP/1.1 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBwoD7UfkD3qr9C7cyubamQr9wFbjX0RM3WaZRCTSQnPwYNEz5PcrA_goEd8_sF198Mmj599GWakv09Y7lKlZ10IjVQddhnLIA7ugirWy3Iyyz5ppN80fMJu26Ly6TwxtbwMvveAPrXPplIxwu0o3JkMMSvujNBbCnqwMYciUgCoAI Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.25 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 792d76dbc4394c77bee09f600364cb74 Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 51e6ef02-b609-4ab1-8243-f5edaa26853a could not be found. Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '51e6ef02-b609-4ab1-8243-f5edaa26853a'} Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e6ef02-b609-4ab1-8243-f5edaa26853a could not be found. Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e6ef02-b609-4ab1-8243-f5edaa26853a could not be found. Sep 13 16:39:39.202522 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e6ef02-b609-4ab1-8243-f5edaa26853a could not be found. Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:39.206866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Returning 404 to user: Instance 51e6ef02-b609-4ab1-8243-f5edaa26853a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:39.208337 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dccc394e-a2c7-415c-ad07-17b148580e4d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a" status: 404 len: 111 microversion: 2.25 time: 0.139349 Sep 13 16:39:39.213619 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1177/2444] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:39 2022] GET /compute/v2.1/servers/51e6ef02-b609-4ab1-8243-f5edaa26853a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:39:39.229504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:39.231658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:39.250503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:39.255903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:39.259209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:39.260220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:39.262475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:39.262941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:39.574136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:39.591062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa20d2f1-94cd-48c9-b477-c1255fdcc636 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1275 microversion: 2.1 time: 0.376062 Sep 13 16:39:39.603397 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1178/2445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:39 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1275 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:39.624944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1874731508", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "2daf86d7-598d-4b98-a079-651359bfdcee"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:39.794121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] validate_networks() for [('2daf86d7-598d-4b98-a079-651359bfdcee', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:39:40.246716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:40.255451 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26227a40-1247-4ce1-bb71-5a56688bf840 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 1.287887 Sep 13 16:39:40.268424 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1268/2446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:38 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:40.285415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:40.286085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:40.312554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:40.313102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:40.313574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:40.314374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:40.316563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:40.320109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:40.756226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:40.778789 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7f98d606-8857-4a38-ba04-7bd1425e278f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.506071 Sep 13 16:39:40.783520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1269/2447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:40 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:40.819403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:40.822919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:40.832212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:40.834338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:40.834968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:40.835867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:40.836511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:40.837205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.010163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:41.026465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:41.031852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:41.060157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e59a20ed-38ae-4d5a-9384-1f4de2702740 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.272528 Sep 13 16:39:41.062715 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1270/2448] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:40 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:41.079777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:41.080637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:41.089289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:41.090143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:41.090933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.093457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:41.094223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:41.095097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.186915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:41.197927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a60c3dd-fa20-4d28-a5a1-0cc596d60b7e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1273 microversion: 2.1 time: 0.131724 Sep 13 16:39:41.198717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1271/2449] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:41 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:41.245775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:39:41.247570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:39:41.248514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:39:41.249539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:39:41.250244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:39:41.271242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:41.272144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:41.272768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.273859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1928202917", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2d67f00-3d76-4c01-9d44-ba2cf66dba91"}], "security_groups": [{"name": "tempest-securitygroup--1966178810"}], "key_name": "tempest-keypair-1147636200", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:41.274433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:41.275053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:41.275658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.305785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Getting quotas for project 2677cc7ad9fa426aa14de85453b4b368. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:39:41.313217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Getting quotas for user 4f79b99f0e814aaebc8e60ab612a58d4 and project 2677cc7ad9fa426aa14de85453b4b368. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:39:41.358393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:39:41.362381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:39:41.466841 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-31505258-192b-4d8e-8b2b-1b1b53080175 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.857807 Sep 13 16:39:41.474485 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1179/2450] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:39:41.478214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:41.478831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:41.495350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:41.495860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:41.496315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.497050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:41.497604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:41.498077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:41.513321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] validate_networks() for [('a2d67f00-3d76-4c01-9d44-ba2cf66dba91', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:39:42.554243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:42.578888 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-604f3301-f7c5-40c0-8660-b6e5e1a416d2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 1.104735 Sep 13 16:39:42.591136 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1180/2451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:41 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:42.598063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:42.600381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:42.617364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:42.618378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:42.619273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:42.620306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:42.620974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:42.621623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:42.818688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:42.835192 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c69e7725-9f6f-4b23-a977-d7788d0266a3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1220 microversion: 2.1 time: 0.241313 Sep 13 16:39:42.837852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1181/2452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:42 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1220 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:42.846053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:42.848681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:42.870325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:42.872070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:42.872534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:42.873294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:42.873780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:42.874249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.009352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:39:43.010474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:39:43.011145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:39:43.011763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:39:43.012366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:39:43.025975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.026772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.027438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.028958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.030077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.031075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.073486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for project 1ce4b7f916b64240af037c66c8665c53. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:39:43.090399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Getting quotas for user 780658a6bd6649bf889299f03d80c145 and project 1ce4b7f916b64240af037c66c8665c53. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:39:43.115301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:39:43.118204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:39:43.186768 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-54420ca3-c7a8-46fd-8406-b326bd1a99c7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.918679 Sep 13 16:39:43.195864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1272/2453] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:39:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:39:43.202741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:43.203586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:43.229393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.232854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.233567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.235923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.236558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.239436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.349273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:43.360758 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea9ee49a-619c-4333-9407-ebeec4e7249e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.520938 Sep 13 16:39:43.366508 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1182/2454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:42 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:43.380745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8677d423-350d-4e66-9905-e1be540e91ef req-2d27b7c3-5ba8-4263-bfcd-2de7c185a392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d055443-8621-42d4-b259-aea93fc37245", "name": "network-vif-plugged", "status": "completed", "tag": "495f1050-c242-435c-9639-4ad73725e092"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:43.383301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:43.405897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8677d423-350d-4e66-9905-e1be540e91ef req-2d27b7c3-5ba8-4263-bfcd-2de7c185a392 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.406618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8677d423-350d-4e66-9905-e1be540e91ef req-2d27b7c3-5ba8-4263-bfcd-2de7c185a392 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.407256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8677d423-350d-4e66-9905-e1be540e91ef req-2d27b7c3-5ba8-4263-bfcd-2de7c185a392 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.411665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:43.417812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:43.425794 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8677d423-350d-4e66-9905-e1be540e91ef req-2d27b7c3-5ba8-4263-bfcd-2de7c185a392 service nova] Creating event network-vif-plugged:495f1050-c242-435c-9639-4ad73725e092 for instance 5d055443-8621-42d4-b259-aea93fc37245 on n-h2-857467-1 Sep 13 16:39:43.427318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc0f8217-a913-4683-88b2-18377e80bd70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.229912 Sep 13 16:39:43.446133 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8677d423-350d-4e66-9905-e1be540e91ef req-2d27b7c3-5ba8-4263-bfcd-2de7c185a392 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067850 Sep 13 16:39:43.446803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1273/2455] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:43 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:43.454992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:43.455625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:43.457466 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1183/2456] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:43.463695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.464455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.465212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.466896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.468307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.469349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.473247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f21704ae-75e9-4537-af53-4830eadff8b9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:43.473999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f21704ae-75e9-4537-af53-4830eadff8b9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:43.748785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f21704ae-75e9-4537-af53-4830eadff8b9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:43.764356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f21704ae-75e9-4537-af53-4830eadff8b9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1246 microversion: 2.1 time: 0.305394 Sep 13 16:39:43.767603 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1184/2457] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:43 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1246 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:43.779005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-fe5d0fa4-20c2-4227-9acb-abb9a0160732 req-308806e5-36b5-40ef-bde8-6a2b941171a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97440adf-b971-4533-8e5a-49a5b5937d02", "tag": "92ec5222-77bb-4339-b616-cfcd79911a8c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:43.827761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fe5d0fa4-20c2-4227-9acb-abb9a0160732 req-308806e5-36b5-40ef-bde8-6a2b941171a8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.828256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fe5d0fa4-20c2-4227-9acb-abb9a0160732 req-308806e5-36b5-40ef-bde8-6a2b941171a8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.828694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fe5d0fa4-20c2-4227-9acb-abb9a0160732 req-308806e5-36b5-40ef-bde8-6a2b941171a8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.843240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:43.861139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03e441ee-ca10-44c4-8cb8-6183a8f4af82 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.407728 Sep 13 16:39:43.864161 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1274/2458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:43 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:43.866049 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fe5d0fa4-20c2-4227-9acb-abb9a0160732 req-308806e5-36b5-40ef-bde8-6a2b941171a8 service nova] Creating event network-changed:92ec5222-77bb-4339-b616-cfcd79911a8c for instance 97440adf-b971-4533-8e5a-49a5b5937d02 on n-h1-857467-1 Sep 13 16:39:43.876858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-fe5d0fa4-20c2-4227-9acb-abb9a0160732 req-308806e5-36b5-40ef-bde8-6a2b941171a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107928 Sep 13 16:39:43.878129 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1185/2459] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:43.892803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:43.895055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:43.896085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:43.896902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:43.918114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.918863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.919615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.923782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.924518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.925143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.936123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.945750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.953027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:43.954617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:43.955898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:43.960380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.210368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.222959 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01ed8ffa-9b65-4fc5-8116-fef8f36e7aaf tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1276 microversion: 2.1 time: 0.342158 Sep 13 16:39:44.245493 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1186/2460] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:43 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1276 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:44.288753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.296726 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aae2b539-93de-4ae5-b7a1-569fa297527a tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 0.431109 Sep 13 16:39:44.297318 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1275/2461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:43 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:44.395832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:44.396503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:44.408665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:44.412211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:44.413682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.416711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:44.417582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:44.418252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.463050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:44.463925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:44.489664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:44.490396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:44.492505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.493405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:44.495280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:44.495877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.696090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.714486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.721875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.738865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7e01397-1f44-4a85-a59f-fa1f471f2e37 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.278744 Sep 13 16:39:44.742169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1276/2462] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:44 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:44.792691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:44.793891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:44.806440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:44.808874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:44.811379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.814178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:44.816629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:44.819079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:44.973662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.981391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:44.982473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e0db143-1b8c-4466-9acf-bec6db3ac559 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.592535 Sep 13 16:39:44.983059 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1187/2463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:44 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:45.012009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ccc53db1-e804-4dc3-8ba4-3ebac8cd4bcd tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1298 microversion: 2.1 time: 0.222436 Sep 13 16:39:45.013633 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1277/2464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:44 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:45.021075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:45.021701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:45.053338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.055218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.056840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.058438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.059055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.060470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.257124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:45.258433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:45.273019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.275674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.276686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.279904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.280587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.281367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.415122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:45.426651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-757ac24b-6051-4f22-8c7f-38968758f360 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1274 microversion: 2.1 time: 0.178345 Sep 13 16:39:45.429512 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1278/2465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:45 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:45.449427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:45.454097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:45.476798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.478365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.479124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.481503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.482998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.483921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.787680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:45.805417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-110b798f-5b9c-4626-8b54-59bb9aa8c0c1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.790398 Sep 13 16:39:45.810676 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1188/2466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:44 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:45.812631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:45.820901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:45.822028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:45.826124 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d1edee2f-9b8e-4fde-bce1-c6675526d8de tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1308 microversion: 2.1 time: 0.394326 Sep 13 16:39:45.828808 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1279/2467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:45 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:45.841174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.844046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.844471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:45.846469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:45.846963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:45.848036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.011694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:46.012735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:46.021361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.022230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.022846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.023901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.024519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.025269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.070646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:46.087599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:46.093380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:46.109231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79dd37aa-2e2a-4a49-a3ce-54209a9613c0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.296046 Sep 13 16:39:46.137427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1189/2468] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:45 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:46.148837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:46.154846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:46.168693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.199320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.201667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.205383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.207985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.216093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.412345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:46.435126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce658368-a3d0-4b62-838b-e0dfa740a681 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.428182 Sep 13 16:39:46.436684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1280/2469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:46 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:39:46.458898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:46.461054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:46.470431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c8bcdfa-b599-4852-80ec-e3d458b5a03a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1298 microversion: 2.1 time: 0.331515 Sep 13 16:39:46.471131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:46.471930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1190/2470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:46 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:46.480670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.481506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.482193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.483308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.484099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.484825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.811071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:46.826094 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b5544e4-2993-499e-8c13-6c82ffebfd41 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.371897 Sep 13 16:39:46.855525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:46.856229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:46.873647 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1281/2471] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:46 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:46.883148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.893041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.893619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.896889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:46.897528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:46.900743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.901250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.901700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.927857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.931841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.933603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:46.935516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:46.937479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:46.944400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:47.288397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:47.308053 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c357d7d-e672-4543-8a48-9b1925d8713b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1488 microversion: 2.1 time: 0.432954 Sep 13 16:39:47.309078 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1282/2472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:46 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1488 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:47.324966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:47.325815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:47.336214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:47.337042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:47.337667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:47.339953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:47.344192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:47.345004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:47.503060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:47.513989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:47.516195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:47.522969 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3bbec21-1459-4e24-abf2-33059b847623 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.201912 Sep 13 16:39:47.524027 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1283/2473] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:47 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:47.528898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-457337407"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:47.531887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:47.539220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:47.540095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:47.540885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:47.541879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:47.543532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:47.544716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:47.954254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:47.977497 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4b25ff8-0517-4d34-a632-c4ad7c137c7b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 1.130110 Sep 13 16:39:47.978535 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1191/2474] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:46 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:48.000923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:48.006789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:48.024885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:48.025259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:48.027615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:48.032554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:48.033730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:48.035461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:49.522484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:49.532720 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2760396b-92cb-45b7-8133-1c285213cec7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 1.553059 Sep 13 16:39:49.539340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1192/2475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:47 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:49.549481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:49.551180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:49.570153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:49.571119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:49.571866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:49.573299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:49.574357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:49.579300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:49.631732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:49.711013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:49.719894 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c799bb08-5702-4371-8c79-24cb2c5118b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1304 microversion: 2.1 time: 0.179214 Sep 13 16:39:49.725702 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1193/2476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:49 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:49.735070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:49.736059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:49.751822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:49.752687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:49.753354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:49.754876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:49.758530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:49.759262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:50.235145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:50.246821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-447cde0a-a127-4fd2-b22f-45d42fe4acbd tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.519593 Sep 13 16:39:50.251609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1194/2477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:49 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:50.261701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:50.265422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:50.281738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:50.282570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:50.283223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:50.284161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:50.288255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:50.288907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:50.331436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:39:50.512039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e037cfd9-2591-4444-86ff-6acfb4c2d103 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 204 len: 0 microversion: 2.25 time: 0.258031 Sep 13 16:39:50.519873 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1195/2478] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:39:50 2022] DELETE /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:39:50.544736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:50.549370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:50.562461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:50.569556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:50.570991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:50.574185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:50.574768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:50.577594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:50.750139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:50.763272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:50.767106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:50.787897 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fab3d71c-7bca-43bc-9627-0446f5e08fc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.261756 Sep 13 16:39:50.788584 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1196/2479] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:50 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:50.794303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:50.794934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:50.813264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:50.814763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:50.819101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:50.824153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:50.827209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:50.828782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:51.214131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:51.235730 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ab22d16-3c36-4a75-8eab-f4dee010b4d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.445177 Sep 13 16:39:51.236688 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1197/2480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:50 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:51.260228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5c0bc37e-63fd-42a0-80e5-7e2fe046cfce req-607e9601-12cb-4269-a082-c980139b8c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3c2e4f-eda6-4e0f-934b-56bb68b93941", "tag": "0c98a460-0b3b-4003-a5a8-09d73bca81cf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:51.287316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5c0bc37e-63fd-42a0-80e5-7e2fe046cfce req-607e9601-12cb-4269-a082-c980139b8c72 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:51.288892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5c0bc37e-63fd-42a0-80e5-7e2fe046cfce req-607e9601-12cb-4269-a082-c980139b8c72 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:51.290225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5c0bc37e-63fd-42a0-80e5-7e2fe046cfce req-607e9601-12cb-4269-a082-c980139b8c72 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:51.304739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:51.315332 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5c0bc37e-63fd-42a0-80e5-7e2fe046cfce req-607e9601-12cb-4269-a082-c980139b8c72 service nova] Creating event network-changed:0c98a460-0b3b-4003-a5a8-09d73bca81cf for instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 on n-h2-857467-1 Sep 13 16:39:51.322251 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5c0bc37e-63fd-42a0-80e5-7e2fe046cfce req-607e9601-12cb-4269-a082-c980139b8c72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073552 Sep 13 16:39:51.323653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1198/2481] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:51.330416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:51.333539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:51.346647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:51.348056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:51.349717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:51.351610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:51.352436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:51.353051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:51.926255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:51.940151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:51.946142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:51.951184 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec3e4ee4-6c15-4f99-9075-9429880b5c35 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1732 microversion: 2.25 time: 0.622503 Sep 13 16:39:51.962482 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1199/2482] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:51 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1732 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:51.980817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:51.981519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:51.996914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:51.999773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:52.000269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:52.000709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:52.004706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:52.008460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:52.009097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:52.415001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:52.428819 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-acdbbdc9-48c9-442c-9f0d-368e1c8ce3de tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.463930 Sep 13 16:39:52.445754 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1200/2483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:51 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:52.451239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:52.451955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:52.461606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:52.462140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:52.462802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:52.463547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:52.464016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:52.464455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:52.790941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:52.799181 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6877c7a-aef6-4f04-a013-2fe6c7523fa9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.352245 Sep 13 16:39:52.803408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1201/2484] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:52 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:52.814828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:52.814828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:52.837084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:52.837593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:52.839623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:52.840357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:52.840826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:52.841264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.044353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:53.108230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:53.157018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.170542 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cf78b733-b948-4d6f-8b03-41de15dc6740 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.365979 Sep 13 16:39:53.171144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1202/2485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:52 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:53.176952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-40aa8f1d-d7a5-4cb2-9d6c-50d7914ebd77 req-150dd052-03c9-4eae-a827-9473c1c02a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97440adf-b971-4533-8e5a-49a5b5937d02", "name": "network-vif-plugged", "status": "completed", "tag": "92ec5222-77bb-4339-b616-cfcd79911a8c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:53.196540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-40aa8f1d-d7a5-4cb2-9d6c-50d7914ebd77 req-150dd052-03c9-4eae-a827-9473c1c02a80 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.197403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-40aa8f1d-d7a5-4cb2-9d6c-50d7914ebd77 req-150dd052-03c9-4eae-a827-9473c1c02a80 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.198060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-40aa8f1d-d7a5-4cb2-9d6c-50d7914ebd77 req-150dd052-03c9-4eae-a827-9473c1c02a80 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.214292 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-40aa8f1d-d7a5-4cb2-9d6c-50d7914ebd77 req-150dd052-03c9-4eae-a827-9473c1c02a80 service nova] Creating event network-vif-plugged:92ec5222-77bb-4339-b616-cfcd79911a8c for instance 97440adf-b971-4533-8e5a-49a5b5937d02 on n-h1-857467-1 Sep 13 16:39:53.219997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-40aa8f1d-d7a5-4cb2-9d6c-50d7914ebd77 req-150dd052-03c9-4eae-a827-9473c1c02a80 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047714 Sep 13 16:39:53.220914 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1203/2486] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:53.228087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:53.228971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:53.236167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.236885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.237522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.239047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.239967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.240594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.329429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.345492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.347301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.356096 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d95db28-b8f4-4300-a088-249a72f8a2e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.133589 Sep 13 16:39:53.357236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1204/2487] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:53 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:53.362153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:53.363486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:53.369687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.370488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.371088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.372290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.372914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.373502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.731050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.742598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a90059f6-c09d-43ed-afcd-8c9ca266f333 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.382762 Sep 13 16:39:53.743223 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1205/2488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:53 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:53.756668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-0178215e-c792-45f1-afdf-8c9080ae2197 req-db533db6-36ec-4e05-80af-a71c87f42191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b35670-fff0-424c-ae44-5adf194bb6b2", "tag": "eb633aec-7996-4ba1-beff-b41c46875ab2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:53.780624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:53.786077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0178215e-c792-45f1-afdf-8c9080ae2197 req-db533db6-36ec-4e05-80af-a71c87f42191 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.787132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0178215e-c792-45f1-afdf-8c9080ae2197 req-db533db6-36ec-4e05-80af-a71c87f42191 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.787860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0178215e-c792-45f1-afdf-8c9080ae2197 req-db533db6-36ec-4e05-80af-a71c87f42191 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.819478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-0178215e-c792-45f1-afdf-8c9080ae2197 req-db533db6-36ec-4e05-80af-a71c87f42191 service nova] Creating event network-changed:eb633aec-7996-4ba1-beff-b41c46875ab2 for instance 52b35670-fff0-424c-ae44-5adf194bb6b2 on n-h1-857467-1 Sep 13 16:39:53.826533 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-0178215e-c792-45f1-afdf-8c9080ae2197 req-db533db6-36ec-4e05-80af-a71c87f42191 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079379 Sep 13 16:39:53.829751 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1206/2489] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:53.838573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:53.839761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:53.855598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.856056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.856514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.857253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:53.857731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:53.858209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:53.958672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.974918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.977420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:53.980333 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cf7a1e35-dcef-402e-9eb0-9e540e2dcf23 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 200 len: 1664 microversion: 2.25 time: 0.148491 Sep 13 16:39:53.981113 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1207/2490] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:53 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:53.988996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:53.990031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:53.999743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.000683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.001535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.002626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.003269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.004090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.396260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:54.405024 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c65b972-1809-40e0-9fd1-b7d0cd47b7e1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.421682 Sep 13 16:39:54.410782 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1208/2491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:53 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:54.420762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2d5d4714-193d-467a-aac7-044fc727998d req-2358f350-5090-4535-9ce1-ec1a16065581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7305af6-eeb4-43bc-ac65-52988a63a1de", "name": "network-vif-deleted", "tag": "623fd98d-6910-4803-8c51-595d0e97b6c3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:54.442625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d5d4714-193d-467a-aac7-044fc727998d req-2358f350-5090-4535-9ce1-ec1a16065581 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.443126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d5d4714-193d-467a-aac7-044fc727998d req-2358f350-5090-4535-9ce1-ec1a16065581 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.443572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d5d4714-193d-467a-aac7-044fc727998d req-2358f350-5090-4535-9ce1-ec1a16065581 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.475532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2d5d4714-193d-467a-aac7-044fc727998d req-2358f350-5090-4535-9ce1-ec1a16065581 service nova] Creating event network-vif-deleted:623fd98d-6910-4803-8c51-595d0e97b6c3 for instance f7305af6-eeb4-43bc-ac65-52988a63a1de on n-h2-857467-1 Sep 13 16:39:54.492888 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2d5d4714-193d-467a-aac7-044fc727998d req-2358f350-5090-4535-9ce1-ec1a16065581 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080559 Sep 13 16:39:54.493856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1209/2492] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:54.522531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:54.523388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:54.532684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.533245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.544814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.545747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.546285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.546737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.786252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:54.794895 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19fa8ccb-2d40-42c3-be69-5a52ef479157 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.289396 Sep 13 16:39:54.795495 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1210/2493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:54 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:54.803103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:54.803747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:54.810653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.811165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.811613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.812334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:54.812804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:54.813246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:54.818208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:55.243573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:55.255582 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12863438-0ce6-487d-9c5b-b6e864eb1261 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.458963 Sep 13 16:39:55.257416 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1211/2494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:54 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:55.272401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:55.277001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:55.292796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.293307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.293989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.295900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.296621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.297416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.392064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:55.410737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:55.412216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:55.423861 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f778f7b9-1c63-497c-ba89-6aa230f5b652 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.162798 Sep 13 16:39:55.442236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1212/2495] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:55 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:55.457950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:55.458591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:55.468095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.469136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.469584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.470352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.470828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.471263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.687206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:55.696464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c580506-9451-49ea-8234-3f8a94db553c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.253022 Sep 13 16:39:55.697066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1213/2496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:55 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:55.711604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:55.711604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: f7305af6-eeb4-43bc-ac65-52988a63a1de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:55.711604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.711604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.711604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.711604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.712161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.712299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.761734 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] HTTP exception thrown: Instance f7305af6-eeb4-43bc-ac65-52988a63a1de could not be found. Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Request method failure captured: Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de HTTP/1.1 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBwoD7UfkD3qr9C7cyubamQr9wFbjX0RM3WaZRCTSQnPwYNEz5PcrA_goEd8_sF198Mmj599GWakv09Y7lKlZ10IjVQddhnLIA7ugirWy3Iyyz5ppN80fMJu26Ly6TwxtbwMvveAPrXPplIxwu0o3JkMMSvujNBbCnqwMYciUgCoAI Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.25 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 792d76dbc4394c77bee09f600364cb74 Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance f7305af6-eeb4-43bc-ac65-52988a63a1de could not be found. Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f7305af6-eeb4-43bc-ac65-52988a63a1de'} Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7305af6-eeb4-43bc-ac65-52988a63a1de could not be found. Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7305af6-eeb4-43bc-ac65-52988a63a1de could not be found. Sep 13 16:39:55.763488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7305af6-eeb4-43bc-ac65-52988a63a1de could not be found. Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Returning 404 to user: Instance f7305af6-eeb4-43bc-ac65-52988a63a1de could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a5f7da2-f98b-4fa6-be49-f8d4b5efc28b tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de" status: 404 len: 111 microversion: 2.25 time: 0.066939 Sep 13 16:39:55.771018 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1214/2497] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:55 2022] GET /compute/v2.1/servers/f7305af6-eeb4-43bc-ac65-52988a63a1de => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:39:55.777960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:55.778976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:55.790246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.790729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.791529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:55.792258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:55.793002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:55.793454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:56.103894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:56.123366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19ff161b-b067-41b4-a6ab-0cd708ceba40 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.352372 Sep 13 16:39:56.124971 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1215/2498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:55 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:56.138870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cf1913c0-0154-4233-adbc-8cad78a43eed tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '.version_select at 0x7fbeb4e5c0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:56.170125 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cf1913c0-0154-4233-adbc-8cad78a43eed tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344773176" status: 204 len: 0 microversion: 2.25 time: 0.043078 Sep 13 16:39:56.170827 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1216/2499] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:39:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344773176 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:39:56.176340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:56.177157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:56.186417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:56.186855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:56.187313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:56.188410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:56.188957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:56.189543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:56.437035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:56.452334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-026713cb-2574-4f7d-b906-c15e2ac60205 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.280364 Sep 13 16:39:56.454011 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1217/2500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:56 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:56.463630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:56.464725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:56.479046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:56.479806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:56.480412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:56.481340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:56.482130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:56.483662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:56.903812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:56.915380 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bffe03be-f6ad-4a75-b00b-e9031ca4f9ae tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.459900 Sep 13 16:39:56.916446 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1218/2501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:56 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:56.922074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:56.922825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:56.930821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:56.934403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:56.935059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:56.935909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:56.936540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:56.937059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.039443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:57.049038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:57.051224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:57.057815 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c2d41b9-68ce-4421-994e-9b21833b042f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.140141 Sep 13 16:39:57.058744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1219/2502] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:56 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:57.067592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:57.068415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:57.075212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.075714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.076160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.076878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.077344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.077785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.289526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:57.309025 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40f02166-d7ce-4c02-ae63-43d3ee5d82cf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.249108 Sep 13 16:39:57.310334 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1220/2503] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:57 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:57.319951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:57.320918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:57.330478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.331436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.333121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.334117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.334817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.335492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.537056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:57.604514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:39:57.615841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:57.627678 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d40eda0-6bc1-4e4c-b43d-c0f1f65cd292 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.315626 Sep 13 16:39:57.642404 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1221/2504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:57 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:57.657092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:57.658111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:57.665616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.666262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.667064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.668152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.668698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.669227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.873099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:57.884051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-09b503e6-ca77-4b20-a94a-37c4fdcf5d61 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.236820 Sep 13 16:39:57.884966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1222/2505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:57 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:57.891652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:57.892286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:57.899890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.900756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.901269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.902162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:57.903105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:57.903623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:57.951999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:39:58.110260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc641465-e934-4a8b-9c98-a41f06b052d4 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 204 len: 0 microversion: 2.25 time: 0.223296 Sep 13 16:39:58.110871 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1223/2506] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:39:57 2022] DELETE /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:39:58.118275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:58.119003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:58.127584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.128099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.128549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.130282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.130766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.131482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.518917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a1b06cd-ba68-4c66-b3d9-26becfa18261 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "POST /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245/action" status: 202 len: 0 microversion: 2.1 time: 10.993385 Sep 13 16:39:58.538506 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1284/2507] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:39:47 2022] POST /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245/action => generated 0 bytes in 11013 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:39:58.547208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-dd264d76-da6c-4adf-a530-ce234571ce37 req-58118b4c-4e61-474c-8f4c-37461a8865e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3c2e4f-eda6-4e0f-934b-56bb68b93941", "name": "network-vif-plugged", "status": "completed", "tag": "0c98a460-0b3b-4003-a5a8-09d73bca81cf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:39:58.597882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-dd264d76-da6c-4adf-a530-ce234571ce37 req-58118b4c-4e61-474c-8f4c-37461a8865e4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.597882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-dd264d76-da6c-4adf-a530-ce234571ce37 req-58118b4c-4e61-474c-8f4c-37461a8865e4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.597882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-dd264d76-da6c-4adf-a530-ce234571ce37 req-58118b4c-4e61-474c-8f4c-37461a8865e4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.611368 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-dd264d76-da6c-4adf-a530-ce234571ce37 req-58118b4c-4e61-474c-8f4c-37461a8865e4 service nova] Creating event network-vif-plugged:0c98a460-0b3b-4003-a5a8-09d73bca81cf for instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 on n-h2-857467-1 Sep 13 16:39:58.619427 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-dd264d76-da6c-4adf-a530-ce234571ce37 req-58118b4c-4e61-474c-8f4c-37461a8865e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077949 Sep 13 16:39:58.624468 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1285/2508] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:39:58.632276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:58.633710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:58.641694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.642371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.643142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.645025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.645718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.646450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.705703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:58.717150 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73b67fbd-4629-4422-b657-8be98eaa1921 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.605038 Sep 13 16:39:58.718455 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1224/2509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:58 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:58.722821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:58.723453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:58.735881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.738264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.740665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.741441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.742000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.742461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.805726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:58.840054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:58.843441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:58.854604 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-476c3bd4-919a-4e65-9658-2f560dc67fd0 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.227156 Sep 13 16:39:58.856200 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1286/2510] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:58 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:58.861928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:58.862783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:58.872138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.873005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.873657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:58.876550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:58.877209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:58.877953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:59.448955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:59.458410 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75c6014e-1a60-49c8-8525-0aaf985f441d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1315 microversion: 2.1 time: 0.599899 Sep 13 16:39:59.470802 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1287/2511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:58 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:59.476081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c4a1752e-6d20-4a64-9705-9829904208b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb52a9b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:59.568051 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c4a1752e-6d20-4a64-9705-9829904208b1 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb" status: 200 len: 1413 microversion: 2.1 time: 0.095967 Sep 13 16:39:59.576183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1288/2512] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:39:59 2022] GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:39:59.586965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:59.588206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:59.601066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:59.605580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:59.606424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:59.607772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:59.610416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:59.611539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:59.703531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:59.737057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:59.740365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:39:59.741691 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e0111bd9-83a0-4f7f-b25d-1fb6aa2c7001 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1550 microversion: 2.25 time: 1.022652 Sep 13 16:39:59.759264 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1225/2513] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:39:58 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1550 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:39:59.770109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:39:59.770668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:39:59.781258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:59.781765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:59.783834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:39:59.786092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:39:59.787855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:39:59.788444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.214596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:00.230479 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-844dccb9-63ec-41a0-ab6d-ee00d537841f tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.651295 Sep 13 16:40:00.233934 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1289/2514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:59 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:00.243879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-5cb66d15-f53a-46ce-a421-b980229ca869 req-00c6b7a3-0103-489c-9410-787fc359d01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa012e4d-50f0-4820-b7fe-39152d3710c5", "name": "network-vif-unplugged", "status": "completed", "tag": "f1cdf295-3265-4032-9f1e-693658cfcee9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:00.284465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5cb66d15-f53a-46ce-a421-b980229ca869 req-00c6b7a3-0103-489c-9410-787fc359d01c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.305956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5cb66d15-f53a-46ce-a421-b980229ca869 req-00c6b7a3-0103-489c-9410-787fc359d01c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.306772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5cb66d15-f53a-46ce-a421-b980229ca869 req-00c6b7a3-0103-489c-9410-787fc359d01c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.345142 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-5cb66d15-f53a-46ce-a421-b980229ca869 req-00c6b7a3-0103-489c-9410-787fc359d01c service nova] Creating event network-vif-unplugged:f1cdf295-3265-4032-9f1e-693658cfcee9 for instance fa012e4d-50f0-4820-b7fe-39152d3710c5 on n-h2-857467-1 Sep 13 16:40:00.353580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-5cb66d15-f53a-46ce-a421-b980229ca869 req-00c6b7a3-0103-489c-9410-787fc359d01c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117706 Sep 13 16:40:00.354803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1290/2515] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:00.360649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2776c57-a2d9-455b-b730-1ca2d58f0e9d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb582dca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:00.445476 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2776c57-a2d9-455b-b730-1ca2d58f0e9d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb" status: 200 len: 1413 microversion: 2.1 time: 0.088405 Sep 13 16:40:00.458041 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1291/2516] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:40:00 2022] GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:00.466611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:00.468199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:00.484067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.485014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.485741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.491374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.492256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.493438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.590574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:00.604998 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1364ee4f-1a5f-4b65-b75f-6c82cb142cc7 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.844424 Sep 13 16:40:00.605611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1226/2517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:39:59 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:00.635289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:00.636104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:00.668637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.669459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.672176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.672973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.673454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.673970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.760573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:00.779913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81490710-7360-47da-a90b-521b351e99ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1316 microversion: 2.1 time: 0.320356 Sep 13 16:40:00.781103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1292/2518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:00 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:00.789001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ae0492ed-42ac-4506-a73d-60bf7beb19e4 req-c0d22f05-e92a-464b-a0dd-c020049f640f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc75b21-5d7e-45f8-9e20-54284da59b4f", "name": "network-vif-deleted", "tag": "8cecb1b1-676f-4d30-903a-addf6afd1de1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:00.804734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ae0492ed-42ac-4506-a73d-60bf7beb19e4 req-c0d22f05-e92a-464b-a0dd-c020049f640f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.805760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ae0492ed-42ac-4506-a73d-60bf7beb19e4 req-c0d22f05-e92a-464b-a0dd-c020049f640f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.806778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ae0492ed-42ac-4506-a73d-60bf7beb19e4 req-c0d22f05-e92a-464b-a0dd-c020049f640f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.823676 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ae0492ed-42ac-4506-a73d-60bf7beb19e4 req-c0d22f05-e92a-464b-a0dd-c020049f640f service nova] Creating event network-vif-deleted:8cecb1b1-676f-4d30-903a-addf6afd1de1 for instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f on n-h1-857467-1 Sep 13 16:40:00.829532 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ae0492ed-42ac-4506-a73d-60bf7beb19e4 req-c0d22f05-e92a-464b-a0dd-c020049f640f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047078 Sep 13 16:40:00.835987 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1293/2519] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:00.842632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6be9072f-7ebd-468a-8ce7-7be36f05749b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb536e0d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:00.862479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:00.866310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:00.886992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:00.897353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:00.908335 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f43d6e6a-a581-44ba-8332-35d3945e5243 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.289223 Sep 13 16:40:00.932030 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1227/2520] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:00 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:00.937058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:00.937685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:00.946798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.947292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.948014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:00.949101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:00.949756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:00.950623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.202087 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6be9072f-7ebd-468a-8ce7-7be36f05749b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb" status: 204 len: 0 microversion: 2.1 time: 0.364463 Sep 13 16:40:01.203284 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1294/2521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:00 2022] DELETE /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:01.213338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a74db5d2-49c9-4479-9b1e-f2961afc2703 req-17deed71-32c7-44ba-9586-67b4930003b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b35670-fff0-424c-ae44-5adf194bb6b2", "name": "network-vif-plugged", "status": "completed", "tag": "eb633aec-7996-4ba1-beff-b41c46875ab2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:01.228135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a74db5d2-49c9-4479-9b1e-f2961afc2703 req-17deed71-32c7-44ba-9586-67b4930003b2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.228787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a74db5d2-49c9-4479-9b1e-f2961afc2703 req-17deed71-32c7-44ba-9586-67b4930003b2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.230921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a74db5d2-49c9-4479-9b1e-f2961afc2703 req-17deed71-32c7-44ba-9586-67b4930003b2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.249235 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a74db5d2-49c9-4479-9b1e-f2961afc2703 req-17deed71-32c7-44ba-9586-67b4930003b2 service nova] Creating event network-vif-plugged:eb633aec-7996-4ba1-beff-b41c46875ab2 for instance 52b35670-fff0-424c-ae44-5adf194bb6b2 on n-h1-857467-1 Sep 13 16:40:01.257202 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a74db5d2-49c9-4479-9b1e-f2961afc2703 req-17deed71-32c7-44ba-9586-67b4930003b2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052167 Sep 13 16:40:01.258552 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1295/2522] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:01.263968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:01.274032 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0fedfee-373b-4caf-b306-db61440c3b99 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1502 microversion: 2.1 time: 0.340621 Sep 13 16:40:01.278834 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1228/2523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:00 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1502 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:01.283776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:01.287361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:01.292401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13e16f80-70c8-4e6d-8daf-0ed700627fb2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb4dbb040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:01.310406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.311072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.314028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.314792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.315272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.319774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.330593 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-13e16f80-70c8-4e6d-8daf-0ed700627fb2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Image not found. Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13e16f80-70c8-4e6d-8daf-0ed700627fb2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb HTTP/1.1 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '02efc7b7-7267-414a-a409-f7adaa9a48bb'} Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02efc7b7-7267-414a-a409-f7adaa9a48bb Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:40:01.333473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02efc7b7-7267-414a-a409-f7adaa9a48bb could not be found. Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13e16f80-70c8-4e6d-8daf-0ed700627fb2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:01.337127 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13e16f80-70c8-4e6d-8daf-0ed700627fb2 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb" status: 404 len: 62 microversion: 2.1 time: 0.054773 Sep 13 16:40:01.341647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1229/2524] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:40:01 2022] GET /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:40:01.346285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:01.346285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:01.368528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.372228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.375597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.376970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.378921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.381846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.418493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.423245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.423852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.426817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lazy-loading 'fault' on Instance uuid 1bc75b21-5d7e-45f8-9e20-54284da59b4f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:01.489372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:01.500388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:01.502165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:01.503623 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96733100-e0d5-4d52-8748-86f6ca9eb45e tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 200 len: 1352 microversion: 2.25 time: 0.243904 Sep 13 16:40:01.505894 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1296/2525] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:01 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 1352 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:01.511417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:01.512360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:01.556852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.560463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.561128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.565034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.567659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.570976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.745360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:01.762590 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88833dcb-7e05-4d62-9a41-8646377b0ab5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.419678 Sep 13 16:40:01.765080 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1230/2526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:01 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:01.782307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:01.787876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:01.797753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.798499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.799166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.800105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.801817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.802497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.916565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:01.942427 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0c9f3708-f607-428a-92b9-9f14fe6669be tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1506 microversion: 2.1 time: 0.431399 Sep 13 16:40:01.943278 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1297/2527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:01 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:01.948819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:01.957468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:01.975102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.980674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.981517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:01.984225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:01.986339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:01.990847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.204563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:02.214695 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34662c02-e91e-45d1-a0bb-774881da66f9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.445790 Sep 13 16:40:02.215557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1231/2528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:01 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:02.223182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:02.224178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:02.231171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.231897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.232580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.233521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.234283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.234948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.344950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:02.357458 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa343df5-fb65-41a0-af16-7b955d974516 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1505 microversion: 2.1 time: 0.413023 Sep 13 16:40:02.359341 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1298/2529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:01 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:02.381080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:02.388880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-297309388"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:02.389378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:02.392085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:02.393892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:02.401697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.403666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.404141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.404888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.405362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.405805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.407783 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-16e2cdc3-b17f-47eb-aaaa-fa96ca36da89 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.190936 Sep 13 16:40:02.421632 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1232/2530] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:02 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:02.435573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c498c30c-5143-4051-9533-ab437d99c83f req-99e7ef4e-f771-441a-ad54-05f6c20ab103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa012e4d-50f0-4820-b7fe-39152d3710c5", "tag": "f1cdf295-3265-4032-9f1e-693658cfcee9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:02.447075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c498c30c-5143-4051-9533-ab437d99c83f req-99e7ef4e-f771-441a-ad54-05f6c20ab103 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.448519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c498c30c-5143-4051-9533-ab437d99c83f req-99e7ef4e-f771-441a-ad54-05f6c20ab103 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.449196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c498c30c-5143-4051-9533-ab437d99c83f req-99e7ef4e-f771-441a-ad54-05f6c20ab103 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.471884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c498c30c-5143-4051-9533-ab437d99c83f req-99e7ef4e-f771-441a-ad54-05f6c20ab103 service nova] Creating event network-changed:f1cdf295-3265-4032-9f1e-693658cfcee9 for instance fa012e4d-50f0-4820-b7fe-39152d3710c5 on n-h2-857467-1 Sep 13 16:40:02.489986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c498c30c-5143-4051-9533-ab437d99c83f req-99e7ef4e-f771-441a-ad54-05f6c20ab103 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067178 Sep 13 16:40:02.491674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1233/2531] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:02.573662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:02.574593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 1bc75b21-5d7e-45f8-9e20-54284da59b4f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:02.585948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.595088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.595688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.603216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.604192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.604780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.622473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] HTTP exception thrown: Instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f could not be found. Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Request method failure captured: Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f HTTP/1.1 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILBwoD7UfkD3qr9C7cyubamQr9wFbjX0RM3WaZRCTSQnPwYNEz5PcrA_goEd8_sF198Mmj599GWakv09Y7lKlZ10IjVQddhnLIA7ugirWy3Iyyz5ppN80fMJu26Ly6TwxtbwMvveAPrXPplIxwu0o3JkMMSvujNBbCnqwMYciUgCoAI Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.25 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 792d76dbc4394c77bee09f600364cb74 Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f could not be found. Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1bc75b21-5d7e-45f8-9e20-54284da59b4f'} Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f could not be found. Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f could not be found. Sep 13 16:40:02.624447 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f could not be found. Sep 13 16:40:02.628324 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:02.629714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Returning 404 to user: Instance 1bc75b21-5d7e-45f8-9e20-54284da59b4f could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:02.630766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48d5b19b-acde-4bb3-ae40-02bd53bce4b0 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f" status: 404 len: 111 microversion: 2.25 time: 0.088050 Sep 13 16:40:02.631779 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1234/2532] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:02 2022] GET /compute/v2.1/servers/1bc75b21-5d7e-45f8-9e20-54284da59b4f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:40:02.642199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:02.642891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:02.650384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.652242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.652800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.655735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.656305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.682147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.699855 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.network.security_group_api [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Adding security group 77b00d18-f003-4c90-abc7-791026eeeca0 to port 0c98a460-0b3b-4003-a5a8-09d73bca81cf Sep 13 16:40:02.746765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:02.946899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f867a08-7e2a-4ec7-9259-3d2e10c45b83 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "DELETE /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 204 len: 0 microversion: 2.25 time: 0.309135 Sep 13 16:40:02.948000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1235/2533] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:40:02 2022] DELETE /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:40:02.961724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:02.962539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:02.975371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.975865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.976302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:02.977016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:02.977473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:02.982511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.554979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ccaca62b-a48c-4392-b732-c607e49d0e83 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941/action" status: 202 len: 0 microversion: 2.1 time: 1.172669 Sep 13 16:40:03.559425 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1299/2534] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:40:02 2022] POST /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:03.564158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:03.577837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-70dbc89f-0468-470e-b617-ca05fba0bc1e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.628294 Sep 13 16:40:03.577995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:03.578497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:03.596363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1236/2535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:02 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:03.603539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:03.604180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:03.608347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.608868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.610926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.611430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.611982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.612709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.613284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.618460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.619944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.620568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.621074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.621530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.841164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:03.856361 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6092069e-5415-4596-b93e-9affa454e6af tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1506 microversion: 2.1 time: 0.258678 Sep 13 16:40:03.872506 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1237/2536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:03 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:03.877430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:03.878364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:03.888293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:03.895572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.896218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.896662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.897383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.897895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.902495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:03.903256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.905462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:03.907164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0c4278cb-88a3-4e02-b4a2-447346f6fc73 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1564 microversion: 2.25 time: 0.341091 Sep 13 16:40:03.917817 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1300/2537] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:03 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1564 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:03.936715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:03.939819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:03.948603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.950201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.951079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:03.952059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:03.952756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:03.953417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.052529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:04.081483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:04.085491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:04.090314 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff2c5c1e-9853-457d-8a4a-65b5a944297f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.170913 Sep 13 16:40:04.091314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1301/2538] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:03 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:04.098395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34fc7362-ea06-4932-b268-8ae08004fdc7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb5158790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:04.219353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:04.229194 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7b99b225-357c-42b6-9fd1-1382a4b0dc29 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1372 microversion: 2.1 time: 0.355485 Sep 13 16:40:04.229804 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1238/2539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:03 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:04.245225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6891e045-c5c8-49dc-8101-b0e9de60f9ce req-a9a2720f-c145-4ff0-a462-bfcf3356321c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3c2e4f-eda6-4e0f-934b-56bb68b93941", "tag": "0c98a460-0b3b-4003-a5a8-09d73bca81cf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:04.283113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:04.285093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6891e045-c5c8-49dc-8101-b0e9de60f9ce req-a9a2720f-c145-4ff0-a462-bfcf3356321c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.292165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6891e045-c5c8-49dc-8101-b0e9de60f9ce req-a9a2720f-c145-4ff0-a462-bfcf3356321c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.293189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6891e045-c5c8-49dc-8101-b0e9de60f9ce req-a9a2720f-c145-4ff0-a462-bfcf3356321c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.340509 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6891e045-c5c8-49dc-8101-b0e9de60f9ce req-a9a2720f-c145-4ff0-a462-bfcf3356321c service nova] Creating event network-changed:0c98a460-0b3b-4003-a5a8-09d73bca81cf for instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 on n-h2-857467-1 Sep 13 16:40:04.362218 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6891e045-c5c8-49dc-8101-b0e9de60f9ce req-a9a2720f-c145-4ff0-a462-bfcf3356321c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130995 Sep 13 16:40:04.363747 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1239/2540] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:04.370065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b760ca7c-4cef-41e2-aab7-03caae13eec8"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:04.372463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:04.373105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-34fc7362-ea06-4932-b268-8ae08004fdc7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use.", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:04.374045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-34fc7362-ea06-4932-b268-8ae08004fdc7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.374045 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34fc7362-ea06-4932-b268-8ae08004fdc7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0 HTTP/1.1 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: exception: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '77b00d18-f003-4c90-abc7-791026eeeca0'} Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:04.376334 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] Sep 13 16:40:04.381672 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:04.387051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.387051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.387051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.387051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.387051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.387051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.398557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34fc7362-ea06-4932-b268-8ae08004fdc7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 400 to user: Security Group 77b00d18-f003-4c90-abc7-791026eeeca0 in use. Sep 13 16:40:04.398557 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-f1bbce0f-646b-4b41-ad41-b67a1f64d574'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:04.399953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34fc7362-ea06-4932-b268-8ae08004fdc7 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0" status: 400 len: 185 microversion: 2.1 time: 0.307260 Sep 13 16:40:04.401499 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1302/2541] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:04 2022] DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0 => generated 185 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:40:04.409598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:04.417426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:04.435302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.436600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.437301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.438332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.439160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.439842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.618935 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e06f083-f40e-4888-82aa-5df6a215cc28 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941/action" status: 202 len: 0 microversion: 2.1 time: 0.212882 Sep 13 16:40:04.620080 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1303/2542] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:40:04 2022] POST /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:04.642287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:04.645003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:04.662048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.665798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.667509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:04.674194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:04.675085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:04.675832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.113516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.130897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73cf46f1-df64-4b7e-8036-378c025616f7 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.509394 Sep 13 16:40:05.139545 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1304/2543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:04 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:05.154718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:05.155676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:05.157732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-46225799-df96-4fb6-82da-45657506c7c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789647 Sep 13 16:40:05.161648 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1240/2544] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:40:04 2022] POST /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:05.163855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.164532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.165171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.166134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.166752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.167848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.188282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:05.194573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:05.219717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.224055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.224999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.225971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.228318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.230547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.400392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.404389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:05.411189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1496a76e-c7e4-4d29-a202-b1f19c331216 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1575 microversion: 2.1 time: 0.270257 Sep 13 16:40:05.411853 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1305/2545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:05 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:05.416735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:05.417597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:05.426836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.427624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.428593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.429812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.430487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.431123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.698533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.715414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.719474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.730558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10db923f-e30c-4328-9381-05f3851a9147 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1564 microversion: 2.25 time: 0.310304 Sep 13 16:40:05.731796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1306/2546] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:05 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1564 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:05.736768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:05.739187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:05.757101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.759511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.761184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.763321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.763982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.767641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.823276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.834669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ab5326d-5126-43f4-af38-3d9d14d83806 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1506 microversion: 2.1 time: 0.671157 Sep 13 16:40:05.835197 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1241/2547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:05 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:05.847201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:05.848068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:05.872293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.872925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.873571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.874414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:05.875090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:05.875326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:05.968545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.978130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.985863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:05.992415 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f600ef7-c9fb-421d-b00d-35c5c0163034 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.259285 Sep 13 16:40:05.993170 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1307/2548] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:05 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:06.157627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:06.158679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:06.178328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.182291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.185749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:06.187269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.198748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.200532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:06.569950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:06.581165 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8808112-6a39-48df-97e3-ca993312f2e9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.426390 Sep 13 16:40:06.583004 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1308/2549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:06 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:06.588671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-8a86bb89-ab0c-4ad2-9361-1c3989f9f6f4 req-faccc179-9fe5-402b-bdd1-fdb0817b93eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d055443-8621-42d4-b259-aea93fc37245", "name": "network-vif-plugged", "status": "completed", "tag": "495f1050-c242-435c-9639-4ad73725e092"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:06.601924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a86bb89-ab0c-4ad2-9361-1c3989f9f6f4 req-faccc179-9fe5-402b-bdd1-fdb0817b93eb service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.602389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a86bb89-ab0c-4ad2-9361-1c3989f9f6f4 req-faccc179-9fe5-402b-bdd1-fdb0817b93eb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.602823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a86bb89-ab0c-4ad2-9361-1c3989f9f6f4 req-faccc179-9fe5-402b-bdd1-fdb0817b93eb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:06.627521 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8a86bb89-ab0c-4ad2-9361-1c3989f9f6f4 req-faccc179-9fe5-402b-bdd1-fdb0817b93eb service nova] Creating event network-vif-plugged:495f1050-c242-435c-9639-4ad73725e092 for instance 5d055443-8621-42d4-b259-aea93fc37245 on n-h2-857467-1 Sep 13 16:40:06.640559 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-8a86bb89-ab0c-4ad2-9361-1c3989f9f6f4 req-faccc179-9fe5-402b-bdd1-fdb0817b93eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051231 Sep 13 16:40:06.641419 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1309/2550] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:06.652598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:06.653309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:06.653677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:06.666110 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a8ab0f38-ed42-47a6-8e0d-d82cbe0d7179 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1566 microversion: 2.1 time: 0.829713 Sep 13 16:40:06.681858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.681858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.681858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:06.681858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.681858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.681858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:06.683945 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1242/2551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:05 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1566 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:06.706398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:06.707800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:06.725719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.726763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.730449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:06.731214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:06.731715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:06.732774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.011290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.027595 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f823d98a-47dc-4451-8bfe-b82367830f8a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1575 microversion: 2.1 time: 0.384781 Sep 13 16:40:07.028548 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1310/2552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:06 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1575 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:07.074970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:07.075898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:07.089763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.090721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.091790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.094154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.096136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.096136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.166937 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49f210f6-091c-4dc0-bfb5-0bc554fe7cef tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.469665 Sep 13 16:40:07.169293 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1243/2553] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:40:06 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-interface => generated 285 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:07.174233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:07.174859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:07.194043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.194552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.195001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.195722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.196189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.196625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.204252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.214789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.220068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.223469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-068cbd71-46b1-420c-9748-7bf0564e32d5 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1522 microversion: 2.25 time: 0.192614 Sep 13 16:40:07.225239 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1311/2554] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:07 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:07.230779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:07.231720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:07.241052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.241953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.242746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.243750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.244726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.245425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.338233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.351939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.353931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:07.360158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f2ba28b-952b-4ea5-9078-b3c47e28a9ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.133565 Sep 13 16:40:07.373851 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1312/2555] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:07 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:07.533816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-441169c7-35ab-4635-871b-1f6c66c98cf5 req-3a5af3e0-d4b8-48d4-870b-f401554cc8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378220d4-c1e6-4b23-984a-f0151aa19039", "name": "network-vif-deleted", "tag": "3f72e4f3-3cf0-4a5b-972a-e784bddb2960"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:07.562843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-441169c7-35ab-4635-871b-1f6c66c98cf5 req-3a5af3e0-d4b8-48d4-870b-f401554cc8bb service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.565226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-441169c7-35ab-4635-871b-1f6c66c98cf5 req-3a5af3e0-d4b8-48d4-870b-f401554cc8bb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.574361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-441169c7-35ab-4635-871b-1f6c66c98cf5 req-3a5af3e0-d4b8-48d4-870b-f401554cc8bb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.617792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-441169c7-35ab-4635-871b-1f6c66c98cf5 req-3a5af3e0-d4b8-48d4-870b-f401554cc8bb service nova] Creating event network-vif-deleted:3f72e4f3-3cf0-4a5b-972a-e784bddb2960 for instance 378220d4-c1e6-4b23-984a-f0151aa19039 on n-h1-857467-1 Sep 13 16:40:07.631308 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-441169c7-35ab-4635-871b-1f6c66c98cf5 req-3a5af3e0-d4b8-48d4-870b-f401554cc8bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101287 Sep 13 16:40:07.632518 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1313/2556] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:07.640737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:07.647473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:07.682920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.685141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.685979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:07.687018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:07.687646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:07.689241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.016410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.024801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:08.037246 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e03b5ee0-ac28-463f-a9f7-9bc1c370b184 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1501 microversion: 2.1 time: 0.866735 Sep 13 16:40:08.040244 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1244/2557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:07 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1501 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:08.089648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:08.090572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:08.111851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.112732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.113512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.114697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.116251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.118434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.183442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.214750 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43b108db-2090-467a-8e3b-7ffa2087814a tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.580316 Sep 13 16:40:08.215914 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1314/2558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:07 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:08.274325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:08.275285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:08.300812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.301632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.302216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.302979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.303461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.304194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.420514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.421017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.421637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.422288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lazy-loading 'fault' on Instance uuid 378220d4-c1e6-4b23-984a-f0151aa19039 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:08.483532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.494688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.496817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '792d76dbc4394c77bee09f600364cb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c837d5c9bef44cc86e125db0fcfcfb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.498383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a486ccef-117c-4970-a773-d63fc48c6d6d tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 200 len: 1352 microversion: 2.25 time: 0.243268 Sep 13 16:40:08.499130 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1315/2559] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:08 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 1352 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:08.505198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:08.506063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:08.512714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.513394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.514043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.514925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:08.515541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:08.515970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:08.598389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.608444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.611867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:08.618150 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a90605f-4688-471c-a1dd-543f1482ac44 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.117757 Sep 13 16:40:08.619037 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1316/2560] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:08 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:09.076086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.077078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:09.085343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.085586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:09.086657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.087840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.088949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.089619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.090290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.102494 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6037f678-5fda-4e22-85db-f1d8e42aa980 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1575 microversion: 2.1 time: 1.009319 Sep 13 16:40:09.105095 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1245/2561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:08 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1575 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:09.245930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.246133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:09.246568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:09.254458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.254983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.256576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b945e62a-2f41-4306-82a0-55c2e024e4c8 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1488 microversion: 2.1 time: 0.186988 Sep 13 16:40:09.273868 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1317/2562] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:09 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1488 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:09.274088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.274088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.274088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.274088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.289572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.291284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:09.302655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.303165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.303620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.309844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.310379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.310831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.342846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:09.493760 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b12d329-0b06-44dc-980c-3ec9afd7163d tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 204 len: 0 microversion: 2.1 time: 0.214203 Sep 13 16:40:09.494665 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1318/2563] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:09 2022] DELETE /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:40:09.508416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd72f84-fdad-4058-9f29-e1f5d435618e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb5da0a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.558155 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-5cd72f84-fdad-4058-9f29-e1f5d435618e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Image not found. Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd72f84-fdad-4058-9f29-e1f5d435618e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb HTTP/1.1 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '02efc7b7-7267-414a-a409-f7adaa9a48bb'} Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 02efc7b7-7267-414a-a409-f7adaa9a48bb to delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02efc7b7-7267-414a-a409-f7adaa9a48bb could not be found. Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.560081 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd72f84-fdad-4058-9f29-e1f5d435618e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cd72f84-fdad-4058-9f29-e1f5d435618e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb" status: 404 len: 62 microversion: 2.1 time: 0.058251 Sep 13 16:40:09.564109 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1319/2564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:09 2022] DELETE /compute/v2.1/images/02efc7b7-7267-414a-a409-f7adaa9a48bb => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:40:09.568299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.569057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] [instance: 378220d4-c1e6-4b23-984a-f0151aa19039] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:09.602948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.605103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.605728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.608793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.611114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.611810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.634442 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] HTTP exception thrown: Instance 378220d4-c1e6-4b23-984a-f0151aa19039 could not be found. Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Request method failure captured: Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 HTTP/1.1 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILBwoD7UfkD3qr9C7cyubamQr9wFbjX0RM3WaZRCTSQnPwYNEz5PcrA_goEd8_sF198Mmj599GWakv09Y7lKlZ10IjVQddhnLIA7ugirWy3Iyyz5ppN80fMJu26Ly6TwxtbwMvveAPrXPplIxwu0o3JkMMSvujNBbCnqwMYciUgCoAI Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.25 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c837d5c9bef44cc86e125db0fcfcfb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 5c837d5c9bef44cc86e125db0fcfcfb5 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-447766562 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 792d76dbc4394c77bee09f600364cb74 Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-447766562-project Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 378220d4-c1e6-4b23-984a-f0151aa19039 could not be found. Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '378220d4-c1e6-4b23-984a-f0151aa19039'} Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378220d4-c1e6-4b23-984a-f0151aa19039 could not be found. Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378220d4-c1e6-4b23-984a-f0151aa19039 could not be found. Sep 13 16:40:09.636142 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378220d4-c1e6-4b23-984a-f0151aa19039 could not be found. Sep 13 16:40:09.640444 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:09.651289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] Returning 404 to user: Instance 378220d4-c1e6-4b23-984a-f0151aa19039 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:09.652043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eaee1199-2ba4-41a0-8bff-ef5cf0810040 tempest-LiveAutoBlockMigrationV225Test-447766562 tempest-LiveAutoBlockMigrationV225Test-447766562-project] 10.222.0.61 "GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039" status: 404 len: 111 microversion: 2.25 time: 0.088578 Sep 13 16:40:09.655187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1320/2565] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:09 2022] GET /compute/v2.1/servers/378220d4-c1e6-4b23-984a-f0151aa19039 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:40:09.672373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.673060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:09.681772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.682112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.682671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.683541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.684107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.684695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.719583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:09.836711 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.compute.api [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Instance is already in deleting state, ignoring this request Sep 13 16:40:09.838307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fac1b9ae-84c6-4656-9764-f185acdf2c02 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 204 len: 0 microversion: 2.1 time: 0.170252 Sep 13 16:40:09.842871 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1321/2566] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:09 2022] DELETE /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:09.857908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:09.858533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:09.866298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.868324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.869177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.870648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:09.871441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:09.873290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:09.906635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:09.972094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:09.984913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:09.986792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:09.995622 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-955be743-b5e2-451c-99c5-3bc13a471823 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.151595 Sep 13 16:40:10.013925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1322/2567] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:09 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:10.013925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:10.013925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:10.033217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:10.033855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:10.034315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:10.036558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:10.038320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:10.040219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:10.219852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:10.230492 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aae704ec-edeb-4ef7-baca-fd0dca4b98ac tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.988554 Sep 13 16:40:10.242217 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1246/2568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:09 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:10.252687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e740ce98-b1d1-44ab-990d-92ecca67f66d req-fd800951-1e68-4c2a-873e-ca2e01263d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d055443-8621-42d4-b259-aea93fc37245", "name": "network-vif-unplugged", "status": "completed", "tag": "495f1050-c242-435c-9639-4ad73725e092"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:10.263168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e740ce98-b1d1-44ab-990d-92ecca67f66d req-fd800951-1e68-4c2a-873e-ca2e01263d38 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:10.264014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e740ce98-b1d1-44ab-990d-92ecca67f66d req-fd800951-1e68-4c2a-873e-ca2e01263d38 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:10.264691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e740ce98-b1d1-44ab-990d-92ecca67f66d req-fd800951-1e68-4c2a-873e-ca2e01263d38 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:10.277546 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e740ce98-b1d1-44ab-990d-92ecca67f66d req-fd800951-1e68-4c2a-873e-ca2e01263d38 service nova] Creating event network-vif-unplugged:495f1050-c242-435c-9639-4ad73725e092 for instance 5d055443-8621-42d4-b259-aea93fc37245 on n-h2-857467-1 Sep 13 16:40:10.283617 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e740ce98-b1d1-44ab-990d-92ecca67f66d req-fd800951-1e68-4c2a-873e-ca2e01263d38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039781 Sep 13 16:40:10.284622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1247/2569] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:10.291766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:10.292745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:10.299505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:10.300439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:10.301770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:10.302776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:10.303438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:10.304064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:10.449934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:10.459584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-474f6f0b-cf50-4daa-b834-7a7d067195e3 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1494 microversion: 2.1 time: 0.457489 Sep 13 16:40:10.478430 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1323/2570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:09 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1494 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:10.493876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-14d4406b-066a-4b4e-8b70-b6dd1f8db7ed req-530301fd-a255-4d60-805a-d387ed344e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b35670-fff0-424c-ae44-5adf194bb6b2", "tag": "eb633aec-7996-4ba1-beff-b41c46875ab2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:10.517494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-14d4406b-066a-4b4e-8b70-b6dd1f8db7ed req-530301fd-a255-4d60-805a-d387ed344e33 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:10.521136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-14d4406b-066a-4b4e-8b70-b6dd1f8db7ed req-530301fd-a255-4d60-805a-d387ed344e33 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:10.526057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-14d4406b-066a-4b4e-8b70-b6dd1f8db7ed req-530301fd-a255-4d60-805a-d387ed344e33 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:10.537073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:10.545452 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dd5d5697-f212-4aa1-a8d3-f3385a03501d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1580 microversion: 2.1 time: 0.258345 Sep 13 16:40:10.546734 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1248/2571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:10 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1580 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:10.548477 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-14d4406b-066a-4b4e-8b70-b6dd1f8db7ed req-530301fd-a255-4d60-805a-d387ed344e33 service nova] Creating event network-changed:eb633aec-7996-4ba1-beff-b41c46875ab2 for instance 52b35670-fff0-424c-ae44-5adf194bb6b2 on n-h1-857467-1 Sep 13 16:40:10.554215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-14d4406b-066a-4b4e-8b70-b6dd1f8db7ed req-530301fd-a255-4d60-805a-d387ed344e33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065536 Sep 13 16:40:10.555096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1324/2572] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:40:11.031730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:11.032513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:11.040067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.044082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.046887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.047898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.050248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.051475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.197186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:11.211215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:11.213006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:11.225943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5824cc37-cc9d-4567-9aae-17ce64741f93 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.198308 Sep 13 16:40:11.231095 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1249/2573] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:11 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:11.261639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:11.262599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:11.279976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.281523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.283453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.285128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.287770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.288735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.492072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:11.493119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:11.507002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.508151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.508832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.509778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.510492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.511145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.696686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:11.708515 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eff38816-246b-4ed5-94f6-94100cf45b54 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.453012 Sep 13 16:40:11.713672 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1325/2574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:11 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:11.724786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:11.725761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:11.743551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.747042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.748218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.750879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:11.751805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:11.755432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:11.997705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:12.007635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd54d0c6-a7b7-4e63-9c33-25916f5bff52 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1494 microversion: 2.1 time: 0.521686 Sep 13 16:40:12.008520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1250/2575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:11 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1494 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:12.261762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:12.262470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:12.277703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:12.278248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:12.278709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:12.279437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:12.279913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:12.280367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:12.597289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:12.611946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:12.619010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:12.633693 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35a23a65-7d68-4359-99cc-ba64e5209e57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.374820 Sep 13 16:40:12.636928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:12.637067 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1251/2576] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:12 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:40:12.662656 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-95c00ebf-132e-4672-9992-91c28609df14 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1580 microversion: 2.1 time: 0.947369 Sep 13 16:40:12.663646 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1326/2577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:11 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1580 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:12.743079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:12.744412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:12.764961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:12.767601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:12.768115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:12.768886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:12.772310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:12.777384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.035108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:13.036590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:13.047921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.049684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.050747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.066238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.067034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.067410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.076196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:13.087606 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b88c480-bf01-459e-99ed-6bf09cd16ac8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.350693 Sep 13 16:40:13.088831 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1252/2578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:12 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:13.322370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bf4353dd-0590-41d4-9120-d4457ded197a req-69cbdedf-23be-45dc-9658-ea86859aadab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d055443-8621-42d4-b259-aea93fc37245", "name": "network-vif-deleted", "tag": "495f1050-c242-435c-9639-4ad73725e092"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:13.341084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bf4353dd-0590-41d4-9120-d4457ded197a req-69cbdedf-23be-45dc-9658-ea86859aadab service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.342021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bf4353dd-0590-41d4-9120-d4457ded197a req-69cbdedf-23be-45dc-9658-ea86859aadab service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.342681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bf4353dd-0590-41d4-9120-d4457ded197a req-69cbdedf-23be-45dc-9658-ea86859aadab service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.362347 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bf4353dd-0590-41d4-9120-d4457ded197a req-69cbdedf-23be-45dc-9658-ea86859aadab service nova] Creating event network-vif-deleted:495f1050-c242-435c-9639-4ad73725e092 for instance 5d055443-8621-42d4-b259-aea93fc37245 on n-h2-857467-1 Sep 13 16:40:13.375474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:13.375899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bf4353dd-0590-41d4-9120-d4457ded197a req-69cbdedf-23be-45dc-9658-ea86859aadab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057070 Sep 13 16:40:13.377092 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1253/2579] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:13.384382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55ca65ae-8a1e-4d7a-a215-707918c992ec tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1494 microversion: 2.1 time: 0.355048 Sep 13 16:40:13.401228 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1327/2580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:13 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1494 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:13.668438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:13.669369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:13.680037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.683920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.684557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.685445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.686149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:13.686904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:13.692245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:13.692615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.693569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.702439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.703438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.704356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.705286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:13.706092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:13.716838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:13.828614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:13.844077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:13.846815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:13.854772 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e2bb659-81d5-4630-bb9f-8cb2a974fb4d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.190693 Sep 13 16:40:13.856357 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1254/2581] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:13 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:14.113117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:14.114234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:14.140383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.140901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.141346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.142113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.142577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.143012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.229500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:14.238948 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-daa34ec2-bdec-4593-a316-59bd6d727765 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1573 microversion: 2.1 time: 0.556121 Sep 13 16:40:14.244952 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1328/2582] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:13 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1573 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:14.272819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-712369328"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:14.273373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:14.280548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.281027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.281659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.282542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.283152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.283732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.549725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:14.560526 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a4b5305-1d3e-46b7-8ea3-7856a5905680 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1390 microversion: 2.1 time: 0.452981 Sep 13 16:40:14.561115 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1255/2583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:14 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1390 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:14.592034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:14.593302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:14.617267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.617773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.618244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.618956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.619420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.619853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.731593 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.network.security_group_api [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Adding security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 to port 0c98a460-0b3b-4003-a5a8-09d73bca81cf Sep 13 16:40:14.743950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.745434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.746175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.747363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lazy-loading 'fault' on Instance uuid 5d055443-8621-42d4-b259-aea93fc37245 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:14.868257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dc5c1abf0649888b406f5911e5e5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be598c0e112c40dc894a680a37eefb38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:14.890011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ff06954-7dc7-4864-8107-eb9ded09aeed tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 200 len: 1298 microversion: 2.1 time: 0.319400 Sep 13 16:40:14.891090 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1256/2584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:14 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 1298 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:14.928168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:14.930548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:14.939648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.943945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.944717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:14.945481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:14.945983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:14.946443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.086882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:15.096733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:15.098960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:15.109878 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eba6a36e-7011-4528-b926-c173d4eecc14 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1538 microversion: 2.91 time: 0.217424 Sep 13 16:40:15.122897 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1257/2585] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:14 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1538 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:15.146761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:15.149517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:15.157794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:15.162704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:15.163403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.164378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:15.165054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:15.167079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.335177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-857467-1". {{(pid=122327) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 16:40:15.469304 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e0369cd-226a-43ea-ade2-4857c20bfdfd tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action" status: 202 len: 0 microversion: 2.91 time: 0.330344 Sep 13 16:40:15.473585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1258/2586] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:40:15 2022] POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:40:15.483745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:15.486180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:15.517381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:15.518220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:15.521393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.521393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:15.521603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:15.524695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.790595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:15.799527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:15.805814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:15.820334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0136b8e9-cee2-46ea-bd4b-99c9492463eb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1486 microversion: 2.91 time: 0.344988 Sep 13 16:40:15.823557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1259/2587] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:15 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1486 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:15.835581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:15.836260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:15.859784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:15.861610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:15.863902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.865386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:15.866633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:15.867080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:15.902863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4b4994f-6928-430a-9201-215586777819 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941/action" status: 202 len: 0 microversion: 2.1 time: 1.634335 Sep 13 16:40:15.904354 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1329/2588] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:40:14 2022] POST /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941/action => generated 0 bytes in 1636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:15.913299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6629813d-1d32-462c-af82-33553b5a4c34 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb50e4160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.447441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:16.456739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21b48de0-3e15-48a1-beb9-c29e3e71bb14 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1380 microversion: 2.1 time: 0.632013 Sep 13 16:40:16.458260 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1260/2589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:15 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1380 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:16.463925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.465149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 5d055443-8621-42d4-b259-aea93fc37245] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:16.482578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.483531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.484188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.485212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.487635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.488901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.494905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:16.511334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance 5d055443-8621-42d4-b259-aea93fc37245 could not be found. Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 HTTP/1.1 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 5d055443-8621-42d4-b259-aea93fc37245 could not be found. Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '5d055443-8621-42d4-b259-aea93fc37245'} Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d055443-8621-42d4-b259-aea93fc37245 could not be found. Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d055443-8621-42d4-b259-aea93fc37245 could not be found. Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.514351 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d055443-8621-42d4-b259-aea93fc37245 could not be found. Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.520461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance 5d055443-8621-42d4-b259-aea93fc37245 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:16.523319 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39991f36-5481-4a49-826e-7dcbe16e459c tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245" status: 404 len: 111 microversion: 2.1 time: 0.063641 Sep 13 16:40:16.524771 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1261/2590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:16 2022] GET /compute/v2.1/servers/5d055443-8621-42d4-b259-aea93fc37245 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:16.532302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-0390c742-5d4e-40b2-83a1-4133464f883b req-6035b0d9-2678-462c-bbbb-48340365d049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3c2e4f-eda6-4e0f-934b-56bb68b93941", "tag": "0c98a460-0b3b-4003-a5a8-09d73bca81cf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:16.549475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0390c742-5d4e-40b2-83a1-4133464f883b req-6035b0d9-2678-462c-bbbb-48340365d049 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.551561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0390c742-5d4e-40b2-83a1-4133464f883b req-6035b0d9-2678-462c-bbbb-48340365d049 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.554402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0390c742-5d4e-40b2-83a1-4133464f883b req-6035b0d9-2678-462c-bbbb-48340365d049 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.571154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-0390c742-5d4e-40b2-83a1-4133464f883b req-6035b0d9-2678-462c-bbbb-48340365d049 service nova] Creating event network-changed:0c98a460-0b3b-4003-a5a8-09d73bca81cf for instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 on n-h2-857467-1 Sep 13 16:40:16.578307 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-0390c742-5d4e-40b2-83a1-4133464f883b req-6035b0d9-2678-462c-bbbb-48340365d049 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051329 Sep 13 16:40:16.579606 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1262/2591] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:16.586153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-865b2132-b294-49d6-8840-7cc73d108396 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '.version_select at 0x7fbeb9723dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.591111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b2132-b294-49d6-8840-7cc73d108396 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.592476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b2132-b294-49d6-8840-7cc73d108396 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.593042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b2132-b294-49d6-8840-7cc73d108396 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.602760 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-865b2132-b294-49d6-8840-7cc73d108396 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.021466 Sep 13 16:40:16.604035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1263/2592] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 16:40:16 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:16.615981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a93a3bd-a051-4ff9-ac1a-ae0aa3c29eba tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb95b9700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.649058 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0a93a3bd-a051-4ff9-ac1a-ae0aa3c29eba tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Image not found. Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a93a3bd-a051-4ff9-ac1a-ae0aa3c29eba tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d HTTP/1.1 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c4901a79-179e-4406-91a4-df200729243d'} Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c4901a79-179e-4406-91a4-df200729243d to delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4901a79-179e-4406-91a4-df200729243d could not be found. Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.652319 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a93a3bd-a051-4ff9-ac1a-ae0aa3c29eba tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a93a3bd-a051-4ff9-ac1a-ae0aa3c29eba tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d" status: 404 len: 62 microversion: 2.1 time: 0.048577 Sep 13 16:40:16.659479 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1264/2593] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:16 2022] DELETE /compute/v2.1/images/c4901a79-179e-4406-91a4-df200729243d => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:40:16.666443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.669966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:16.678463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.679044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.679575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.680366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.681113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.682133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.735983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-6629813d-1d32-462c-af82-33553b5a4c34 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use.", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:16.736749 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-6629813d-1d32-462c-af82-33553b5a4c34 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.736749 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6629813d-1d32-462c-af82-33553b5a4c34 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7 HTTP/1.1 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: exception: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'f6487e5e-43de-4fe5-89c5-e524a38f6cd7'} Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:16.739625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] Sep 13 16:40:16.743310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.747491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6629813d-1d32-462c-af82-33553b5a4c34 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 400 to user: Security Group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 in use. Sep 13 16:40:16.747491 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-60eb29bd-c27f-4363-8adb-8bfc1687511d'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:16.748946 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6629813d-1d32-462c-af82-33553b5a4c34 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7" status: 400 len: 185 microversion: 2.1 time: 0.841001 Sep 13 16:40:16.749816 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1330/2594] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:15 2022] DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7 => generated 185 bytes in 842 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:40:16.756455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.757391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:16.764216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.765015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.765681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.767475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.768177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.768830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.785874 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 HTTP/1.1 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b5acb43c-b494-4f96-bafe-5c7a5abe2da7'} Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:16.788260 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:16.791629 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:16.794089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:16.795518 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-010dfaa9-032a-485b-9bbb-fe1487cf341e tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 404 len: 111 microversion: 2.1 time: 0.044475 Sep 13 16:40:16.799726 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1331/2595] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:16 2022] DELETE /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:16.807602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:16.808377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:16.816166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.817064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.817756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.818742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:16.819410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:16.820467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:16.890529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:17.039938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c03985c9-915b-47ad-ac9e-c1cafecaecc3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 204 len: 0 microversion: 2.1 time: 0.235767 Sep 13 16:40:17.042043 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1332/2596] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:16 2022] DELETE /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:17.049406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.051842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: b5acb43c-b494-4f96-bafe-5c7a5abe2da7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.060507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.061519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.062389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.063414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.064140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.064777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.088517 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 HTTP/1.1 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b5acb43c-b494-4f96-bafe-5c7a5abe2da7'} Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.091128 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.095584 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.095584 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.095584 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.095584 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.095584 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. Sep 13 16:40:17.095584 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.097184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance b5acb43c-b494-4f96-bafe-5c7a5abe2da7 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.099585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-034966d7-6ad0-4f5c-bc9a-77c30e25a551 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7" status: 404 len: 111 microversion: 2.1 time: 0.055403 Sep 13 16:40:17.100323 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1333/2597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] GET /compute/v2.1/servers/b5acb43c-b494-4f96-bafe-5c7a5abe2da7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:17.107589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.109099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.119931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.122094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.122778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.123725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.124688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.125341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.156802 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60686e50-62bf-4fc9-a2f5-5277d77a3c81 tempest-LiveMigrationTest-501852831 tempest-LiveMigrationTest-501852831-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1531 microversion: 2.1 time: 0.496403 Sep 13 16:40:17.161966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1265/2598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:16 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1531 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:17.182415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.183818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.204027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.204723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.207897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.209071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.212230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.213084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.292698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:17.308530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:17.313821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:17.326913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fff685ef-9a77-42be-851e-83482f5ef588 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.223923 Sep 13 16:40:17.331080 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1334/2599] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:17 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:17.343030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-975ba2b6-e3c7-42bf-87af-2e0ce903204b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb51eaa60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.387620 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-975ba2b6-e3c7-42bf-87af-2e0ce903204b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Image not found. Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-975ba2b6-e3c7-42bf-87af-2e0ce903204b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 HTTP/1.1 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: exception: Image not found. Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '887760ef-1bac-4aec-aab8-dbc7178eea71'} Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 887760ef-1bac-4aec-aab8-dbc7178eea71 to delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 887760ef-1bac-4aec-aab8-dbc7178eea71 could not be found. Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.389697 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-975ba2b6-e3c7-42bf-87af-2e0ce903204b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Image not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-975ba2b6-e3c7-42bf-87af-2e0ce903204b tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71" status: 404 len: 62 microversion: 2.1 time: 0.058875 Sep 13 16:40:17.396902 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1335/2600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] DELETE /compute/v2.1/images/887760ef-1bac-4aec-aab8-dbc7178eea71 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:40:17.401659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.402441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.412349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.413117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.414335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.415325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.416258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.416900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.453332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:17.493191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:17.502815 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9eedb6bb-c567-4a15-ac10-69ca89539b36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1647 microversion: 2.1 time: 0.338590 Sep 13 16:40:17.503730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1266/2601] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1647 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:17.509589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.510174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.516582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.517059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.517667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.519114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.520314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.520913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.551416 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 HTTP/1.1 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '4942170b-e2df-40ac-8f82-89f3e1487d14'} Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:17.572190 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-04ba2323-e133-43dd-adee-3d1d4ad3bc72 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 404 len: 111 microversion: 2.1 time: 0.068197 Sep 13 16:40:17.575621 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1267/2602] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:17 2022] DELETE /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:17.590993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.591616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 4942170b-e2df-40ac-8f82-89f3e1487d14] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.604617 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ed0e7b5-d036-43a6-8335-179681d48ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 204 len: 0 microversion: 2.1 time: 0.211007 Sep 13 16:40:17.607713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.608226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.608667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.609560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1336/2603] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:17 2022] DELETE /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:17.609663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.609853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.610564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.619498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.620760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.632357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.633606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.634444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.635436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.636247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.636987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.647487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 HTTP/1.1 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '4942170b-e2df-40ac-8f82-89f3e1487d14'} Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.648980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.654049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance 4942170b-e2df-40ac-8f82-89f3e1487d14 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.655994 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d063ccf9-2762-4552-a0e6-ac4991a6d017 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14" status: 404 len: 111 microversion: 2.1 time: 0.066713 Sep 13 16:40:17.657892 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1268/2604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] GET /compute/v2.1/servers/4942170b-e2df-40ac-8f82-89f3e1487d14 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:17.665979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d029bcd-d71a-4a9c-9983-2b7c159fe229 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '.version_select at 0x7fbeb9723160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.699805 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8d029bcd-d71a-4a9c-9983-2b7c159fe229 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Image not found. Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d029bcd-d71a-4a9c-9983-2b7c159fe229 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 HTTP/1.1 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7bb5de95-61b3-46b2-b3ff-214938e29fc9'} Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7bb5de95-61b3-46b2-b3ff-214938e29fc9 to delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bb5de95-61b3-46b2-b3ff-214938e29fc9 could not be found. Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.701590 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d029bcd-d71a-4a9c-9983-2b7c159fe229 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d029bcd-d71a-4a9c-9983-2b7c159fe229 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9" status: 404 len: 62 microversion: 2.1 time: 0.042346 Sep 13 16:40:17.709207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1269/2605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] DELETE /compute/v2.1/images/7bb5de95-61b3-46b2-b3ff-214938e29fc9 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:40:17.712364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.715545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.734154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.734879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.735476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.736368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.737072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.737715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.752451 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de HTTP/1.1 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3c5793c3-b5e5-4b6c-91cd-62af303c98de'} Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:17.755983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.759725 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.761423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.762501 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32f8a2b1-f1cb-415b-ace6-ae8da3b781ff tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 404 len: 111 microversion: 2.1 time: 0.054103 Sep 13 16:40:17.763865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1270/2606] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:17 2022] DELETE /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:17.776442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:17.777072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] [instance: 3c5793c3-b5e5-4b6c-91cd-62af303c98de] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:17.788663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.789160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.789644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.790340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:17.790806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:17.791239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:17.809725 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] HTTP exception thrown: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Request method failure captured: Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de HTTP/1.1 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILFlO3HuIXCPlpZ-44qpY26q59UxooUW1KnBjMXgCSX-TP-Eku6hoGy0SpJyLrS9R5QvsQFz-1kpG09_S8DeoGZyolS5H7y7IFNH_r8k_3H3XlBB_swIc9C293X_-kTYZOy3zkGcVKifGiRRdU8BpT6HC4KaxH93N5TEaaf8rsRFy_Q Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_be598c0e112c40dc894a680a37eefb38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/be598c0e112c40dc894a680a37eefb38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: be598c0e112c40dc894a680a37eefb38 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesTestJSON-1178663222 Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 67dc5c1abf0649888b406f5911e5e5dd Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesTestJSON-1178663222-project Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3c5793c3-b5e5-4b6c-91cd-62af303c98de'} Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.812556 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] Returning 404 to user: Instance 3c5793c3-b5e5-4b6c-91cd-62af303c98de could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:17.816140 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5108b12-fe61-4d9a-9028-9e1a1327a407 tempest-ImagesTestJSON-1178663222 tempest-ImagesTestJSON-1178663222-project] 10.222.0.61 "GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de" status: 404 len: 111 microversion: 2.1 time: 0.044845 Sep 13 16:40:17.820214 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1271/2607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] GET /compute/v2.1/servers/3c5793c3-b5e5-4b6c-91cd-62af303c98de => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:18.031291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:18.048989 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62cdbe1d-73e9-414f-8f08-d0fa25a86d59 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1386 microversion: 2.1 time: 0.433274 Sep 13 16:40:18.074092 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1337/2608] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:17 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1386 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:18.362592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:18.365246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:18.373090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:18.373795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:18.374507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:18.375301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:18.375846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:18.376354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:18.465479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:18.475897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:18.478818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:18.484590 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3043c9f5-0624-483e-b054-4846a108890b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.125850 Sep 13 16:40:18.486071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1272/2609] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:18 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:18.533326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:18.534227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:18.543706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:18.544511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:18.545172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:18.546764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:18.547843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:18.548486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:18.932903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:18.947973 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c163bba-b968-4d10-af46-60fd56fdb9ef tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1647 microversion: 2.1 time: 0.422765 Sep 13 16:40:18.950924 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1338/2610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:18 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1647 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:19.080674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:19.081306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:19.100847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:19.101275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:19.101727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:19.102906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:19.103019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:19.103379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:19.513043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:19.513677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:19.522486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:19.523317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:19.524111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:19.525069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:19.527646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:19.528685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:19.686119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:19.691177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:19.720307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:19.723692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:19.736926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f92c713-f2d8-4fe1-a4f2-3d1bac6b87f9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.227448 Sep 13 16:40:19.739619 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1339/2611] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:19 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:19.763574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:19.776011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dbf420b5-62a1-4a30-9bed-037601a99d97 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1386 microversion: 2.1 time: 0.699199 Sep 13 16:40:19.778007 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1273/2612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:19 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1386 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:19.980445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:19.981396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:20.001559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:20.002389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:20.003503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:20.005038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:20.007717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:20.008764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:20.271730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:20.280287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ccdb2a95-e928-4c5c-b9d2-10296a722c0a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1647 microversion: 2.1 time: 0.305251 Sep 13 16:40:20.281625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1340/2613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:19 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1647 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:20.774275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:20.775691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:20.791377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:20.794579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:20.795508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:20.803046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:20.804463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:20.810955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:20.813943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:20.815628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:20.823043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:20.840746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:20.843473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:20.846924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:20.854741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:20.855452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:21.094711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:21.108346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-95e13cf5-8f08-4638-bf3d-c8523cacbec2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1344 microversion: 2.1 time: 0.311040 Sep 13 16:40:21.109651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1341/2614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:20 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1344 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:21.314605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:21.316045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:21.330994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:21.331990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:21.334726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:21.336680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:21.338455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:21.339323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:21.399519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:21.419314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:21.422695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:21.437210 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be1a10c3-45cb-4b5c-abf1-d0dc3a6db152 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.669285 Sep 13 16:40:21.458393 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1274/2615] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:20 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:21.683570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-43565dae-765d-490c-806a-ba304d805d1c req-f7c568f2-15fe-436e-bae7-ff341509728f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa012e4d-50f0-4820-b7fe-39152d3710c5", "name": "network-vif-deleted", "tag": "f1cdf295-3265-4032-9f1e-693658cfcee9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:21.710498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-43565dae-765d-490c-806a-ba304d805d1c req-f7c568f2-15fe-436e-bae7-ff341509728f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:21.713311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-43565dae-765d-490c-806a-ba304d805d1c req-f7c568f2-15fe-436e-bae7-ff341509728f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:21.714290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-43565dae-765d-490c-806a-ba304d805d1c req-f7c568f2-15fe-436e-bae7-ff341509728f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:21.752632 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-43565dae-765d-490c-806a-ba304d805d1c req-f7c568f2-15fe-436e-bae7-ff341509728f service nova] Creating event network-vif-deleted:f1cdf295-3265-4032-9f1e-693658cfcee9 for instance fa012e4d-50f0-4820-b7fe-39152d3710c5 on n-h1-857467-1 Sep 13 16:40:21.764997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-43565dae-765d-490c-806a-ba304d805d1c req-f7c568f2-15fe-436e-bae7-ff341509728f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086095 Sep 13 16:40:21.768582 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1275/2616] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:40:21.871346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:21.892764 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9ce8236-c3f8-4aee-b21f-0008c2cf0557 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1647 microversion: 2.1 time: 0.581681 Sep 13 16:40:21.900641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1342/2617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:21 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1647 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:22.135852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:22.136629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:22.164286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:22.165666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:22.168376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:22.169155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:22.169630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:22.180383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:22.420796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:22.447452 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b00759a1-3eae-4e15-a630-a73cfe5c25d1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.315559 Sep 13 16:40:22.450133 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1276/2618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:22 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:22.485250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:22.485949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:22.506939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:22.507453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:22.507950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:22.509049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:22.509604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:22.517122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:22.923868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:22.924743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:22.943975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:22.944970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:22.951929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:22.961519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:22.966752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:22.969592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.203862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.215827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.217240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.220765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lazy-loading 'fault' on Instance uuid df3c2e4f-eda6-4e0f-934b-56bb68b93941 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:23.429208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:23.443944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:23.445564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:23.455456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:23.460846 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bf356a9-1dc7-4a7c-91fd-a1a8e0cddc73 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 200 len: 1306 microversion: 2.1 time: 0.542990 Sep 13 16:40:23.467113 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1277/2619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:22 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 1306 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:23.482982 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7f516c0-bcba-4197-98b0-6012fa54a10d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.991926 Sep 13 16:40:23.485355 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1343/2620] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:22 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:23.494227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:23.495259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:23.496900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:23.505535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:23.511986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.513449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.515697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.516196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.516748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.518239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.519241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.524226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.528095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.529016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.529510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.530091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.624191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:23.812848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:23.824192 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb143d8d-e1bd-4a27-8fae-7ed5de1367b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 204 len: 0 microversion: 2.1 time: 0.338083 Sep 13 16:40:23.827486 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1278/2621] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:23 2022] DELETE /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:23.846023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ecd613ff-9083-42a5-8cb9-b9af8f8548c8 req-f9a78aa2-4379-4eef-9704-3c8a23c4ca43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3c2e4f-eda6-4e0f-934b-56bb68b93941", "name": "network-vif-deleted", "tag": "0c98a460-0b3b-4003-a5a8-09d73bca81cf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:23.893478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecd613ff-9083-42a5-8cb9-b9af8f8548c8 req-f9a78aa2-4379-4eef-9704-3c8a23c4ca43 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.899153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecd613ff-9083-42a5-8cb9-b9af8f8548c8 req-f9a78aa2-4379-4eef-9704-3c8a23c4ca43 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.901520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecd613ff-9083-42a5-8cb9-b9af8f8548c8 req-f9a78aa2-4379-4eef-9704-3c8a23c4ca43 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.945874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ecd613ff-9083-42a5-8cb9-b9af8f8548c8 req-f9a78aa2-4379-4eef-9704-3c8a23c4ca43 service nova] Creating event network-vif-deleted:0c98a460-0b3b-4003-a5a8-09d73bca81cf for instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 on n-h2-857467-1 Sep 13 16:40:23.953225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ecd613ff-9083-42a5-8cb9-b9af8f8548c8 req-f9a78aa2-4379-4eef-9704-3c8a23c4ca43 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120693 Sep 13 16:40:23.954514 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1279/2622] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:40:23.965692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:23.967688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:23.983713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.984534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.985208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:23.986212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:23.991262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:23.993377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:24.547207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:24.565692 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce163708-a962-4e1a-b553-9fd491034e1f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1554 microversion: 2.1 time: 0.609652 Sep 13 16:40:24.570784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1280/2623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:23 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1554 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:24.597047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:24.602128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:24.631537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:24.632557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:24.634855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:24.635849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:24.639057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:24.641388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:24.698643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 HTTP/1.1 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'df3c2e4f-eda6-4e0f-934b-56bb68b93941'} Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:24.700375 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:24.705168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:24.718956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:24.727606 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a624cdb9-1519-463b-b0fb-72b71e7f5124 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 404 len: 111 microversion: 2.1 time: 0.150227 Sep 13 16:40:24.728620 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1281/2624] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:24 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:24.743532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:24.746604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:24.768238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:24.792834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:24.793752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:24.796775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:24.797446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:24.799463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:24.934376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:24.950773 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1e72769-a63c-4bd2-998c-8048a83817f1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 1.464857 Sep 13 16:40:24.957984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1344/2625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:23 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:24.995288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-911475e1-5fe9-411b-9833-ae1b3d3c260c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb56a1310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:25.037283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:25.055958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:25.060309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:25.112266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73fb2d8e-4312-4a14-b6ac-dd9d3fab07ce tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.381766 Sep 13 16:40:25.112915 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1282/2626] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:24 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:25.602120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:25.602772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:25.627445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:25.635274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:25.637389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:25.640313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:25.643910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:25.654365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:26.512864 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-911475e1-5fe9-411b-9833-ae1b3d3c260c tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0" status: 202 len: 0 microversion: 2.1 time: 1.550137 Sep 13 16:40:26.516843 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1345/2627] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:24 2022] DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0 => generated 0 bytes in 1555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:26.523234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:26.528175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:26.556497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:26.560097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:26.562029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:26.563122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:26.568083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:26.574371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:26.724117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:26.788170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99142461-6abf-41d8-bde3-8a4c60003415 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.270097 Sep 13 16:40:26.798889 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1346/2628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:26 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:26.815898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:26.821107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:26.834746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:26.840422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:26.841135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:26.842104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:26.847613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:26.849429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:27.081454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:27.110284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:27.165982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:27.185423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:27.192792 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca45e3ef-0bad-4913-a3c2-69b0514ab483 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1554 microversion: 2.1 time: 1.598633 Sep 13 16:40:27.193409 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1283/2629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:25 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1554 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:27.222501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-935ebcc0-2237-473d-9cdf-2e30a512a89b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb97039d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:27.222676 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed2f9a89-ba0d-4b10-a4bd-5c0647730559 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.422299 Sep 13 16:40:27.234351 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1347/2630] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:26 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:27.817921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:27.818731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:27.830256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:27.834172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:27.834897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:27.837251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:27.838113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:27.840273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:28.140264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:28.160798 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17e850e8-4afb-446c-8e0d-72a424b77059 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.349040 Sep 13 16:40:28.182335 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1348/2631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:27 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:28.227792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:28.229534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:28.264553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:28.265315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:28.268484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:28.269560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:28.270606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:28.271302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:28.959394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:28.976090 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5fe02a7b-d922-45e7-b53f-8d9e1b20af4e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1554 microversion: 2.1 time: 0.755517 Sep 13 16:40:28.977311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1349/2632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:28 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1554 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:28.987667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:28.992942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:29.007431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:29.008241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:29.010429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:29.012879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:29.013634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:29.015365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:29.460738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:29.479424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:29.486464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:29.510656 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b10f13d7-2ca6-4f5d-9a5f-f564985450f8 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.530255 Sep 13 16:40:29.515181 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1350/2633] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:28 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:29.534555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:29.536962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:29.560759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:29.564827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:29.566093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:29.574921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:29.575604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:29.576333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:29.797654 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-935ebcc0-2237-473d-9cdf-2e30a512a89b tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7" status: 202 len: 0 microversion: 2.1 time: 2.590612 Sep 13 16:40:29.798648 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1284/2634] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:27 2022] DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7 => generated 0 bytes in 2605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:29.815871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-341a88ce-500c-44a5-9754-56b45bad5a94 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'create', calling method: .version_select at 0x7fbeb53c7c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-329348799", "description": "tempest-description-1368822169"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:30.122589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:30.148419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4da2ad1f-c50e-44ce-a3ab-2f62cd69a890 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.625954 Sep 13 16:40:30.151029 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1351/2635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:29 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:30.166299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:30.168175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:30.183929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:30.185400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:30.186818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:30.188699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:30.190865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:30.191412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:31.135633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:31.155397 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40714acf-bd55-45fc-bfed-9bd302d9e0d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1554 microversion: 2.1 time: 1.002582 Sep 13 16:40:31.165629 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1352/2636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:30 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1554 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:31.185777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:31.187463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:31.212874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:31.215410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:31.217462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:31.222211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:31.224268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:31.226008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:31.444085 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-341a88ce-500c-44a5-9754-56b45bad5a94 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.631520 Sep 13 16:40:31.446090 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1285/2637] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Sep 13 16:40:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:31.455443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f26922d2-9b6c-474c-a903-4a4d32d46ac2 req-263170d6-8e55-4d8e-8e21-22bd7246007e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97440adf-b971-4533-8e5a-49a5b5937d02", "name": "network-vif-deleted", "tag": "92ec5222-77bb-4339-b616-cfcd79911a8c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:31.497955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f26922d2-9b6c-474c-a903-4a4d32d46ac2 req-263170d6-8e55-4d8e-8e21-22bd7246007e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:31.500180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f26922d2-9b6c-474c-a903-4a4d32d46ac2 req-263170d6-8e55-4d8e-8e21-22bd7246007e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:31.501250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f26922d2-9b6c-474c-a903-4a4d32d46ac2 req-263170d6-8e55-4d8e-8e21-22bd7246007e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:31.556659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f26922d2-9b6c-474c-a903-4a4d32d46ac2 req-263170d6-8e55-4d8e-8e21-22bd7246007e service nova] Creating event network-vif-deleted:92ec5222-77bb-4339-b616-cfcd79911a8c for instance 97440adf-b971-4533-8e5a-49a5b5937d02 on n-h1-857467-1 Sep 13 16:40:31.584553 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f26922d2-9b6c-474c-a903-4a4d32d46ac2 req-263170d6-8e55-4d8e-8e21-22bd7246007e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136600 Sep 13 16:40:31.588934 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1286/2638] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:31.596424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:31.628821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:31.650575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:31.660344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:31.665207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:31.675263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:31.677648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:31.706769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:31.708835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:31.712991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:31.714818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:31.719851 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e2af9db-7292-4ec1-ba9e-cce01e6e0026 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.546700 Sep 13 16:40:31.721107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1353/2639] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:31 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:31.727807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:31.740416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa9e3455-20cc-4259-bd33-5694d6b5b70f tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Action: 'update', calling method: .version_select at 0x7fbeb4aeaee0>, body: {"security_group": {"name": "tempest-sg-hth-425650558", "description": "tempest-description-hth-1000955269"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:31.870067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:31.889435 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec9136f5-a73c-44d9-9af5-ae768ca3769b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.297687 Sep 13 16:40:31.891430 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1287/2640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:31 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:32.195150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:32.196033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:32.209415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:32.211287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:32.212414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:32.214499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:32.217997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:32.218659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:32.367627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:32.381057 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f8b442cb-44a4-497a-a771-d41b7edd920d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1346 microversion: 2.1 time: 0.189979 Sep 13 16:40:32.391046 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1288/2641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:32 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:32.483301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b947ae9b-2d2c-403f-857f-80ea6bdfda33 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Action: 'create', calling method: .version_select at 0x7fbeb56b2940>, body: {"keypair": {"name": "tempest-keypair-1336227260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGx2HOl4eGP223iNBmtV1g36ypqkdqdBmrm48OXd+sT70nZVMI9hDsvbay3c2DdqTNicbTjy4gtIcg/VfU/CMd4IP3iZN+KBdXcu413syzvxKGwzeiGZ1GlleINt/a/jVA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:32.516312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b947ae9b-2d2c-403f-857f-80ea6bdfda33 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Getting quotas for project dbcd5c8269404586979c1009c106c0e0. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:32.536792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b947ae9b-2d2c-403f-857f-80ea6bdfda33 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Getting quotas for user 435b8c15842a44f2be3674fce942cb3c and project dbcd5c8269404586979c1009c106c0e0. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:32.596154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b947ae9b-2d2c-403f-857f-80ea6bdfda33 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.122874 Sep 13 16:40:32.604394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1289/2642] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:40:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:40:32.751628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:32.752256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:32.779668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:32.780310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:32.780782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:32.781556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:32.787841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:32.788386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:32.855863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa9e3455-20cc-4259-bd33-5694d6b5b70f tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "PUT /compute/v2.1/os-security-groups/e08d0e13-d1d2-44bd-bdc4-d611b9fcf518" status: 200 len: 217 microversion: 2.1 time: 1.133078 Sep 13 16:40:32.865509 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1354/2643] 10.222.0.61 () {60 vars in 1290 bytes} [Tue Sep 13 16:40:31 2022] PUT /compute/v2.1/os-security-groups/e08d0e13-d1d2-44bd-bdc4-d611b9fcf518 => generated 217 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:32.871751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca84483c-4095-4c25-9a56-4c3174439b62 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb51ea3a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:33.011142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:33.037938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:33.041136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:33.048828 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad0fe215-227b-4d10-b129-49a56fcb7be5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.301240 Sep 13 16:40:33.050165 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1290/2644] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:32 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:33.056988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:33.058034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:33.080603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.085605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.086314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.090787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.091474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.092099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.214867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:33.224615 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4091465b-e731-4484-86df-706ebab52fb8 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.172064 Sep 13 16:40:33.235812 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1291/2645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:33 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:33.281267 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca84483c-4095-4c25-9a56-4c3174439b62 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/e08d0e13-d1d2-44bd-bdc4-d611b9fcf518" status: 200 len: 217 microversion: 2.1 time: 0.414132 Sep 13 16:40:33.282597 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1355/2646] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:40:32 2022] GET /compute/v2.1/os-security-groups/e08d0e13-d1d2-44bd-bdc4-d611b9fcf518 => generated 217 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:33.303587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-879ab71a-5eb6-4a16-8ce2-ecfb19f6da4a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb568c1f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:33.420500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:33.421119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:33.444092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.444601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.445053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.445776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.446280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.446717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.665464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:33.678284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3c5fa8e-8490-40c3-a8a9-3e52176cbaf9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1346 microversion: 2.1 time: 0.261438 Sep 13 16:40:33.694903 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1356/2647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:33 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1346 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:33.800496 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-879ab71a-5eb6-4a16-8ce2-ecfb19f6da4a tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e08d0e13-d1d2-44bd-bdc4-d611b9fcf518" status: 202 len: 0 microversion: 2.1 time: 0.503541 Sep 13 16:40:33.805229 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1292/2648] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:33 2022] DELETE /compute/v2.1/os-security-groups/e08d0e13-d1d2-44bd-bdc4-d611b9fcf518 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:33.811813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:33.812480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:33.832842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.833505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.854546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.855979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.857627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.858331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.914376 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 HTTP/1.1 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'df3c2e4f-eda6-4e0f-934b-56bb68b93941'} Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:33.916515 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:33.922174 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc8467ef-d07e-4715-aa4a-432e23debd39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 404 len: 111 microversion: 2.1 time: 0.111336 Sep 13 16:40:33.927028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:33.927935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: df3c2e4f-eda6-4e0f-934b-56bb68b93941] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:33.933266 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1357/2649] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:33 2022] DELETE /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:33.957249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.958858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.959462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.960382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:33.960998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:33.961575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:33.996278 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 HTTP/1.1 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'df3c2e4f-eda6-4e0f-934b-56bb68b93941'} Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:33.998181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Instance df3c2e4f-eda6-4e0f-934b-56bb68b93941 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.002500 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68e9c01b-1f32-43f7-8bd4-a3893cfc9911 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941" status: 404 len: 111 microversion: 2.1 time: 0.076847 Sep 13 16:40:34.018794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb4aea430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.022747 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1293/2650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:33 2022] GET /compute/v2.1/servers/df3c2e4f-eda6-4e0f-934b-56bb68b93941 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.087411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.088599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:34.103918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.110362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.111344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.112903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.113747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.116415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.289932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:34.290997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.security_group_api [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 not found {{(pid=122328) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:40:34.291690 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.291690 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7 HTTP/1.1 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: exception: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'f6487e5e-43de-4fe5-89c5-e524a38f6cd7'} Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:34.294287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] Sep 13 16:40:34.298367 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.303656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group f6487e5e-43de-4fe5-89c5-e524a38f6cd7 does not exist Sep 13 16:40:34.303656 n-d-857467-1 devstack@n-api.service[122328]: Neutron server returns request_ids: ['req-e1e90c13-fb07-43cb-9e42-65b205bad809'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.305092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-afe37c68-5010-424f-9f8f-5b21e33514f4 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7" status: 404 len: 194 microversion: 2.1 time: 0.298941 Sep 13 16:40:34.309720 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1358/2651] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/os-security-groups/f6487e5e-43de-4fe5-89c5-e524a38f6cd7 => generated 194 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.316517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.318325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:34.326763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.327682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.328603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.329610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.330405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.334807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:34.339705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.353233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:34.356519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:34.371385 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68f757e4-0eec-4d32-9aed-71f2a65d32e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.290278 Sep 13 16:40:34.375775 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1294/2652] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:34 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:40:34.386217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb5451430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.438991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:34.439865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 77b00d18-f003-4c90-abc7-791026eeeca0 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:40:34.441072 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.441072 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0 HTTP/1.1 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '77b00d18-f003-4c90-abc7-791026eeeca0'} Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:34.444619 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] Sep 13 16:40:34.451517 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.461757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 77b00d18-f003-4c90-abc7-791026eeeca0 does not exist Sep 13 16:40:34.461757 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f8d1061b-3bb7-4a82-a3a9-636f13d9ebab'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.463694 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3c3ce95-fd99-4808-a9d4-e5ff84b4c171 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0" status: 404 len: 194 microversion: 2.1 time: 0.085215 Sep 13 16:40:34.464601 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1295/2653] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/os-security-groups/77b00d18-f003-4c90-abc7-791026eeeca0 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.475056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb56b2430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.501215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:34.502097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 01ae8d72-5657-4925-ae1a-d7876edf6048 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:40:34.502889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.502889 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048 HTTP/1.1 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '01ae8d72-5657-4925-ae1a-d7876edf6048'} Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:34.510347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] Sep 13 16:40:34.514140 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.524079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 01ae8d72-5657-4925-ae1a-d7876edf6048 does not exist Sep 13 16:40:34.524079 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-add95d82-236b-4ddc-a383-aaa3c98dad5f'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.526273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd59bcb3-7667-4f81-b380-22b434c65cdb tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048" status: 404 len: 194 microversion: 2.1 time: 0.057398 Sep 13 16:40:34.527421 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1296/2654] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/os-security-groups/01ae8d72-5657-4925-ae1a-d7876edf6048 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.536589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb95b9280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.566057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:34.567397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:40:34.568050 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.568050 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01 HTTP/1.1 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '340ff24a-4e42-4b0e-be25-1cdcb018be01'} Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:34.570934 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] Sep 13 16:40:34.574770 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.577855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 340ff24a-4e42-4b0e-be25-1cdcb018be01 does not exist Sep 13 16:40:34.577855 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-ff7b86ac-9eb6-4fd9-bc9d-90a00be33802'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.579564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-029b0c5c-862e-4f9c-a8c4-459d2da158b2 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01" status: 404 len: 194 microversion: 2.1 time: 0.048078 Sep 13 16:40:34.581184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1297/2655] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/os-security-groups/340ff24a-4e42-4b0e-be25-1cdcb018be01 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.600437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb970f040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.665205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:34.666215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group 44c1db99-0df1-4712-9f83-d00e359376f8 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:40:34.667053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.667053 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8 HTTP/1.1 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '44c1db99-0df1-4712-9f83-d00e359376f8'} Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:34.669473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] Sep 13 16:40:34.673592 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.681959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group 44c1db99-0df1-4712-9f83-d00e359376f8 does not exist Sep 13 16:40:34.681959 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-130c615b-f550-4b49-8417-9c35a5b73f7a'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.683487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aab37088-c52f-4018-b982-a005ca2eb434 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8" status: 404 len: 194 microversion: 2.1 time: 0.098181 Sep 13 16:40:34.685628 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1298/2656] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/os-security-groups/44c1db99-0df1-4712-9f83-d00e359376f8 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.696378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb95b9280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.719360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:34.742514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3fa0142-9179-490a-97e0-a67e748f544d tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1183 microversion: 2.1 time: 0.431073 Sep 13 16:40:34.743135 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1359/2657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:34 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1183 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:34.755679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:40:34.756601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Neutron security group e614fdbc-0ac6-45c7-afb6-87d349702361 not found {{(pid=122327) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 13 16:40:34.757356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.757356 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] Sep 13 16:40:34.758859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361 HTTP/1.1 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: exception: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e614fdbc-0ac6-45c7-afb6-87d349702361'} Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:40:34.759957 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] Sep 13 16:40:34.763639 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:34.777378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Security group e614fdbc-0ac6-45c7-afb6-87d349702361 does not exist Sep 13 16:40:34.777378 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-f5841b5d-3307-43d0-b625-3e160bc58d5d'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:34.778852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-17670eb4-cdd4-4579-8e56-5c2e0147b8fe tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361" status: 404 len: 194 microversion: 2.1 time: 0.090080 Sep 13 16:40:34.779904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:34.784750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1299/2658] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/os-security-groups/e614fdbc-0ac6-45c7-afb6-87d349702361 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:34.813949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.822616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.824722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.827022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.828379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.831466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.844072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:34.846538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:34.882923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.884160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.884778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.885986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:34.886807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:34.887406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:34.965369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:35.042127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:35.076276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a757778-04da-4175-af35-f469494fd19c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1346 microversion: 2.1 time: 0.331868 Sep 13 16:40:35.081800 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1360/2659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:34 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1346 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:35.165362 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54bbd9bd-af67-40d9-9ee8-a7e7f14294c3 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 204 len: 0 microversion: 2.1 time: 0.376255 Sep 13 16:40:35.168155 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1300/2660] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:34 2022] DELETE /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:35.176882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:35.177761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:35.186617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.187191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.187918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.188731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.189317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.189989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.199103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:35.414047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:35.415389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:35.427337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.428049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.428341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:35.428845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.429819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.430621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.431230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.437122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-481b743c-aca3-4eab-a166-5390dfdf7d24 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1647 microversion: 2.1 time: 0.264584 Sep 13 16:40:35.437688 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1361/2661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:35 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1647 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:35.569231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:35.586699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:35.589643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:35.608715 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e845cd0-b400-44bc-883b-32b7757bd54b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.201112 Sep 13 16:40:35.622828 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1301/2662] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:35 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:35.768628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:35.769578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:35.783465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.783972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.784770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.786069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.786722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.787528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.825356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:35.827505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:35.828252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:35.828712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lazy-loading 'fault' on Instance uuid fa012e4d-50f0-4820-b7fe-39152d3710c5 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:35.879305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:35.888017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61d7be6e-3312-40e7-abf5-60ba5ddc943b tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 200 len: 1188 microversion: 2.1 time: 0.123855 Sep 13 16:40:35.888926 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1362/2663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:35 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 1188 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:36.104400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:36.105454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:36.119028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:36.122521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:36.123026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:36.123854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:36.124330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:36.124773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:36.262709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:36.276343 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bff9b02d-45f6-43bc-83bf-81fa3ad4f9e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1346 microversion: 2.1 time: 0.175757 Sep 13 16:40:36.277193 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1302/2664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:36 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:36.462011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:36.462628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:36.473189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:36.484388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:36.484388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:36.488265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:36.488265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:36.488937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:36.645457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:36.646300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:36.656735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:36.658414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:36.664304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:36.667434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:36.667965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:36.668423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:36.733480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:36.743386 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f65f9b9-5366-4a41-9462-ea63c3d53044 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1647 microversion: 2.1 time: 0.286714 Sep 13 16:40:36.744285 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1363/2665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:36 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1647 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:36.776982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:36.786068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:36.787540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:36.798301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1067ff7f-c18d-4ac4-9168-7017e5ad680f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.159379 Sep 13 16:40:36.798904 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1303/2666] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:36 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:36.885064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2026759245", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9d85fdfa-22fb-4856-927e-40a4825bd1c0"}, {"port": "a5a19eaf-0b13-4a24-ab8c-6cebeb712e50", "tag": "port-1"}, {"port": "3b88ed2f-d58e-4333-a77c-43db1fd0a0d2", "tag": "port-2"}, {"uuid": "bec41095-e3db-4224-b2c0-e21e4359db3b", "tag": "net-1"}, {"uuid": "bec41095-e3db-4224-b2c0-e21e4359db3b"}, {"uuid": "f24e2810-4389-4e6a-b7a6-88bfd00dc54b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f24e2810-4389-4e6a-b7a6-88bfd00dc54b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "51f9c7e2-984d-4625-b4af-60662ddf7de6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f1238d42-b8b1-41ed-8c96-eb4dd15a5c00", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2dea45ff-f8fd-433b-ba08-2b292ee92f64", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1114961731"}], "key_name": "tempest-keypair-1336227260", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:37.106525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] validate_networks() for [('9d85fdfa-22fb-4856-927e-40a4825bd1c0', None, None, None, None, None), (None, None, 'a5a19eaf-0b13-4a24-ab8c-6cebeb712e50', None, None, None), (None, None, '3b88ed2f-d58e-4333-a77c-43db1fd0a0d2', None, None, None), ('bec41095-e3db-4224-b2c0-e21e4359db3b', None, None, None, None, None), ('bec41095-e3db-4224-b2c0-e21e4359db3b', None, None, None, None, None), ('f24e2810-4389-4e6a-b7a6-88bfd00dc54b', '10.2.2.100', None, None, None, None), ('f24e2810-4389-4e6a-b7a6-88bfd00dc54b', '10.2.2.200', None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:40:37.195232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43da93a0-afaa-4a0f-9abc-713867f320d7 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '.version_select at 0x7fbeb4989e50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:37.285883 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43da93a0-afaa-4a0f-9abc-713867f320d7 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add" status: 200 len: 371 microversion: 2.1 time: 0.516231 Sep 13 16:40:37.293145 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1364/2667] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:40:36 2022] GET /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add => generated 371 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:37.293145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:37.293145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: fa012e4d-50f0-4820-b7fe-39152d3710c5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:37.298130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:37.298621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:37.299263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:37.299970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:37.300431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:37.300859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:37.315591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] HTTP exception thrown: Instance fa012e4d-50f0-4820-b7fe-39152d3710c5 could not be found. Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Request method failure captured: Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 HTTP/1.1 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILClrZJJcasMYsTwUFZ049N1GVMnB9gM6bMGQgvBqHRA0C7rSS-UvNJ2R_WWOAw-ftLx0pEmDlzz06e2CTaS9IjBnRwqHH8U36lzhxobPCQ6BPB1Tlsn-_eX_4i5lNlaC3KBUxYrxTtEgP4M9BjEbMQdBHE9i_AwWGu9yNBnS-Kuv8A Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-LiveMigrationTest-779205528 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-LiveMigrationTest-779205528-project Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1fdc6602945c46fa98eebf50ea85a86e Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-LiveMigrationTest-779205528-project Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance fa012e4d-50f0-4820-b7fe-39152d3710c5 could not be found. Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'fa012e4d-50f0-4820-b7fe-39152d3710c5'} Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa012e4d-50f0-4820-b7fe-39152d3710c5 could not be found. Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa012e4d-50f0-4820-b7fe-39152d3710c5 could not be found. Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:37.317847 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa012e4d-50f0-4820-b7fe-39152d3710c5 could not be found. Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Returning 404 to user: Instance fa012e4d-50f0-4820-b7fe-39152d3710c5 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fad25b3b-c36c-4b44-ae16-bada03f4b903 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5" status: 404 len: 111 microversion: 2.1 time: 0.031860 Sep 13 16:40:37.325233 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1365/2668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:37 2022] GET /compute/v2.1/servers/fa012e4d-50f0-4820-b7fe-39152d3710c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:37.383696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-92579034", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:37.452158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:40:37.687907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:40:37.688503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:40:37.688989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:40:37.689550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:40:37.690135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:40:37.700343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:37.700830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:37.701269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:37.702026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:37.702639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:37.703070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:37.733734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Getting quotas for project 1e9f5c731cfd4ebba006c7d818d26d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:37.741645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Getting quotas for user 83ade3c22e244d4e899dafb768efdaa7 and project 1e9f5c731cfd4ebba006c7d818d26d5a. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:37.744675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:37.758445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:40:37.761584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:40:37.826156 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8316484e-54a1-4086-98c7-922a787fd71f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504620 Sep 13 16:40:37.833019 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1366/2669] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:40:37.833019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4989c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:37.926449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:37.927130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:37.927530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:37.928297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:37.928766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:37.929202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.005162 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8665e391-90e0-4e6f-9ad8-b68223a25df9 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add" status: 200 len: 328 microversion: 2.1 time: 0.176137 Sep 13 16:40:38.006949 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1367/2670] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:40:37 2022] PUT /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add => generated 328 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:38.018093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:38.020847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:38.027351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.028010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.028470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.029181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.029657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.030157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.128136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:38.139773 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c804e0b2-00e9-43b6-b7af-f73f52516f76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1346 microversion: 2.1 time: 0.131591 Sep 13 16:40:38.141038 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1368/2671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:38 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:38.146523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:38.147439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:38.154751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.155538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.156322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.157140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.157785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.158456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.371575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f79b99f0e814aaebc8e60ab612a58d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2677cc7ad9fa426aa14de85453b4b368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:38.383047 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c361c937-ef23-4129-8b78-33f56679bc7d tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 200 len: 1647 microversion: 2.1 time: 0.240589 Sep 13 16:40:38.393956 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1369/2672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:38 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 1647 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:38.393956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:38.393956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:38.406167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.407597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.410145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.412912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.413520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.417783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.534544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:38.544406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:38.546086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:38.553751 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c83d43dd-9354-4036-a722-e76d335840b5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.168344 Sep 13 16:40:38.554652 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1370/2673] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:38 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:38.559858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:38.560613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:38.583931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.585100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.585603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.586422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.587154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.587658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.663553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:38.678621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30659b53-fff3-4c77-a448-1518e8806df5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1219 microversion: 2.1 time: 0.122514 Sep 13 16:40:38.679199 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1371/2674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:38 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:38.694034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-700a8c8b-71f2-48dc-b607-c19f84bd3aad tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:38.706692 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-700a8c8b-71f2-48dc-b607-c19f84bd3aad tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add" status: 202 len: 0 microversion: 2.1 time: 0.022832 Sep 13 16:40:38.707365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1372/2675] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:40:38 2022] DELETE /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:38.717727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-11d72ccc-4aee-4db7-a01b-6bf636713388 req-034db123-631d-4352-a541-d8da66564eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3675b4ed-f67e-4b6d-8637-fa28b6d848d8", "name": "network-vif-deleted", "tag": "1b0c2f2f-223b-45b9-9927-448cdd44cf52"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:38.730285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-11d72ccc-4aee-4db7-a01b-6bf636713388 req-034db123-631d-4352-a541-d8da66564eb7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:38.731055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-11d72ccc-4aee-4db7-a01b-6bf636713388 req-034db123-631d-4352-a541-d8da66564eb7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:38.731639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-11d72ccc-4aee-4db7-a01b-6bf636713388 req-034db123-631d-4352-a541-d8da66564eb7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:38.749210 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-11d72ccc-4aee-4db7-a01b-6bf636713388 req-034db123-631d-4352-a541-d8da66564eb7 service nova] Creating event network-vif-deleted:1b0c2f2f-223b-45b9-9927-448cdd44cf52 for instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 on n-h1-857467-1 Sep 13 16:40:38.755697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-11d72ccc-4aee-4db7-a01b-6bf636713388 req-034db123-631d-4352-a541-d8da66564eb7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043180 Sep 13 16:40:38.756857 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1373/2676] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:38.764723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a11ee64f-1b37-4685-b47e-3322dd512c1e tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '.version_select at 0x7fbeb4aeaee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:38.878435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a11ee64f-1b37-4685-b47e-3322dd512c1e tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add" status: 200 len: 371 microversion: 2.1 time: 0.120134 Sep 13 16:40:38.879326 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1374/2677] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:40:38 2022] GET /compute/v2.1/os-quota-sets/13ead01781d049d9908ee643b1c23add => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:39.083031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3b8d084-a071-455a-b4f1-49a069664cc2 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '.version_select at 0x7fbeb56e13a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:39.307363 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3b8d084-a071-455a-b4f1-49a069664cc2 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867/defaults" status: 200 len: 371 microversion: 2.1 time: 0.228804 Sep 13 16:40:39.308710 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1375/2678] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:40:39 2022] GET /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867/defaults => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:40:39.313558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:39.316254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:39.325098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:39.325985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:39.326754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:39.327655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:39.328561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:39.329183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:39.435115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:39.446032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d779f47-1c6d-4b44-83ba-0723dfd89a02 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1346 microversion: 2.1 time: 0.136031 Sep 13 16:40:39.447413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1376/2679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:39 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:39.453938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:39.463052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] [instance: 3675b4ed-f67e-4b6d-8637-fa28b6d848d8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:39.476286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:39.477243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:39.477787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:39.478657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:39.479215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:39.479657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:39.501014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] HTTP exception thrown: Instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 could not be found. Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Request method failure captured: Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 HTTP/1.1 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIUyGqCC2ntobFPVWh2bMHevYVkkgTdwuBTAJMDoM4IcyCmR-buC0XaIjMiHMrCTn-QAtcXmQQO2ZtfgvZsKerW74QgYnVHU0WnEZk1K7WV0X1JLrTsWtTWeyfJdOF8VrrMHOW6bJ9zLEL8k6P37U3AcGcArSCnTkWjkIcHVZR-cdE Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2677cc7ad9fa426aa14de85453b4b368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2677cc7ad9fa426aa14de85453b4b368 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1728643377 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4f79b99f0e814aaebc8e60ab612a58d4 Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-SecurityGroupsTestJSON-1728643377-project Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 could not be found. Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3675b4ed-f67e-4b6d-8637-fa28b6d848d8'} Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 could not be found. Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 could not be found. Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:39.502923 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 could not be found. Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Returning 404 to user: Instance 3675b4ed-f67e-4b6d-8637-fa28b6d848d8 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:39.506705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41b12c22-6f8b-4737-a0f7-02f18c5f2b39 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8" status: 404 len: 111 microversion: 2.1 time: 0.055874 Sep 13 16:40:39.508629 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1377/2680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:39 2022] GET /compute/v2.1/servers/3675b4ed-f67e-4b6d-8637-fa28b6d848d8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:39.514702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-95790237-6c04-4293-b44a-59f85be73e45 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb50ee3a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:39.832000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-95790237-6c04-4293-b44a-59f85be73e45 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/aab6ba2f-aff3-4980-9d3d-9b7803a53000" status: 202 len: 0 microversion: 2.1 time: 0.321410 Sep 13 16:40:39.834747 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1378/2681] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:39 2022] DELETE /compute/v2.1/os-security-groups/aab6ba2f-aff3-4980-9d3d-9b7803a53000 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:39.839806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:39.840529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:39.849821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:39.851026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:39.851026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:39.851733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:39.852417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:39.852999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:39.939975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:39.951186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:39.953008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:39.959299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa59dbaf-f1e9-4735-98f6-8579d6f59a7d tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.123635 Sep 13 16:40:39.959908 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1379/2682] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:39 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:39.964508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4aea790>, body: {"quota_set": {"ram": "5120"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:40.185083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.185678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.186285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.187173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.187633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.188065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.275859 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-630d31bd-58ad-438d-8f7c-9fa69d66d20d tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372" status: 200 len: 328 microversion: 2.1 time: 0.312805 Sep 13 16:40:40.278343 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1380/2683] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:40:39 2022] PUT /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372 => generated 328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:40.292956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:40.293854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:40.312796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.314107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.314714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.315641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.316263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.317786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.402815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:40.411389 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3bb66dc-8b09-4eed-9f3d-341198b10742 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1267 microversion: 2.1 time: 0.129729 Sep 13 16:40:40.412297 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1381/2684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:40 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:40.416843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4314c9c9-9b87-4662-8a9d-683cd4e76f36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] Calling method '.version_select at 0x7fbeb51b0310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:40.600287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:40:40.601989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:40:40.602490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:40:40.602941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:40:40.603493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:40:40.614659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.615447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.616066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.616921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.617395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.617861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.625767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4314c9c9-9b87-4662-8a9d-683cd4e76f36 tempest-SecurityGroupsTestJSON-1728643377 tempest-SecurityGroupsTestJSON-1728643377-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/5d6b8f58-cde5-40c9-bb49-429acc15eff3" status: 202 len: 0 microversion: 2.1 time: 0.212283 Sep 13 16:40:40.627204 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1382/2685] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:40:40 2022] DELETE /compute/v2.1/os-security-groups/5d6b8f58-cde5-40c9-bb49-429acc15eff3 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:40.633453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '.version_select at 0x7fbeb50ee550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:40.637511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Getting quotas for project dbcd5c8269404586979c1009c106c0e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:40.646149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Getting quotas for user 435b8c15842a44f2be3674fce942cb3c and project dbcd5c8269404586979c1009c106c0e0. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:40.748324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.748822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.749258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.751207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.751686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.752119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.805887 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85c26529-ed59-4312-b841-fb598dd37597 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372/detail" status: 200 len: 916 microversion: 2.1 time: 0.176925 Sep 13 16:40:40.809294 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1383/2686] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:40:40 2022] GET /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372/detail => generated 916 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:40.815443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:40.816062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:40.840445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.846342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.847030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.848457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.849660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.850444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.872130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:40:40.880612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='51f9c7e2-984d-4625-b4af-60662ddf7de6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f1238d42-b8b1-41ed-8c96-eb4dd15a5c00',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dea45ff-f8fd-433b-ba08-2b292ee92f64',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:40:40.928047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:40.928598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:40.929120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:40.929639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'fault' on Instance uuid 97440adf-b971-4533-8e5a-49a5b5937d02 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:41.006748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.028264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-49c6a11e-25cc-4a89-a9ce-6c7f3cef090f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 200 len: 1351 microversion: 2.1 time: 0.217650 Sep 13 16:40:41.029703 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1384/2687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:40 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 1351 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:41.046399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:41.047308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:41.064603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.065130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.065612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.066431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.068518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.069192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.172900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.184391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.186392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.193183 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59b74710-c69a-4371-9f77-966381b8ad17 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.161720 Sep 13 16:40:41.194028 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1385/2688] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:41 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:41.210836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb96fb820>, body: {"quota_set": {"ram": "2048"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:41.344497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.344995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.345429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.346331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.346791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.347219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.396081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.396934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.397767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.398747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.399392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.400015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.458921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:41.476348 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1594159b-38bf-44d3-81b3-973674470086 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372?user_id=29904ef414074e348bafcc580b136fcc" status: 200 len: 328 microversion: 2.1 time: 0.281054 Sep 13 16:40:41.484355 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbefbb9c-28f8-4258-b16b-9c7928c88ec6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.607268 Sep 13 16:40:41.485541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1304/2689] 10.222.0.61 () {62 vars in 1189 bytes} [Tue Sep 13 16:40:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 4609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:40:41.493323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:41.494202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:41.506257 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1386/2690] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 16:40:41 2022] PUT /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372?user_id=29904ef414074e348bafcc580b136fcc => generated 328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:41.517165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9571a0fb-167f-43b8-bbdb-31aa21177739 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '.version_select at 0x7fbeb5da08b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:41.522369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.523056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.523678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.524554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:41.525169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:41.525754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:41.706210 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9571a0fb-167f-43b8-bbdb-31aa21177739 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372?user_id=29904ef414074e348bafcc580b136fcc" status: 200 len: 370 microversion: 2.1 time: 0.196878 Sep 13 16:40:41.719056 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1387/2691] 10.222.0.61 () {58 vars in 1323 bytes} [Tue Sep 13 16:40:41 2022] GET /compute/v2.1/os-quota-sets/6d508b1ca6374b009b0642f791b5e372?user_id=29904ef414074e348bafcc580b136fcc => generated 370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:41.733586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b718cbd-6790-4cc8-96e1-eb1826316984 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:41.735540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b718cbd-6790-4cc8-96e1-eb1826316984 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:41.752118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.762222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9921bf39-7d3c-4d45-b94f-b5aad96c958a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1267 microversion: 2.1 time: 0.275449 Sep 13 16:40:41.770487 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1305/2692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:41 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:41.846928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b718cbd-6790-4cc8-96e1-eb1826316984 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.876196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b718cbd-6790-4cc8-96e1-eb1826316984 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.885136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b718cbd-6790-4cc8-96e1-eb1826316984 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:41.889757 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b718cbd-6790-4cc8-96e1-eb1826316984 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1286 microversion: 2.32 time: 0.167036 Sep 13 16:40:41.907769 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1388/2693] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:41 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:42.068821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:42.069479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:42.086549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.088498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.088979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.098936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.099458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.100567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.122113 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 HTTP/1.1 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '97440adf-b971-4533-8e5a-49a5b5937d02'} Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:42.124066 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.128272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.130784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:42.132544 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2bbe7d4c-f695-480f-b28f-9cb7d6867dea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 404 len: 111 microversion: 2.1 time: 0.083623 Sep 13 16:40:42.133605 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1306/2694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:42 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:42.239580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:42.242378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:42.265585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.266362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.271543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.278730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.279856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.282508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.324979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e2c9aad-ccd2-4fed-abf4-f34a2a76a2c1 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Calling method '.version_select at 0x7fbeb9760af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:42.444896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:42.456885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:42.459864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:42.466272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07225961-e53d-429e-af78-523dca9033fd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.232394 Sep 13 16:40:42.478909 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1389/2695] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:42 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:42.493379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:42.495902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:42.502360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.502854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.503293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.503991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.505157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.506378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.511222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:42.527016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02/os-volume_attachments HTTP/1.1 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '97440adf-b971-4533-8e5a-49a5b5937d02'} Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:42.530929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:42.535042 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-786f4099-9888-43c0-bcb3-c7c9af3ec07b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050592 Sep 13 16:40:42.538027 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1390/2696] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:40:42 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:42.786506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:42.787130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:42.794489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.794989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.795427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:42.796144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:42.809469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:42.810106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:43.013291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:43.027472 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6f5372f-7fe0-47be-8fc2-4485d9778f10 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1273 microversion: 2.1 time: 0.244974 Sep 13 16:40:43.028075 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1391/2697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:42 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:43.038563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-943221107", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:43.139334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e2c9aad-ccd2-4fed-abf4-f34a2a76a2c1 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867/defaults" status: 200 len: 371 microversion: 2.1 time: 0.818032 Sep 13 16:40:43.140800 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1307/2698] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:40:42 2022] GET /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867/defaults => generated 371 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:40:43.166445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ef00db6-0c79-44b6-9906-ae30d2222961 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:43.178697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ef00db6-0c79-44b6-9906-ae30d2222961 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:43.184570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:40:43.454012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ef00db6-0c79-44b6-9906-ae30d2222961 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:43.464760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ef00db6-0c79-44b6-9906-ae30d2222961 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:43.478098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ef00db6-0c79-44b6-9906-ae30d2222961 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:43.479470 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ef00db6-0c79-44b6-9906-ae30d2222961 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1286 microversion: 2.32 time: 0.337667 Sep 13 16:40:43.480601 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1308/2699] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:43 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1286 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:43.485517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4d68f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:43.637219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:43.637918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:43.638516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:43.639625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:43.640258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:43.640858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:43.771600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:44.161318 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a75c8953-c984-4f41-a2cf-6ba3f7813d30 tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867" status: 200 len: 329 microversion: 2.1 time: 0.678753 Sep 13 16:40:44.167378 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1309/2700] 10.222.0.61 () {60 vars in 1263 bytes} [Tue Sep 13 16:40:43 2022] PUT /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867 => generated 329 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:44.176925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:44.177681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:44.194103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.194630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.196277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.198347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.198809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.200376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.376493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:44.393509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:44.395799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:44.409111 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7633c58e-a9b9-45d5-b252-c9671ded0cc4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1531 microversion: 2.91 time: 0.240409 Sep 13 16:40:44.409712 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1310/2701] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:44 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1531 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:44.440874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:44.441509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:44.444559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:40:44.445041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:40:44.445467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:40:44.445884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:40:44.446306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:40:44.459287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.460264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.460719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.461450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.461946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.465051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.465549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.466024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.466157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.466765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.467228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.467661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.505086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:44.512387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:44.528238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:40:44.531407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:40:44.627865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abe9b166-1b11-463b-a281-6d591ce34aef tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594768 Sep 13 16:40:44.632896 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1392/2702] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:40:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:40:44.644482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Action: 'update', calling method: .version_select at 0x7fbeb4a4aca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:44.833967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.834470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.834907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:44.835788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:44.844295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:44.845375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:45.111853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:45.121708 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-257d14e0-733d-411f-aec8-76a8a4f50a2d tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.698660 Sep 13 16:40:45.125726 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1311/2703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:44 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:45.156407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:45.157601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:45.173057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:45.176778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:45.180425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:45.181247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:45.182091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:45.183004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:45.468830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lazy-loading 'services' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:45.522837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1359f87f-d7bb-4abf-a5d4-c2f574dfae54 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1936 microversion: 2.91 time: 0.393320 Sep 13 16:40:45.525768 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1312/2704] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:45 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1936 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:45.540108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:45.543137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:45.571069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:45.572686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:45.576520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:45.578339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:45.580595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:45.582988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:45.688144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=17,nova_api:UPDATE=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:45.740508 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c127cd43-4e43-4392-a1ab-f999f216ca1f tempest-QuotasAdminTestJSON-803883473 tempest-QuotasAdminTestJSON-803883473-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867" status: 200 len: 329 microversion: 2.1 time: 1.103075 Sep 13 16:40:45.742140 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1393/2705] 10.222.0.61 () {60 vars in 1263 bytes} [Tue Sep 13 16:40:44 2022] PUT /compute/v2.1/os-quota-sets/b56e9e9fb2634952a7fee96f7be2f867 => generated 329 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:45.766753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:45.776205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:45.787860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:45.811358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:45.817654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:45.823700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:45.826942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:45.834632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:45.838807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.039880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:46.049359 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35d89b50-753f-42b5-bb10-8f8eda25174f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 200 len: 1218 microversion: 2.1 time: 0.304680 Sep 13 16:40:46.053093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1394/2706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:45 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:46.060366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:46.060921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:46.093386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.094678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.095139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.099438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.100372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.101414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.139044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lazy-loading 'flavor' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:46.539712 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4babef4-cb7f-4467-b946-5fa2bd3157d4 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action" status: 202 len: 0 microversion: 2.91 time: 0.485023 Sep 13 16:40:46.541650 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1395/2707] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:40:46 2022] POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:46.563392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:46.563392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:46.581025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.581898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.582981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.584345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.585092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.586664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.630515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:46.740521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:46.762494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:46.764242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:46.765604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fa87ebb-a184-4952-a210-a2ae8501830f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1594 microversion: 2.32 time: 1.238121 Sep 13 16:40:46.766952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1313/2708] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:45 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1594 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:46.769297 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-140d2064-26f1-453f-9105-9c5d19d163ed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 204 len: 0 microversion: 2.1 time: 0.222567 Sep 13 16:40:46.771374 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1396/2709] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:46 2022] DELETE /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:46.779482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:46.781082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:46.783897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:46.784761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:46.799935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.800604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.801228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.802290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.802730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.803500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.803687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.803970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.804405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:46.805238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:46.807467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:46.808818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.250336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:47.292408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:47.302706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:47.348669 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f0d2955c-a1ee-4739-a141-5dbc1419480c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.569437 Sep 13 16:40:47.349418 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1397/2710] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:46 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:47.358987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:47.372805 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f587dbe-a759-45d4-8124-e5a8dd0e2b32 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.602196 Sep 13 16:40:47.375080 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1314/2711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:46 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:47.415965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:47.416622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:47.432274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.432790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.433252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.438070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.438678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.439204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.602663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:47.603164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:47.610819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.611311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.611750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.612455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.612912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.613337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.661352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:47.669900 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb00478f-1204-4944-9d26-4d9c94989867 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 200 len: 1216 microversion: 2.1 time: 0.285126 Sep 13 16:40:47.670509 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1398/2712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:47 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 1216 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:47.720042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:47.802163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:47.802969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:47.815502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.817768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.818772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.821127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.822223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.823479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:47.943541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-10eda00b-8f40-4e9f-b607-8bb46f386284 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 204 len: 0 microversion: 2.1 time: 0.342683 Sep 13 16:40:47.946549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1315/2713] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:47 2022] DELETE /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:40:47.965098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:47.972785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:47.986811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:47.993099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:47.995151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.000841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.001602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.003034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.096970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.116505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.118746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.120210 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ea5347c-8d27-478e-aa75-26f4038f14b2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1594 microversion: 2.32 time: 0.323653 Sep 13 16:40:48.121533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1399/2714] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:47 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1594 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:48.380504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:48.381155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:48.391546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.393229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.393696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.397283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.397735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.398235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.606280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.618080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.622870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.638898 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5665f317-e1a4-4c9c-a7c2-2e0f6bc4a32c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.264212 Sep 13 16:40:48.652972 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1400/2715] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:48 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:40:48.661188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:48.664234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:48.695392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.696258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.696930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.697973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.699050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.699714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.735451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.763622 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8b2d05f-6d93-4462-9037-eb020b5aad24 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1665 microversion: 2.1 time: 0.793303 Sep 13 16:40:48.764812 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1316/2716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:47 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1665 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:48.787321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:48.788397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:48.796534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.797497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.798346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.799382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:48.800844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:48.801780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:48.897797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:48.923256 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a4721b4-f445-473e-832c-55aba564b964 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 200 len: 1216 microversion: 2.1 time: 0.157082 Sep 13 16:40:48.930271 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1317/2717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:48 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:49.156591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:49.157132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:49.182418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:49.182930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:49.183379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:49.189211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:49.191337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:49.193155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:49.449596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:49.465444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:49.466581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:49.472828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:49.478263 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-197eb6b9-67ea-4f68-b2e4-3393ca1038d2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1594 microversion: 2.32 time: 0.327551 Sep 13 16:40:49.479201 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1318/2718] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:49 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1594 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:49.484041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27919577-cb46-418a-a090-3b304f829f26 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.843425 Sep 13 16:40:49.500698 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1401/2719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:48 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:49.675807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:49.677681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:49.694556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:49.696708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:49.697936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:49.699238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:49.703181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:49.705919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:49.791614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:49.792689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:49.805062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:49.805936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:49.806621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:49.807549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:49.815798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:49.816496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:49.965324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:49.987350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:49.994760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.002900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ca87d27-de60-4194-ad56-e4b876d07ebb tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.331430 Sep 13 16:40:50.003839 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1319/2720] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:49 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:50.022860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-30b9bd68-2225-4fcb-ab0d-8d87d733ec12 req-1f03e8ee-1b80-443c-84ec-ae9efccb51c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:50.038153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-30b9bd68-2225-4fcb-ab0d-8d87d733ec12 req-1f03e8ee-1b80-443c-84ec-ae9efccb51c3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.038690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-30b9bd68-2225-4fcb-ab0d-8d87d733ec12 req-1f03e8ee-1b80-443c-84ec-ae9efccb51c3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.039309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-30b9bd68-2225-4fcb-ab0d-8d87d733ec12 req-1f03e8ee-1b80-443c-84ec-ae9efccb51c3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.055331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-30b9bd68-2225-4fcb-ab0d-8d87d733ec12 req-1f03e8ee-1b80-443c-84ec-ae9efccb51c3 service nova] Creating event network-changed:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:40:50.061724 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-30b9bd68-2225-4fcb-ab0d-8d87d733ec12 req-1f03e8ee-1b80-443c-84ec-ae9efccb51c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056620 Sep 13 16:40:50.063385 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1320/2721] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:50.069936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:50.070808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:50.079738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.080445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.081061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.082030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.084665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.086073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.335263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.355155 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-447c4ac6-30a0-428b-843b-df932ac72ce7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 200 len: 1218 microversion: 2.1 time: 0.290220 Sep 13 16:40:50.355974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1321/2722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:50 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:50.378076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.387963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-189c66b3-da39-4acc-adab-3cf550b256ea tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1665 microversion: 2.1 time: 0.600366 Sep 13 16:40:50.388948 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1402/2723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:49 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1665 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:50.505347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:50.506015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:50.508081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:50.509275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:50.516562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.517067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.517511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.517633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.518243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.518609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.518719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.519126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.519583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.521137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:50.521910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:50.522554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:50.811464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.826897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.829562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.835397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e280e1be-2a25-440f-91bd-c50e7e35c59d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1594 microversion: 2.32 time: 0.334412 Sep 13 16:40:50.837203 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1322/2724] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:50 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1594 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:50.878996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:50.893991 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a20a33d-9789-4156-b610-2c17e0071950 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.390393 Sep 13 16:40:50.894596 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1403/2725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:50 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:51.032418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:51.033367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:51.045542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.046387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.047073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.048004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.048731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.049541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.192296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:51.222276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:51.227773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:51.264123 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12b04ae5-849b-43a9-bbfa-b6cca81b22ee tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.235980 Sep 13 16:40:51.278744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1323/2726] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:51 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:51.380378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:51.381531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:51.405045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.406434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.412381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.413512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.414295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.415216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.421628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:51.422379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:51.438921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.443070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.443540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.444693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.445344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.445967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.513276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.514838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.515552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.516268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'fault' on Instance uuid b9099f6f-71a5-4f4c-b297-7681f9e3e472 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:51.589752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:51.602102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:51.604106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63af1420-3942-47c3-bb6c-d24dec82810e tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1599 microversion: 2.1 time: 0.191010 Sep 13 16:40:51.605074 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1324/2727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:51 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1599 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:51.619134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:51.644793 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c96577a-eaa5-45d1-896d-33dc7727bb87 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 200 len: 1220 microversion: 2.1 time: 0.269770 Sep 13 16:40:51.645536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1404/2728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:51 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 1220 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:51.873978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:51.874609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:51.916775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.917302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.917804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.920498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.920991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.921175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:51.921442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.922154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:51.939025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.942419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.944614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:51.946860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:51.949119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:51.950962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:52.275956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:52.295646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:52.300755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:52.304529 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3124d086-f86d-4616-8b54-80d4f3d8852b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1662 microversion: 2.32 time: 0.437932 Sep 13 16:40:52.316234 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1325/2729] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:51 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1662 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:52.684234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-02b618bd-72ca-4e9c-b44e-7318f83b8bdf req-62f31928-c20a-407a-a43c-5d61a09af19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af1ff17-c9a7-4884-a14f-cf19ab92e5e9", "name": "network-vif-deleted", "tag": "b85d6229-5594-4441-8f64-63c4a4b3c750"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:52.726753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02b618bd-72ca-4e9c-b44e-7318f83b8bdf req-62f31928-c20a-407a-a43c-5d61a09af19d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:52.727260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02b618bd-72ca-4e9c-b44e-7318f83b8bdf req-62f31928-c20a-407a-a43c-5d61a09af19d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:52.731973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02b618bd-72ca-4e9c-b44e-7318f83b8bdf req-62f31928-c20a-407a-a43c-5d61a09af19d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:52.745816 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-02b618bd-72ca-4e9c-b44e-7318f83b8bdf req-62f31928-c20a-407a-a43c-5d61a09af19d service nova] Creating event network-vif-deleted:b85d6229-5594-4441-8f64-63c4a4b3c750 for instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 on n-h1-857467-1 Sep 13 16:40:52.751550 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-02b618bd-72ca-4e9c-b44e-7318f83b8bdf req-62f31928-c20a-407a-a43c-5d61a09af19d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.428520 Sep 13 16:40:52.751801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1326/2730] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:52.760186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:52.760186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:52.765738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:52.766324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:52.766784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:52.767512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:52.767984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:52.768422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:52.849948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:52.862918 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a980ec20-7072-4a6d-bc78-8e3b7d72b675 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.945216 Sep 13 16:40:52.868180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1405/2731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:51 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:40:52.884985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:52.887623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:52.908526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:52.909627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:52.915305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:52.916368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:52.917135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:52.917847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.015114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.027556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.028450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.029165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.030059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lazy-loading 'fault' on Instance uuid 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:53.043463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.049339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.081165 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-866ba645-e520-466e-95a0-cd0427d6ee70 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.326629 Sep 13 16:40:53.083181 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1327/2732] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:52 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:53.093749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:53.096024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:53.103825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.104512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.105115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.106062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.106687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.107282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.169083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.182692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.183199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.183654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.186770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'fault' on Instance uuid b9099f6f-71a5-4f4c-b297-7681f9e3e472 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:40:53.199225 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-423ff3a8-781d-44cf-ab65-c929f1bb8ca5 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 200 len: 1325 microversion: 2.1 time: 0.329321 Sep 13 16:40:53.205997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1406/2733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:52 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:53.346305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:53.347034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:53.361881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.364255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.366488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.369042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.370757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.381663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.665031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:53.679506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.705604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.709767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.713545 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3a0b7bf-5234-426f-8ce2-f655546d2123 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1709 microversion: 2.32 time: 0.373803 Sep 13 16:40:53.716230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1407/2734] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:53 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1709 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:40:53.858380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:53.866950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7aae4426-2073-4afc-8902-766cfdd72b64 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 200 len: 1220 microversion: 2.1 time: 0.780425 Sep 13 16:40:53.868963 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1328/2735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:53 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 1220 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:53.890845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:53.892512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:53.907081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.909322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.910006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:53.913946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:53.914688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:53.915693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.142581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=46 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:54.219962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:54.231234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c7d43d6-c175-4300-8a23-7614eee2092b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.347250 Sep 13 16:40:54.234944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1408/2736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:53 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:54.250039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:54.250663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:54.259530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:54.263221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:54.263859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.266583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:54.266977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:54.267418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.414371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:54.429027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:54.433655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:54.446792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0f3153d-3e2a-4cd0-9037-b453b12bdd1e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.210646 Sep 13 16:40:54.447471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1409/2737] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:54 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:54.456817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:54.457523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:54.476182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:54.482727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:54.483216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.483973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:54.484503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:54.484949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.490465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-885011021", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:54.530809 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] HTTP exception thrown: Instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 could not be found. Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Request method failure captured: Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 HTTP/1.1 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILClrZJJcasMYsTwUFZ049N1GVMnB9gM6bMGQgvBqHRA0C7rSS-UvNJ2R_WWOAw-ftLx0pEmDlzz06e2CTaS9IjBnRwqHH8U36lzhxobPCQ6BPB1Tlsn-_eX_4i5lNlaC3KBUxYrxTtEgP4M9BjEbMQdBHE9i_AwWGu9yNBnS-Kuv8A Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-LiveMigrationTest-779205528 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-LiveMigrationTest-779205528-project Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 1fdc6602945c46fa98eebf50ea85a86e Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-LiveMigrationTest-779205528-project Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 could not be found. Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1af1ff17-c9a7-4884-a14f-cf19ab92e5e9'} Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 could not be found. Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 could not be found. Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:54.541335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 could not be found. Sep 13 16:40:54.545093 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:54.548179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Returning 404 to user: Instance 1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:54.554184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d9ea4320-77ae-4739-b333-91ccdd0938e4 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9" status: 404 len: 111 microversion: 2.1 time: 0.105733 Sep 13 16:40:54.554760 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1410/2738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:54 2022] GET /compute/v2.1/servers/1af1ff17-c9a7-4884-a14f-cf19ab92e5e9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:54.569089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7c7e2ae-6c02-4998-b50d-b4acf55ff893 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '.version_select at 0x7fbeb48bee50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:54.593578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:40:54.626275 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7c7e2ae-6c02-4998-b50d-b4acf55ff893 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145535241" status: 202 len: 0 microversion: 2.1 time: 0.062135 Sep 13 16:40:54.627509 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1411/2739] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145535241 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:40:54.743341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:54.744264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:54.756435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:54.759295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:54.760572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.761514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:54.762043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:54.762495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:54.904479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=17 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:55.225672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.241310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.244097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.245305 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d59cb6e4-b80d-4bbe-9f48-0e2b6377bc8a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1709 microversion: 2.32 time: 0.507404 Sep 13 16:40:55.245999 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1412/2740] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:54 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1709 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:40:55.251070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:55.251665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:55.260171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.260884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.261323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.262044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.262651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.263338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.286621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 HTTP/1.1 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b9099f6f-71a5-4f4c-b297-7681f9e3e472'} Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:40:55.289349 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:40:55.298461 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:40:55.300358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:40:55.302131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dddc9769-748c-447e-8767-fccb8fb76e0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 404 len: 111 microversion: 2.1 time: 0.053906 Sep 13 16:40:55.312985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1413/2741] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:55 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:40:55.340998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:40:55.341744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:40:55.342644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:40:55.344004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:40:55.344474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:40:55.357177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:55.359659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:55.397299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.397730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.400058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.401063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.402941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.406189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.407010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.407637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.409003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.409421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.410273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.412827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.432021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Getting quotas for project 7ff0f00f321e4f37a57e652100b85607. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:55.442603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Getting quotas for user 37df2c00d1ef41a6a5d0ec8da4ca275b and project 7ff0f00f321e4f37a57e652100b85607. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:55.479649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:40:55.483862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:40:55.530469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:INSERT=15,nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:55.583228 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e599a3e2-6618-4a6e-ab4b-06355e3b8793 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657429 Sep 13 16:40:55.585117 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1329/2742] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:40:55.591705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:55.592632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:55.605003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.605795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.606467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.608582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:55.610087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:55.610671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:55.623198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:55.715761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=86 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:55.751710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.767688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.769876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.786548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9480ff9c-9478-4d3a-b1ad-518b70791eec tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.199404 Sep 13 16:40:55.790247 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1330/2743] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:55 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:55.796368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1274840110", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:55.884117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:40:55.960618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:55.972634 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-228093c6-2c20-49f0-8733-c9534be066cb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.661407 Sep 13 16:40:55.976291 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1414/2744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:55 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:55.988452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29200df5-6a3d-4ce8-8293-2dd581e885c2 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:55.991932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-29200df5-6a3d-4ce8-8293-2dd581e885c2 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:56.113604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-29200df5-6a3d-4ce8-8293-2dd581e885c2 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:56.147122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-29200df5-6a3d-4ce8-8293-2dd581e885c2 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1221 microversion: 2.1 time: 0.169310 Sep 13 16:40:56.147751 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1415/2745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:55 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:56.274568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:56.278477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:56.292924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.293434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.294303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.297246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.297965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.301574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.612359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:56.627075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:56.629080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:56.630943 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e33a78d9-b28d-44c9-b964-8ba995de7d0d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1756 microversion: 2.32 time: 0.361918 Sep 13 16:40:56.634135 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1416/2746] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:56 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1756 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:40:56.640663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-690891a7-358e-4bcb-ba06-78416f3d93c4 req-5d86205d-f1b8-44bf-9d37-dd09a378b8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "name": "network-vif-plugged", "status": "completed", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:56.656250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-690891a7-358e-4bcb-ba06-78416f3d93c4 req-5d86205d-f1b8-44bf-9d37-dd09a378b8ec service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.657200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-690891a7-358e-4bcb-ba06-78416f3d93c4 req-5d86205d-f1b8-44bf-9d37-dd09a378b8ec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.657996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-690891a7-358e-4bcb-ba06-78416f3d93c4 req-5d86205d-f1b8-44bf-9d37-dd09a378b8ec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.681101 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-690891a7-358e-4bcb-ba06-78416f3d93c4 req-5d86205d-f1b8-44bf-9d37-dd09a378b8ec service nova] Creating event network-vif-plugged:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:40:56.687616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-690891a7-358e-4bcb-ba06-78416f3d93c4 req-5d86205d-f1b8-44bf-9d37-dd09a378b8ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051407 Sep 13 16:40:56.688440 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1417/2747] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:40:56.696631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:56.697462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:56.706714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.707637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.708456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.709375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.710130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.710722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.755666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:40:56.872123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c2c7f41-7fc7-47c1-bd68-34d4c7c3f895 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 204 len: 0 microversion: 2.1 time: 0.181439 Sep 13 16:40:56.876440 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1418/2748] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:40:56 2022] DELETE /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:40:56.884749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:56.885858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:56.893216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.893811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.894300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.895766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.896400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.897056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.898773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:40:56.899275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:40:56.900019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:40:56.900671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:40:56.901166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:40:56.927952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.928916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.929595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.930664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:56.931363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:56.931853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:56.966749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:56.975664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:57.002732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:40:57.006524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:40:57.070090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:57.094081 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d905554-b9e8-4819-8e82-272c0e72213f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302206 Sep 13 16:40:57.097381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:57.101795 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1331/2749] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:40:57.102732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:57.108036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:57.108656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:57.111993 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1af18785-5184-4c08-a193-da6d5cc36432 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.233581 Sep 13 16:40:57.137795 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1419/2750] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:56 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:57.171590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.173328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:57.173812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.174517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.175402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.176057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:57.180156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.180808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.196248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.196760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.198005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.200145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.203869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.204562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.638530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:57.650831 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a328c985-ab9a-4a49-a2be-327d496a6a77 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1483 microversion: 2.1 time: 0.547315 Sep 13 16:40:57.652085 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1332/2751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:57 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1483 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:57.666510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c7700d8-93d9-4b00-965c-cdb933437877 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:57.667434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c7700d8-93d9-4b00-965c-cdb933437877 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:57.803634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:57.818625 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4da1cb7-e519-4b3b-b075-285f5081dd67 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1315 microversion: 2.1 time: 0.679012 Sep 13 16:40:57.824240 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1420/2752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:57 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:57.829725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:57.831208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:57.853612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.854505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.855503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.858047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.859881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.862553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.903671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c7700d8-93d9-4b00-965c-cdb933437877 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:57.934294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c7700d8-93d9-4b00-965c-cdb933437877 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1215 microversion: 2.1 time: 0.272327 Sep 13 16:40:57.935180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1333/2753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:57 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1215 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:57.945472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:57.952352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:57.970437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.977786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.978521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:57.982301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:57.982972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:57.983599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:58.128889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.141882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0c0f6906-9dcf-47a7-8f75-0c80d9586aa9 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1273 microversion: 2.1 time: 0.315838 Sep 13 16:40:58.142684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1421/2754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:57 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:58.168564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:58.173951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:58.193014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:58.193954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:58.194616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:58.198227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:58.198942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:58.202613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:58.460158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.470169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.477075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.500983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c74aa936-4c07-4be5-a7f0-367ea719f253 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.335494 Sep 13 16:40:58.515286 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1422/2755] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:58 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:58.528778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.565673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.576341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:58.586408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b734403c-3ca6-4477-92d6-1914e7999fa8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1803 microversion: 2.32 time: 0.641643 Sep 13 16:40:58.589198 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1334/2756] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:57 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1803 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:40:58.692150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:58.693450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:58.706486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:58.707273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:58.708044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:58.716316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:58.717250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:58.717872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:58.750953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:40:58.859429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:58.861290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:58.881782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:58.886582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:58.887211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:58.888309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:58.888952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:58.898207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.354023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:59.366958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9368d5a1-a990-4a79-8be8-117cd935bc8c tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1483 microversion: 2.1 time: 0.694991 Sep 13 16:40:59.372265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1423/2757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:58 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1483 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:59.387383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:59.388259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:59.402845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.403657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.404328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.404972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:59.405767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.406455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.406902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.415339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20fdc378-4449-491d-8d56-86ac4f9bd12b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1465 microversion: 2.1 time: 0.563278 Sep 13 16:40:59.415937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1335/2758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:58 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1465 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:59.427641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:59.428261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:59.456480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.457123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.458426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.459440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.460064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.460650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.589012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:59.607337 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-553942ac-2299-4235-851e-2d4a47e0796f tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1279 microversion: 2.1 time: 0.183774 Sep 13 16:40:59.608209 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1336/2759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:59 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:59.627831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1961165468", "metadata": {"image_type": "test"}}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:40:59.631001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:59.645811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.646614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.647386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.649597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.650299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.653392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.747859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Getting quotas for project 1e9f5c731cfd4ebba006c7d818d26d5a. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:40:59.753725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Getting quotas for user 83ade3c22e244d4e899dafb768efdaa7 and project 1e9f5c731cfd4ebba006c7d818d26d5a. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:40:59.846866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:40:59.883639 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57ed1381-8ea1-4e58-b71d-4588f615f572 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1273 microversion: 2.1 time: 0.509917 Sep 13 16:40:59.887162 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1424/2760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:40:59 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1273 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:40:59.907089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:40:59.909430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:40:59.946361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.947032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.948274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:40:59.955262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:40:59.956475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:40:59.960571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:00.267318 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1d66c024-0399-4837-877b-52f774a62261 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "POST /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6/action" status: 202 len: 0 microversion: 2.1 time: 0.657686 Sep 13 16:41:00.270980 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1337/2761] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:40:59 2022] POST /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:41:00.284434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:00.286096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:00.301731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:00.302459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:00.305631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:00.306467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:00.307100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:00.307554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:00.465140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:00.478971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:00.488016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:00.493210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:00.498977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-210e714b-a6a8-4aee-81aa-c3eec0e7d412 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.610468 Sep 13 16:41:00.502262 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1425/2762] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:40:59 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:00.539886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e434fd92-5229-4194-aabf-ca8655669e5c tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb490f430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:00.636024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e434fd92-5229-4194-aabf-ca8655669e5c tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.115524 Sep 13 16:41:00.653704 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1426/2763] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:00 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:00.669799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:00.674893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:00.705839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:00.706362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:00.706811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:00.707606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:00.708677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:00.709075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:00.784468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:00.786769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:00.787543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:00.788165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lazy-loading 'fault' on Instance uuid d6afe5ca-008b-43d4-93cb-7b1cc636ee58 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:00.931753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:00.949604 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cd22038-6646-4978-8554-c91f5d3a0fe9 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 200 len: 1300 microversion: 2.1 time: 0.290174 Sep 13 16:41:00.951083 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1427/2764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:00 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 1300 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:00.958832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-20c7757d-228b-4a53-a536-30a0dba74fc9 req-5355e1fd-a12c-4661-b928-454b5eb97bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6afe5ca-008b-43d4-93cb-7b1cc636ee58", "name": "network-vif-deleted", "tag": "ab3df1fb-0ed3-41a4-9e86-3bef784c98f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:00.972963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-20c7757d-228b-4a53-a536-30a0dba74fc9 req-5355e1fd-a12c-4661-b928-454b5eb97bef service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:00.974431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-20c7757d-228b-4a53-a536-30a0dba74fc9 req-5355e1fd-a12c-4661-b928-454b5eb97bef service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:00.975091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-20c7757d-228b-4a53-a536-30a0dba74fc9 req-5355e1fd-a12c-4661-b928-454b5eb97bef service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.001960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-20c7757d-228b-4a53-a536-30a0dba74fc9 req-5355e1fd-a12c-4661-b928-454b5eb97bef service nova] Creating event network-vif-deleted:ab3df1fb-0ed3-41a4-9e86-3bef784c98f7 for instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 on n-h1-857467-1 Sep 13 16:41:01.012462 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-20c7757d-228b-4a53-a536-30a0dba74fc9 req-5355e1fd-a12c-4661-b928-454b5eb97bef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059204 Sep 13 16:41:01.013907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1428/2765] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:01.024403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:01.025348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:01.036981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.037921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.039247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.041211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.042733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.043675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.090069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.099866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.101338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.109248 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d8b934ea-4824-4c33-b81f-077b01e52adc tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1850 microversion: 2.32 time: 0.830357 Sep 13 16:41:01.122341 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1338/2766] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:00 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1850 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:01.134098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:01.135257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:01.142032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.142720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.143335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.144473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.145122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.145716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.205707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.219819 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db2cb39f-cf16-40b1-a3ea-91c5bae937cf tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1279 microversion: 2.1 time: 0.204328 Sep 13 16:41:01.222605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1429/2767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:01 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:01.274240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.283852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe1909e2-9471-4d2e-bbea-7ae836a815c0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1273 microversion: 2.1 time: 0.160321 Sep 13 16:41:01.289198 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1339/2768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:01 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:01.538884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:01.539496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:01.547120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.547623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.548063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.548780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.549241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.549669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.659082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2849e25e-801f-409a-b0e8-0bafde1ca29f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb56b2d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:01.714984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2849e25e-801f-409a-b0e8-0bafde1ca29f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.059130 Sep 13 16:41:01.723451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1340/2769] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:01 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:01.745631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.762519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.764754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:01.772654 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ad09525-16cc-427a-bfa9-493939381814 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.237764 Sep 13 16:41:01.773993 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1430/2770] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:01 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:01.978725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:01.979736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: d6afe5ca-008b-43d4-93cb-7b1cc636ee58] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:01.986880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.987726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.988377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:01.990116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:01.990798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:01.991437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.006182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] HTTP exception thrown: Instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 could not be found. Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Request method failure captured: Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 HTTP/1.1 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILClrZJJcasMYsTwUFZ049N1GVMnB9gM6bMGQgvBqHRA0C7rSS-UvNJ2R_WWOAw-ftLx0pEmDlzz06e2CTaS9IjBnRwqHH8U36lzhxobPCQ6BPB1Tlsn-_eX_4i5lNlaC3KBUxYrxTtEgP4M9BjEbMQdBHE9i_AwWGu9yNBnS-Kuv8A Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-LiveMigrationTest-779205528 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-LiveMigrationTest-779205528-project Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 1fdc6602945c46fa98eebf50ea85a86e Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-LiveMigrationTest-779205528-project Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 could not be found. Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd6afe5ca-008b-43d4-93cb-7b1cc636ee58'} Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 could not be found. Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 could not be found. Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:02.008204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 could not be found. Sep 13 16:41:02.012407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:02.013931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Returning 404 to user: Instance d6afe5ca-008b-43d4-93cb-7b1cc636ee58 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:02.015011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1421b536-1915-44e7-bd4e-de401002a9f0 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58" status: 404 len: 111 microversion: 2.1 time: 0.040176 Sep 13 16:41:02.023889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:02.024866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:02.028068 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1341/2771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:01 2022] GET /compute/v2.1/servers/d6afe5ca-008b-43d4-93cb-7b1cc636ee58 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:02.036315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.037148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.037661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.038439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.038907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.039338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.084924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:02.141258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:02.142820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:02.156449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.156949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.157586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.158610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.159386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.160003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.266057 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-495e527a-935e-4ad4-b89d-11380e73b939 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 204 len: 0 microversion: 2.1 time: 0.245673 Sep 13 16:41:02.266678 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1431/2772] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:02 2022] DELETE /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:02.272904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:02.273930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:02.293865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.295019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.295019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.295709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.296172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.296863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.575080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:02.591849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:02.593860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:02.596179 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d093ff7-e788-436b-ae76-47b432db8bbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1850 microversion: 2.32 time: 0.459678 Sep 13 16:41:02.598104 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1342/2773] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:02 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1850 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:02.604271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:02.605338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:02.615645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.616490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.617180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.618384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.619409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.620534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.817809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:02.829063 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5472afec-5cec-4e51-877e-f299647d6335 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.561164 Sep 13 16:41:02.829663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1432/2774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:02 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:02.847228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:02.848092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:02.855521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.863566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.864323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:02.865311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:02.865956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:02.866520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.065611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:03.079814 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2cc54b81-d7b6-46d2-8e28-59513bcdcfe1 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1499 microversion: 2.1 time: 0.474595 Sep 13 16:41:03.080757 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1343/2775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:02 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1499 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:03.088279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-74397a81-ae1e-4e4a-a058-9f20f23ea3a0 req-ccd22781-f432-49af-bedc-c0937054a1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "816a7944-a34a-4fc7-b0b0-05133c00a7c5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:03.115313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-74397a81-ae1e-4e4a-a058-9f20f23ea3a0 req-ccd22781-f432-49af-bedc-c0937054a1a5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.115911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-74397a81-ae1e-4e4a-a058-9f20f23ea3a0 req-ccd22781-f432-49af-bedc-c0937054a1a5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.116724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-74397a81-ae1e-4e4a-a058-9f20f23ea3a0 req-ccd22781-f432-49af-bedc-c0937054a1a5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.144790 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-74397a81-ae1e-4e4a-a058-9f20f23ea3a0 req-ccd22781-f432-49af-bedc-c0937054a1a5 service nova] Creating event network-changed:816a7944-a34a-4fc7-b0b0-05133c00a7c5 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:03.158316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-74397a81-ae1e-4e4a-a058-9f20f23ea3a0 req-ccd22781-f432-49af-bedc-c0937054a1a5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074591 Sep 13 16:41:03.161428 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1344/2776] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:03.175787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76cbb904-a03f-4544-b8a7-903506f03211 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb56b2d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:03.268823 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76cbb904-a03f-4544-b8a7-903506f03211 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.104169 Sep 13 16:41:03.269425 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1345/2777] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:03 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:03.280632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:03.284919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:03.306810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.307544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.317310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.317310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.317310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.317310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.643098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:03.653022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:03.658878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:03.671736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c4e1150-58dc-4390-ad80-184a8bff3f35 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.400735 Sep 13 16:41:03.672338 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1346/2778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:03 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:03.684437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:03.686256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:03.702585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.703214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.703664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.704437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.704906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.706071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.843286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:03.855398 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f870456-3420-4a0c-adcf-a9dd62df2731 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 1.024234 Sep 13 16:41:03.855992 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1433/2779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:02 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:03.861646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:03.871791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:03.891554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.892092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.892536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:03.893555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:03.895851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:03.906018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:04.387875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.405004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.406621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.408122 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ee6c282-c2cc-4317-9a1e-78dd3bbf74b1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1850 microversion: 2.32 time: 0.734266 Sep 13 16:41:04.427098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1347/2780] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:03 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1850 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:04.435318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:04.436202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:04.444164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:04.444936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:04.445594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:04.446670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:04.447360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:04.448165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:04.541518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.558110 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96cdd45a-6fe3-4cce-a1b0-fc37dfe7b25b tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.693534 Sep 13 16:41:04.559783 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1434/2781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:03 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:04.575627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6e55591-6121-446d-a12d-509e1423b6ca tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb48ceee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:04.652461 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6e55591-6121-446d-a12d-509e1423b6ca tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.090581 Sep 13 16:41:04.654597 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1435/2782] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:04 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:04.705697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:04.706349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:04.718595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:04.724401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:04.725738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:04.726691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:04.727448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:04.728045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:04.935613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.953814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.956323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:04.964071 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66d88c9f-8fd7-4cdf-9457-6ec5c2eefbf9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.262177 Sep 13 16:41:04.979563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1436/2783] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:04 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:04.995715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:04.996395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:05.004095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.005375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.006070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.006958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.007621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.008316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.122449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:05.136125 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8d82269-8187-449b-952a-643902eab7be tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1499 microversion: 2.1 time: 0.706317 Sep 13 16:41:05.138865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1348/2784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:04 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1499 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:05.144623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8e7b3edf-5efe-49ad-a685-8fd2ca2e060d req-f1302d5e-7aba-4f19-8a1e-7dd12f628b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2556308-a5f0-42af-a4be-5bf3d32b0961", "tag": "549bb066-67a2-4465-908d-e554c0f9d14b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:05.166751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8e7b3edf-5efe-49ad-a685-8fd2ca2e060d req-f1302d5e-7aba-4f19-8a1e-7dd12f628b7b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.167585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8e7b3edf-5efe-49ad-a685-8fd2ca2e060d req-f1302d5e-7aba-4f19-8a1e-7dd12f628b7b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.169217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8e7b3edf-5efe-49ad-a685-8fd2ca2e060d req-f1302d5e-7aba-4f19-8a1e-7dd12f628b7b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.186025 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8e7b3edf-5efe-49ad-a685-8fd2ca2e060d req-f1302d5e-7aba-4f19-8a1e-7dd12f628b7b service nova] Creating event network-changed:549bb066-67a2-4465-908d-e554c0f9d14b for instance f2556308-a5f0-42af-a4be-5bf3d32b0961 on n-h1-857467-1 Sep 13 16:41:05.194905 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8e7b3edf-5efe-49ad-a685-8fd2ca2e060d req-f1302d5e-7aba-4f19-8a1e-7dd12f628b7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054411 Sep 13 16:41:05.196138 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1349/2785] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:05.442961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:05.446131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:05.478763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.486826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.488547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.491083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.491817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.492767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.528269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:05.878029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:05.891111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-684935bc-2dc7-404c-adc7-c363ace072c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.910310 Sep 13 16:41:05.899174 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1437/2786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:04 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:05.910593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-52c04fed-af89-4e56-9aea-d7fc169f78ab req-2df61c93-5082-434c-bd02-7958c797a7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab", "tag": "a3b9c3c5-39ce-4bd9-8126-86dacff81584"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:05.921334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-52c04fed-af89-4e56-9aea-d7fc169f78ab req-2df61c93-5082-434c-bd02-7958c797a7d0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.922100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-52c04fed-af89-4e56-9aea-d7fc169f78ab req-2df61c93-5082-434c-bd02-7958c797a7d0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.922852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-52c04fed-af89-4e56-9aea-d7fc169f78ab req-2df61c93-5082-434c-bd02-7958c797a7d0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.938116 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-52c04fed-af89-4e56-9aea-d7fc169f78ab req-2df61c93-5082-434c-bd02-7958c797a7d0 service nova] Creating event network-changed:a3b9c3c5-39ce-4bd9-8126-86dacff81584 for instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab on n-h2-857467-1 Sep 13 16:41:05.944724 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-52c04fed-af89-4e56-9aea-d7fc169f78ab req-2df61c93-5082-434c-bd02-7958c797a7d0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043995 Sep 13 16:41:05.946048 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1438/2787] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:05.951633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:05.952632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:05.968206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.969094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.970697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:05.971633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:05.972260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:05.973553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:06.119073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:06.444963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.475411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.482528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.483797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa76a47f-7842-4feb-ad27-3ae7485f6dbd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1871 microversion: 2.32 time: 1.047054 Sep 13 16:41:06.484522 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1350/2788] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:05 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1871 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:06.495593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d70cbd8d-d3a1-4793-a8ea-f7c2126bed22 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb53a9040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:06.514737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.552808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12319585-4e1e-4fcc-afad-8c5a526f6927 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.605083 Sep 13 16:41:06.568224 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1439/2789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:05 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:06.591498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:06.595094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:06.609904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:06.610427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:06.610872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:06.611585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:06.612043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:06.612780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:06.617117 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d70cbd8d-d3a1-4793-a8ea-f7c2126bed22 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.131440 Sep 13 16:41:06.630258 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1351/2790] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:06 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:06.642386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:06.644618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:06.672213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:06.682266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:06.682999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:06.684119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:06.686765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:06.689923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:06.816123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:06.816609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:06.819971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.821712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:06.822246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lazy-loading 'fault' on Instance uuid ba427499-3971-463a-9fd1-065bbdee6476 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:06.859187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.875325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.903473 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28d356c0-bf01-48ef-88e9-5625e8ae537e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.327552 Sep 13 16:41:06.904193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1440/2791] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:06 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:06.949698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:06.987068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fdc6602945c46fa98eebf50ea85a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc29bce0b24edc80de72d3e6337c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:06.997016 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e5ea4a7-6bb7-4cde-aa92-e505522f9af2 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 200 len: 1300 microversion: 2.1 time: 0.365053 Sep 13 16:41:06.998666 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1352/2792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:06 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:07.003929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:07.005262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:07.014154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.014936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.015840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.016917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.017754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.018652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.241106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b5ae4b58-0981-464c-92e2-4ed7495cf6d3 req-748e542e-32ca-4f46-8d88-a519362ea84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "name": "network-vif-plugged", "status": "completed", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:07.254822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b5ae4b58-0981-464c-92e2-4ed7495cf6d3 req-748e542e-32ca-4f46-8d88-a519362ea84b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.255321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b5ae4b58-0981-464c-92e2-4ed7495cf6d3 req-748e542e-32ca-4f46-8d88-a519362ea84b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.255765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b5ae4b58-0981-464c-92e2-4ed7495cf6d3 req-748e542e-32ca-4f46-8d88-a519362ea84b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.274890 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b5ae4b58-0981-464c-92e2-4ed7495cf6d3 req-748e542e-32ca-4f46-8d88-a519362ea84b service nova] Creating event network-vif-plugged:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:41:07.280434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b5ae4b58-0981-464c-92e2-4ed7495cf6d3 req-748e542e-32ca-4f46-8d88-a519362ea84b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374040 Sep 13 16:41:07.281681 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1441/2793] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:07.516760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:07.517768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:07.527833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.528775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.529547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.530536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.531558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.532401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.538927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:07.773244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:07.791326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-854b79ef-91b2-4d62-9731-8251224773f3 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.790757 Sep 13 16:41:07.798773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1353/2794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:06 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:07.814652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:07.815298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:07.823376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.825546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.826048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.826831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.827346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.827785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.837119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:07.862225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:07.865534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:07.866862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9402d9b7-ca41-48fd-a91c-b7c47c80e1de tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1871 microversion: 2.32 time: 0.355146 Sep 13 16:41:07.882616 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1442/2795] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:07 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1871 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:07.889011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38d1018a-1012-4251-9bdf-f72a4f86dcdc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb490f700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:07.911437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:07.969862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38d1018a-1012-4251-9bdf-f72a4f86dcdc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.085127 Sep 13 16:41:07.970463 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1443/2796] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:07 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:07.984350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:07.985082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:07.992426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.992934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.993530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:07.994543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:07.995014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:07.995451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:08.121278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:08.131946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:08.139348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:08.157086 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b9206c00-d7eb-43f8-b01d-27f42156f3a2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.182192 Sep 13 16:41:08.157765 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1444/2797] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:07 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:08.172231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba427499-3971-463a-9fd1-065bbdee6476", "name": "network-vif-deleted", "tag": "6f3c2223-a389-4adf-bbd7-8727cc9d53a9"}, {"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "a5a19eaf-0b13-4a24-ab8c-6cebeb712e50"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:08.184104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:08.186495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:08.186993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:08.187596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:08.199450 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35020589-294c-4a5d-8680-6704cc8acac1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.394962 Sep 13 16:41:08.201272 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1354/2798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:07 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:08.214623 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] Creating event network-vif-deleted:6f3c2223-a389-4adf-bbd7-8727cc9d53a9 for instance ba427499-3971-463a-9fd1-065bbdee6476 on n-h2-857467-1 Sep 13 16:41:08.215374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] Creating event network-changed:a5a19eaf-0b13-4a24-ab8c-6cebeb712e50 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:08.236378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c639b644-8f7a-45ed-b839-fb8538d069fd req-f2bf9513-7c86-4bf3-8abf-154ee2f7f4f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076244 Sep 13 16:41:08.237209 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1445/2799] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:08.255497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:08.256239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] [instance: ba427499-3971-463a-9fd1-065bbdee6476] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:08.269740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:08.270732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:08.271437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:08.272596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:08.273971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:08.274643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:08.294168 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] HTTP exception thrown: Instance ba427499-3971-463a-9fd1-065bbdee6476 could not be found. Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Request method failure captured: Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 HTTP/1.1 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILClrZJJcasMYsTwUFZ049N1GVMnB9gM6bMGQgvBqHRA0C7rSS-UvNJ2R_WWOAw-ftLx0pEmDlzz06e2CTaS9IjBnRwqHH8U36lzhxobPCQ6BPB1Tlsn-_eX_4i5lNlaC3KBUxYrxTtEgP4M9BjEbMQdBHE9i_AwWGu9yNBnS-Kuv8A Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aadc29bce0b24edc80de72d3e6337c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-LiveMigrationTest-779205528 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: aadc29bce0b24edc80de72d3e6337c10 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-LiveMigrationTest-779205528 Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-LiveMigrationTest-779205528-project Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 1fdc6602945c46fa98eebf50ea85a86e Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-LiveMigrationTest-779205528-project Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ba427499-3971-463a-9fd1-065bbdee6476 could not be found. Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ba427499-3971-463a-9fd1-065bbdee6476'} Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba427499-3971-463a-9fd1-065bbdee6476 could not be found. Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba427499-3971-463a-9fd1-065bbdee6476 could not be found. Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:08.296260 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba427499-3971-463a-9fd1-065bbdee6476 could not be found. Sep 13 16:41:08.299977 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:08.302871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] Returning 404 to user: Instance ba427499-3971-463a-9fd1-065bbdee6476 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:08.304558 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d11b38dc-8122-4341-bf22-49b59e21e758 tempest-LiveMigrationTest-779205528 tempest-LiveMigrationTest-779205528-project] 10.222.0.61 "GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476" status: 404 len: 111 microversion: 2.1 time: 0.100358 Sep 13 16:41:08.305694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1355/2800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:08 2022] GET /compute/v2.1/servers/ba427499-3971-463a-9fd1-065bbdee6476 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:08.618368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1271764883", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "10b5ab5d-ac5a-409a-97db-3ce8142fe6a1"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:08.707058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] validate_networks() for [('10b5ab5d-ac5a-409a-97db-3ce8142fe6a1', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:41:08.819773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:08.820984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:08.828239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:08.828929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:08.829529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:08.830410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:08.831020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:08.831602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.006524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.026442 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-625a6db2-fa78-46e9-93ab-cd417da57108 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.209423 Sep 13 16:41:09.027838 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1356/2801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:08 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:09.047162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:09.048224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:09.082155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.083557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.084207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.085840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.086517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.087428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.427354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.445234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.446773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.448269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd28a9f0-8c3e-45d4-abe0-51d517d9e3a5 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1892 microversion: 2.32 time: 0.417635 Sep 13 16:41:09.455923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1357/2802] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:09 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1892 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:09.462210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afa17233-3f39-4411-b065-74c20127e67c tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb57e2550>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:09.534010 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-afa17233-3f39-4411-b065-74c20127e67c tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.076566 Sep 13 16:41:09.534535 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1358/2803] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:09 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:09.540280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:09.548388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:09.557384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.557916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.558375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.559100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.559573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.560011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.729011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:41:09.729635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:41:09.730592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:41:09.731012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:41:09.731593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:41:09.745746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.746518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.746966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.747694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.748678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.749112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.761407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.772721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.774313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:09.791997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed767555-95cf-4b5b-9b09-dd9a0cb937ca tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.255592 Sep 13 16:41:09.798937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1359/2804] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:09 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:09.804993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:09.805615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:09.812452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.813110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.814812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Getting quotas for project 09df4a6e599746d985beba2d61454ab6. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:41:09.822261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Getting quotas for user 8fbf448f09434faea9e8afb24d45412a and project 09df4a6e599746d985beba2d61454ab6. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:41:09.825725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.826641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:09.827135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:09.827579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:09.847605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:41:09.858225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:41:09.962118 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8dba1ca0-028a-4f88-8010-7e78090817db tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441381 Sep 13 16:41:09.965277 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1446/2805] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:41:09.977821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2268402-80dc-4911-973d-49c37c11bfc5 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:09.980719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a2268402-80dc-4911-973d-49c37c11bfc5 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:10.469769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:10.482405 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-766950ea-522e-43aa-ae70-7257f3b49a54 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.681566 Sep 13 16:41:10.484772 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1360/2806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:09 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:10.495940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:10.499366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:10.515337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:10.515862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:10.516318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:10.530749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:10.534283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:10.536586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:10.719119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a2268402-80dc-4911-973d-49c37c11bfc5 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:10.737910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a2268402-80dc-4911-973d-49c37c11bfc5 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1217 microversion: 2.1 time: 0.765192 Sep 13 16:41:10.753862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1447/2807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:09 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1217 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:10.754264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cbba3103-948a-42a6-915c-17aa08c67d3f req-8fe522e7-bac5-47ab-af28-b377c5a6875d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "3b88ed2f-d58e-4333-a77c-43db1fd0a0d2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:10.798874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cbba3103-948a-42a6-915c-17aa08c67d3f req-8fe522e7-bac5-47ab-af28-b377c5a6875d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:10.802689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cbba3103-948a-42a6-915c-17aa08c67d3f req-8fe522e7-bac5-47ab-af28-b377c5a6875d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:10.805465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cbba3103-948a-42a6-915c-17aa08c67d3f req-8fe522e7-bac5-47ab-af28-b377c5a6875d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:10.837208 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cbba3103-948a-42a6-915c-17aa08c67d3f req-8fe522e7-bac5-47ab-af28-b377c5a6875d service nova] Creating event network-changed:3b88ed2f-d58e-4333-a77c-43db1fd0a0d2 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:10.845038 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cbba3103-948a-42a6-915c-17aa08c67d3f req-8fe522e7-bac5-47ab-af28-b377c5a6875d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097411 Sep 13 16:41:10.846057 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1448/2808] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:10.852990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:10.853702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:10.862964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:10.863740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:10.865154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:10.867507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:10.868225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:10.868730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:11.069578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:11.092701 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5542fc99-e14e-46f9-a055-4aa1828ff4d7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.599712 Sep 13 16:41:11.094066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1361/2809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:10 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:11.113743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13f71ef7-73fd-4793-af91-1cc6fa9ad370 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb9703700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:11.219908 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13f71ef7-73fd-4793-af91-1cc6fa9ad370 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.124503 Sep 13 16:41:11.222240 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1362/2810] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:11 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:11.237421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:11.245022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:11.265656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:11.270545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:11.273423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:11.274472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:11.279077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:11.279753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:11.688304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:11.699054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:11.711189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:11.744327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-518e530d-5539-4ed1-bf10-67820e74f0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.520621 Sep 13 16:41:11.744935 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1363/2811] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:11 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:11.773296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:11.773960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:11.800875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:11.802522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:11.803250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:11.804389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:11.805079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:11.805734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:12.036723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:12.053470 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7faaac2-004a-45be-a3f1-df568b284666 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.295748 Sep 13 16:41:12.079885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1364/2812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:11 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:12.088315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:12.090183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:12.106120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:12.106859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:12.107461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:12.110778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:12.111905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:12.112566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:12.127942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:12.146665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:12.150236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:12.153716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-37b35f3e-7d90-4f82-a778-8daf9e06c730 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1892 microversion: 2.32 time: 1.306492 Sep 13 16:41:12.157264 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1449/2813] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:10 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1892 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:12.171307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:12.171968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:12.186839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:12.187355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:12.187812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:12.189970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:12.193120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:12.193633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:12.260679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:12.273417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6a134a3-0eb8-4fc7-bcc5-07c0fca5846d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1269 microversion: 2.1 time: 0.192049 Sep 13 16:41:12.274863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1365/2814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:12 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:12.293641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-953b466e-5d4c-4edd-9ef2-00a604f5c34c tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb9813c10>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:12.425737 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-953b466e-5d4c-4edd-9ef2-00a604f5c34c tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.148587 Sep 13 16:41:12.427657 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1366/2815] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:12 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:12.788703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:12.789661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:12.816732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:12.817907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:12.823616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:12.824819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:12.826902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:12.827289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.056859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.077346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.080777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.090086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:13.101614 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e5a0c39b-7384-4b3b-be61-82569df242e2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.330873 Sep 13 16:41:13.102521 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1367/2816] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:12 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:13.133227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:13.140470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:13.149259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:13.150471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:13.152508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.153465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:13.155654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:13.157224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.504767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.514798 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b66e917-a892-4ee6-9a0b-c6797e21b24e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.394239 Sep 13 16:41:13.518180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1368/2817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:13 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:13.525071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:13.529518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:13.547800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:13.548540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:13.549168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.550102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:13.550726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:13.551323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.663027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.677718 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2207936b-0e0a-4e61-9139-1ffc49b3a9d0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 1.512541 Sep 13 16:41:13.679077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1450/2818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:12 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:13.707275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:13.708145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:13.726733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:13.727232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:13.727693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.730524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:13.730989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:13.731548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:13.904905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.921297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.934428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:13.935678 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9337107-b012-4c50-bfe2-0e4b87afed5b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.416249 Sep 13 16:41:13.936256 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1369/2819] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:13 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:13.946025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14c3618d-d6ef-4912-995e-bd7920ee9935 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb98139d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:14.025754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:14.035541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-174cbdf6-72d0-4054-95de-6b56655f854c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1275 microversion: 2.1 time: 0.341737 Sep 13 16:41:14.039523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14c3618d-d6ef-4912-995e-bd7920ee9935 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.102203 Sep 13 16:41:14.042609 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1451/2820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:13 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1275 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:14.048110 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1370/2821] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:13 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:14.135170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:14.137517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:14.156637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.157663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.158360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.159353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.160019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.160820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.308935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:14.318962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7cdeaa20-532a-4c05-96a7-504f203d06b6 req-94f425db-4999-40e0-8b70-817c339e4c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "8feb22e4-a248-4a18-a706-2ff409d8f154"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:14.329527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:14.340345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:14.349209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7cdeaa20-532a-4c05-96a7-504f203d06b6 req-94f425db-4999-40e0-8b70-817c339e4c1d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.352085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7cdeaa20-532a-4c05-96a7-504f203d06b6 req-94f425db-4999-40e0-8b70-817c339e4c1d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.352749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7cdeaa20-532a-4c05-96a7-504f203d06b6 req-94f425db-4999-40e0-8b70-817c339e4c1d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.372494 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-609a9bec-add7-472f-8bfc-c11b9f118a48 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.231462 Sep 13 16:41:14.376304 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1452/2822] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:14 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:14.379725 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7cdeaa20-532a-4c05-96a7-504f203d06b6 req-94f425db-4999-40e0-8b70-817c339e4c1d service nova] Creating event network-changed:8feb22e4-a248-4a18-a706-2ff409d8f154 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:14.398916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7cdeaa20-532a-4c05-96a7-504f203d06b6 req-94f425db-4999-40e0-8b70-817c339e4c1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085393 Sep 13 16:41:14.403111 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1371/2823] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:14.469641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-21b4240d-f783-44d6-8028-f5134c2a3e19 req-873470d6-ca2b-4326-8f7e-2a7374f5b1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab", "name": "network-vif-plugged", "status": "completed", "tag": "a3b9c3c5-39ce-4bd9-8126-86dacff81584"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:14.491287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-21b4240d-f783-44d6-8028-f5134c2a3e19 req-873470d6-ca2b-4326-8f7e-2a7374f5b1fe service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.494946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-21b4240d-f783-44d6-8028-f5134c2a3e19 req-873470d6-ca2b-4326-8f7e-2a7374f5b1fe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.495715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-21b4240d-f783-44d6-8028-f5134c2a3e19 req-873470d6-ca2b-4326-8f7e-2a7374f5b1fe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.526616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-21b4240d-f783-44d6-8028-f5134c2a3e19 req-873470d6-ca2b-4326-8f7e-2a7374f5b1fe service nova] Creating event network-vif-plugged:a3b9c3c5-39ce-4bd9-8126-86dacff81584 for instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab on n-h2-857467-1 Sep 13 16:41:14.539386 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-21b4240d-f783-44d6-8028-f5134c2a3e19 req-873470d6-ca2b-4326-8f7e-2a7374f5b1fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075061 Sep 13 16:41:14.547329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:14.548167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:14.551553 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1453/2824] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:14.569101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.571002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.573122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.574887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.580361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.584491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.706953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:14.707734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:14.721404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.721921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.722367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:14.723079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:14.723573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:14.724003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.101690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:15.110313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33ddca11-135e-46b3-86e3-5050e61b189c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.567533 Sep 13 16:41:15.116892 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1372/2825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:14 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:15.122729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:15.128555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:15.146630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:15.147417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:15.151032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.151971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:15.152597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:15.153182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.211394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:15.342116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:15.356390 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8f5978e-0379-42fb-a205-fdcf141e667d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.654182 Sep 13 16:41:15.370924 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1454/2826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:14 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:15.384326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3a81c81-16bc-4039-a70e-59bf81dbe522 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb48a69d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:15.461309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3a81c81-16bc-4039-a70e-59bf81dbe522 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.088480 Sep 13 16:41:15.462408 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1455/2827] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:15 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:15.481773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:15.499866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:15.516670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:15.520074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:15.520738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.521785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:15.525024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:15.525677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.785271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:15.817691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:15.821083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:15.822787 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-225ef309-3dcf-4054-902e-5c1f10d2cff2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.704655 Sep 13 16:41:15.824001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1373/2828] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:15 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:15.833455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:15.837328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:15.861821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:15.862823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:15.864920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.868037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:15.869322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:15.872425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:15.995421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:16.010503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:16.015185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:16.034737 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-235bdbe1-72e4-4e88-b968-76a879df3b08 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.209301 Sep 13 16:41:16.058837 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1374/2829] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:15 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:16.137440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:16.138282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:16.148803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.153439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.155939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.157250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.158093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.158667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.386807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:16.405017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec3ddce1-2dd2-4c0e-b012-0ff78aa73b74 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1321 microversion: 2.1 time: 0.271667 Sep 13 16:41:16.419172 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1375/2830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:16 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:16.419172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:16.419172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:16.433390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.434392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.435101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.436444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.438634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.439384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.615756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:16.632548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-436f0641-4515-46a7-8d2a-375d34c6d720 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1317 microversion: 2.1 time: 1.162824 Sep 13 16:41:16.633585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1456/2831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:15 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1317 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:16.639328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-cb307ca9-2cf0-4b0b-96b2-fe36ee99edd9 req-b9c7a56b-7291-4df7-9ad8-9a423afe27e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d8dd57-db9f-4112-98c2-60e288414fcd", "tag": "421b8389-858a-424e-a09a-abc14534d37e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:16.651615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cb307ca9-2cf0-4b0b-96b2-fe36ee99edd9 req-b9c7a56b-7291-4df7-9ad8-9a423afe27e7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.653273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cb307ca9-2cf0-4b0b-96b2-fe36ee99edd9 req-b9c7a56b-7291-4df7-9ad8-9a423afe27e7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.653979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-cb307ca9-2cf0-4b0b-96b2-fe36ee99edd9 req-b9c7a56b-7291-4df7-9ad8-9a423afe27e7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.669387 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-cb307ca9-2cf0-4b0b-96b2-fe36ee99edd9 req-b9c7a56b-7291-4df7-9ad8-9a423afe27e7 service nova] Creating event network-changed:421b8389-858a-424e-a09a-abc14534d37e for instance c9d8dd57-db9f-4112-98c2-60e288414fcd on n-h2-857467-1 Sep 13 16:41:16.675398 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-cb307ca9-2cf0-4b0b-96b2-fe36ee99edd9 req-b9c7a56b-7291-4df7-9ad8-9a423afe27e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040478 Sep 13 16:41:16.677443 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1457/2832] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:16.683447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ccdab7f6-38b1-4f40-887d-a04eb9b20f46 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b2bf70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:16.762074 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ccdab7f6-38b1-4f40-887d-a04eb9b20f46 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.082632 Sep 13 16:41:16.763975 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1458/2833] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:16 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:16.769496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3ffb3a4e-5d9a-48bb-b3d1-0f6f10373a38 req-71e0e0ef-135e-41be-957a-a9db92af90f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2556308-a5f0-42af-a4be-5bf3d32b0961", "name": "network-vif-plugged", "status": "completed", "tag": "549bb066-67a2-4465-908d-e554c0f9d14b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:16.780641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3ffb3a4e-5d9a-48bb-b3d1-0f6f10373a38 req-71e0e0ef-135e-41be-957a-a9db92af90f7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.781397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3ffb3a4e-5d9a-48bb-b3d1-0f6f10373a38 req-71e0e0ef-135e-41be-957a-a9db92af90f7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.782574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3ffb3a4e-5d9a-48bb-b3d1-0f6f10373a38 req-71e0e0ef-135e-41be-957a-a9db92af90f7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.797542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3ffb3a4e-5d9a-48bb-b3d1-0f6f10373a38 req-71e0e0ef-135e-41be-957a-a9db92af90f7 service nova] Creating event network-vif-plugged:549bb066-67a2-4465-908d-e554c0f9d14b for instance f2556308-a5f0-42af-a4be-5bf3d32b0961 on n-h1-857467-1 Sep 13 16:41:16.805859 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3ffb3a4e-5d9a-48bb-b3d1-0f6f10373a38 req-71e0e0ef-135e-41be-957a-a9db92af90f7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040192 Sep 13 16:41:16.811571 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1459/2834] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:16.872204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:16.878693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:16.883058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:16.883296 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65f8a452-6a0b-4568-9600-45f8fe6fe816 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.474364 Sep 13 16:41:16.902362 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1376/2835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:16 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:16.913216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.914145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.915382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:16.916812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:16.918061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:16.918715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.068798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:17.070755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:17.086101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.086837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.087612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.088493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.089311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.089949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.190856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.200263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.202615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.209317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64f0cf95-ad54-4514-bdb8-c9e9c4699b8c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.145494 Sep 13 16:41:17.210525 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1377/2836] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:17 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:17.432278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:17.432900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:17.439290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.440015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.440454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.441340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.441804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.442804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.491067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.502809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.505388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.506954 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99d5f03f-8bad-443f-8afa-d2fbf01daaf4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.660352 Sep 13 16:41:17.508487 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1460/2837] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:16 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:17.659699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:17.659981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:17.661678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:17.673889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6571606-d855-43de-b049-a61e39050b3d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1470 microversion: 2.1 time: 0.245181 Sep 13 16:41:17.689856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1378/2838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:17 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:17.692781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.695562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.696520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.697527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.698269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.698925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.845704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6550aaa0-8bf7-4d6e-87e5-1a741a2a9271 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:17.846342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6550aaa0-8bf7-4d6e-87e5-1a741a2a9271 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] [instance: cdb3f9b5-39cb-4888-85e6-bd27481aec9f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:17.853774 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-6550aaa0-8bf7-4d6e-87e5-1a741a2a9271 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] HTTP exception thrown: Instance cdb3f9b5-39cb-4888-85e6-bd27481aec9f could not be found. Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6550aaa0-8bf7-4d6e-87e5-1a741a2a9271 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Request method failure captured: Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/cdb3f9b5-39cb-4888-85e6-bd27481aec9f/action HTTP/1.1 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 15 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILKVMQSpi6XiPKBy2mIX1YhK-3vY2MojKZOd9kmH_kwJLBUZyAu0Dvgjd_lP3WIQweXaQUHns8_59dN7lgwcNHrnJG_O09yFEf8zJI1qt_Ei8XB6WMI7Qd-RLDBfW3vuX7BV5ZkBRWryz9zFSWND4jjLrWYmaGsyCJlJwkAg8O7CCzk Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 417ea6f2a53d44949fca1d82aa08b868 Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: {"migrate": {}} Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance cdb3f9b5-39cb-4888-85e6-bd27481aec9f could not be found. Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'cdb3f9b5-39cb-4888-85e6-bd27481aec9f', 'body': {'migrate': {}}} Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb3f9b5-39cb-4888-85e6-bd27481aec9f could not be found. Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb3f9b5-39cb-4888-85e6-bd27481aec9f could not be found. Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:17.871884 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb3f9b5-39cb-4888-85e6-bd27481aec9f could not be found. Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6550aaa0-8bf7-4d6e-87e5-1a741a2a9271 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Returning 404 to user: Instance cdb3f9b5-39cb-4888-85e6-bd27481aec9f could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6550aaa0-8bf7-4d6e-87e5-1a741a2a9271 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/cdb3f9b5-39cb-4888-85e6-bd27481aec9f/action" status: 404 len: 111 microversion: 2.1 time: 0.175729 Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1379/2839] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:17 2022] POST /compute/v2.1/servers/cdb3f9b5-39cb-4888-85e6-bd27481aec9f/action => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:17.887344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89819434-e986-4864-aa3b-1f815c97800e tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb9668790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:17.952753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89819434-e986-4864-aa3b-1f815c97800e tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.076818 Sep 13 16:41:17.954660 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1380/2840] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:17 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:17.961324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:17.962237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:17.970315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.971138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.971852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:17.974931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:17.976282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:17.977218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.187365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:18.198109 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23ac8717-1b1b-41f3-bdf5-de8fd75b8117 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1317 microversion: 2.1 time: 0.540862 Sep 13 16:41:18.199359 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1461/2841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:17 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:18.204335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-83a6e4e3-f0d3-4b71-8e22-0c01f96b8c94 req-a93eff95-39af-464b-b93d-02658f91e2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "43111ac9-cc42-4b8e-b068-0c286448e068"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:18.216178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-83a6e4e3-f0d3-4b71-8e22-0c01f96b8c94 req-a93eff95-39af-464b-b93d-02658f91e2ca service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.217908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-83a6e4e3-f0d3-4b71-8e22-0c01f96b8c94 req-a93eff95-39af-464b-b93d-02658f91e2ca service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.218755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-83a6e4e3-f0d3-4b71-8e22-0c01f96b8c94 req-a93eff95-39af-464b-b93d-02658f91e2ca service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.240286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-83a6e4e3-f0d3-4b71-8e22-0c01f96b8c94 req-a93eff95-39af-464b-b93d-02658f91e2ca service nova] Creating event network-changed:43111ac9-cc42-4b8e-b068-0c286448e068 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:18.245863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-83a6e4e3-f0d3-4b71-8e22-0c01f96b8c94 req-a93eff95-39af-464b-b93d-02658f91e2ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045062 Sep 13 16:41:18.246714 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1462/2842] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:18.259356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-416964577", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:18.278771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:18.292277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:18.306306 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3630fc89-53e9-460f-87c2-88da8706299e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1315 microversion: 2.1 time: 0.350222 Sep 13 16:41:18.310264 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1381/2843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:17 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:18.324820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:18.327203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:18.339040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.339774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.340425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.341345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.342137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.342757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.343883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] validate_networks() for None {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:41:18.430941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:18.440852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:18.443021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:18.450246 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9229bf0c-4d0e-4274-af1f-e12df88ce9f1 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.138427 Sep 13 16:41:18.451453 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1382/2844] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:18 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:18.539796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:18.542681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:18.553819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.553819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.555362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.556121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.556590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.557021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.887920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:41:18.887920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:41:18.887920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:41:18.887920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:41:18.887920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:41:18.904074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.904563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.905004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.905729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:18.909904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:18.910831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:18.935785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Getting quotas for project 7ff0f00f321e4f37a57e652100b85607. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:41:18.945881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Getting quotas for user 37df2c00d1ef41a6a5d0ec8da4ca275b and project 7ff0f00f321e4f37a57e652100b85607. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:41:18.973243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:41:18.978609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:41:18.985774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:19.002615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:19.007929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:19.010172 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c6a2966-c4e3-4ada-93e1-9e22fd98f40c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.475546 Sep 13 16:41:19.020803 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1383/2845] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:18 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:19.048789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f86f8ba-8e67-49d9-8f46-5c78647f22d8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb9788700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:19.081305 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fdcd7d8-3774-4141-bdd5-90cc5754c6c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831275 Sep 13 16:41:19.093377 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1463/2846] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:41:19.099169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc03e372-6520-4f1b-87fb-db97ea913ff1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:19.100054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc03e372-6520-4f1b-87fb-db97ea913ff1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:19.150479 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f86f8ba-8e67-49d9-8f46-5c78647f22d8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.125046 Sep 13 16:41:19.153557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1384/2847] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:19 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:19.231403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:19.232824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:19.254179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:19.254471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:19.255513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:19.260051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:19.262423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:19.264235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:19.391406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc03e372-6520-4f1b-87fb-db97ea913ff1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:19.401769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc03e372-6520-4f1b-87fb-db97ea913ff1 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1221 microversion: 2.1 time: 0.306893 Sep 13 16:41:19.417013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1464/2848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:19 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1221 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:19.447631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:19.450978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:19.468885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:19.469555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:19.474653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:19.474653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:19.474653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:19.477373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.108727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:20.131983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-485d9aca-0dd7-40e9-90c5-805580b302ba tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1502 microversion: 2.1 time: 0.712760 Sep 13 16:41:20.148460 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1465/2849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:19 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1502 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:20.163768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:20.166832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:20.186602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:20.189019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:20.190361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.191629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:20.194307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:20.194957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.414362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:20.415014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:20.425883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df67111d-87ac-44e5-aec8-e23ff2cc0b1d tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1317 microversion: 2.1 time: 1.200580 Sep 13 16:41:20.440523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:20.452940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:20.454327 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1385/2850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:19 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1317 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:20.463569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:20.468526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:20.482656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:20.483625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:20.486662 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e47be301-9d21-47a3-996d-994148f2d4a5 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1558 microversion: 2.91 time: 0.333939 Sep 13 16:41:20.487865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.489702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:20.490434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:20.493306 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1466/2851] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:20 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1558 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:20.494187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.511589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:20.518092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:20.543873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:20.545005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:20.547683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.550975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:20.551538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:20.553681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:20.798029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c73f0e9b-00ab-422e-b4e8-7f15ae27fd0b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961/action" status: 202 len: 0 microversion: 2.1 time: 0.303077 Sep 13 16:41:20.803884 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1467/2852] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:20 2022] POST /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:41:20.812056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb1ebc5a-bc01-44f6-92a4-b567a31340aa tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb48ba940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:21.188664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:21.215474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:21.217229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:21.218737 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-505edf46-4687-4676-bb34-f74ef777a2e4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.763192 Sep 13 16:41:21.219477 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1386/2853] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:20 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:21.235451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:21.236339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:21.248352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.249272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.252670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:21.254230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.255675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.256525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:21.315490 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb1ebc5a-bc01-44f6-92a4-b567a31340aa tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1422 microversion: 2.1 time: 0.506419 Sep 13 16:41:21.316257 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1468/2854] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:20 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1422 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:21.327846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6116788c-0787-4809-8cb5-e919709909d9 req-b36ec604-7177-43e8-b594-04a701a75f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "6199766c-27f4-49fb-92e6-fc117ebbbc52"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:21.358664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6116788c-0787-4809-8cb5-e919709909d9 req-b36ec604-7177-43e8-b594-04a701a75f52 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.359372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6116788c-0787-4809-8cb5-e919709909d9 req-b36ec604-7177-43e8-b594-04a701a75f52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.363482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6116788c-0787-4809-8cb5-e919709909d9 req-b36ec604-7177-43e8-b594-04a701a75f52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:21.389032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:21.398560 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6116788c-0787-4809-8cb5-e919709909d9 req-b36ec604-7177-43e8-b594-04a701a75f52 service nova] Creating event network-changed:6199766c-27f4-49fb-92e6-fc117ebbbc52 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:21.413080 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6116788c-0787-4809-8cb5-e919709909d9 req-b36ec604-7177-43e8-b594-04a701a75f52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092091 Sep 13 16:41:21.417185 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1469/2855] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:21.430179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:21.430923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:21.452416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.453557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.469400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:21.474426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.475050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.475518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:21.605373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:21.614808 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-761d724e-1f0b-4143-8b68-464a20a028b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1273 microversion: 2.1 time: 0.393501 Sep 13 16:41:21.617371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1387/2856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:21 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:21.631232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:21.633617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:21.649228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.650375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.651035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:21.653002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:21.658479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:21.659747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:22.621453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:22.640419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c56014b8-8e9f-48db-b32b-951331f6927c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1487 microversion: 2.1 time: 1.220428 Sep 13 16:41:22.643480 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1470/2857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:21 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1487 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:22.663944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:22.664929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:22.675030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:22.679196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:22.680586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:22.682924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:22.685538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:22.687658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:22.973280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:22.986170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-570c83f9-30b8-427f-ae68-0886c0d596ea tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1317 microversion: 2.1 time: 1.365607 Sep 13 16:41:22.991608 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1388/2858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:21 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1317 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:23.003048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:23.006121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:23.026122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:23.027022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:23.028262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:23.029324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:23.033137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:23.034089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:24.054618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.073493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.079885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.087325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.093688 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1f3a458-684a-403d-a115-15de391da1ae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 1.446674 Sep 13 16:41:24.094329 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1471/2859] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:22 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:24.103349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.108552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.112062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c77ecbd7-177b-4e18-90ea-192128bb3815 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 1.117909 Sep 13 16:41:24.115881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bc5fc6a-3102-4b65-b5d7-88397d376ff8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4899820>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:24.129645 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1389/2860] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:22 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:24.150702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:24.152035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:24.176105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:24.177611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:24.180039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:24.184214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:24.185006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:24.187339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:24.381880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:24.394789 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-258855ad-3f42-4de4-91d4-5f888d5fc8a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1279 microversion: 2.1 time: 0.262548 Sep 13 16:41:24.398724 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1390/2861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:24 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:24.405455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:24.407181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:24.433062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:24.433844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:24.440978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:24.442051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:24.442711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:24.446040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:24.511441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:24.629407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:24.746257 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a5c7234-41f3-4aa2-b160-335ef80d9c07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 204 len: 0 microversion: 2.1 time: 0.345883 Sep 13 16:41:24.747460 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1391/2862] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:24 2022] DELETE /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:24.757904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:24.758624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:24.777391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:24.777911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:24.778356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:24.779070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:24.779544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:24.779967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.091418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:25.100919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c68c8973-373c-4001-9525-8e2b920573e9 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1317 microversion: 2.1 time: 0.351995 Sep 13 16:41:25.105250 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1392/2863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:24 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:25.144501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b9c9a4d9-1552-4d7e-a608-aa18702339af req-65ae422c-3bb2-46de-89a6-698a345f6ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d8dd57-db9f-4112-98c2-60e288414fcd", "name": "network-vif-plugged", "status": "completed", "tag": "421b8389-858a-424e-a09a-abc14534d37e"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:25.179112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b9c9a4d9-1552-4d7e-a608-aa18702339af req-65ae422c-3bb2-46de-89a6-698a345f6ef3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.179763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b9c9a4d9-1552-4d7e-a608-aa18702339af req-65ae422c-3bb2-46de-89a6-698a345f6ef3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.180321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b9c9a4d9-1552-4d7e-a608-aa18702339af req-65ae422c-3bb2-46de-89a6-698a345f6ef3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.205331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b9c9a4d9-1552-4d7e-a608-aa18702339af req-65ae422c-3bb2-46de-89a6-698a345f6ef3 service nova] Creating event network-vif-plugged:421b8389-858a-424e-a09a-abc14534d37e for instance c9d8dd57-db9f-4112-98c2-60e288414fcd on n-h2-857467-1 Sep 13 16:41:25.215877 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b9c9a4d9-1552-4d7e-a608-aa18702339af req-65ae422c-3bb2-46de-89a6-698a345f6ef3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092600 Sep 13 16:41:25.217641 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1393/2864] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:25.234694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:25.235420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:25.253238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.253782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.254254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.255592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.256056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.256485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.591928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:25.609716 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b0234af9-dd57-4b42-a653-95e83699e39b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1493 microversion: 2.1 time: 0.384916 Sep 13 16:41:25.610786 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1394/2865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:25 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1493 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:25.629626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:25.631036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:25.663226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.664106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.666202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.673256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.674252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.679820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.832034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:25.843355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:25.845045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:25.852384 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea915f45-1eac-4108-b34a-a7922452d1c2 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.240349 Sep 13 16:41:25.865864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1395/2866] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:25 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:25.865864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:25.865864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:25.880687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.880687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.880687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:25.880687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:25.880687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:25.881193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:26.769759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:26.785117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:26.791395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:26.793099 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-764c3ea0-38bc-47ca-b47f-5553dd4dde3d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.938328 Sep 13 16:41:26.795846 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1396/2867] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:25 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:26.805493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:26.808491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:26.824388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:26.825905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:26.826616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:26.827712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:26.828630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:26.830938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:27.368067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:27.380465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-520d5385-e32c-480a-a721-8bd8ec726468 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1321 microversion: 2.1 time: 0.583118 Sep 13 16:41:27.382213 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1397/2868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:26 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:27.390448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a2969f39-99e7-4823-b029-8945505b8793 req-415fd0b3-2572-4240-a33c-f2c6127f7342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "d7a4126e-90a5-4a5b-80a4-1cb57c0445d8"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:27.418228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a2969f39-99e7-4823-b029-8945505b8793 req-415fd0b3-2572-4240-a33c-f2c6127f7342 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:27.423162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a2969f39-99e7-4823-b029-8945505b8793 req-415fd0b3-2572-4240-a33c-f2c6127f7342 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:27.424052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a2969f39-99e7-4823-b029-8945505b8793 req-415fd0b3-2572-4240-a33c-f2c6127f7342 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:27.459128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a2969f39-99e7-4823-b029-8945505b8793 req-415fd0b3-2572-4240-a33c-f2c6127f7342 service nova] Creating event network-changed:d7a4126e-90a5-4a5b-80a4-1cb57c0445d8 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:41:27.476148 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a2969f39-99e7-4823-b029-8945505b8793 req-415fd0b3-2572-4240-a33c-f2c6127f7342 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092227 Sep 13 16:41:27.477475 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1398/2869] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:27.487520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:27.504091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:27.531775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:27.532543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:27.534171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:27.535244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:27.543588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:27.544207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:28.080100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:28.095793 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83aaaa1a-e3c6-4b54-afdb-e89004b25d70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1506 microversion: 2.1 time: 0.615629 Sep 13 16:41:28.096442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1399/2870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:27 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:28.101570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cef5d09-22c8-4928-94ad-77b5fdfce98d"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:28.104163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:28.110420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:28.110916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:28.111379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:28.112077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:28.112555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:28.112982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:28.726047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e313895d-0fa1-4595-8137-cc1035ab5e47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628283 Sep 13 16:41:28.750485 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1400/2871] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:41:28 2022] POST /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:28.764127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:28.773509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:28.782008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:28.789437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:28.790415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:28.791693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:28.793811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:28.794528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:28.920820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:29.215240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:29.235024 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00c7e298-0403-4039-a301-66d6573d1a6e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1493 microversion: 2.1 time: 0.479434 Sep 13 16:41:29.235938 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1401/2872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:28 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1493 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:29.260440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:29.261327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:29.267684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:29.268183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:29.268631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:29.269350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:29.269816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:29.270811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:29.398052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=16 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:29.405471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:29.416948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:29.418471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:29.434125 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33a04eba-c21d-4ba2-a26f-7dd7752e50a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.183018 Sep 13 16:41:29.435451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1402/2873] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:29 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:29.603161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-0a26a79a-8d58-4e96-80ea-ee011634e8b5 req-768d142d-d56c-481d-9f4f-ac7108a1fde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfa6d0b-1050-45a3-8e55-d9d2eea71c70", "tag": "fde9d5f9-bdf1-457c-96ef-84b536ee2052"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:29.631653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0a26a79a-8d58-4e96-80ea-ee011634e8b5 req-768d142d-d56c-481d-9f4f-ac7108a1fde8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:29.632439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0a26a79a-8d58-4e96-80ea-ee011634e8b5 req-768d142d-d56c-481d-9f4f-ac7108a1fde8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:29.633800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0a26a79a-8d58-4e96-80ea-ee011634e8b5 req-768d142d-d56c-481d-9f4f-ac7108a1fde8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:29.654326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-0a26a79a-8d58-4e96-80ea-ee011634e8b5 req-768d142d-d56c-481d-9f4f-ac7108a1fde8 service nova] Creating event network-changed:fde9d5f9-bdf1-457c-96ef-84b536ee2052 for instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 on n-h1-857467-1 Sep 13 16:41:29.669547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-0a26a79a-8d58-4e96-80ea-ee011634e8b5 req-768d142d-d56c-481d-9f4f-ac7108a1fde8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232617 Sep 13 16:41:29.675773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1403/2874] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:29.719554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:29.720609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:29.731334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:29.735677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:29.736395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:29.737349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:29.741536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:29.742285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.239868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:30.252781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:30.254291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:30.256739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f996fe39-33d2-454c-b281-2d4a754e6ab1 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.577989 Sep 13 16:41:30.265853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1404/2875] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:29 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:30.265853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:30.265853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:30.279218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.285618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.285618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.285618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.285618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.285618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.346163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:30.347266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58dc0cd6-d6fc-41cc-bbc1-907121160806 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd/os-instance-actions/req-8dba1ca0-028a-4f88-8010-7e78090817db" status: 200 len: 313 microversion: 2.1 time: 0.088251 Sep 13 16:41:30.347770 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1405/2876] 10.222.0.61 () {58 vars in 1419 bytes} [Tue Sep 13 16:41:30 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd/os-instance-actions/req-8dba1ca0-028a-4f88-8010-7e78090817db => generated 313 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:30.358594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:30.359236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:30.375224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.375856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.376376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.377171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.382114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.382804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.686506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:30.701339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34b2f248-3d85-4ee7-8b96-1ce34ac0f7b7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1321 microversion: 2.1 time: 0.352495 Sep 13 16:41:30.701973 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1406/2877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:30 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:30.710012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bc8b7e20-93d3-452e-9008-40b018238174 req-d14488b8-38fc-494b-842e-7e7781376655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2556308-a5f0-42af-a4be-5bf3d32b0961", "name": "network-vif-deleted", "tag": "549bb066-67a2-4465-908d-e554c0f9d14b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:30.725459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bc8b7e20-93d3-452e-9008-40b018238174 req-d14488b8-38fc-494b-842e-7e7781376655 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.726563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bc8b7e20-93d3-452e-9008-40b018238174 req-d14488b8-38fc-494b-842e-7e7781376655 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.727193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bc8b7e20-93d3-452e-9008-40b018238174 req-d14488b8-38fc-494b-842e-7e7781376655 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.753705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bc8b7e20-93d3-452e-9008-40b018238174 req-d14488b8-38fc-494b-842e-7e7781376655 service nova] Creating event network-vif-deleted:549bb066-67a2-4465-908d-e554c0f9d14b for instance f2556308-a5f0-42af-a4be-5bf3d32b0961 on n-h1-857467-1 Sep 13 16:41:30.765821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bc8b7e20-93d3-452e-9008-40b018238174 req-d14488b8-38fc-494b-842e-7e7781376655 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062522 Sep 13 16:41:30.767863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1407/2878] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:30.774061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:30.774778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:30.783456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.784206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.784661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.785437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.786592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.787100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.898476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:30.908718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5dafe79-079f-4c81-a9be-b2483ad9d869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 200 len: 1451 microversion: 2.1 time: 0.139428 Sep 13 16:41:30.930128 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1408/2879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:30 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:30.934390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:30.937036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:30.946222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.946876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.947434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.948296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:30.948906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:30.949442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:30.969226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:31.103271 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51db06a5-203b-4ff6-b525-0e5894018a70 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "POST /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.178611 Sep 13 16:41:31.155323 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1409/2880] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:30 2022] POST /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:41:31.168828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:31.169865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:31.192736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:31.193956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:31.195002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:31.196199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:31.196958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:31.197942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:31.384624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:31.400415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:31.401927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:31.441398 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6da8514a-dc88-4c7d-ba5b-5ae1236bda65 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.282496 Sep 13 16:41:31.444654 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1410/2881] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:31 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:31.468378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:31.469026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:31.481271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:31.490462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:31.491866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:31.495712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:31.500289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:31.500801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:31.503161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:32.248657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:32.258139 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9efc3913-e7cc-4486-a247-571a9b28b327 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1508 microversion: 2.1 time: 0.808448 Sep 13 16:41:32.274025 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1411/2882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:31 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1508 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:32.280433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:32.280979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:32.291080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:32.291604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:32.292193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:32.292926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:32.293395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:32.293849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:32.741644 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bc5fc6a-3102-4b65-b5d7-88397d376ff8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1431 microversion: 2.1 time: 8.643863 Sep 13 16:41:32.746512 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1472/2883] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:24 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1431 bytes in 8649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:32.766935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:32.769392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:32.819821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:32.821252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:32.823141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:32.824101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:32.825510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:32.831376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.353201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:33.374344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:33.378895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:33.384713 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54d1231c-9629-4968-b746-7f713e9e7aa0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 1.123432 Sep 13 16:41:33.386661 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1412/2884] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:32 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:33.395843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:33.400620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:33.419418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.419918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.423545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.426096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.429476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.431232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.468784 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 HTTP/1.1 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f2556308-a5f0-42af-a4be-5bf3d32b0961'} Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:33.471239 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:33.476131 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5539d381-b17c-4a19-9ccc-65e17443da76 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 404 len: 111 microversion: 2.1 time: 0.084695 Sep 13 16:41:33.478372 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1413/2885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:33 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:33.521922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:33.526096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:33.553458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.555874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.556358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.559301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.576861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.578041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.765513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:33.774212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76aea84d-ebb4-40ed-94d6-20665c243c03 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1321 microversion: 2.1 time: 1.026299 Sep 13 16:41:33.778169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1473/2886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:32 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1321 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:33.784323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80609ede-9650-4116-a405-e463c0586793 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4899b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:33.882168 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80609ede-9650-4116-a405-e463c0586793 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 200 len: 1431 microversion: 2.1 time: 0.102669 Sep 13 16:41:33.883529 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1474/2887] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:33 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 1431 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:33.888629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:33.890115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:33.898355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.899224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.899897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:33.900859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:33.901536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:33.902208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.174161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:34.188002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:34.189747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:34.204963 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-45388c63-c263-42ae-95bb-86f970b4b2a6 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.712370 Sep 13 16:41:34.214647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1414/2888] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:33 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:34.219832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1426458254", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:34.328312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:41:34.819629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:34.828092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e0e6205-76e6-4033-8ccd-4d1e16597446 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1508 microversion: 2.1 time: 0.943288 Sep 13 16:41:34.828695 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1475/2889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:33 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1508 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:34.867017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:34.868014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:34.903117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.903562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.904013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:34.904744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:34.905196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:34.914484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.433162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:35.451361 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d43009e3-5972-475e-be0c-5cb8ef6dbbe8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1465 microversion: 2.1 time: 0.609193 Sep 13 16:41:35.467954 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1476/2890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:34 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1465 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:35.482390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:35.483448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:35.490827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.491708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.492145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.493017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.493636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.494281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.510494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:41:35.512030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:41:35.512666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:41:35.513262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:41:35.513860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:41:35.527815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.528764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.529432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.531019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.532992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.534430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.623047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:41:35.644382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:41:35.684261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:41:35.688552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:41:35.825015 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db0aa7a2-8a91-41f6-baaf-e9ec40db154e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608951 Sep 13 16:41:35.827762 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1415/2891] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:41:35.846410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:35.847013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:35.872746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.873427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.874271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:35.875400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:35.877174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:35.877731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.227583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.241020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8cbb832c-763f-44e2-884b-bb177fa23e43 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1321 microversion: 2.1 time: 0.405379 Sep 13 16:41:36.242384 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1416/2892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:35 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:36.263876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.265415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.281620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.282794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.283504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.284495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.285616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.287117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.402866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.416112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.418161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.424400 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-551fada4-3ea5-4703-8160-ad8643ea1576 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.181020 Sep 13 16:41:36.425671 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1417/2893] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:36.432205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d705229a-9022-473a-bb18-8cee8c127651 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb54a8ca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.509955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.520352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.522290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.523499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bc63bb8-6b7b-4f72-a746-487b9d78d53a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 1.054457 Sep 13 16:41:36.524400 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1477/2894] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:35 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:36.530689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f448c29-106a-4d09-aa8c-983abb5c3bc9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.531305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1f448c29-106a-4d09-aa8c-983abb5c3bc9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.559926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d705229a-9022-473a-bb18-8cee8c127651 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/5853c870-0393-4bca-bd0a-d3ea26765a2c" status: 200 len: 784 microversion: 2.1 time: 0.132830 Sep 13 16:41:36.570750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1418/2895] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/images/5853c870-0393-4bca-bd0a-d3ea26765a2c => generated 784 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:36.590084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.591305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.611452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.612237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.612926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.613920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.614988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.617249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.630356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f448c29-106a-4d09-aa8c-983abb5c3bc9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.637765 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f448c29-106a-4d09-aa8c-983abb5c3bc9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1215 microversion: 2.1 time: 0.110658 Sep 13 16:41:36.642220 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1478/2896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:36.654852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9808393-1185-417a-abfa-c30d1a7306ed tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.675368 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c9808393-1185-417a-abfa-c30d1a7306ed tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031131 Sep 13 16:41:36.686261 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1479/2897] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:36.702912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36919869-482a-4551-9596-e7df8eedf7c0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb488baf0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.799383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:36.810684 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f45a4031-254e-4ca2-a3ad-303ac5736a28 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1506 microversion: 2.1 time: 0.237931 Sep 13 16:41:36.812000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1419/2898] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:36.838623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '.version_select at 0x7fbeb4b78160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.839390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.863698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.864247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.865187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.866145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.866873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.867311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.964841 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-589328c0-7886-4a44-b76c-bad2c65de13c tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.130832 Sep 13 16:41:36.964841 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1420/2899] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Sep 13 16:41:36 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd/os-instance-actions => generated 611 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:36.978072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:36.978587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:36.991886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.992566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.993194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:36.993964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:36.994432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:36.994864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:37.096208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:37.355678 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a8e5b4a-6df2-4d5a-9342-c9325b4db468 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 204 len: 0 microversion: 2.1 time: 0.381134 Sep 13 16:41:37.356580 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1421/2900] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:36 2022] DELETE /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:37.365046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:37.365806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:37.382196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:37.382713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:37.386137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:37.387202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:37.387693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:37.388140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:37.713211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:37.731478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-45f72238-06b9-4238-be11-e010ded544a0 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1321 microversion: 2.1 time: 0.373583 Sep 13 16:41:37.747182 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1422/2901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:37 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:37.775858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:37.799510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:37.817602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:37.821260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:37.822550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:37.831950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:37.832725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:37.834135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.087490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.097102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-865f46dd-9124-4c38-95b4-a0521216815b tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1512 microversion: 2.1 time: 0.344248 Sep 13 16:41:38.097701 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1423/2902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:37 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:38.122901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-02f2fc9e-84c7-48d1-b95e-8ad46c5a7147 req-47e69061-9a16-4044-bd25-29a078423625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfa6d0b-1050-45a3-8e55-d9d2eea71c70", "name": "network-vif-plugged", "status": "completed", "tag": "fde9d5f9-bdf1-457c-96ef-84b536ee2052"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:38.157678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02f2fc9e-84c7-48d1-b95e-8ad46c5a7147 req-47e69061-9a16-4044-bd25-29a078423625 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.158356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02f2fc9e-84c7-48d1-b95e-8ad46c5a7147 req-47e69061-9a16-4044-bd25-29a078423625 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.158959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02f2fc9e-84c7-48d1-b95e-8ad46c5a7147 req-47e69061-9a16-4044-bd25-29a078423625 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.182414 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-02f2fc9e-84c7-48d1-b95e-8ad46c5a7147 req-47e69061-9a16-4044-bd25-29a078423625 service nova] Creating event network-vif-plugged:fde9d5f9-bdf1-457c-96ef-84b536ee2052 for instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 on n-h1-857467-1 Sep 13 16:41:38.192874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-02f2fc9e-84c7-48d1-b95e-8ad46c5a7147 req-47e69061-9a16-4044-bd25-29a078423625 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088041 Sep 13 16:41:38.197910 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1424/2903] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:38.221895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36919869-482a-4551-9596-e7df8eedf7c0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "DELETE /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 204 len: 0 microversion: 2.1 time: 1.534007 Sep 13 16:41:38.226401 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1480/2904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:36 2022] DELETE /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 0 bytes in 1536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:38.231556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:38.232171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:38.274838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:38.282602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:38.288144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.288660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.289114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.289872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.290350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.290794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.307468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.319511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.320675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.322304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.323024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.324051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.542334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.581027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.586430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.606267 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a0c5204-3755-4fe6-9388-6ae85bb2e980 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.400076 Sep 13 16:41:38.607566 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1425/2905] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:38 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:38.619311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:38.623327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:38.640143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.643045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.643605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.646040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.647581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.650675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.727041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:38.852264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.865481 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0082a0ee-1458-47f8-8536-9f48a35caeae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1267 microversion: 2.1 time: 0.254883 Sep 13 16:41:38.868188 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1426/2906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:38 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:38.875165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13b27b19-2bbe-4ab6-9e42-7c9056ffa055 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b78820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:38.911755 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-13b27b19-2bbe-4ab6-9e42-7c9056ffa055 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] HTTP exception thrown: Image not found. Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13b27b19-2bbe-4ab6-9e42-7c9056ffa055 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Request method failure captured: Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff HTTP/1.1 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILKF89UixwEbPWlo9ww_WZq37IXiV3kTM8_QUNeQTVJQC5rSfDqPaKG8jvOdydN7zpp9QIzkJcFGJhDgs7KyAMH0ZKflO5nz5oXoJk6jJu0eoZk5zgb5pgGWhmL9_z8_lsEgMYYLj7-thk9v24LIJLuJN_phh2Tf13BWmOuYjWeA2Nk Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1e9f5c731cfd4ebba006c7d818d26d5a Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1e9f5c731cfd4ebba006c7d818d26d5a Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerTestJSON-708410407-project Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 83ade3c22e244d4e899dafb768efdaa7 Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerTestJSON-708410407-project Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'aa6c6ca2-b887-4afb-8dd7-73bd49420eff'} Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aa6c6ca2-b887-4afb-8dd7-73bd49420eff Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 13 16:41:38.914207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa6c6ca2-b887-4afb-8dd7-73bd49420eff could not be found. Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:41:38.918537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:38.922576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13b27b19-2bbe-4ab6-9e42-7c9056ffa055 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:38.925056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13b27b19-2bbe-4ab6-9e42-7c9056ffa055 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 404 len: 62 microversion: 2.1 time: 0.054250 Sep 13 16:41:38.936572 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1427/2907] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:38 2022] GET /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:41:38.949485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:38.950926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:38.969087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.970742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.971278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.972070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.974154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:38.976416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:38.977345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:38.994414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.996555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:38.998067 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-86a0bfdc-f37a-47cb-9c82-9e4d457c8b05 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.770628 Sep 13 16:41:39.004787 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1481/2908] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:38 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:39.010437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1603506569"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:39.030200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:39.040388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.040912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.041361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.060329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.061730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.062395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.209467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:39.221926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e0bf18fa-f41e-4c78-8cb9-0834781cbb19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1321 microversion: 2.1 time: 0.282715 Sep 13 16:41:39.226030 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1428/2909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:38 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:39.236514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:39.238362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:39.249723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.250576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.251171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.251962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.252771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.253780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.464003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:39.475621 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abdf587f-60b5-4c91-82a5-2902784c52e2 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1512 microversion: 2.1 time: 0.248116 Sep 13 16:41:39.476466 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1429/2910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:39 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:39.528099 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-477feb17-263c-4966-af50-f3989719b8dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "POST /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6/action" status: 202 len: 0 microversion: 2.1 time: 0.521236 Sep 13 16:41:39.533330 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1482/2911] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:39 2022] POST /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:41:39.564765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-84334076-2d91-4acb-86c3-3815c6773946 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb97e4e50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:39.641916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:39.643901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:39.669385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.672386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.673047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.674033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.678713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.679426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.699371 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-84334076-2d91-4acb-86c3-3815c6773946 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.158260 Sep 13 16:41:39.702523 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1430/2912] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:39 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:39.897313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:39.898894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:39.915003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:39.929716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:39.933906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:39.941244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.946423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1dc9c823-f616-436d-acd5-bfe2ad657b2c tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.310207 Sep 13 16:41:39.948238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.949048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:39.953766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:39.955198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:39.959544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1483/2913] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:39 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:39.961085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.028872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:40.029487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:40.037618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.038140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.054549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.057988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.063904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.065146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.218699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:40.252323 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1662e1ba-f802-4aba-9c4e-1ec08c0ff8c6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1275 microversion: 2.1 time: 0.360593 Sep 13 16:41:40.256684 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1431/2914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:39 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1275 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:40.274554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:40.279656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:40.306227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.311226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.311847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.313942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.324896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.326540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.557426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:40.560731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:40.562680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:40.564050 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8730169f-ff48-4460-8a78-eff68cb0d550 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.539072 Sep 13 16:41:40.578951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1484/2915] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:40 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:40.590807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d021e16a-2bb6-439a-8eb9-1be43e626b28 req-cf0e3347-3d83-48c4-a9cb-5dcf4568b144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "name": "network-vif-unplugged", "status": "completed", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:40.613265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d021e16a-2bb6-439a-8eb9-1be43e626b28 req-cf0e3347-3d83-48c4-a9cb-5dcf4568b144 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.619148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d021e16a-2bb6-439a-8eb9-1be43e626b28 req-cf0e3347-3d83-48c4-a9cb-5dcf4568b144 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.619989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d021e16a-2bb6-439a-8eb9-1be43e626b28 req-cf0e3347-3d83-48c4-a9cb-5dcf4568b144 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.639190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d021e16a-2bb6-439a-8eb9-1be43e626b28 req-cf0e3347-3d83-48c4-a9cb-5dcf4568b144 service nova] Creating event network-vif-unplugged:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:41:40.652554 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d021e16a-2bb6-439a-8eb9-1be43e626b28 req-cf0e3347-3d83-48c4-a9cb-5dcf4568b144 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072022 Sep 13 16:41:40.656975 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1485/2916] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:40.671121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:40.672761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:40.686437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.687030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.688038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.688981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.689857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.690539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.769029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbf448f09434faea9e8afb24d45412a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09df4a6e599746d985beba2d61454ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:40.778588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76194bf3-ab03-43bd-9bfd-e2554b96a65e tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 200 len: 1470 microversion: 2.1 time: 0.119308 Sep 13 16:41:40.780532 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1486/2917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:40 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 1470 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:40.785515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-711fc83a-3842-4c77-ba82-9527a358d441 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb52a9b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:40.857696 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-711fc83a-3842-4c77-ba82-9527a358d441 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.070081 Sep 13 16:41:40.858776 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1487/2918] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:40 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:40.981381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:40.982598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:40.992661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.994197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.994981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:40.995957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:40.997384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:40.998083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.008746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:41.027196 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f7d61d8-7098-405d-b2d1-dc7a43a9a65c tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1471 microversion: 2.1 time: 0.767657 Sep 13 16:41:41.030486 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1432/2919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:40 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1471 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:41.128946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:41.145068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:41.148369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:41.174866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe4698c1-1784-4f31-93dd-6795ad94fe57 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.197468 Sep 13 16:41:41.189668 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1488/2920] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:40 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:41.224207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:41.225130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:41.245363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.246157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.247649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.249274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.250949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.254529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.298863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-285639011", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:41.303204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lazy-loading 'flavor' on Instance uuid dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:41.377800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:41:41.475672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c83f1bf-b4a7-4c8b-9fbf-8f9664358cd6 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70/action" status: 202 len: 0 microversion: 2.1 time: 0.281843 Sep 13 16:41:41.480487 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1489/2921] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:41 2022] POST /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:41:41.489726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-397b611a-d308-45e4-abd3-01c1d8fc965c req-7c96a382-18f7-4844-94ea-2ff4efe3acb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d8dd57-db9f-4112-98c2-60e288414fcd", "name": "network-vif-deleted", "tag": "421b8389-858a-424e-a09a-abc14534d37e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:41.508455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-397b611a-d308-45e4-abd3-01c1d8fc965c req-7c96a382-18f7-4844-94ea-2ff4efe3acb9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.508948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-397b611a-d308-45e4-abd3-01c1d8fc965c req-7c96a382-18f7-4844-94ea-2ff4efe3acb9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.509388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-397b611a-d308-45e4-abd3-01c1d8fc965c req-7c96a382-18f7-4844-94ea-2ff4efe3acb9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.512856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:41.528163 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-397b611a-d308-45e4-abd3-01c1d8fc965c req-7c96a382-18f7-4844-94ea-2ff4efe3acb9 service nova] Creating event network-vif-deleted:421b8389-858a-424e-a09a-abc14534d37e for instance c9d8dd57-db9f-4112-98c2-60e288414fcd on n-h2-857467-1 Sep 13 16:41:41.534993 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-397b611a-d308-45e4-abd3-01c1d8fc965c req-7c96a382-18f7-4844-94ea-2ff4efe3acb9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053046 Sep 13 16:41:41.535899 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1490/2922] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:41.542421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:41.543239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:41.551416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.552469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.552925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.553654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.554146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.554583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.666395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:41.689239 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a353b4a4-07f5-4edb-b744-652386dc9f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1273 microversion: 2.1 time: 0.150319 Sep 13 16:41:41.707594 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1491/2923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:41 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:41.714450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:41.715788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:41.724575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.725080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.725587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:41.726476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:41.727601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:41.728045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.152477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:41:42.154254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:41:42.155056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:41:42.156324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:41:42.159030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:41:42.178734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.179499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.180189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.181696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.182407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.183138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.218652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Getting quotas for project 86240d08d58941c58e5c44f5770aacf2. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:41:42.226837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Getting quotas for user 46eff935c2304c649e5b4c7cc7295f0f and project 86240d08d58941c58e5c44f5770aacf2. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:41:42.243939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:41:42.246862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:41:42.344171 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9696866b-530a-4ef2-8cec-ce475e1bd62c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310646 Sep 13 16:41:42.349684 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1433/2924] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:41:42.360531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:42.363851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:42.372990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.374645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.375834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.377787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.378304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.378748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.571789 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f59555c-0960-4201-97fd-deffa78c383c tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1630 microversion: 2.1 time: 0.859805 Sep 13 16:41:42.572432 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1492/2925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:41 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1630 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:42.602782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:42.602782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] [instance: c9d8dd57-db9f-4112-98c2-60e288414fcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:42.638577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.639168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.643353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.644176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.646142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.646142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.695947 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] HTTP exception thrown: Instance c9d8dd57-db9f-4112-98c2-60e288414fcd could not be found. Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Request method failure captured: Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd HTTP/1.1 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILKkzADNqOHHt224tLhPY3iHbnE68lRZSjGBwWJwBC_QLpb4i6pnFMe7gTm8TGBlhY6iKyuZliEo0jpQOdV8tqwo22mnfP5erOWuw_O766hMHTz0qifZlKyqQchEQmo249hyw9RQOSRrf4IiURZxTyWq8Uxvz5sFGPxFsf9OhFHcW0E Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 09df4a6e599746d985beba2d61454ab6 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-InstanceActionsTestJSON-896142358 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/09df4a6e599746d985beba2d61454ab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_09df4a6e599746d985beba2d61454ab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/09df4a6e599746d985beba2d61454ab6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/09df4a6e599746d985beba2d61454ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-InstanceActionsTestJSON-896142358 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 09df4a6e599746d985beba2d61454ab6 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-InstanceActionsTestJSON-896142358 Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-InstanceActionsTestJSON-896142358-project Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 8fbf448f09434faea9e8afb24d45412a Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-InstanceActionsTestJSON-896142358-project Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance c9d8dd57-db9f-4112-98c2-60e288414fcd could not be found. Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'c9d8dd57-db9f-4112-98c2-60e288414fcd'} Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d8dd57-db9f-4112-98c2-60e288414fcd could not be found. Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d8dd57-db9f-4112-98c2-60e288414fcd could not be found. Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:42.704478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d8dd57-db9f-4112-98c2-60e288414fcd could not be found. Sep 13 16:41:42.712687 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:42.716781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] Returning 404 to user: Instance c9d8dd57-db9f-4112-98c2-60e288414fcd could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:42.717957 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6a63e89-6523-4303-886d-a24fb50bd030 tempest-InstanceActionsTestJSON-896142358 tempest-InstanceActionsTestJSON-896142358-project] 10.222.0.61 "GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd" status: 404 len: 111 microversion: 2.1 time: 0.140126 Sep 13 16:41:42.719426 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1493/2926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:42 2022] GET /compute/v2.1/servers/c9d8dd57-db9f-4112-98c2-60e288414fcd => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:42.726173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9dc7c77d-0403-47b5-9e70-588ee08b8acc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb48aad30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:42.810695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9dc7c77d-0403-47b5-9e70-588ee08b8acc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.090075 Sep 13 16:41:42.816071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1494/2927] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:42 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:42.831273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:42.831900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:42.852048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.856348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.857022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.858649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:42.860263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:42.864179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:42.935578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:42.951826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:42.957297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:42.959656 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ae9e39c-c294-486d-9e1a-9cc429abe91e tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.609906 Sep 13 16:41:42.962619 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1434/2928] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:42 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:42.978045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d592fd17-1508-46fa-9be5-caea793b9d7a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:42.978946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d592fd17-1508-46fa-9be5-caea793b9d7a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:43.076059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d592fd17-1508-46fa-9be5-caea793b9d7a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:43.087340 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d592fd17-1508-46fa-9be5-caea793b9d7a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1218 microversion: 2.1 time: 0.123317 Sep 13 16:41:43.101862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1435/2929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:42 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:43.101862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:43.101862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:43.104998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.105688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.106320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.107646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.108418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.110568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.208524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:43.229303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:43.232147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:43.244001 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7188b115-4d8b-4d64-b157-aaa8eb50e772 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1553 microversion: 2.91 time: 0.424106 Sep 13 16:41:43.245374 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1495/2930] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:42 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1553 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:43.414066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:43.424102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1da25f84-84b0-4da7-bbf2-713689255541 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.334000 Sep 13 16:41:43.426024 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1436/2931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:43 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:43.599983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:43.600730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:43.608124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.608615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.609051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.610065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.610603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.611028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.798586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-814a012d-7a16-4f36-b5fa-3ebb0acd020e req-0bff332b-de1a-47a8-938a-678b7dacde0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cdb5ce-4613-4eef-82c8-ac221d8fcf65", "tag": "a711467a-e3c3-4157-bf8c-314e5acff2ae"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:43.815312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-814a012d-7a16-4f36-b5fa-3ebb0acd020e req-0bff332b-de1a-47a8-938a-678b7dacde0d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.816548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-814a012d-7a16-4f36-b5fa-3ebb0acd020e req-0bff332b-de1a-47a8-938a-678b7dacde0d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.817091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-814a012d-7a16-4f36-b5fa-3ebb0acd020e req-0bff332b-de1a-47a8-938a-678b7dacde0d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.834883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-814a012d-7a16-4f36-b5fa-3ebb0acd020e req-0bff332b-de1a-47a8-938a-678b7dacde0d service nova] Creating event network-changed:a711467a-e3c3-4157-bf8c-314e5acff2ae for instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 on n-h2-857467-1 Sep 13 16:41:43.836336 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e6cb0b0-87b8-4c45-a851-25d8d8319ac5 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1613 microversion: 2.1 time: 0.240081 Sep 13 16:41:43.840622 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-814a012d-7a16-4f36-b5fa-3ebb0acd020e req-0bff332b-de1a-47a8-938a-678b7dacde0d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046760 Sep 13 16:41:43.841946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1437/2932] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:41:43.846517 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1496/2933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:43 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1613 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:43.854785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbf908e3-3aa4-4cc7-b5d3-0644aea01394 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b78940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:43.860438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:43.861160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:43.867608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.868107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.868548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.869257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:43.869716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:43.870214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:43.904003 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] HTTP exception thrown: Cannot 'migrate' instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 while it is in vm_state suspended Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Request method failure captured: Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70/action HTTP/1.1 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 15 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILKVMQSpi6XiPKBy2mIX1YhK-3vY2MojKZOd9kmH_kwJLBUZyAu0Dvgjd_lP3WIQweXaQUHns8_59dN7lgwcNHrnJG_O09yFEf8zJI1qt_Ei8XB6WMI7Qd-RLDBfW3vuX7BV5ZkBRWryz9zFSWND4jjLrWYmaGsyCJlJwkAg8O7CCzk Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 417ea6f2a53d44949fca1d82aa08b868 Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: {"migrate": {}} Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'migrate' instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 while it is in vm_state suspended Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'dbfa6d0b-1050-45a3-8e55-d9d2eea71c70', 'body': {'migrate': {}}} Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 in vm_state suspended. Cannot resize while the instance is in this state. Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:41:43.905885 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 while it is in vm_state suspended Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 while it is in vm_state suspended Sep 13 16:41:43.909636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.913713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Returning 409 to user: Cannot 'migrate' instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 while it is in vm_state suspended {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:43.914741 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e91a3399-e4d5-4551-a9d4-0b67b9ebef6f tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70/action" status: 409 len: 148 microversion: 2.1 time: 0.058581 Sep 13 16:41:43.921214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1497/2934] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:43 2022] POST /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70/action => generated 148 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:41:43.937191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a666a37-c852-4b3a-bba7-ece9dbc60906 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:43.938530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbf908e3-3aa4-4cc7-b5d3-0644aea01394 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.095150 Sep 13 16:41:43.939753 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1438/2935] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:43 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a666a37-c852-4b3a-bba7-ece9dbc60906 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Request method failure captured: Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab/action HTTP/1.1 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 39 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILKVMQSpi6XiPKBy2mIX1YhK-3vY2MojKZOd9kmH_kwJLBUZyAu0Dvgjd_lP3WIQweXaQUHns8_59dN7lgwcNHrnJG_O09yFEf8zJI1qt_Ei8XB6WMI7Qd-RLDBfW3vuX7BV5ZkBRWryz9zFSWND4jjLrWYmaGsyCJlJwkAg8O7CCzk Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 417ea6f2a53d44949fca1d82aa08b868 Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: {"os-resetState": {"state": "invalid"}} Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'invalid' Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:41:43.953417 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a666a37-c852-4b3a-bba7-ece9dbc60906 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:43.958928 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a666a37-c852-4b3a-bba7-ece9dbc60906 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab/action" status: 400 len: 144 microversion: 2.1 time: 0.032831 Sep 13 16:41:43.963084 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1498/2936] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:43 2022] POST /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab/action => generated 144 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:41:43.965658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d54bd08f-32d2-4359-bcce-608599e7f752 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d54bd08f-32d2-4359-bcce-608599e7f752 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Request method failure captured: Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab/action HTTP/1.1 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 31 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILKVMQSpi6XiPKBy2mIX1YhK-3vY2MojKZOd9kmH_kwJLBUZyAu0Dvgjd_lP3WIQweXaQUHns8_59dN7lgwcNHrnJG_O09yFEf8zJI1qt_Ei8XB6WMI7Qd-RLDBfW3vuX7BV5ZkBRWryz9zFSWND4jjLrWYmaGsyCJlJwkAg8O7CCzk Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 417ea6f2a53d44949fca1d82aa08b868 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: {"os-resetState": {"state": 1}} Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab', 'body': {'os-resetState': {'state': 1}}} Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 1 Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 13 16:41:43.970872 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d54bd08f-32d2-4359-bcce-608599e7f752 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:43.975684 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d54bd08f-32d2-4359-bcce-608599e7f752 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab/action" status: 400 len: 120 microversion: 2.1 time: 0.010960 Sep 13 16:41:43.979100 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1439/2937] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:43 2022] POST /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:41:43.983572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b851ea9d-e5e9-4511-8811-8b6a0743c939 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:43.990001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b851ea9d-e5e9-4511-8811-8b6a0743c939 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Failed to fetch instance by id 999 {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:41:43.990705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b851ea9d-e5e9-4511-8811-8b6a0743c939 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b851ea9d-e5e9-4511-8811-8b6a0743c939 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Request method failure captured: Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 37 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILKVMQSpi6XiPKBy2mIX1YhK-3vY2MojKZOd9kmH_kwJLBUZyAu0Dvgjd_lP3WIQweXaQUHns8_59dN7lgwcNHrnJG_O09yFEf8zJI1qt_Ei8XB6WMI7Qd-RLDBfW3vuX7BV5ZkBRWryz9zFSWND4jjLrWYmaGsyCJlJwkAg8O7CCzk Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b34525d5a62845a1b6b68a53b6bdf221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b34525d5a62845a1b6b68a53b6bdf221 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-361286781 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 417ea6f2a53d44949fca1d82aa08b868 Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdminNegativeTestJSON-361286781-project-admin Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: {"os-resetState": {"state": "error"}} Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 999 could not be found. Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:43.998616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:44.002957 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:44.002957 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 13 16:41:44.002957 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:44.004379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b851ea9d-e5e9-4511-8811-8b6a0743c939 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:44.005776 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b851ea9d-e5e9-4511-8811-8b6a0743c939 tempest-ServersAdminNegativeTestJSON-361286781 tempest-ServersAdminNegativeTestJSON-361286781-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026345 Sep 13 16:41:44.006897 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1499/2938] 10.222.0.61 () {60 vars in 1179 bytes} [Tue Sep 13 16:41:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:41:44.013304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:44.014139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:44.017495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:44.018093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:44.029702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.030245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.030688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.031402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.031864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.032300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.033414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.033952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.034393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.035167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.035549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.036605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.071699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:44.179855 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e9afeea1-066e-423b-88e5-6d7cca63bd50 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 204 len: 0 microversion: 2.1 time: 0.168031 Sep 13 16:41:44.180467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1500/2939] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:44 2022] DELETE /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:44.193393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:44.194171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:44.201700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.202475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.203725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.204916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.205857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.206483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.262697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.273978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.276391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.276795 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47319876-2c4e-4cf9-90de-0eaa918376dd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.284950 Sep 13 16:41:44.277374 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1440/2940] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:43 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:44.282070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:44.282681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:44.289788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.290360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.290807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.291587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.292045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.292472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.323772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.338171 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a77d1dbd-ea9f-4580-8f4d-4c16fc84294e tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1270 microversion: 2.1 time: 0.153521 Sep 13 16:41:44.345989 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1501/2941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:44 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:44.365378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:44.367408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:44.388020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.391174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.391174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.392732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.395433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.397153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.487944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.501182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.503461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.510997 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4360b021-01e8-4ce5-86c0-d2445a30943e tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.163549 Sep 13 16:41:44.512931 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1502/2942] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:44 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:44.525097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:44.526693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:44.536949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:44.539971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.541506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.543628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.544866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:44.545637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:44.547045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:44.604193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.614860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ced800b8-4597-4808-921d-a3016a9c27c7 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1468 microversion: 2.1 time: 0.335847 Sep 13 16:41:44.626251 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1441/2943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:44 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:44.934672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:44.943742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25af910a-92eb-452e-846a-29ac92ded888 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.429360 Sep 13 16:41:44.953984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1503/2944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:44 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:44.960493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-faec7c9b-3d35-4182-96a5-39aec5f0e3dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b67d30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:45.024455 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-faec7c9b-3d35-4182-96a5-39aec5f0e3dc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.068905 Sep 13 16:41:45.036937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1442/2945] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:44 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:45.306472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:45.307442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:45.313506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.314002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.314451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.315162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.315853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.316051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.363481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:45.364546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:45.371705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.372535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.373234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.374216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.375305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.375966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.489225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.497928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29240edf-e68b-4e18-8e80-34e76ae4be4d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1276 microversion: 2.1 time: 0.137980 Sep 13 16:41:45.498722 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1443/2946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:45 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:45.544386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:45.545980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:45.556317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.557048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.557774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.559156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.559872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.560910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.665378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.673811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.675313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.681392 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d180288e-6b81-4d67-83ec-d135a4ad5b73 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.144122 Sep 13 16:41:45.681995 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1444/2947] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:45 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:45.693588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:45.694369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:45.700415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.701044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:45.702678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.703426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.703906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.704594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.705120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.705500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.713695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.715644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.717013 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0eb43b8a-1ee1-4a4c-821a-986330ee5fc4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.414507 Sep 13 16:41:45.717663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1504/2948] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:45 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:45.848047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:45.856369 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7fe78b62-5f5c-4880-8f91-59d9bdd53344 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1468 microversion: 2.1 time: 0.167625 Sep 13 16:41:45.856969 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1445/2949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:45 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1468 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:45.972840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:45.974003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:45.981294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.981804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.982297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:45.983098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:45.983564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:45.983997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.040677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-472ee3f4-9130-48a2-a8f0-c15ab6868f6e tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb966fe50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:46.087705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-472ee3f4-9130-48a2-a8f0-c15ab6868f6e tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.051521 Sep 13 16:41:46.088258 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1446/2950] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:46 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:46.367249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-290baccb-5928-4e5b-b755-255b5c5e7822 req-94947ca4-b5ac-46c3-ba8c-f14896c340cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "name": "network-vif-plugged", "status": "completed", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:46.371687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:46.380036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-290baccb-5928-4e5b-b755-255b5c5e7822 req-94947ca4-b5ac-46c3-ba8c-f14896c340cf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.380681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-290baccb-5928-4e5b-b755-255b5c5e7822 req-94947ca4-b5ac-46c3-ba8c-f14896c340cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.380841 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-726d3c97-27fd-46be-b490-cca2bc99c83a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.411798 Sep 13 16:41:46.381383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-290baccb-5928-4e5b-b755-255b5c5e7822 req-94947ca4-b5ac-46c3-ba8c-f14896c340cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.381720 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1505/2951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:45 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:46.408992 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-290baccb-5928-4e5b-b755-255b5c5e7822 req-94947ca4-b5ac-46c3-ba8c-f14896c340cf service nova] Creating event network-vif-plugged:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:41:46.415560 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-290baccb-5928-4e5b-b755-255b5c5e7822 req-94947ca4-b5ac-46c3-ba8c-f14896c340cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053265 Sep 13 16:41:46.416426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1447/2952] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:41:46.523184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:46.523899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:46.529990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.530681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.531116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.531980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.532439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.532867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.636096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:46.656482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:46.676565 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef378501-76f7-4a40-98b5-c13c4debe54f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1276 microversion: 2.1 time: 0.155815 Sep 13 16:41:46.694528 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1506/2953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:46 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:46.713317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:46.714064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:46.727694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.729334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.731511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.732372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.736091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.736767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.748634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:46.749283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:46.761263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.762629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.763365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.764903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.765793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.766852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.844419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:46.861471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:46.863615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:46.871042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7997af53-3f9d-4b93-b97f-966bf2cfcdcd tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.163818 Sep 13 16:41:46.871988 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1448/2954] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:46 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:46.886134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:46.887457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:46.894788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.896213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.897074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:46.898527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:46.899166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:46.900116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.151034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:47.164674 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f844dd53-bc78-4dca-8a26-b96b65c03596 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1468 microversion: 2.1 time: 0.280811 Sep 13 16:41:47.165622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1449/2955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:46 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1468 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:47.182061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-013f862b-ec5e-462c-8251-0317a4a6b05f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb966f040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:47.195556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:47.206138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:47.207578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:47.209740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-717fc7cf-5cdc-408a-9528-f163f99c4899 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.470390 Sep 13 16:41:47.218705 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1507/2956] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:46 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:47.253496 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-013f862b-ec5e-462c-8251-0317a4a6b05f tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.086116 Sep 13 16:41:47.254319 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1450/2957] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:47 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:47.370592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-468ce9f9-28a7-43d7-93a3-6e3816704cc5 req-6a76c219-ec85-4002-bbc1-1bc4d02cb9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfa6d0b-1050-45a3-8e55-d9d2eea71c70", "name": "network-vif-deleted", "tag": "fde9d5f9-bdf1-457c-96ef-84b536ee2052"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:47.384535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-468ce9f9-28a7-43d7-93a3-6e3816704cc5 req-6a76c219-ec85-4002-bbc1-1bc4d02cb9f9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.385422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-468ce9f9-28a7-43d7-93a3-6e3816704cc5 req-6a76c219-ec85-4002-bbc1-1bc4d02cb9f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.386127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-468ce9f9-28a7-43d7-93a3-6e3816704cc5 req-6a76c219-ec85-4002-bbc1-1bc4d02cb9f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.426119 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-468ce9f9-28a7-43d7-93a3-6e3816704cc5 req-6a76c219-ec85-4002-bbc1-1bc4d02cb9f9 service nova] Creating event network-vif-deleted:fde9d5f9-bdf1-457c-96ef-84b536ee2052 for instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 on n-h1-857467-1 Sep 13 16:41:47.426365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:47.434878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:47.440157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-468ce9f9-28a7-43d7-93a3-6e3816704cc5 req-6a76c219-ec85-4002-bbc1-1bc4d02cb9f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073761 Sep 13 16:41:47.443634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.444351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.444600 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1508/2958] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:47.444793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.445565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.446080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.446513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.707551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:47.709374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:47.716435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.717320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.718149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.719551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.720264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.720805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.841401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:47.856536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-372e4a5b-c963-439a-846a-459015eaa94b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.449651 Sep 13 16:41:47.858720 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1451/2959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:47 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:47.909257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:47.912420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:47.926317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.927657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.928177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:47.928954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:47.929530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:47.931929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.031460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.040481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebb7339b-78ea-4b24-a1b4-e89bf1c6460b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.338534 Sep 13 16:41:48.041269 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1509/2960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:47 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:48.058459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.066132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:48.070189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.071710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.077520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f74fefad-972f-43e7-8308-e080240ebfc9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.177219 Sep 13 16:41:48.078448 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1452/2961] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:47 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:48.191248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:48.191851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:48.198729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.199491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.200063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.200646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.201103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.201528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.217227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:48.241064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.241064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.241064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.242932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lazy-loading 'fault' on Instance uuid dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:48.248207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:48.255919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:48.273116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.274547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.275273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.277554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.278322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.278972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.303648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.313869 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41cfe555-ccc7-464d-883a-f1303c1dce0e tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 200 len: 1311 microversion: 2.1 time: 0.125965 Sep 13 16:41:48.314475 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1510/2962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:48 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:48.320001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c076c47e-44d3-47d8-9291-e60ba5c1de12 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4970ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:48.380917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c076c47e-44d3-47d8-9291-e60ba5c1de12 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.064593 Sep 13 16:41:48.382196 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1511/2963] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:48 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:48.542868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:48.545458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:48.558651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.559157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.559596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.560304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.561135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.561889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.596965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'flavor' on Instance uuid 52b35670-fff0-424c-ae44-5adf194bb6b2 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:48.682365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.704308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.716107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:48.717391 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c873258-0aaf-4685-9138-42b7c6cbac74 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.473002 Sep 13 16:41:48.720543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1453/2964] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:48 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:48.811863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-09eb25cf-7cdc-4822-8f88-face7cf5991c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/action" status: 200 len: 32 microversion: 2.1 time: 0.273097 Sep 13 16:41:48.813290 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1512/2965] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:48 2022] POST /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:41:48.824710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:48.825328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:48.831541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.831976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.832424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.833169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.833764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.834488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.888211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:48.888917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:48.912153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.915364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.915972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:48.916852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:48.917487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:48.918703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.131064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.141320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d870face-ebd1-432d-a38c-75ccf9d84201 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.320716 Sep 13 16:41:49.142335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1454/2966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:48 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:49.147806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.148866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:49.155737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.156514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.157168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.158122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.159067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.160381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.239022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.248882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2fefc1e7-b609-4f94-81c0-1fbc87faad07 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.367188 Sep 13 16:41:49.267769 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1513/2967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:48 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:49.274825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.275437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:49.287536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.288041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.288481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.291288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.294617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.295305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.343444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.352414 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca37647b-0d76-4cce-a17e-979d349a8717 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.208726 Sep 13 16:41:49.352999 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1455/2968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:49 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:49.357670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.358479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: dbfa6d0b-1050-45a3-8e55-d9d2eea71c70] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:49.366031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.369183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.369894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.370622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.371083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.371753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.387171 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] HTTP exception thrown: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 could not be found. Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Request method failure captured: Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 HTTP/1.1 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILKUhjI5zFZ_R7emQKb6o-sqEve388T59FW6JlQHpm-gsUIyfpoKL0Ecel3SeI6-X1_79MVbbg_fcXnlPAa_paDghZrBeID0owibp5LAvQL9yE5yfnLjM4tEJYsbA3giowJFQpnckF_c4lbjXpbZSzQIYC1L2xLSk0z3SqiTCMzTdC0 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7ff0f00f321e4f37a57e652100b85607 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1914902911 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1914902911 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7ff0f00f321e4f37a57e652100b85607 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1914902911 Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminNegativeTestJSON-1914902911-project Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 37df2c00d1ef41a6a5d0ec8da4ca275b Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1914902911-project Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 could not be found. Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'dbfa6d0b-1050-45a3-8e55-d9d2eea71c70'} Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 could not be found. Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 could not be found. Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:49.388986 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 could not be found. Sep 13 16:41:49.393559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:41:49.394628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Returning 404 to user: Instance dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:49.395179 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f7a07cc-9d15-43cb-bf02-46053101f7c3 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70" status: 404 len: 111 microversion: 2.1 time: 0.041251 Sep 13 16:41:49.396523 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1456/2969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:49 2022] GET /compute/v2.1/servers/dbfa6d0b-1050-45a3-8e55-d9d2eea71c70 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:49.403107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17c9de6a-cd27-4319-b23b-a087496faacc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb9819e50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.422059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.447967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.449566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.452060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-17c9de6a-cd27-4319-b23b-a087496faacc tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.054221 Sep 13 16:41:49.452653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1457/2970] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:49 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:49.455652 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c4d4b0f-17ca-42e5-bfc7-90a43fdeb318 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.186224 Sep 13 16:41:49.457862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1514/2971] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:49 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:49.460828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.461447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:49.469393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.470048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.470570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.471374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.471992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.472387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.501425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:41:49.590708 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64d274a2-b248-4105-b011-ae0adee191d4 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 204 len: 0 microversion: 2.1 time: 0.136379 Sep 13 16:41:49.591312 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1458/2972] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:41:49 2022] DELETE /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:49.599510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.600247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:49.606385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.606868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.607479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.608177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.608630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.609229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.745340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:49.746323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:49.752813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.753460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.754033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.754887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:49.755448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:49.756166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:49.780329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:49.797161 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-557c11ce-a3bd-462e-a70a-6ee66cb9ae19 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1476 microversion: 2.1 time: 0.201539 Sep 13 16:41:49.797771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1515/2973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:49 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:49.999158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.017085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.019542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.022182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e827e6bd-d115-4de4-a4e4-450d62cadc84 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.280846 Sep 13 16:41:50.026207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1459/2974] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:49 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:50.167818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:50.168672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:50.175345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.176147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.177278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.178194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.178857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.179301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.275778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:50.276743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:50.288879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.289733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.290288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.291086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.291953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.292614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.407753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.419290 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0eb6c543-3857-45ce-916e-8b14a720e691 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.258607 Sep 13 16:41:50.424743 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1516/2975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:50 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:50.432047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:50.432681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:50.439567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.440274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.443460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.444824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.446729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.447327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.477186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.503897 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24320d66-c863-47b8-87da-678efce8bbac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.231876 Sep 13 16:41:50.508269 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1460/2976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:50 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:50.524976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-481480a4-7c93-4f72-963c-cd09d636b89a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b67940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:50.592643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-481480a4-7c93-4f72-963c-cd09d636b89a tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.082288 Sep 13 16:41:50.593981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1461/2977] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:50 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:50.599820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:50.600622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:50.607635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.608367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.608967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.610722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.611319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.611756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.700037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.709462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.710978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.716018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d30bff3-5ca7-4ee5-bbc2-467963d58372 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1535 microversion: 2.91 time: 0.120519 Sep 13 16:41:50.716600 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1462/2978] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:50 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1535 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:50.728630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.738036 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2a80578-997a-4097-8123-364738541def tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.312178 Sep 13 16:41:50.738897 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1517/2979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:50 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:50.821062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:50.821694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:50.827848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.828351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.828796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.829512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.830022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.830461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.923807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a50a8455-ee8d-418d-9bde-95ec95856e67 req-b3fb645a-1d11-43fb-8587-9bdcc7f7a055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146ffc03-bef9-43c4-9209-479a2339b5ad", "tag": "91fd51cf-edd3-4001-8f99-0ad3fc8ef39b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:50.937335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a50a8455-ee8d-418d-9bde-95ec95856e67 req-b3fb645a-1d11-43fb-8587-9bdcc7f7a055 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:50.938166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a50a8455-ee8d-418d-9bde-95ec95856e67 req-b3fb645a-1d11-43fb-8587-9bdcc7f7a055 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:50.938874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a50a8455-ee8d-418d-9bde-95ec95856e67 req-b3fb645a-1d11-43fb-8587-9bdcc7f7a055 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:50.953707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a50a8455-ee8d-418d-9bde-95ec95856e67 req-b3fb645a-1d11-43fb-8587-9bdcc7f7a055 service nova] Creating event network-changed:91fd51cf-edd3-4001-8f99-0ad3fc8ef39b for instance 146ffc03-bef9-43c4-9209-479a2339b5ad on n-h2-857467-1 Sep 13 16:41:50.960074 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a50a8455-ee8d-418d-9bde-95ec95856e67 req-b3fb645a-1d11-43fb-8587-9bdcc7f7a055 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040263 Sep 13 16:41:50.961173 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1518/2980] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:41:50.971517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:50.980349 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0712b2b-5d1c-46e3-bde8-fa2aff32dc78 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1476 microversion: 2.1 time: 0.163372 Sep 13 16:41:50.986119 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1463/2981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:50 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:51.049121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:51.049915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:51.057650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.058190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.058816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.059542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.060054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.061013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.445357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.446776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:51.447495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:51.454833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.455411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.455932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.456723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.457272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.457770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.477216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.478679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.479880 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f20e509-5cd5-4f00-a2c0-d4e932e5e457 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.435217 Sep 13 16:41:51.485015 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1519/2982] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:51 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:51.530510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:51.531353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:51.538226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.538959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.539567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.540483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.541112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.541725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.629247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.638653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-97060e4f-9bda-4b29-947a-70407d7b36e9 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.198792 Sep 13 16:41:51.639243 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1464/2983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:51 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:51.643648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f18dbe4-a4b0-41fc-8ec2-1cd5a37fa4b6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb966fca0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:51.696667 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f18dbe4-a4b0-41fc-8ec2-1cd5a37fa4b6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.056322 Sep 13 16:41:51.697814 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1465/2984] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:51 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:51.745060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:51.745678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:51.752151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.752923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.753377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.756738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.757257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.757698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.832307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.841714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.843227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.848316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-30858785-9e8e-4382-9cc0-6f7a2c676b51 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1538 microversion: 2.91 time: 0.108045 Sep 13 16:41:51.848937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1466/2985] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:51 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1538 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:51.867507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:51.868104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:51.875255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.875984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.876681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.877785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.878336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.878858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.889738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:51.898726 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f056ed21-b0bb-4425-bef1-be2dad0fa82d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.371992 Sep 13 16:41:51.899626 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1520/2986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:51 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:51.904572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:51.914178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:51.921051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.921722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.922313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.923326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:51.923978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:51.924582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:51.990468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-857467-1". {{(pid=122328) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 16:41:52.035051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.045341 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c29c7e4e-e4ab-4ab4-8a8c-12a8efe182ee tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.195338 Sep 13 16:41:52.046408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1467/2987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:51 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:52.051470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:52.053307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:52.059726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.060513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.061208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.062265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.063451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.064215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.132035 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b38727fd-db4e-4046-99ed-9cfaf4a83954 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action" status: 202 len: 0 microversion: 2.91 time: 0.231038 Sep 13 16:41:52.132970 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1521/2988] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:41:51 2022] POST /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:41:52.141317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:52.142292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:52.151330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.152704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.153950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.154918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.155989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.156801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.196962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:52.384098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.401505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.424097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.425386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.427543 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f289cbb-95bc-4abb-8bfc-7fbe11d71b06 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1476 microversion: 2.1 time: 0.379499 Sep 13 16:41:52.428628 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1468/2989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:52 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:52.447817 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d6d1fcf-2228-409b-bebc-9db276d9d0a3 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1546 microversion: 2.91 time: 0.310643 Sep 13 16:41:52.462050 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1522/2990] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:52 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1546 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:41:52.508312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:52.508940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:52.519074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.519578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.520404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.527407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.530974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.534633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.665072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:52.665763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:52.677328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.678268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.684338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.685227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:52.685684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:52.687377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:52.909652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.920817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.928575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:52.934139 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3bf2bea-8d28-4cf4-afc9-250b36848988 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.432016 Sep 13 16:41:52.935020 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1469/2991] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:52 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:52.948515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-144242ba-c088-4e51-8424-8d2a87b98324 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b20700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:53.011416 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-144242ba-c088-4e51-8424-8d2a87b98324 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.074669 Sep 13 16:41:53.013674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1470/2992] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:52 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:53.019734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f58b6acc-8c38-44cf-9f01-98435ee42814 req-32525c86-5325-4db5-bddb-4e4b19106a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cdb5ce-4613-4eef-82c8-ac221d8fcf65", "name": "network-vif-plugged", "status": "completed", "tag": "a711467a-e3c3-4157-bf8c-314e5acff2ae"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:53.033085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f58b6acc-8c38-44cf-9f01-98435ee42814 req-32525c86-5325-4db5-bddb-4e4b19106a34 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.034411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f58b6acc-8c38-44cf-9f01-98435ee42814 req-32525c86-5325-4db5-bddb-4e4b19106a34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.035548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f58b6acc-8c38-44cf-9f01-98435ee42814 req-32525c86-5325-4db5-bddb-4e4b19106a34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.049199 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f58b6acc-8c38-44cf-9f01-98435ee42814 req-32525c86-5325-4db5-bddb-4e4b19106a34 service nova] Creating event network-vif-plugged:a711467a-e3c3-4157-bf8c-314e5acff2ae for instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 on n-h2-857467-1 Sep 13 16:41:53.055600 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f58b6acc-8c38-44cf-9f01-98435ee42814 req-32525c86-5325-4db5-bddb-4e4b19106a34 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040460 Sep 13 16:41:53.056802 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1471/2993] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:41:53.063431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:53.064360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:53.072688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.073497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.074842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.075905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.076580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.077215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.082689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:53.294907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.309124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-647efda2-0963-45c8-8103-7386b1768bed tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.250846 Sep 13 16:41:53.309723 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1472/2994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:53 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:53.315407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:53.316290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:53.325470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.326321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.326778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.327650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.328117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.328552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.334415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:53.477772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.492182 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-079b8de1-a72e-42e7-b5c1-c7902d7ad02c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.831933 Sep 13 16:41:53.493387 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1523/2995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:52 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:53.503373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:53.505638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:53.513902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.514656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.515270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.516158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.516784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.517380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.552123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.560576 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-16c1ad9f-d6be-4b67-b6af-5ef2513dfdcb tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.249151 Sep 13 16:41:53.561373 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1473/2996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:53 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:53.566633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:53.568488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:53.589012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.589610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.590084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.590819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.591270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.591705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.669576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.681506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.683113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.690429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29750d56-af93-42cf-b21e-0f331e49c91a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1488 microversion: 2.91 time: 0.127950 Sep 13 16:41:53.693885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1474/2997] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:53 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1488 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:53.847339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:53.856484 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8fbfe79-9fad-4566-b5f2-96e2b2caaa37 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1476 microversion: 2.1 time: 0.361744 Sep 13 16:41:53.857635 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1524/2998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:53 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:53.963650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:53.964275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:53.970848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.971400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.971865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.972618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:53.973810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:53.974276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:53.993060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c4d262d1-acb4-442f-94b6-c1fd248492fe req-5be3655f-762d-427c-b28f-ddde2d0c7753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab", "name": "network-vif-deleted", "tag": "a3b9c3c5-39ce-4bd9-8126-86dacff81584"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:54.002571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c4d262d1-acb4-442f-94b6-c1fd248492fe req-5be3655f-762d-427c-b28f-ddde2d0c7753 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.003054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c4d262d1-acb4-442f-94b6-c1fd248492fe req-5be3655f-762d-427c-b28f-ddde2d0c7753 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.003476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c4d262d1-acb4-442f-94b6-c1fd248492fe req-5be3655f-762d-427c-b28f-ddde2d0c7753 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.008844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:41:54.026483 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c4d262d1-acb4-442f-94b6-c1fd248492fe req-5be3655f-762d-427c-b28f-ddde2d0c7753 service nova] Creating event network-vif-deleted:a3b9c3c5-39ce-4bd9-8126-86dacff81584 for instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab on n-h2-857467-1 Sep 13 16:41:54.033729 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c4d262d1-acb4-442f-94b6-c1fd248492fe req-5be3655f-762d-427c-b28f-ddde2d0c7753 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045090 Sep 13 16:41:54.035433 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1525/2999] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:41:54.044211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2a38534-9136-4ea7-a00d-07f0e74095f6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb48ba430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:54.118424 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2a38534-9136-4ea7-a00d-07f0e74095f6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.080686 Sep 13 16:41:54.130591 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1526/3000] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:54 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:54.226219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:54.249701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:54.251636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:54.252946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cfef6bce-87e4-4ee1-b3a6-5466c4889dd7 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.293423 Sep 13 16:41:54.257918 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1475/3001] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:53 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:54.335773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:54.336566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:54.344066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.344644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.345171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.345955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.346437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.346954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.522112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:54.522959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:54.532042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.533162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.533413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.534329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.537359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.538220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.717884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:54.718712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:54.738382 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c92a665-072a-41fb-bcb6-6955ffb5c18f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.223132 Sep 13 16:41:54.742796 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d5030f5-553e-4690-a513-815f3da3ddaa tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 0.411174 Sep 13 16:41:54.753247 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1476/3002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:54 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:54.753717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1527/3003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:54 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:54.770288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:54.771095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:54.772059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:54.772550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:54.785891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.787227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.787964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.790574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.791297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.791621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.792135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.792578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.792815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:54.793742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:54.794569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:54.797751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.031310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.035639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.042183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.043511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.048540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-819903c5-045d-47e1-b86e-05a1273674f6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.293815 Sep 13 16:41:55.049349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1477/3004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:54 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:55.055632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:55.057173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:55.070700 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c62bd49-435f-41a5-aa6d-20ee49ee559f tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.315631 Sep 13 16:41:55.071309 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1528/3005] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:54 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:55.072186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.072874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.073500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.074686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.075305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.075884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.136895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba94d008-7363-4a13-a91a-55657648d7bd tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb47da3a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:55.162894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.174009 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34f8e881-ebf5-45e0-9c94-8acdbfbf2d84 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1434 microversion: 2.1 time: 0.123394 Sep 13 16:41:55.175026 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1478/3006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:55 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1434 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:55.200193 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba94d008-7363-4a13-a91a-55657648d7bd tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.067420 Sep 13 16:41:55.201065 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1529/3007] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:55 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:55.280593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:55.281708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:55.291980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.294929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.295433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.296301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.296835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.297332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.577455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.594137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.596839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:55.599900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc623a10-3fdd-4f46-a51a-0c72c24a5701 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.323334 Sep 13 16:41:55.601709 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1479/3008] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:55 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:55.773056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:55.775129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:55.782426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:55.783403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:55.792411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.793020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.793680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.794539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.795361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.796576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.822741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.823603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.828268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:55.829971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:55.832842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:55.836020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.058928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.109912 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ba28c3d-af91-4325-b868-12072091a80c tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.347904 Sep 13 16:41:56.128046 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1530/3009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:55 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:56.137308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:56.150393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:56.167413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.168167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.168763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.169653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.170348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.170937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.371362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.381727 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-91dfaffa-c8c7-4328-9609-1f67e4b9fd2f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.252476 Sep 13 16:41:56.400826 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1531/3010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:56 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:56.409617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:56.410566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:56.421294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.421799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.422450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.423337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.423970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.424571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.534848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.543374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.544827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.552678 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-049bb4d4-c54d-411c-b13b-ac4789460346 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.149911 Sep 13 16:41:56.553780 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1532/3011] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:56 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:56.558487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:56.559099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:56.565910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.566392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.566828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.568241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.568714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.569137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.633528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.634082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.635349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.635571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lazy-loading 'fault' on Instance uuid 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:41:56.734863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37df2c00d1ef41a6a5d0ec8da4ca275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0f00f321e4f37a57e652100b85607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.746533 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67cb68ac-c6f2-46b4-8b85-1dfa854d68f8 tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 200 len: 1311 microversion: 2.1 time: 0.191576 Sep 13 16:41:56.750876 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1533/3012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:56 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:56.756072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8879ba45-87f6-4fac-b261-903532780937 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb47da550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:56.861460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:56.876694 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f8b9a26-71db-49c9-9c68-ea557be5cce9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1315 microversion: 2.1 time: 1.101499 Sep 13 16:41:56.882754 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1480/3013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:55 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:56.892729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:56.898685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:56.913683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.914549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.915281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:56.916215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:56.916784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:56.918298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.004413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8879ba45-87f6-4fac-b261-903532780937 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.252290 Sep 13 16:41:57.006203 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1534/3014] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:56 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:57.140531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:57.141316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:57.165071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.165807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.169130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.172820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.173646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.174410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.344620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.370778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.375351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.378876 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64d8f2db-f331-4d8b-91de-d6195cbedbba tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.492823 Sep 13 16:41:57.382839 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1481/3015] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:56 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:57.409633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:57.410730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:57.426693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.427386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.428088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.429044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.429733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.430585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.555310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.573497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4473b8b2-977c-4093-b829-605cd457c2de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1737 microversion: 2.1 time: 0.437553 Sep 13 16:41:57.577072 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1535/3016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:57 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1737 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:57.590986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:57.593975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:57.611295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.611799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.612648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.612938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.616334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.616788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.800191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.823686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.825896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.833307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba0a521a-d5e0-468d-afd1-72f1367aa553 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.254143 Sep 13 16:41:57.835180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1536/3017] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:57 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:57.843564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:57.844328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] [instance: 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:57.852201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.852905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.853650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.854793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.855414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.856653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.881054 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] HTTP exception thrown: Instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab could not be found. Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Request method failure captured: Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab HTTP/1.1 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILKUhjI5zFZ_R7emQKb6o-sqEve388T59FW6JlQHpm-gsUIyfpoKL0Ecel3SeI6-X1_79MVbbg_fcXnlPAa_paDghZrBeID0owibp5LAvQL9yE5yfnLjM4tEJYsbA3giowJFQpnckF_c4lbjXpbZSzQIYC1L2xLSk0z3SqiTCMzTdC0 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 7ff0f00f321e4f37a57e652100b85607 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1914902911 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ff0f00f321e4f37a57e652100b85607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1914902911 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 7ff0f00f321e4f37a57e652100b85607 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1914902911 Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdminNegativeTestJSON-1914902911-project Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 37df2c00d1ef41a6a5d0ec8da4ca275b Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1914902911-project Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab could not be found. Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab'} Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab could not be found. Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab could not be found. Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:57.885618 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab could not be found. Sep 13 16:41:57.893556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:41:57.898433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] Returning 404 to user: Instance 6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:41:57.899111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9450b963-f541-4b56-ac6a-11e8873c5b6d tempest-ServersAdminNegativeTestJSON-1914902911 tempest-ServersAdminNegativeTestJSON-1914902911-project] 10.222.0.61 "GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab" status: 404 len: 111 microversion: 2.1 time: 0.061681 Sep 13 16:41:57.900177 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1537/3018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:57 2022] GET /compute/v2.1/servers/6535d40c-6c50-4b1b-bddd-9dcba5e7e9ab => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:41:57.932683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:57.934128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:57.941783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:57.955101 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-257140d1-ef11-4798-9e4b-a5089eac9dc7 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.550191 Sep 13 16:41:57.955806 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1482/3019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:57 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:41:57.957729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.958305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.958752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:57.959489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:57.959943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:57.960372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:58.021281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a04e9be2-c514-4930-a799-2375a2f787db tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b243a0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:58.520178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:58.540425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45de575e-3faf-44d8-badb-2a22bc5415d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1503 microversion: 2.1 time: 0.635469 Sep 13 16:41:58.545884 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1538/3020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:41:57 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1503 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:41:58.563934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:41:58.564603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:58.579714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:58.580215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:58.580657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:58.581901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:58.581901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:58.582349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:59.080058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:59.096319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:59.097813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:41:59.103104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f75aacb6-eb34-4063-9a0c-0722db53766c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.556701 Sep 13 16:41:59.121197 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1539/3021] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:41:58 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:41:59.140288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:41:59.148009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:41:59.162060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:59.169079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:59.171337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:59.172342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:41:59.174199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:41:59.174850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:41:59.693067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'flavor' on Instance uuid e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:07.415501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:07.950343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=58 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:09.158218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=84 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:09.799816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:11.660037 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a04e9be2-c514-4930-a799-2375a2f787db tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 13.643015 Sep 13 16:42:11.670178 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1483/3022] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:41:58 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 13645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:11.674996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:11.675627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:11.695698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:11.696195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:11.696637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:11.697351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:11.697811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:11.698259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:11.882606 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0e44372-5487-458e-8195-41c7a8e11ed4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65/action" status: 202 len: 0 microversion: 2.1 time: 12.756358 Sep 13 16:42:11.884414 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1540/3023] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:41:59 2022] POST /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65/action => generated 0 bytes in 12763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:42:11.901806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:11.902797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:11.917797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:11.919623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:11.920723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:11.928378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:11.929002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:11.929538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:11.977960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:11.987036 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e181802-f204-4970-8d0b-d58f3e776f72 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1717 microversion: 2.1 time: 0.323850 Sep 13 16:42:11.999548 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1484/3024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:11 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1717 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:12.005048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:12.014396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:12.040659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.041235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.043795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.046399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.046948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.050138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.109535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.123438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.124995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.139087 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96c1c3e0-b191-4e71-9ed8-2e43f71510aa tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.252005 Sep 13 16:42:12.139667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1541/3025] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:11 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:12.161804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:12.164243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:12.171305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.172075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.172757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.173637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.174425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.175006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.322339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.340726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa041655-1329-4457-ba72-246dd3be3752 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.338562 Sep 13 16:42:12.352181 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1485/3026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:11 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:12.497572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.513552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.530200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:12.532084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e56f3161-abde-4084-b35f-385d9d76a630 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.382498 Sep 13 16:42:12.550929 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1542/3027] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:12 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:12.565480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d45ffd0a-a1b6-4eb2-8c56-fe81f8cd175f req-df43c135-aab3-475d-85e2-2ba99d9cea1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146ffc03-bef9-43c4-9209-479a2339b5ad", "name": "network-vif-plugged", "status": "completed", "tag": "91fd51cf-edd3-4001-8f99-0ad3fc8ef39b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:12.589990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d45ffd0a-a1b6-4eb2-8c56-fe81f8cd175f req-df43c135-aab3-475d-85e2-2ba99d9cea1b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.590727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d45ffd0a-a1b6-4eb2-8c56-fe81f8cd175f req-df43c135-aab3-475d-85e2-2ba99d9cea1b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.591438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d45ffd0a-a1b6-4eb2-8c56-fe81f8cd175f req-df43c135-aab3-475d-85e2-2ba99d9cea1b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.617334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d45ffd0a-a1b6-4eb2-8c56-fe81f8cd175f req-df43c135-aab3-475d-85e2-2ba99d9cea1b service nova] Creating event network-vif-plugged:91fd51cf-edd3-4001-8f99-0ad3fc8ef39b for instance 146ffc03-bef9-43c4-9209-479a2339b5ad on n-h2-857467-1 Sep 13 16:42:12.627818 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d45ffd0a-a1b6-4eb2-8c56-fe81f8cd175f req-df43c135-aab3-475d-85e2-2ba99d9cea1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074664 Sep 13 16:42:12.631253 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1543/3028] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:12.646505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:12.647397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:12.660559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.663256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.663782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.666665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:12.667142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:12.667566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:12.668754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1430541865", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:12.798622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] validate_networks() for [('36b08551-b5e8-4f23-b964-424d79f8e083', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:42:13.067508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:13.077215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8add23ee-10f0-4f1c-92c6-52d78178a0f5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.444482 Sep 13 16:42:13.082179 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1544/3029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:12 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:13.101681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:13.102600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:13.110367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.111253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.111925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.119284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.125236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.126052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.322861 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Cannot 'detach_volume' instance 52b35670-fff0-424c-ae44-5adf194bb6b2 while it is in vm_state rescued Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments/7cef5d09-22c8-4928-94ad-77b5fdfce98d HTTP/1.1 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'detach_volume' instance 52b35670-fff0-424c-ae44-5adf194bb6b2 while it is in vm_state rescued Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '52b35670-fff0-424c-ae44-5adf194bb6b2', 'id': '7cef5d09-22c8-4928-94ad-77b5fdfce98d'} Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 52b35670-fff0-424c-ae44-5adf194bb6b2 while it is in vm_state rescued Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:13.330063 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:13.335731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:13.335731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:13.335731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:13.335731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:13.335731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 52b35670-fff0-424c-ae44-5adf194bb6b2 while it is in vm_state rescued Sep 13 16:42:13.335731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:13.337328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 409 to user: Cannot 'detach_volume' instance 52b35670-fff0-424c-ae44-5adf194bb6b2 while it is in vm_state rescued {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:13.338427 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-113bac2c-1935-40fa-87c3-c2f4d0485501 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments/7cef5d09-22c8-4928-94ad-77b5fdfce98d" status: 409 len: 152 microversion: 2.1 time: 0.254161 Sep 13 16:42:13.343366 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1545/3030] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:42:13 2022] DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments/7cef5d09-22c8-4928-94ad-77b5fdfce98d => generated 152 bytes in 260 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:42:13.352564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-152d05f8-3552-4f68-a6fb-b7d3e2bf2cfb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb489a0d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:13.434497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-152d05f8-3552-4f68-a6fb-b7d3e2bf2cfb tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1427 microversion: 2.1 time: 0.089575 Sep 13 16:42:13.435503 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1546/3031] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:42:13 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:13.440856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:13.445544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:13.456467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.457155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.457515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.458789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.459426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.460176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.604991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:13.622153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:13.628601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:13.657515 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f35a5595-5043-4a92-ad04-587feb5f3240 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.218218 Sep 13 16:42:13.660349 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1547/3032] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:13 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:13.673814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:13.678442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:13.693138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.694046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.694499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.695699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.696329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.697104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.853811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-125c7398-ee4e-41e7-be55-ec4bd45fd4ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.191291 Sep 13 16:42:13.860492 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1548/3033] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:42:13 2022] POST /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:42:13.895414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:13.900160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:13.925455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.926631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.927135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.927881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.929539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.930479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.938031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:42:13.938867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:42:13.939527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:42:13.939958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:42:13.940383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:42:13.967378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.967888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.968341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:13.969092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:13.969562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:13.978806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:14.066285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Getting quotas for project 6c81314de0504e8cb7384614eeb71f53. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:14.076571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Getting quotas for user 5e1aa783d75740e787bfbb007cfabffb and project 6c81314de0504e8cb7384614eeb71f53. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:14.121345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:42:14.124085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:42:14.232758 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e12fc06-463d-4ea0-b37b-b03a434556ae tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889880 Sep 13 16:42:14.234187 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1486/3034] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:42:14.243416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:14.251957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:14.259688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:14.260575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:14.261414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:14.262426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:14.263432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:14.264104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:14.489951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:14.508265 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac9d3401-be0d-4c44-becf-84642399024a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1318 microversion: 2.1 time: 0.646165 Sep 13 16:42:14.522124 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1549/3035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:13 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:14.532426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:14.541012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:14.568936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:14.568936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:14.569250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:14.569975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:14.570451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:14.584812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:14.694203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:14.722039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:14.724357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:14.725820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed21d593-64d7-45fa-b066-0b34717a3d2d tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.490338 Sep 13 16:42:14.737859 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1487/3036] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:14 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:14.750919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:14.754892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:14.763347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:14.763883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:14.764293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:14.765048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:14.765490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:14.766100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.062413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.076393 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a2166af-8fb2-46ab-ba6a-67bbb49fec0d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.348094 Sep 13 16:42:15.077915 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1488/3037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:14 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:15.089719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3831132b-52b6-498c-9421-8943b02d2e63 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.090749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3831132b-52b6-498c-9421-8943b02d2e63 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:15.159391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3831132b-52b6-498c-9421-8943b02d2e63 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.170587 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3831132b-52b6-498c-9421-8943b02d2e63 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1224 microversion: 2.1 time: 0.091077 Sep 13 16:42:15.171730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1489/3038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:15.180635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6f9c084e-ccbb-4dce-9494-42878314fbea tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4b50ee0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.243970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6f9c084e-ccbb-4dce-9494-42878314fbea tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1436 microversion: 2.1 time: 0.070688 Sep 13 16:42:15.253335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1490/3039] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1436 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:15.258759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.259498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:15.285996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.287683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.292084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.294131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.294903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.295438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.325891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.335024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-15d7161e-8755-4629-9444-e58e30b6d7a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1725 microversion: 2.1 time: 0.807289 Sep 13 16:42:15.338587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1550/3040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:14 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1725 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:15.354152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94abce40-248e-4e8b-a096-0efbc59b2592 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb4808a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.412658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.428113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.430002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.435786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94abce40-248e-4e8b-a096-0efbc59b2592 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 200 len: 1436 microversion: 2.1 time: 0.093901 Sep 13 16:42:15.437040 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1551/3041] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 1436 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:15.438277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-331a98bc-7bdb-464d-98cc-2bad8f532462 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.190985 Sep 13 16:42:15.454267 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1491/3042] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:15.454479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.454479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:15.458098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.458864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.459505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.460436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.461108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.461748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.545296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.545961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:15.553442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.553975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.554424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.555131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.555680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.556092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.635963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.647025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd8933f3-9c18-4103-90ef-c8e2dd9541c5 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1478 microversion: 2.1 time: 0.200108 Sep 13 16:42:15.663235 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1552/3043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1478 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:15.761293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:15.762562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:15.792870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.794769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.795500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.803291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:15.804264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:15.804938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:15.845410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:15.857466 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c3bf902-29c5-49a0-ace0-e3edd9305b41 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1468 microversion: 2.1 time: 0.315705 Sep 13 16:42:15.875107 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1492/3044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:16.026457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-747247231", "block_migration": true, "disk_over_commit": false}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:16.029052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.037770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.038546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.039043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.039750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.040387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.040816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.084018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lazy-loading 'flavor' on Instance uuid 146ffc03-bef9-43c4-9209-479a2339b5ad {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:16.096953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Going to try to live migrate instance to tempest-host-747247231 {{(pid=122327) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 16:42:16.105235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] HTTP exception thrown: Compute host tempest-host-747247231 could not be found. Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Request method failure captured: Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad/action HTTP/1.1 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 106 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLEweaD0G3WQdPJkTMADdLPqbgNGEzJJkceSZoyJFXOvvM67urJJy_l7hCdYHBDoQ2a5mp2HKoo0a8PVKM379mC2hYAUBU0JbX3i1wnVIlnXNAgwT8-QvTqG1ZWY69renp1UTKZmyTEllcXy4FdrPJpdyWgK87tw1C8jKJNBB1jmWo Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6dd46b88a5d64060b67fe08938eba352 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-LiveMigrationNegativeTest-1394749925 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-LiveMigrationNegativeTest-1394749925 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6dd46b88a5d64060b67fe08938eba352 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1394749925 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-LiveMigrationNegativeTest-1394749925-project-admin Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: d4efbd086e7044b09d9b486b7b9e4807 Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-LiveMigrationNegativeTest-1394749925-project-admin Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: {"os-migrateLive": {"host": "tempest-host-747247231", "block_migration": true, "disk_over_commit": false}} Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: exception: Compute host tempest-host-747247231 could not be found. Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '146ffc03-bef9-43c4-9209-479a2339b5ad', 'body': {'os-migrateLive': {'host': 'tempest-host-747247231', 'block_migration': True, 'disk_over_commit': False}}} Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 13 16:42:16.116857 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-747247231 could not be found. Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-747247231 could not be found. Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-747247231 could not be found. Sep 13 16:42:16.121338 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:16.125209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Returning 400 to user: Compute host tempest-host-747247231 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:16.126117 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-de53301d-c595-4dc2-aa5e-ba540e0bb700 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad/action" status: 400 len: 99 microversion: 2.1 time: 0.244334 Sep 13 16:42:16.126718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1493/3045] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Sep 13 16:42:15 2022] POST /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad/action => generated 99 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:42:16.132744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.133369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.141229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.141725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.142343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.143113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.143737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.144338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.252902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.268810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.271648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.273717 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0fe6fac-3639-457f-8780-a430d3b1ff7c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.517014 Sep 13 16:42:16.278403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1553/3046] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:15 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:16.284117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.285048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.292538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.293242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.293947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.294993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.295655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.296895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.329648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.340224 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96857b0d-6094-4d41-9039-22b2e0b2f0c4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.212277 Sep 13 16:42:16.354698 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1494/3047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:16.362943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.363576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.372466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.373599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.374088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.374807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.375269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.375703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.454266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.463428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5acfc5a7-bd20-491a-8155-ba2a4c9fb8b9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1228 microversion: 2.1 time: 0.107595 Sep 13 16:42:16.464005 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1495/3048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1228 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:16.468640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.469786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.483071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.483487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.484112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.484997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.485629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.486251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.621014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.635072 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df76b70c-1aa6-4422-9714-1795b753ea2a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1468 microversion: 2.1 time: 0.355304 Sep 13 16:42:16.635686 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1554/3049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:16.648191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.651310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.663593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.667016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.667682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.668715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.669540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.670249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.788758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.801480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.804514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:16.816128 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-177c76d7-b027-4e3d-9566-7b05fce0da87 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.176426 Sep 13 16:42:16.819488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1555/3050] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:16.826264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:16.827226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:16.833987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.834736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.835352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:16.836255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:16.836883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:16.837465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.059848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:17.084772 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c7487d8-45c2-4ff3-b204-c6954eae1d26 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1725 microversion: 2.1 time: 0.612612 Sep 13 16:42:17.085331 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1496/3051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1725 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:17.090188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-263677971", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:17.151892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:42:17.219145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:17.230557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-045a2c02-0501-4241-815d-152054cccbe9 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1465 microversion: 2.1 time: 0.407985 Sep 13 16:42:17.231763 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1556/3052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:16 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1465 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:17.262022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5e394e4-7210-41a7-bca7-c0e07d795fe0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb489ac10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:17.433609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:42:17.434496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:42:17.434989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:42:17.435404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:42:17.436022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:42:17.446585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:17.447316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:17.447934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.448969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:17.449598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:17.450232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.471022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Getting quotas for project 86240d08d58941c58e5c44f5770aacf2. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:17.483997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Getting quotas for user 46eff935c2304c649e5b4c7cc7295f0f and project 86240d08d58941c58e5c44f5770aacf2. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:17.515126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:42:17.517492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:42:17.592755 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3cacb11d-214b-47c3-81cc-8b566e632ab6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506227 Sep 13 16:42:17.593685 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1497/3053] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:42:17.601020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:17.601845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:17.608863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:17.609631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:17.610356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.611255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:17.612061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:17.612659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:17.957913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:17.981700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:17.983771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:17.985486 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79192583-245d-4f90-aac6-1e6e277a8e4b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.390041 Sep 13 16:42:17.990356 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1498/3054] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:17 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:18.007105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:18.007748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:18.042786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.042786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.043033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.043564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.052914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.053412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.299644 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5e394e4-7210-41a7-bca7-c0e07d795fe0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "DELETE /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339" status: 204 len: 0 microversion: 2.1 time: 1.041648 Sep 13 16:42:18.301036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1557/3055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:17 2022] DELETE /compute/v2.1/images/2267cd62-988f-47df-aa86-f8c021f3b339 => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:42:18.319516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:18.321501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:18.353061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.355807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.356819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.357585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.361417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.363032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.486143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:18.497180 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f842cd26-5609-4354-937a-e0164ab4eb60 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.505129 Sep 13 16:42:18.498036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1499/3056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:17 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:18.526045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33a3bee3-52a6-44c9-ab46-bcca786e3b3c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:18.529294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33a3bee3-52a6-44c9-ab46-bcca786e3b3c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:18.627091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:18.640192 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-353aeef0-404d-4f42-885e-b3b5df638a06 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1276 microversion: 2.1 time: 0.337457 Sep 13 16:42:18.646892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33a3bee3-52a6-44c9-ab46-bcca786e3b3c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:18.657033 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33a3bee3-52a6-44c9-ab46-bcca786e3b3c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1218 microversion: 2.1 time: 0.157677 Sep 13 16:42:18.659325 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1558/3057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:18 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:18.660078 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1500/3058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:18 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:18.669186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:18.671336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:18.672659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:18.673301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:18.691646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.693060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.693759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.695196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.695572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.696098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.696555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.698517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.700774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.700951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:18.701517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:18.702007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:18.975033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:19.002570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d3e9af7-5979-4557-b0db-3bb193769d58 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1725 microversion: 2.1 time: 0.340955 Sep 13 16:42:19.025974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1501/3059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:18 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1725 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:19.031381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7df1c9c-5c11-416a-a6bf-1cbbde560ee8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '.version_select at 0x7fbeb96d7820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:19.068440 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d7df1c9c-5c11-416a-a6bf-1cbbde560ee8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] HTTP exception thrown: Image not found. Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7df1c9c-5c11-416a-a6bf-1cbbde560ee8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Request method failure captured: Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff HTTP/1.1 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILKF89UixwEbPWlo9ww_WZq37IXiV3kTM8_QUNeQTVJQC5rSfDqPaKG8jvOdydN7zpp9QIzkJcFGJhDgs7KyAMH0ZKflO5nz5oXoJk6jJu0eoZk5zgb5pgGWhmL9_z8_lsEgMYYLj7-thk9v24LIJLuJN_phh2Tf13BWmOuYjWeA2Nk Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1e9f5c731cfd4ebba006c7d818d26d5a Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1e9f5c731cfd4ebba006c7d818d26d5a Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerTestJSON-708410407-project Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 83ade3c22e244d4e899dafb768efdaa7 Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerTestJSON-708410407-project Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: exception: Image not found. Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'aa6c6ca2-b887-4afb-8dd7-73bd49420eff'} Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aa6c6ca2-b887-4afb-8dd7-73bd49420eff to delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa6c6ca2-b887-4afb-8dd7-73bd49420eff could not be found. Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.070613 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7df1c9c-5c11-416a-a6bf-1cbbde560ee8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Returning 404 to user: Image not found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:19.075031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d7df1c9c-5c11-416a-a6bf-1cbbde560ee8 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "DELETE /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff" status: 404 len: 62 microversion: 2.1 time: 0.044648 Sep 13 16:42:19.080860 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1502/3060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:19 2022] DELETE /compute/v2.1/images/aa6c6ca2-b887-4afb-8dd7-73bd49420eff => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:42:19.111476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:19.112110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:19.125992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.125992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.127190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.132496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:19.134248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.134901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.138964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.148931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:19.157023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:19.170671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9267975b-5ba2-47e0-90f6-a30030f94083 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.510103 Sep 13 16:42:19.197691 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1559/3061] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:18 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:19.207771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:19.209995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:19.227157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.227975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.230035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.232897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.234112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.234768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.246806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:19.314374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:19.548473 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e5c6aec-5228-484d-ab60-fb699d1fceb3 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 204 len: 0 microversion: 2.1 time: 0.346796 Sep 13 16:42:19.549986 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1560/3062] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:42:19 2022] DELETE /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:42:19.562085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:19.567949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:19.577295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.578490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.579074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:19.580580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:19.581786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:19.582441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.078770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.089087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.091186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.093217 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a9ed88b-66ca-490d-81c4-7ee8f9e1cd62 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 1.011145 Sep 13 16:42:20.095536 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1503/3063] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:19 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:20.104419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:20.106264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:20.130718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.132722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.136578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.137753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.138741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.139407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.147960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.169408 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f2e0573-283c-4785-b85c-fab51449d4dd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.617638 Sep 13 16:42:20.205370 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1561/3064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:19 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:20.218918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:20.220381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:20.247991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.249342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.249969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.250891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.254826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.255998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.413637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.425142 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d519c161-9877-4379-ad57-3b84f6e28913 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1282 microversion: 2.1 time: 0.218399 Sep 13 16:42:20.433300 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1562/3065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:20 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:20.448971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:20.453231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:20.459893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.476403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7be8ef67-889b-4bc6-a147-8bf797918e0b tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1471 microversion: 2.1 time: 0.377999 Sep 13 16:42:20.477390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.478154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.478793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.479727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.480259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.480683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.497494 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1504/3066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:20 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:20.507428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:20.508435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:20.518887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.519724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.520339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.523281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.523952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.524593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.566831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:20.626502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.648917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-363c48d4-5041-49c0-842b-b3dd208cf51d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1270 microversion: 2.1 time: 0.214169 Sep 13 16:42:20.652280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1563/3067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:20 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:20.662901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:20.663604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:20.684121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.684974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.689736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.690997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:20.692745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:20.692745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:20.891989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.905887 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93d0297c-c4c3-4bc3-b2b7-95e62d1d5709 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1725 microversion: 2.1 time: 0.407083 Sep 13 16:42:20.924722 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1505/3068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:20 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1725 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:20.945252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.960002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.962221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:20.974215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0b16247-cba5-47ee-b227-d4bddc97b5d9 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1544 microversion: 2.91 time: 0.320581 Sep 13 16:42:20.976100 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1564/3069] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:20 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1544 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:20.995927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6fe7312b-00ce-4f27-bf3f-d4f2964a720e req-a7cf75a9-88b2-4076-88d5-40341bcdfd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "name": "network-vif-unplugged", "status": "completed", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:21.020454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6fe7312b-00ce-4f27-bf3f-d4f2964a720e req-a7cf75a9-88b2-4076-88d5-40341bcdfd1e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.021232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6fe7312b-00ce-4f27-bf3f-d4f2964a720e req-a7cf75a9-88b2-4076-88d5-40341bcdfd1e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.021792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6fe7312b-00ce-4f27-bf3f-d4f2964a720e req-a7cf75a9-88b2-4076-88d5-40341bcdfd1e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.050173 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6fe7312b-00ce-4f27-bf3f-d4f2964a720e req-a7cf75a9-88b2-4076-88d5-40341bcdfd1e service nova] Creating event network-vif-unplugged:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:42:21.059450 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6fe7312b-00ce-4f27-bf3f-d4f2964a720e req-a7cf75a9-88b2-4076-88d5-40341bcdfd1e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067134 Sep 13 16:42:21.060905 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1506/3070] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:21.142521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:21.143139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:21.155778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.157132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.159024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.160017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.161068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.164773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.204840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:21.205559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:21.229891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.230586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.231040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.231776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.232243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.232678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.483617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.494586 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d972a483-9870-4482-890b-ab161083a9ea tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.293989 Sep 13 16:42:21.507639 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1507/3071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:21.519005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:21.519609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:21.526573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.527222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.527981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.528779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.529339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.529867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.552717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.562872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.564682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.566137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7b9e4d2-c9d8-402a-9b5c-e0b2038012f4 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.428450 Sep 13 16:42:21.566905 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1565/3072] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:21.571735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:21.572677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:21.579336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.580119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.580802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.581743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.582509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.583893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.720182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.730649 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-144441d4-d623-47bb-b704-dd5088b560dc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.221602 Sep 13 16:42:21.731799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1508/3073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:21.737543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:21.738367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:21.745997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.746695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.747319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.748210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.748834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.749431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.826831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.842679 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-534cee0e-2ba2-4e94-aeb6-80dfa729f8bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1270 microversion: 2.1 time: 0.109495 Sep 13 16:42:21.843520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1509/3074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:21.917954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:21.926969 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0cf85d5-15df-43de-8017-cae10357dcf6 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1471 microversion: 2.1 time: 0.358673 Sep 13 16:42:21.937348 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1566/3075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:21.963054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:21.963816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:21.977916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.979184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.979645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:21.981997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:21.983021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:21.983021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.023530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:22.024202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:22.043221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.043750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.044208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.044952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.045427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.045891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.201907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:22.212964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:22.226913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:22.232687 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9ea670b-e1e5-47d7-90bf-a0b5ac91baae tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1531 microversion: 2.91 time: 0.215811 Sep 13 16:42:22.245615 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1567/3076] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:22 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1531 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:42:22.265437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:22.266369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:22.292069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.294249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.294922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.295969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.308929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.309663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.595807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] Lazy-loading 'services' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:22.624289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c1d37983-6308-4bf8-bbf2-4eceb9f65f89 tempest-UnshelveToHostMultiNodesTest-197838774 tempest-UnshelveToHostMultiNodesTest-197838774-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1936 microversion: 2.91 time: 0.363201 Sep 13 16:42:22.625692 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1568/3077] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:22 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1936 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:22.632147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:22.632978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:22.642789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.643901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.644557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.647040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.647772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.649187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.801247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:22.819405 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-16957eb2-942a-4b99-9b6b-41c8d1b44148 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1725 microversion: 2.1 time: 0.862599 Sep 13 16:42:22.820906 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1510/3078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:21 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1725 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:22.826393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:22.834016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:22.853717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.854839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.855509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.859752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.860559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.861224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.929148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:22.940152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc7c4256-6c28-40f1-9158-0ba038c34642 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.312876 Sep 13 16:42:22.941011 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1569/3079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:22 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:22.947531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:22.948273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:22.963529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.966970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.968184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:22.971335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:22.972685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:22.976868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.032002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:23.152566 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ae54b99-cc0c-4dd5-a081-87f073a29822 tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "DELETE /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 204 len: 0 microversion: 2.91 time: 0.208872 Sep 13 16:42:23.153584 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1570/3080] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:42:22 2022] DELETE /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:42:23.166922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:23.167673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:23.185545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.186865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.190194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.192084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.194693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.195348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.538637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:23.556954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:23.558930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:23.560274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-459e45da-abef-4edf-aa10-5a35ba92e43b tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.738152 Sep 13 16:42:23.561353 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1511/3081] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:22 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:23.577071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:23.579067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:23.601394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.608913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.609623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.610553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.611168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.611774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.768122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:23.779108 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-78b427a7-11eb-4b50-b063-f9261b5e82d9 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.622583 Sep 13 16:42:23.781169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:23.783214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1571/3082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:23 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:23.789688 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea77b979-24b1-4bb9-8e1e-dcea63b09ab2 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1276 microversion: 2.1 time: 0.227006 Sep 13 16:42:23.793531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:23.798510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:23.806097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1512/3083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:23 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:23.814640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.815129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.818189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:23.819044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:23.820939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:23.821574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.025693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ade3c22e244d4e899dafb768efdaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f5c731cfd4ebba006c7d818d26d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:24.034122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-557bfc37-a331-49df-a886-dbe4ff1a4ce0 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 200 len: 1429 microversion: 2.1 time: 0.245436 Sep 13 16:42:24.034719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1572/3084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:23 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 1429 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:24.047234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:24.048636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:24.071435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.072294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.072943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.073905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.077173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.077761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.092150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:24.132959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2677fd40-7da6-4644-a6c7-63d448792bec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Action: 'create', calling method: .version_select at 0x7fbeb4b20dc0>, body: {"keypair": {"name": "tempest-keypair-733134686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB4AbMQFznBYNJdaZQmW91D53JCfMEaGFW9cV992hItC5ow1yc+dx7zVsu6lnWAW5xYFyHgMUoDLzy5tM+0D5UKnncwIqsMF31VSujjQYuDENfCB7TWZyfNZxSc4dr+4w=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:24.194580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2677fd40-7da6-4644-a6c7-63d448792bec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Getting quotas for project 50f324180b2c4db6b10898b623098bec. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:24.214352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2677fd40-7da6-4644-a6c7-63d448792bec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Getting quotas for user d9b7e0d5309849ab8a8ff78447780461 and project 50f324180b2c4db6b10898b623098bec. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:24.237962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:24.248967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:24.256442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:24.273915 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d4f877bc-921b-438d-958a-39da45ddcf2a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1537 microversion: 2.91 time: 0.238089 Sep 13 16:42:24.284961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:24.306140 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1573/3085] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:24 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1537 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:24.312346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2677fd40-7da6-4644-a6c7-63d448792bec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.501565 Sep 13 16:42:24.315373 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1513/3086] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:42:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:24.335710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:24.336243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-85ff62f5-4ec0-49a7-b281-590460bb3b87 req-ab50885f-ab8b-4067-98fb-f5bfdd8abc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679f4372-2a2c-4438-a29f-671d1b24a52c", "tag": "58c4ec53-8d75-43ea-892c-ebbca7211bc8"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:24.339164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:24.364385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85ff62f5-4ec0-49a7-b281-590460bb3b87 req-ab50885f-ab8b-4067-98fb-f5bfdd8abc9d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.365974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85ff62f5-4ec0-49a7-b281-590460bb3b87 req-ab50885f-ab8b-4067-98fb-f5bfdd8abc9d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.373537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85ff62f5-4ec0-49a7-b281-590460bb3b87 req-ab50885f-ab8b-4067-98fb-f5bfdd8abc9d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.378816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.383145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.384095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.388464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.390055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.391738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.421743 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-85ff62f5-4ec0-49a7-b281-590460bb3b87 req-ab50885f-ab8b-4067-98fb-f5bfdd8abc9d service nova] Creating event network-changed:58c4ec53-8d75-43ea-892c-ebbca7211bc8 for instance 679f4372-2a2c-4438-a29f-671d1b24a52c on n-h1-857467-1 Sep 13 16:42:24.430601 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-85ff62f5-4ec0-49a7-b281-590460bb3b87 req-ab50885f-ab8b-4067-98fb-f5bfdd8abc9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120843 Sep 13 16:42:24.438787 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1574/3087] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:24.445975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b7801e7a-3819-4679-b679-f92110adfc21 req-2317d1f8-c65a-4765-b4a7-b70e8dcba290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "43111ac9-cc42-4b8e-b068-0c286448e068"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:24.470230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b7801e7a-3819-4679-b679-f92110adfc21 req-2317d1f8-c65a-4765-b4a7-b70e8dcba290 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.470721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b7801e7a-3819-4679-b679-f92110adfc21 req-2317d1f8-c65a-4765-b4a7-b70e8dcba290 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.471531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b7801e7a-3819-4679-b679-f92110adfc21 req-2317d1f8-c65a-4765-b4a7-b70e8dcba290 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.503143 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b7801e7a-3819-4679-b679-f92110adfc21 req-2317d1f8-c65a-4765-b4a7-b70e8dcba290 service nova] Creating event network-vif-plugged:43111ac9-cc42-4b8e-b068-0c286448e068 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:24.521218 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b7801e7a-3819-4679-b679-f92110adfc21 req-2317d1f8-c65a-4765-b4a7-b70e8dcba290 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078910 Sep 13 16:42:24.522576 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1575/3088] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:24.541918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9034dfc5-43ff-4b10-8cf3-689ef564a17d req-ee24903a-fe99-47c8-ae2b-3e6dd1c302f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d94486-f989-457f-be63-28c8698675c6", "name": "network-vif-deleted", "tag": "3724078a-b834-4220-9430-2d87013046e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:24.560763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9034dfc5-43ff-4b10-8cf3-689ef564a17d req-ee24903a-fe99-47c8-ae2b-3e6dd1c302f6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.561549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9034dfc5-43ff-4b10-8cf3-689ef564a17d req-ee24903a-fe99-47c8-ae2b-3e6dd1c302f6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.562233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9034dfc5-43ff-4b10-8cf3-689ef564a17d req-ee24903a-fe99-47c8-ae2b-3e6dd1c302f6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.626272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9034dfc5-43ff-4b10-8cf3-689ef564a17d req-ee24903a-fe99-47c8-ae2b-3e6dd1c302f6 service nova] Creating event network-vif-deleted:3724078a-b834-4220-9430-2d87013046e6 for instance f1d94486-f989-457f-be63-28c8698675c6 on n-h2-857467-1 Sep 13 16:42:24.635021 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9034dfc5-43ff-4b10-8cf3-689ef564a17d req-ee24903a-fe99-47c8-ae2b-3e6dd1c302f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110014 Sep 13 16:42:24.639085 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1576/3089] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:24.655791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:24.658963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:24.683485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.684660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.685807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:24.687306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:24.688867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:24.690503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.130577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:25.142413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1bde6f2-c6e6-4d0f-b7d5-0c9e856ba169 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.501652 Sep 13 16:42:25.153875 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1577/3090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:24 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:25.158642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:25.158642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:25.169176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.177979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.181638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.183540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.184041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.189463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.537364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:25.554683 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55f45d6e-ebb5-4e32-83d8-2edbb2201d11 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1731 microversion: 2.1 time: 1.237488 Sep 13 16:42:25.557623 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1514/3091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:24 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1731 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:25.581383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:25.582055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:25.593256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.594599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.598479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.605929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.606678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.607290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.638796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:25.670834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:25.684209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:25.688480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-946f8f6c-24b8-4b0d-a13e-1e14562cacd8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.539242 Sep 13 16:42:25.721871 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1578/3092] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:25 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:25.743281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:25.746673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:25.789703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:25.794666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.796705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.798743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.802980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:25.805234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:25.805968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:25.990744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.009584 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d3d2da56-54a0-4db9-95d8-c6ae38dffb61 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.448752 Sep 13 16:42:26.012695 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1515/3093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:25 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:26.022210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.026434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] [instance: f1d94486-f989-457f-be63-28c8698675c6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.043035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.064549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.067570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.068906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.070315 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c488f69-3cc1-4d47-9dfc-def42788cc6b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.356329 Sep 13 16:42:26.071234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.072097 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1579/3094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:25 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:26.073294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.075389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.103513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.105136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.125586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.126548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.127304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.129408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.132941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.134906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.140893 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] HTTP exception thrown: Instance f1d94486-f989-457f-be63-28c8698675c6 could not be found. Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Request method failure captured: Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 HTTP/1.1 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILKF89UixwEbPWlo9ww_WZq37IXiV3kTM8_QUNeQTVJQC5rSfDqPaKG8jvOdydN7zpp9QIzkJcFGJhDgs7KyAMH0ZKflO5nz5oXoJk6jJu0eoZk5zgb5pgGWhmL9_z8_lsEgMYYLj7-thk9v24LIJLuJN_phh2Tf13BWmOuYjWeA2Nk Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1e9f5c731cfd4ebba006c7d818d26d5a Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e9f5c731cfd4ebba006c7d818d26d5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1e9f5c731cfd4ebba006c7d818d26d5a Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-708410407 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ImagesOneServerTestJSON-708410407-project Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 83ade3c22e244d4e899dafb768efdaa7 Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ImagesOneServerTestJSON-708410407-project Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance f1d94486-f989-457f-be63-28c8698675c6 could not be found. Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f1d94486-f989-457f-be63-28c8698675c6'} Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d94486-f989-457f-be63-28c8698675c6 could not be found. Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d94486-f989-457f-be63-28c8698675c6 could not be found. Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:26.150204 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d94486-f989-457f-be63-28c8698675c6 could not be found. Sep 13 16:42:26.154156 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:26.164379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] Returning 404 to user: Instance f1d94486-f989-457f-be63-28c8698675c6 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:26.165266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e01e23f3-a6f1-41f2-9bc0-7dd566c92932 tempest-ImagesOneServerTestJSON-708410407 tempest-ImagesOneServerTestJSON-708410407-project] 10.222.0.61 "GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6" status: 404 len: 111 microversion: 2.1 time: 0.151103 Sep 13 16:42:26.166112 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1516/3095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/f1d94486-f989-457f-be63-28c8698675c6 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:42:26.189119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.191826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.236137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.242873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.246032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.246996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.251829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.253578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.287337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.296718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.297545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.301067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lazy-loading 'fault' on Instance uuid daee60f2-a042-4934-862b-f745cb47c4e3 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:26.375736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.388029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.390819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd5bc66cc7084c91b41feb66c1a8b442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdea39ffdbe456aad11cdf230aa139c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.397577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e6021eb-4ad0-4d73-b823-2810671e0f2b tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 200 len: 1542 microversion: 2.91 time: 0.322716 Sep 13 16:42:26.398686 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1580/3096] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 1542 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:26.404924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.406084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.415928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.416780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.417604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.418578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.419268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.421381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.685764 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c96c71f1-ee53-4518-90eb-eb286db844a1 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.511507 Sep 13 16:42:26.686944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1517/3097] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-interface => generated 285 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:26.691996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "d7a4126e-90a5-4a5b-80a4-1cb57c0445d8"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "3b88ed2f-d58e-4333-a77c-43db1fd0a0d2"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "816a7944-a34a-4fc7-b0b0-05133c00a7c5"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "8feb22e4-a248-4a18-a706-2ff409d8f154"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:26.713736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.716176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.717026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.760251 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Creating event network-vif-plugged:d7a4126e-90a5-4a5b-80a4-1cb57c0445d8 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:26.761732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Creating event network-vif-plugged:3b88ed2f-d58e-4333-a77c-43db1fd0a0d2 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:26.762496 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Creating event network-vif-plugged:816a7944-a34a-4fc7-b0b0-05133c00a7c5 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:26.763492 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] Creating event network-vif-plugged:8feb22e4-a248-4a18-a706-2ff409d8f154 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:26.771933 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bab3ce9b-b11c-42e1-91b5-9ff08f2f5da2 req-514b2e32-d49d-4ed3-944b-82c815eaebd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.083053 Sep 13 16:42:26.773280 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1518/3098] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:26.778293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:26.793620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:26.794258 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-919cfb1d-85c6-4622-836c-deac896b8c66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.393766 Sep 13 16:42:26.794405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:26.796476 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1581/3099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:26.820487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.821348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.821806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:26.822565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:26.823211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:26.823661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.039758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:27.040403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:27.050063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.050586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.051092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.062672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.063570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.064667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.462400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:27.494972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:27.506276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36ad770a-696a-4ae3-9200-8f5300380333 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.471903 Sep 13 16:42:27.506889 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1582/3100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:27 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:27.521898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:27.522742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:27.533160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.537699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.538437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:27.539496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:27.540128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:27.540920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.122148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.133580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.138786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.155530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-443dd953-8714-434d-923c-ca4be91d0273 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 1.364868 Sep 13 16:42:28.159023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1519/3101] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:26 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:28.184819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:28.186834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] [instance: daee60f2-a042-4934-862b-f745cb47c4e3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:28.198665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.199492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.200152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.201104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.201771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.202433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.214445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.225667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff76421e-a5f5-4998-aaf8-d0078e97fbc3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.713127 Sep 13 16:42:28.241520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1583/3102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:27 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:28.254502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] HTTP exception thrown: Instance daee60f2-a042-4934-862b-f745cb47c4e3 could not be found. Sep 13 16:42:28.255825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Request method failure captured: Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 HTTP/1.1 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIgfcBJ_qQtfCDMi86ZVdfcNuiXczwWoD-4TXCQ6V8rXsBi3EKqSoeMjkQ0drG1J-NXDct3p1daW3arPmzZpM1dznIzuv0J37IMrvW-UgJYY-UE4SxA-IlWqJgJTxkglRaoj18uHXg7u2L5AQxAaslr-pQl5nQ93A8VzaHapLvlE4Y Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.91 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1fdea39ffdbe456aad11cdf230aa139c Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-937200013 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1fdea39ffdbe456aad11cdf230aa139c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1fdea39ffdbe456aad11cdf230aa139c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1fdea39ffdbe456aad11cdf230aa139c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1fdea39ffdbe456aad11cdf230aa139c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-937200013 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1fdea39ffdbe456aad11cdf230aa139c Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-937200013 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-UnshelveToHostMultiNodesTest-937200013-project Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: dd5bc66cc7084c91b41feb66c1a8b442 Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-937200013-project Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance daee60f2-a042-4934-862b-f745cb47c4e3 could not be found. Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'daee60f2-a042-4934-862b-f745cb47c4e3'} Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daee60f2-a042-4934-862b-f745cb47c4e3 could not be found. Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daee60f2-a042-4934-862b-f745cb47c4e3 could not be found. Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:28.257702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daee60f2-a042-4934-862b-f745cb47c4e3 could not be found. Sep 13 16:42:28.262231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:28.264300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:28.265696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] Returning 404 to user: Instance daee60f2-a042-4934-862b-f745cb47c4e3 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:28.267868 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55167e30-4621-4600-9856-23fedcf7941a tempest-UnshelveToHostMultiNodesTest-937200013 tempest-UnshelveToHostMultiNodesTest-937200013-project] 10.222.0.61 "GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3" status: 404 len: 111 microversion: 2.91 time: 0.107213 Sep 13 16:42:28.271810 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1520/3103] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:28 2022] GET /compute/v2.1/servers/daee60f2-a042-4934-862b-f745cb47c4e3 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:42:28.278855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.279452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.280208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.281625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.282255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.282816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.533630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:28.534621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:28.549113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.549873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.550541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.551496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:28.552430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:28.553290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:28.581156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:28.606098 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f3370ec-64c7-41da-ad71-33bb484fd858 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1509 microversion: 2.1 time: 0.358869 Sep 13 16:42:28.614413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1584/3104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:28 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:28.766357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1902038967", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "4c66442d-d451-4eb5-af1f-230379be5cc5"}], "security_groups": [{"name": "tempest-securitygroup--1824385938"}], "key_name": "tempest-keypair-733134686", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:28.931445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] validate_networks() for [('4c66442d-d451-4eb5-af1f-230379be5cc5', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:42:28.996702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:29.005665 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66f31438-eed8-4da1-82a5-57133f0042f4 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.476476 Sep 13 16:42:29.010633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1521/3105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:28 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:29.015642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-cd375abe-6192-40ed-9561-ba308f7bfe96 req-e6831a07-05ae-4c40-97f2-d59a58298376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcaad14f-d08b-4b08-9502-459afe45e6d9", "tag": "4e895fd6-7bf9-4331-8723-d542b3109c88"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:29.045764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-cd375abe-6192-40ed-9561-ba308f7bfe96 req-e6831a07-05ae-4c40-97f2-d59a58298376 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.046812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-cd375abe-6192-40ed-9561-ba308f7bfe96 req-e6831a07-05ae-4c40-97f2-d59a58298376 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.048374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-cd375abe-6192-40ed-9561-ba308f7bfe96 req-e6831a07-05ae-4c40-97f2-d59a58298376 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.077993 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-cd375abe-6192-40ed-9561-ba308f7bfe96 req-e6831a07-05ae-4c40-97f2-d59a58298376 service nova] Creating event network-changed:4e895fd6-7bf9-4331-8723-d542b3109c88 for instance bcaad14f-d08b-4b08-9502-459afe45e6d9 on n-h2-857467-1 Sep 13 16:42:29.086724 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-cd375abe-6192-40ed-9561-ba308f7bfe96 req-e6831a07-05ae-4c40-97f2-d59a58298376 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074748 Sep 13 16:42:29.087363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1522/3106] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:29.103147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "6199766c-27f4-49fb-92e6-fc117ebbbc52"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-plugged", "status": "completed", "tag": "a5a19eaf-0b13-4a24-ab8c-6cebeb712e50"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:29.123395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.124715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.125331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.142253 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] Creating event network-vif-plugged:6199766c-27f4-49fb-92e6-fc117ebbbc52 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:29.143739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] Creating event network-vif-plugged:a5a19eaf-0b13-4a24-ab8c-6cebeb712e50 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:29.150786 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ecac2a79-016e-4cfd-b920-1d17607d03ca req-3133a02f-9960-415e-9d96-65b34a1b2147 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057789 Sep 13 16:42:29.152242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1523/3107] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:29.186397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:29.187551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:29.197751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.198548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.199558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.201027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.201878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.202675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.630465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:29.658456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:29.663259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:29.665517 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90e99edd-e657-497b-ad42-442c2f291166 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.484046 Sep 13 16:42:29.677875 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1524/3108] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:29 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:29.687088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:29.687088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:29.690112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.690616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.691057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.698617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.700094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.700630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.872131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:42:29.872640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:42:29.873308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:42:29.873722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:42:29.874532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:42:29.893550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.894529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.896494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.899794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:29.901057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:29.902744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:29.942114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Getting quotas for project 50f324180b2c4db6b10898b623098bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:29.953956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Getting quotas for user d9b7e0d5309849ab8a8ff78447780461 and project 50f324180b2c4db6b10898b623098bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:29.972333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:42:29.975863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:42:30.069882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:30.080831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e7ec779-6128-40b2-92bd-848ec3557980 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.319210 Sep 13 16:42:30.082460 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b23b5a01-4ab6-4f74-88c2-e4830e8c99bd tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.410134 Sep 13 16:42:30.083881 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1525/3109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:29 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:30.092040 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1585/3110] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:42:30.093585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:30.094242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:30.109634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:30.112545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:30.113593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.114370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.115217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.116997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.118028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.118990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.133213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.135332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.138904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.141677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.144042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.144668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.414995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:30.425885 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c806c823-a936-403c-9da5-f0d591031f48 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1530 microversion: 2.1 time: 0.340611 Sep 13 16:42:30.430175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1526/3111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:30 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1530 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:30.442115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-609d97b0-2ea5-433f-837e-38842da16b7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:30.443780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-609d97b0-2ea5-433f-837e-38842da16b7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:30.531687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:30.564119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-609d97b0-2ea5-433f-837e-38842da16b7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:30.575769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-609d97b0-2ea5-433f-837e-38842da16b7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1241 microversion: 2.1 time: 0.144188 Sep 13 16:42:30.581459 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a15cf7aa-431f-475b-93b3-1877a8760c02 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.488117 Sep 13 16:42:30.598479 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1527/3112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:30 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:30.610669 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1586/3113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:30 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:30.697134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:30.697859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:30.713488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.718463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.721050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.722444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:30.742861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:30.747054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:30.803956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:31.106654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:31.107895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:31.121699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.124500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.125268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.126330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.128670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.130875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.485068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.493425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.498916 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6611be6-e2e3-44d6-9517-43adfeb9e8c6 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.396529 Sep 13 16:42:31.502486 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1587/3114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:31 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:31.516860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.520844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.523069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b35670-fff0-424c-ae44-5adf194bb6b2", "tag": "eb633aec-7996-4ba1-beff-b41c46875ab2"}, {"name": "network-changed", "server_uuid": "52b35670-fff0-424c-ae44-5adf194bb6b2", "tag": "eb633aec-7996-4ba1-beff-b41c46875ab2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:31.525638 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b603559-8e67-444c-bef3-ef75771a749a tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.834475 Sep 13 16:42:31.538567 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1528/3115] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:30 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:31.539647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.542396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.544884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.556509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:31.557169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:31.573560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.575434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] Creating event network-changed:eb633aec-7996-4ba1-beff-b41c46875ab2 for instance 52b35670-fff0-424c-ae44-5adf194bb6b2 on n-h1-857467-1 Sep 13 16:42:31.575960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] Creating event network-changed:eb633aec-7996-4ba1-beff-b41c46875ab2 for instance 52b35670-fff0-424c-ae44-5adf194bb6b2 on n-h1-857467-1 Sep 13 16:42:31.576663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.579178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.582432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.583207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.584366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.589575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-293f0d7c-4c85-4097-bcc6-80fb74685030 req-4af8f608-dbc1-4102-a101-86e9e124e6f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085568 Sep 13 16:42:31.592754 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1588/3116] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:31.606776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:31.607517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:31.621876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.622387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.623384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.624997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.625705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.626489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.766972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.783963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:31.790159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4508c0d-c9a0-4976-8cf3-4774bfaade78 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1245 microversion: 2.1 time: 0.192432 Sep 13 16:42:31.794236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e82fe56e-aa66-40ed-8fea-ccc8b9609e78 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1530 microversion: 2.1 time: 0.254192 Sep 13 16:42:31.795162 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1529/3117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:31 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1530 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:31.812519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:31.812779 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1589/3118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:31 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1245 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:31.816219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:31.826036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.826714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.827345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:31.829253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:31.830395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:31.830998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.070040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:32.079319 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8253ea4c-7551-43e7-87f6-a3b87ca15a53 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.281473 Sep 13 16:42:32.080430 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1530/3119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:31 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:32.525791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:32.527166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:32.536725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:32.538141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:32.539338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.540941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:32.543545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:32.544836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.571563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:32.573983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:32.588298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:32.591941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:32.592626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:32.593699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:32.595933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:32.597795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.251091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.266780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.274856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.278476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19a0af56-74d3-44cd-9cb4-3b324d7b85ef tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1880 microversion: 2.32 time: 0.716076 Sep 13 16:42:33.281553 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1531/3120] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:32 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1880 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:42:33.288538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:33.289189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:33.302587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.303230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.303871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.304855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.316530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.317361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.398130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.422151 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8434507a-a746-49da-a185-235e07fba5b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.902473 Sep 13 16:42:33.430684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1590/3121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:32 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:33.474711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:33.476169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:33.496095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.500769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.501283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.502050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.502520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.502952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.539259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.560540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a9049c2-b006-4596-aa73-0a616998628a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1293 microversion: 2.1 time: 0.277582 Sep 13 16:42:33.585227 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1532/3122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:33 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1293 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:33.598818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-dea49301-8be5-4a8a-9b4a-366b5b20c8dc req-fc2bad16-68f2-4d89-ae63-b84fc5b5da8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cdb5ce-4613-4eef-82c8-ac221d8fcf65", "name": "network-vif-plugged", "status": "completed", "tag": "a711467a-e3c3-4157-bf8c-314e5acff2ae"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:33.625239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dea49301-8be5-4a8a-9b4a-366b5b20c8dc req-fc2bad16-68f2-4d89-ae63-b84fc5b5da8e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.625722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dea49301-8be5-4a8a-9b4a-366b5b20c8dc req-fc2bad16-68f2-4d89-ae63-b84fc5b5da8e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.626244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dea49301-8be5-4a8a-9b4a-366b5b20c8dc req-fc2bad16-68f2-4d89-ae63-b84fc5b5da8e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.646409 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-dea49301-8be5-4a8a-9b4a-366b5b20c8dc req-fc2bad16-68f2-4d89-ae63-b84fc5b5da8e service nova] Creating event network-vif-plugged:a711467a-e3c3-4157-bf8c-314e5acff2ae for instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 on n-h2-857467-1 Sep 13 16:42:33.652946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-dea49301-8be5-4a8a-9b4a-366b5b20c8dc req-fc2bad16-68f2-4d89-ae63-b84fc5b5da8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064795 Sep 13 16:42:33.653875 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1533/3123] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:33.663562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:33.664325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:33.672630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.673243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.673691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.675264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:33.675874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:33.676460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:33.844666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:33.869066 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-46a99b95-539d-4e60-9316-ab4e9abca95c tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.211720 Sep 13 16:42:33.875429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1534/3124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:33 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:34.090445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:34.102299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c66ad0a2-b371-4a74-9a3c-5096449f4091 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1530 microversion: 2.1 time: 0.669272 Sep 13 16:42:34.102918 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1591/3125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:33 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1530 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:34.309150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.309776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.324283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.325043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.325648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.326548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.327172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.327979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.458904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.459961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.466733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.467579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.468144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.468957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.469603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.470145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.615367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:34.625998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:34.627823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:34.629372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3149209-1fb7-4248-b200-0bc6ac86e829 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2833 microversion: 2.32 time: 0.324353 Sep 13 16:42:34.630246 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1535/3126] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2833 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:42:34.635394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.636340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.643300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.644041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.644561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.645321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.646736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.647306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.720553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:34.731741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f2a7ed0-5c68-4509-9019-faf36497370b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1299 microversion: 2.1 time: 0.099455 Sep 13 16:42:34.735195 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1536/3127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:34.745269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.746043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.754055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.755816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.756601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.757786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.758463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.759131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.922428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe59b5c5-ac9f-41a3-9008-a87d83e64a40 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.185791 Sep 13 16:42:34.923036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1537/3128] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b/os-interface => generated 1831 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:42:34.929950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:34.930985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:34.943548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.943548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.943548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:34.943548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:34.943548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:34.943548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.117402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:35.129295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:35.134907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a06a7093-f9f5-4fa9-85ea-9fb6e01aeb00 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.685838 Sep 13 16:42:35.135921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1592/3129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:35.142844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:35.143794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:35.161474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:35.174703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:35.175174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.175954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:35.176433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:35.177411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.664029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:35.673313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f7b9231-8485-489a-b932-c2073fa524d0 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.749227 Sep 13 16:42:35.679917 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1538/3130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:34 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:35.760568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:35.767660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:35.788477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:35.788477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:35.788860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.789612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:35.792576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:35.793207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:35.881375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:35.895053 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80edfb28-e9be-4b67-bb41-e869877baea4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1530 microversion: 2.1 time: 0.757451 Sep 13 16:42:35.895747 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1593/3131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:35 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1530 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:35.931535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:35.948251 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12eff576-5267-462f-9399-a793c5eaf7b9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1299 microversion: 2.1 time: 0.196745 Sep 13 16:42:35.953241 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1539/3132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:35 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:36.164040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:36.164679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:36.182077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.183723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.184538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.185500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.186168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.187113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.673676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3fa4a152-6c80-4202-8dee-4721051aa128 req-a3414621-2f5d-4c83-a990-ef8995e5de0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679f4372-2a2c-4438-a29f-671d1b24a52c", "name": "network-vif-plugged", "status": "completed", "tag": "58c4ec53-8d75-43ea-892c-ebbca7211bc8"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:36.692185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3fa4a152-6c80-4202-8dee-4721051aa128 req-a3414621-2f5d-4c83-a990-ef8995e5de0c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.697518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3fa4a152-6c80-4202-8dee-4721051aa128 req-a3414621-2f5d-4c83-a990-ef8995e5de0c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.698223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3fa4a152-6c80-4202-8dee-4721051aa128 req-a3414621-2f5d-4c83-a990-ef8995e5de0c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.733128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3fa4a152-6c80-4202-8dee-4721051aa128 req-a3414621-2f5d-4c83-a990-ef8995e5de0c service nova] Creating event network-vif-plugged:58c4ec53-8d75-43ea-892c-ebbca7211bc8 for instance 679f4372-2a2c-4438-a29f-671d1b24a52c on n-h1-857467-1 Sep 13 16:42:36.744214 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3fa4a152-6c80-4202-8dee-4721051aa128 req-a3414621-2f5d-4c83-a990-ef8995e5de0c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074118 Sep 13 16:42:36.746843 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1540/3133] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:42:36.765265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:36.773903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:36.797908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.799033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.800124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:36.802484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:36.803513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:36.804153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:37.439708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:37.455397 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-91b8bb77-40c8-4b23-aa73-a19614766472 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 1.296578 Sep 13 16:42:37.471379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1594/3134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:36 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:37.487081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:37.487722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:37.507036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:37.509794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:37.510598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:37.512825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:37.519191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:37.519922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.000648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:38.016279 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-28fa2878-b5a2-4321-a149-3b310a34d550 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 1.265337 Sep 13 16:42:38.017496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1541/3135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:36 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:38.034363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:38.035189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:38.047464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.052382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.054403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.055514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.057591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.060778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.388392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:38.398548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:38.401366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb6d9483-eb2a-4e3c-bd87-605f9d91a5de tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1299 microversion: 2.1 time: 0.382452 Sep 13 16:42:38.402007 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1542/3136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:38 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1299 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:38.421028 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec5c58b8-2648-4107-ac2c-a32df6275f8c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.944147 Sep 13 16:42:38.423209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2bee907e-68e1-44e4-a6d0-002db0649d8f req-ad5472a9-3ce1-4ffb-880c-f37df210a3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "tag": "816a7944-a34a-4fc7-b0b0-05133c00a7c5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:38.437189 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1595/3137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:37 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:38.439268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2bee907e-68e1-44e4-a6d0-002db0649d8f req-ad5472a9-3ce1-4ffb-880c-f37df210a3d3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.439921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2bee907e-68e1-44e4-a6d0-002db0649d8f req-ad5472a9-3ce1-4ffb-880c-f37df210a3d3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.441562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2bee907e-68e1-44e4-a6d0-002db0649d8f req-ad5472a9-3ce1-4ffb-880c-f37df210a3d3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.458619 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2bee907e-68e1-44e4-a6d0-002db0649d8f req-ad5472a9-3ce1-4ffb-880c-f37df210a3d3 service nova] Creating event network-changed:816a7944-a34a-4fc7-b0b0-05133c00a7c5 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:42:38.470564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2bee907e-68e1-44e4-a6d0-002db0649d8f req-ad5472a9-3ce1-4ffb-880c-f37df210a3d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054350 Sep 13 16:42:38.484173 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1543/3138] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:38.492148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:38.493650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:38.503965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.513340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.515321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:38.516158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:38.518176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:38.522375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.048299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.050917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.063029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:39.072506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ee0b07e-4cc1-48d6-b8dc-4f8ced67265f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.590472 Sep 13 16:42:39.079193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.080051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.081018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.082061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.082753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.083583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.110598 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1596/3139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:38 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:39.397724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:39.416794 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4899a3dc-a173-4bad-8c14-3b2a16350dcc tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1324 microversion: 2.1 time: 0.376413 Sep 13 16:42:39.417779 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1544/3140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:39 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:39.442385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.443062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.453492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.456995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.462079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.464345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:39.465234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:39.466431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.467306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.469155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.481139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.486261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.487554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.490816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:39.494440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:39.495549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:39.928882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:39.963570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:40.017942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:40.043298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7de34ce7-1133-457d-889a-0e0f756a0e0f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.579360 Sep 13 16:42:40.043961 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1545/3141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:39 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:40.061017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-09f8b1d3-16f8-4831-9667-6ca5d54d7f70 req-1bbfb70a-a104-4bb0-affb-e5d835dc4220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaad14f-d08b-4b08-9502-459afe45e6d9", "name": "network-vif-plugged", "status": "completed", "tag": "4e895fd6-7bf9-4331-8723-d542b3109c88"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:40.116140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-09f8b1d3-16f8-4831-9667-6ca5d54d7f70 req-1bbfb70a-a104-4bb0-affb-e5d835dc4220 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.133506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-09f8b1d3-16f8-4831-9667-6ca5d54d7f70 req-1bbfb70a-a104-4bb0-affb-e5d835dc4220 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.136105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-09f8b1d3-16f8-4831-9667-6ca5d54d7f70 req-1bbfb70a-a104-4bb0-affb-e5d835dc4220 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.158583 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-09f8b1d3-16f8-4831-9667-6ca5d54d7f70 req-1bbfb70a-a104-4bb0-affb-e5d835dc4220 service nova] Creating event network-vif-plugged:4e895fd6-7bf9-4331-8723-d542b3109c88 for instance bcaad14f-d08b-4b08-9502-459afe45e6d9 on n-h2-857467-1 Sep 13 16:42:40.185652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-09f8b1d3-16f8-4831-9667-6ca5d54d7f70 req-1bbfb70a-a104-4bb0-affb-e5d835dc4220 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140388 Sep 13 16:42:40.198419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1546/3142] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:40.217677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:40.222281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:40.246387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.247082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.247785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.249856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.257005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.259774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.575409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=22 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:40.717304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:40.733771 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93714098-67aa-4765-abe7-b9ea6dead35f tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 0.533256 Sep 13 16:42:40.753298 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1547/3143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:40 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:40.768941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:40.769941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:40.785113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.786110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.787313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.790220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:40.790952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:40.792940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:40.849980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:41.108558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:41.126923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-542fc779-568a-4142-8f12-72b717747bf5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1519 microversion: 2.1 time: 0.372025 Sep 13 16:42:41.129904 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1548/3144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:40 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1519 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:41.144744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:41.146228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:41.180822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:41.184353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:41.185464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:41.187509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:41.190524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:41.194760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:41.592949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:41.607641 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2362fae0-37a5-41e2-a2e6-fc12983a88c3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 2.169292 Sep 13 16:42:41.610076 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1597/3145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:39 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:41.632712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-18e5d54e-3c0c-4b33-b9a1-fb050bcefab5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1581551659", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-18e5d54e-3c0c-4b33-b9a1-fb050bcefab5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 243 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1581551659", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1581551659', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '36b08551-b5e8-4f23-b964-424d79f8e083'}]}}} Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:41.645302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-18e5d54e-3c0c-4b33-b9a1-fb050bcefab5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:41.650556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-18e5d54e-3c0c-4b33-b9a1-fb050bcefab5 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.036193 Sep 13 16:42:41.651793 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1598/3146] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:41 2022] POST /compute/v2.1/servers => generated 175 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:42:41.669199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01d3a7fc-2d10-4655-80bd-f1838b240915 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:41.669796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-01d3a7fc-2d10-4655-80bd-f1838b240915 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 1decef13-d3fe-47fc-920c-fb5e631e24b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:41.684361 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-01d3a7fc-2d10-4655-80bd-f1838b240915 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] HTTP exception thrown: Instance 1decef13-d3fe-47fc-920c-fb5e631e24b5 could not be found. Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01d3a7fc-2d10-4655-80bd-f1838b240915 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1decef13-d3fe-47fc-920c-fb5e631e24b5/metadata HTTP/1.1 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1decef13-d3fe-47fc-920c-fb5e631e24b5 could not be found. Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '1decef13-d3fe-47fc-920c-fb5e631e24b5'} Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1decef13-d3fe-47fc-920c-fb5e631e24b5 could not be found. Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1decef13-d3fe-47fc-920c-fb5e631e24b5 could not be found. Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:41.691894 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1decef13-d3fe-47fc-920c-fb5e631e24b5 could not be found. Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01d3a7fc-2d10-4655-80bd-f1838b240915 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 404 to user: Instance 1decef13-d3fe-47fc-920c-fb5e631e24b5 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-01d3a7fc-2d10-4655-80bd-f1838b240915 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/1decef13-d3fe-47fc-920c-fb5e631e24b5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.033763 Sep 13 16:42:41.698469 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1599/3147] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:42:41 2022] GET /compute/v2.1/servers/1decef13-d3fe-47fc-920c-fb5e631e24b5/metadata => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:42:41.765431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:41.766798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:41.777756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:41.780191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:41.780832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:41.782708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:41.785109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:41.785761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:41.872881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:41.884589 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-954ab0cd-5d50-4352-a862-57e293cc6421 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.753497 Sep 13 16:42:41.893075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1549/3148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:41 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:41.911482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47602de7-893f-49f2-a20a-9a61a816528d tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-527870791", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47602de7-893f-49f2-a20a-9a61a816528d tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 498 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-527870791", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-527870791', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '36b08551-b5e8-4f23-b964-424d79f8e083'}]}}} Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:42:41.926318 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:41.929328 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:41.935149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47602de7-893f-49f2-a20a-9a61a816528d tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:41.937965 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47602de7-893f-49f2-a20a-9a61a816528d tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.042100 Sep 13 16:42:41.940890 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1550/3149] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:41 2022] POST /compute/v2.1/servers => generated 687 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:42:42.020195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5258914-4728-45a1-b15f-1c61b547e846 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1747811646", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5258914-4728-45a1-b15f-1c61b547e846 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 500 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1747811646", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1747811646', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '36b08551-b5e8-4f23-b964-424d79f8e083'}]}}} Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:42:42.027334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.031165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.060234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5258914-4728-45a1-b15f-1c61b547e846 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:42.063113 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5258914-4728-45a1-b15f-1c61b547e846 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.047921 Sep 13 16:42:42.068243 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1551/3150] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:42 2022] POST /compute/v2.1/servers => generated 689 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:42:42.154203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edda054b-9d60-4c25-8688-96cd4ef4ea76 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1358135774", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edda054b-9d60-4c25-8688-96cd4ef4ea76 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 754 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1358135774", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1358135774', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '36b08551-b5e8-4f23-b964-424d79f8e083'}]}}} Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:42:42.164240 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:42:42.167261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:42:42.169982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.169982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.172214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edda054b-9d60-4c25-8688-96cd4ef4ea76 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:42.177989 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-edda054b-9d60-4c25-8688-96cd4ef4ea76 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029598 Sep 13 16:42:42.180311 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1552/3151] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:42:42 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 13 16:42:42.267102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53665a50-1ee8-416e-94c8-ffd666f08b97 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-828934875", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53665a50-1ee8-416e-94c8-ffd666f08b97 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 1265 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-828934875", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "36b08551-b5e8-4f23-b964-424d79f8e083"}]}} Sep 13 16:42:42.277263 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-828934875', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '36b08551-b5e8-4f23-b964-424d79f8e083'}]}}} Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.279323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:42:42.280458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:42:42.282124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 13 16:42:42.282124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.282124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53665a50-1ee8-416e-94c8-ffd666f08b97 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:42.282124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-53665a50-1ee8-416e-94c8-ffd666f08b97 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019874 Sep 13 16:42:42.284326 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1553/3152] 10.222.0.61 () {60 vars in 1148 bytes} [Tue Sep 13 16:42:42 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 13 16:42:42.314911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b12d155c-8c71-4103-bacd-999466aa3443 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:42.316503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b12d155c-8c71-4103-bacd-999466aa3443 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 61427f7f-4d83-41fc-89b2-780cfee1b4dd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:42.349269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b12d155c-8c71-4103-bacd-999466aa3443 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] HTTP exception thrown: Instance 61427f7f-4d83-41fc-89b2-780cfee1b4dd could not be found. Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b12d155c-8c71-4103-bacd-999466aa3443 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/61427f7f-4d83-41fc-89b2-780cfee1b4dd/metadata/test2 HTTP/1.1 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 61427f7f-4d83-41fc-89b2-780cfee1b4dd could not be found. Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': '61427f7f-4d83-41fc-89b2-780cfee1b4dd', 'id': 'test2'} Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61427f7f-4d83-41fc-89b2-780cfee1b4dd could not be found. Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61427f7f-4d83-41fc-89b2-780cfee1b4dd could not be found. Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:42.352724 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:42.358046 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:42.358046 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:42.358046 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61427f7f-4d83-41fc-89b2-780cfee1b4dd could not be found. Sep 13 16:42:42.358046 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:42.363390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b12d155c-8c71-4103-bacd-999466aa3443 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 404 to user: Instance 61427f7f-4d83-41fc-89b2-780cfee1b4dd could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:42.365735 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b12d155c-8c71-4103-bacd-999466aa3443 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/61427f7f-4d83-41fc-89b2-780cfee1b4dd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.070985 Sep 13 16:42:42.367454 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1554/3153] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Sep 13 16:42:42 2022] GET /compute/v2.1/servers/61427f7f-4d83-41fc-89b2-780cfee1b4dd/metadata/test2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:42:42.397083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:42.399593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:42.426675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.428195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.428984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.437663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.438321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.438887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.534341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:42.749408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc88e131-f86a-4108-a934-3f6b7685f205 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "DELETE /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 204 len: 0 microversion: 2.1 time: 0.356873 Sep 13 16:42:42.750893 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1555/3154] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:42:42 2022] DELETE /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:42:42.761941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:42.763253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:42.776855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.778097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.778620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.779514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.780105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.781185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.820583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:42.845363 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1273a2b2-ba1d-432b-ab1d-e9f257177d9b tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1318 microversion: 2.1 time: 1.084361 Sep 13 16:42:42.846013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1600/3155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:41 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:42.867091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:42.874623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:42.886173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.886685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.887131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:42.899289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:42.901538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:42.902042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.546974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:43.559958 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3c7df7b-d5fa-46c9-b92c-83eb61cfcd7d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 0.806802 Sep 13 16:42:43.574586 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1556/3156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:42 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:43.597655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:43.598322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:43.633745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:43.633745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:43.633745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.634496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:43.634892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:43.635427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.780353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:43.794009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcb8b561-6bc2-4086-aa7d-d9287dc192ac tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1525 microversion: 2.1 time: 0.942677 Sep 13 16:42:43.812644 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1601/3157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:42 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1525 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:43.870648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:43.872298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:43.887153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:43.891842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:43.892634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.896411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:43.897422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:43.898239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:43.994516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:44.019022 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b7dae4a-d36d-4729-9792-c94e31fa1fe8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.443113 Sep 13 16:42:44.024232 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1557/3158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:43 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:44.387501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:44.398927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a602dee9-50a2-41ca-89c3-21d72706fe64 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1467 microversion: 2.1 time: 0.534126 Sep 13 16:42:44.418296 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1602/3159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:43 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1467 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:44.431881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:44.433214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:44.452388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:44.455925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:44.456640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:44.459416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:44.460792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:44.464172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:44.531226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lazy-loading 'flavor' on Instance uuid bcaad14f-d08b-4b08-9502-459afe45e6d9 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:44.807970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01fdcae2-35a1-46af-bcfd-e2d2c211e0ad tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.382069 Sep 13 16:42:44.809853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1558/3160] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:42:44 2022] POST /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:42:44.819746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:44.821023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:44.840300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:44.841254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:44.841969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:44.842995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:44.843698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:44.844359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:44.930982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f741571-c9f1-4a34-bdef-3745c4853e43 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Action: 'create', calling method: .version_select at 0x7fbeb48473a0>, body: {"keypair": {"name": "tempest-keypair-1775191631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbYPxuxUloRkeF+3C6dDvX3pkYX8p2MlFftim/8Su3crZiJRUtBAMy54FxjIxS5D1ed60afqVEjMB/VG5I/pxWUI31b7caU/oj08Iwnd52sJ7U3fLqTsYkMjJpv/mfEIA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:44.992590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0f741571-c9f1-4a34-bdef-3745c4853e43 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Getting quotas for project 335fc1c923214d4a940ea97bf6a17f55. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:42:45.036862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0f741571-c9f1-4a34-bdef-3745c4853e43 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Getting quotas for user 5bbeb18d6360416a9fce125f830755e7 and project 335fc1c923214d4a940ea97bf6a17f55. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:42:45.135766 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f741571-c9f1-4a34-bdef-3745c4853e43 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.664548 Sep 13 16:42:45.148907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1603/3161] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:42:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:45.162814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:45.163778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:45.183176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:45.184894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:45.187940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:45.188992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:45.190845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:45.193683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:45.851595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:45.862047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-777d92d0-3ffc-4071-927d-4007e35a467a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 1.050553 Sep 13 16:42:45.873616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1559/3162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:44 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:45.905468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:45.907074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:45.945055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:45.945983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:45.946604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:45.949345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:45.951372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:45.952131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:46.553064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:46.589082 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14fdbf20-1141-4dac-aa3c-435c232419df tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1525 microversion: 2.1 time: 0.706959 Sep 13 16:42:46.608602 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1560/3163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:45 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1525 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:46.632846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:46.636131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:46.655459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:46.658111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:46.658865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:46.660222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:46.662665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:46.663405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:46.955525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:46.972765 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35d2d014-db22-48e1-a01f-299b3578c6dc tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1475 microversion: 2.1 time: 1.822441 Sep 13 16:42:46.978964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1604/3164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:45 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1475 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:46.986960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4e58e164-136d-439f-af3b-2df7165df570 req-daff0fe7-4bec-46c6-93c7-03dd05d3ed92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d178d82-e4fa-4f21-a587-26c3e9c7d2bb", "tag": "57452ffb-c696-4d7a-a9a3-9714e404adb4"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:47.014767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4e58e164-136d-439f-af3b-2df7165df570 req-daff0fe7-4bec-46c6-93c7-03dd05d3ed92 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.023896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4e58e164-136d-439f-af3b-2df7165df570 req-daff0fe7-4bec-46c6-93c7-03dd05d3ed92 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.024711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4e58e164-136d-439f-af3b-2df7165df570 req-daff0fe7-4bec-46c6-93c7-03dd05d3ed92 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:47.079389 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4e58e164-136d-439f-af3b-2df7165df570 req-daff0fe7-4bec-46c6-93c7-03dd05d3ed92 service nova] Creating event network-changed:57452ffb-c696-4d7a-a9a3-9714e404adb4 for instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb on n-h2-857467-1 Sep 13 16:42:47.098597 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4e58e164-136d-439f-af3b-2df7165df570 req-daff0fe7-4bec-46c6-93c7-03dd05d3ed92 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118220 Sep 13 16:42:47.106732 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1605/3165] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:47.116203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:47.122854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:47.139494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.142457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.144444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:47.146753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.155076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.155917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:47.511234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:47.534760 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c3d6116-2b4c-4eeb-b18d-1144ccc2dff6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.919934 Sep 13 16:42:47.535368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1561/3166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:46 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:47.621729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:47.622449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:47.659901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.660809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.661643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:47.665055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:47.694088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:47.695057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:48.035878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:48.052676 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e51dee13-4530-41ec-9ced-84d35f6cabfe tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1525 microversion: 2.1 time: 0.435562 Sep 13 16:42:48.069855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1562/3167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:47 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1525 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:48.094170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:48.097218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:48.115174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:48.119437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:48.123389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:48.130387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:48.131330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:48.132776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:48.134653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:48.345363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:48.361700 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc6812bb-d171-48ba-a568-65dc031f6c4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 1.251271 Sep 13 16:42:48.363884 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1606/3168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:47 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:48.563400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:48.564341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:48.599799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:48.605587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:48.608106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:48.614177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:48.629209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:48.630076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.030859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:49.049377 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac0c5020-760f-40a3-b408-adfd9ad48ae1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.489329 Sep 13 16:42:49.053090 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1607/3169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:48 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:49.096047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:49.102825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:49.131328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.136394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.138453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.142056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.142904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.143692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.212135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.212928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.213537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.214190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lazy-loading 'fault' on Instance uuid 679f4372-2a2c-4438-a29f-671d1b24a52c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:49.321030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1aa783d75740e787bfbb007cfabffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c81314de0504e8cb7384614eeb71f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:49.335583 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dab2efcf-4aa6-4c1b-af26-9de3400aad4b tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 200 len: 1314 microversion: 2.1 time: 0.254802 Sep 13 16:42:49.359784 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1608/3170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:49 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:49.371462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b01b6f5a-f4e1-48ed-8a7c-9de5b480146d req-0141c852-96b0-47c1-bded-1fcf783c19e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679f4372-2a2c-4438-a29f-671d1b24a52c", "name": "network-vif-deleted", "tag": "58c4ec53-8d75-43ea-892c-ebbca7211bc8"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:49.393729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b01b6f5a-f4e1-48ed-8a7c-9de5b480146d req-0141c852-96b0-47c1-bded-1fcf783c19e0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.394251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b01b6f5a-f4e1-48ed-8a7c-9de5b480146d req-0141c852-96b0-47c1-bded-1fcf783c19e0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.394689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b01b6f5a-f4e1-48ed-8a7c-9de5b480146d req-0141c852-96b0-47c1-bded-1fcf783c19e0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.427562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b01b6f5a-f4e1-48ed-8a7c-9de5b480146d req-0141c852-96b0-47c1-bded-1fcf783c19e0 service nova] Creating event network-vif-deleted:58c4ec53-8d75-43ea-892c-ebbca7211bc8 for instance 679f4372-2a2c-4438-a29f-671d1b24a52c on n-h1-857467-1 Sep 13 16:42:49.440172 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b01b6f5a-f4e1-48ed-8a7c-9de5b480146d req-0141c852-96b0-47c1-bded-1fcf783c19e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078288 Sep 13 16:42:49.443476 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1609/3171] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:49.455532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:49.459492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:49.474790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.477234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.477715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.478529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.478988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.479430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.715799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:49.725843 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e331515-5873-4eca-b34d-cad91ab22f5d tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1458 microversion: 2.1 time: 1.644922 Sep 13 16:42:49.730133 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1563/3172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:48 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1458 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:49.758597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:49.759571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:49.775342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.776131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.777760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.778966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:49.782286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:49.782976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:49.953454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:49.969481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1843030-ce55-4882-8474-5b71ba6c7883 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 0.516951 Sep 13 16:42:49.970777 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1610/3173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:49 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:50.081612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:50.082757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:50.096810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.097767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.101436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.102631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.103312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.103955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.277151 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1277fdb7-65d3-4505-9b49-c5c08e40195f tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1609 microversion: 2.1 time: 0.524389 Sep 13 16:42:50.281134 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1564/3174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:49 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1609 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:50.303124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:50.308605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.312918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.313855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.314879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.315564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.316344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.376476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f642000f-382a-498a-bb52-9746c1c77a3e tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077536 Sep 13 16:42:50.377543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1565/3175] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 16:42:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:42:50.391596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:50.392240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] [instance: 679f4372-2a2c-4438-a29f-671d1b24a52c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:50.415809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.416349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.416979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.417878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.422556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.423236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.430821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:50.443904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2254712f-402e-4ba3-9b9e-82b5712c07ae tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.365204 Sep 13 16:42:50.452760 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] HTTP exception thrown: Instance 679f4372-2a2c-4438-a29f-671d1b24a52c could not be found. Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Request method failure captured: Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c HTTP/1.1 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILLYp7fwfZHfA5B3ST4XtXpO1eIgg4McoNwgKfFHH-BbjCjFV_YdfLX90bGUIzx_-YLD_ckHr0eQhtm_Ae5j2I1i4v-qMmDSpMgYfnLG8JkHF3rq0rEOknpjsWtOpCO-n-fIJgfL6VxYCpIB_8zwKeBxZxVRgPH7L1b5Sg0ZYpIeBUY Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c81314de0504e8cb7384614eeb71f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6c81314de0504e8cb7384614eeb71f53 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1020061190 Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 5e1aa783d75740e787bfbb007cfabffb Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1020061190-project Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 679f4372-2a2c-4438-a29f-671d1b24a52c could not be found. Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '679f4372-2a2c-4438-a29f-671d1b24a52c'} Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679f4372-2a2c-4438-a29f-671d1b24a52c could not be found. Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679f4372-2a2c-4438-a29f-671d1b24a52c could not be found. Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.455423 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679f4372-2a2c-4438-a29f-671d1b24a52c could not be found. Sep 13 16:42:50.460254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.463253 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1611/3176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:50 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:50.466645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] Returning 404 to user: Instance 679f4372-2a2c-4438-a29f-671d1b24a52c could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:50.469970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:50.471725 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92050fe4-77a4-4c4e-8054-03b781066425 tempest-ServerMetadataNegativeTestJSON-1020061190 tempest-ServerMetadataNegativeTestJSON-1020061190-project] 10.222.0.61 "GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c" status: 404 len: 111 microversion: 2.1 time: 0.092782 Sep 13 16:42:50.472573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:50.473370 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1566/3177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:50 2022] GET /compute/v2.1/servers/679f4372-2a2c-4438-a29f-671d1b24a52c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:42:50.492609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.493172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.493630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.494397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.494860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.497753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.607811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Lazy-loading 'flavor' on Instance uuid bcaad14f-d08b-4b08-9502-459afe45e6d9 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:50.628965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance bcaad14f-d08b-4b08-9502-459afe45e6d9 while it is in vm_state suspended Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Request method failure captured: Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9/action HTTP/1.1 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 97 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLEweaD0G3WQdPJkTMADdLPqbgNGEzJJkceSZoyJFXOvvM67urJJy_l7hCdYHBDoQ2a5mp2HKoo0a8PVKM379mC2hYAUBU0JbX3i1wnVIlnXNAgwT8-QvTqG1ZWY69renp1UTKZmyTEllcXy4FdrPJpdyWgK87tw1C8jKJNBB1jmWo Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6dd46b88a5d64060b67fe08938eba352 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-LiveMigrationNegativeTest-1394749925 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6dd46b88a5d64060b67fe08938eba352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-LiveMigrationNegativeTest-1394749925 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6dd46b88a5d64060b67fe08938eba352 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1394749925 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-LiveMigrationNegativeTest-1394749925-project-admin Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d4efbd086e7044b09d9b486b7b9e4807 Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-LiveMigrationNegativeTest-1394749925-project-admin Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: {"os-migrateLive": {"host": "n-h1-857467-1", "block_migration": true, "disk_over_commit": false}} Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'os-migrateLive' instance bcaad14f-d08b-4b08-9502-459afe45e6d9 while it is in vm_state suspended Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'bcaad14f-d08b-4b08-9502-459afe45e6d9', 'body': {'os-migrateLive': {'host': 'n-h1-857467-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:50.631547 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance bcaad14f-d08b-4b08-9502-459afe45e6d9 while it is in vm_state suspended Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance bcaad14f-d08b-4b08-9502-459afe45e6d9 while it is in vm_state suspended Sep 13 16:42:50.635906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:50.640170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance bcaad14f-d08b-4b08-9502-459afe45e6d9 while it is in vm_state suspended {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:50.641288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a697876a-90c7-4eb2-95b2-415ec558d158 tempest-LiveMigrationNegativeTest-1394749925 tempest-LiveMigrationNegativeTest-1394749925-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9/action" status: 409 len: 155 microversion: 2.1 time: 0.177970 Sep 13 16:42:50.642592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1612/3178] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:42:50 2022] POST /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9/action => generated 155 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:42:50.652388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:50.652988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:50.673082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.673691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.674243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.675068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:50.675616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:50.676123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:50.738053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:50.754661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:50.995535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:50.996159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:51.015277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a125b56-2e1e-434c-9c6a-e6b24fcc3a93 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 204 len: 0 microversion: 2.1 time: 0.360131 Sep 13 16:42:51.018339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.019256 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1567/3179] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:42:50 2022] DELETE /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:42:51.019673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.021800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.028590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.029388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.031560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.035893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:51.038443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:51.055405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.056248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.057328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.059534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.061784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.064823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.091570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:51.367739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:51.382030 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4920c8cd-60d5-41b4-8a93-b15bc8a83268 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 0.392969 Sep 13 16:42:51.387240 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1613/3180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:50 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:51.478849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:51.478849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:51.496030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:51.514693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.522765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.526927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.531054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:51.531568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:51.532045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:51.800323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:51.831695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bacab156-0cc7-419f-9ed9-45b6719ba201 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.360482 Sep 13 16:42:51.853111 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1614/3181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:51 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:52.183386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:52.192396 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d7bece7-13d9-44b8-b15b-a4b564ad17df tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1464 microversion: 2.1 time: 1.167903 Sep 13 16:42:52.221862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1568/3182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:51 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1464 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:52.414160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:52.414709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:52.435568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.439030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.439544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:52.444042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.447412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.447870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:52.875191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:52.878947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:52.923596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.925072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.925539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:52.935303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:52.938314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:52.938951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:53.455949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:53.474509 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e39c43ca-bee5-4bda-af11-7d5f815aac0c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.615228 Sep 13 16:42:53.476666 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1569/3183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:52 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:53.488900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:53.493907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:53.507771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:53.511465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:53.512128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:53.514307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:53.516144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:53.518313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:53.775496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:53.805814 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82fcc59b-6f4c-4270-ad0e-c470ca455954 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 1.393590 Sep 13 16:42:53.808221 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1615/3184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:52 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:54.503267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:54.505925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:54.511451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:54.527643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:54.528371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:54.528992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:54.531750 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e7a78b1-8942-4483-85ff-8ac6e8c8bd6c tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1464 microversion: 2.1 time: 1.052414 Sep 13 16:42:54.532344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:54.533271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:54.534183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:54.553444 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1570/3185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:53 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1464 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:54.842352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:54.847194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:54.871775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:54.872782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:54.873537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:54.874867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:54.884214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:54.885069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:55.093443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:42:55.410822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:55.420153 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0bcf42d3-4207-45fb-a045-e689c9905260 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.923722 Sep 13 16:42:55.428794 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1616/3186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:54 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:55.460729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-175a2dc1-a187-431d-9830-19e9d627eec6 req-9bb0d963-cc27-481d-b279-8b5eeab68a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaad14f-d08b-4b08-9502-459afe45e6d9", "name": "network-vif-deleted", "tag": "4e895fd6-7bf9-4331-8723-d542b3109c88"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:55.506418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-175a2dc1-a187-431d-9830-19e9d627eec6 req-9bb0d963-cc27-481d-b279-8b5eeab68a4a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:55.513487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-175a2dc1-a187-431d-9830-19e9d627eec6 req-9bb0d963-cc27-481d-b279-8b5eeab68a4a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:55.514676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-175a2dc1-a187-431d-9830-19e9d627eec6 req-9bb0d963-cc27-481d-b279-8b5eeab68a4a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:55.567823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:55.569479 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-175a2dc1-a187-431d-9830-19e9d627eec6 req-9bb0d963-cc27-481d-b279-8b5eeab68a4a service nova] Creating event network-vif-deleted:4e895fd6-7bf9-4331-8723-d542b3109c88 for instance bcaad14f-d08b-4b08-9502-459afe45e6d9 on n-h2-857467-1 Sep 13 16:42:55.579248 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-175a2dc1-a187-431d-9830-19e9d627eec6 req-9bb0d963-cc27-481d-b279-8b5eeab68a4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126967 Sep 13 16:42:55.582099 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1617/3187] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:55.603487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b63e4f03-4933-43f3-b367-c608e1b9dd61 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 0.773860 Sep 13 16:42:55.604364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:55.607387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:55.619951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:55.630463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:55.632244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:55.632244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:55.632680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:55.638473 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1571/3188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:54 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:55.642324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:55.801998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:55.802881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:55.803635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:55.804351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lazy-loading 'fault' on Instance uuid bcaad14f-d08b-4b08-9502-459afe45e6d9 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:42:56.211420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:56.222337 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8cf2d351-a9f0-4471-9c14-74871d5cb0cf tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 200 len: 1308 microversion: 2.1 time: 0.635967 Sep 13 16:42:56.227753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1618/3189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:55 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 1308 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:56.464907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:56.465880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:56.491809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:56.501580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:56.504263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:56.505599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:56.510023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:56.511580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:56.641582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:56.642241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:56.661697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:56.667574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:56.671666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:56.674481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:56.674986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:56.675438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.254325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:57.275276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90a0c8e4-9a0b-4334-9804-bf69bd18a4c5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 0.637343 Sep 13 16:42:57.308757 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1619/3190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:56 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:57.329408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:57.330077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: bcaad14f-d08b-4b08-9502-459afe45e6d9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:57.370003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.370522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.371150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.371818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.372336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.372783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.445260 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] HTTP exception thrown: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 could not be found. Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Request method failure captured: Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 HTTP/1.1 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLDVHWo6arbyeXAI03cV0Qlr08FMhbbGmpP62hO9xSo5Me1DwVcDRtP2W2tU8xfaJ3_lL6fn1uriaC8tOHyiyOzFn-D07vKCohUHHBFhsQtYdJ2dT6tnEgeaR1QbCmPXIbgP12ibDjtF2pR-Dl4J-8S2jUY5-Gedr5gX00UGV-a1xs Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 86240d08d58941c58e5c44f5770aacf2 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-LiveMigrationNegativeTest-266557032 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-LiveMigrationNegativeTest-266557032 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 86240d08d58941c58e5c44f5770aacf2 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-266557032 Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-LiveMigrationNegativeTest-266557032-project Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 46eff935c2304c649e5b4c7cc7295f0f Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-LiveMigrationNegativeTest-266557032-project Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 could not be found. Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'bcaad14f-d08b-4b08-9502-459afe45e6d9'} Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 could not be found. Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 could not be found. Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:42:57.447043 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 could not be found. Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Returning 404 to user: Instance bcaad14f-d08b-4b08-9502-459afe45e6d9 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e38ed5c7-8de5-48c9-a5e5-1d9c0bb373a3 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9" status: 404 len: 111 microversion: 2.1 time: 0.131995 Sep 13 16:42:57.452558 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1620/3191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:57 2022] GET /compute/v2.1/servers/bcaad14f-d08b-4b08-9502-459afe45e6d9 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:42:57.481097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:57.482737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:57.500507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.510422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.512983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.513814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.518047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.518451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.612087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:42:57.846349 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39fcdf12-2624-4413-b4e7-6a8b09610a3a tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "DELETE /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 204 len: 0 microversion: 2.1 time: 0.375543 Sep 13 16:42:57.852218 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1621/3192] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:42:57 2022] DELETE /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:42:57.868772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:57.873330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:57.887711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.890570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.893061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.894742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:57.897328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:57.898440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:57.912483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:57.926138 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93d7a48b-5fdf-4434-9736-88b79c0d2708 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 1.469541 Sep 13 16:42:57.926922 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1572/3193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:56 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:42:58.312297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:58.313428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:58.348255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.351035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.353615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.355766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.359915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.360816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.583012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:58.602752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f7e684a-6c20-42b1-ac4b-f004e16bd159 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1474 microversion: 2.1 time: 0.748376 Sep 13 16:42:58.615066 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1622/3194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:57 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1474 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:58.640013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3c4dbad3-9f87-4468-9cc1-54749a943363 req-6475715f-14de-4924-8ed3-a0346b5df20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d178d82-e4fa-4f21-a587-26c3e9c7d2bb", "name": "network-vif-plugged", "status": "completed", "tag": "57452ffb-c696-4d7a-a9a3-9714e404adb4"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:42:58.665688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c4dbad3-9f87-4468-9cc1-54749a943363 req-6475715f-14de-4924-8ed3-a0346b5df20b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:58.666632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c4dbad3-9f87-4468-9cc1-54749a943363 req-6475715f-14de-4924-8ed3-a0346b5df20b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:58.670523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c4dbad3-9f87-4468-9cc1-54749a943363 req-6475715f-14de-4924-8ed3-a0346b5df20b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:58.713046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3c4dbad3-9f87-4468-9cc1-54749a943363 req-6475715f-14de-4924-8ed3-a0346b5df20b service nova] Creating event network-vif-plugged:57452ffb-c696-4d7a-a9a3-9714e404adb4 for instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb on n-h2-857467-1 Sep 13 16:42:58.721706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:58.727294 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3c4dbad3-9f87-4468-9cc1-54749a943363 req-6475715f-14de-4924-8ed3-a0346b5df20b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103276 Sep 13 16:42:58.730794 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1623/3195] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:42:58.735967 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4399f8d4-c8e9-4040-845c-515e4408137b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 0.425862 Sep 13 16:42:58.737917 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1573/3196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:58 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:58.971499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:58.973357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:59.001101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.002978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.005546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.010880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.012209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.014623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.370593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:42:59.388677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3bea2472-1abb-47e9-b00f-b480986466db tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.433952 Sep 13 16:42:59.391180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1624/3197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:58 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:42:59.629791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:59.631000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:59.657957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.662608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.663096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.663863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.664343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.664783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.768006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:42:59.769371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:42:59.784536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.787399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.792294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:42:59.793447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:42:59.796641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:42:59.797529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:00.283983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:00.299294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93f0a75f-1d92-4bab-87b5-34fe28031564 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1474 microversion: 2.1 time: 0.671252 Sep 13 16:43:00.301050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1574/3198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:59 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1474 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:00.425753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:00.426747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:00.434345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:00.436378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:00.437149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:00.438532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:00.440667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:00.441509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:00.443987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:00.932230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:00.944789 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-80b0e4b4-8db9-43b1-ba58-8425e85d3488 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.526534 Sep 13 16:43:00.948501 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1575/3199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:00 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:00.983238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:01.002708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d93f5068-dd39-4453-9b98-1dfe05b109d7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1367 microversion: 2.1 time: 1.234955 Sep 13 16:43:01.009307 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1625/3200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:42:59 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1367 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:01.330068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:01.332594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:01.358589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:01.365290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:01.368282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:01.373941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:01.381584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:01.392728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:01.975790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:01.976583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:02.013590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.021353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.031544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.037820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.038759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.039186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.232583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:02.251280 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce264a5d-12e4-4af0-8dbe-ac4acdd1cf98 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1474 microversion: 2.1 time: 0.925595 Sep 13 16:43:02.268645 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1576/3201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:01 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1474 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:02.284617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:02.285236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:02.316344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.320146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.320757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.321431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:02.321965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:02.322423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:02.939750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:02.968023 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ee75666-cec1-4a5a-bc51-b952a4179ea8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1557 microversion: 2.1 time: 0.696595 Sep 13 16:43:02.970643 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1577/3202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:02 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1557 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:02.999943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c100e2cf-d58e-4c9e-bc18-5a6395554949 req-162910b6-3489-46db-94cf-545882dbf53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146ffc03-bef9-43c4-9209-479a2339b5ad", "name": "network-vif-deleted", "tag": "91fd51cf-edd3-4001-8f99-0ad3fc8ef39b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:03.011888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:03.050575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ea2bd68-0278-4a14-91ed-0be46a56217b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 1.079035 Sep 13 16:43:03.078010 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1626/3203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:01 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:03.092931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c100e2cf-d58e-4c9e-bc18-5a6395554949 req-162910b6-3489-46db-94cf-545882dbf53c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.097587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c100e2cf-d58e-4c9e-bc18-5a6395554949 req-162910b6-3489-46db-94cf-545882dbf53c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.098556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c100e2cf-d58e-4c9e-bc18-5a6395554949 req-162910b6-3489-46db-94cf-545882dbf53c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.111296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:03.111903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:03.143963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.144472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.151242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.151385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.151846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.169374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.171565 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c100e2cf-d58e-4c9e-bc18-5a6395554949 req-162910b6-3489-46db-94cf-545882dbf53c service nova] Creating event network-vif-deleted:91fd51cf-edd3-4001-8f99-0ad3fc8ef39b for instance 146ffc03-bef9-43c4-9209-479a2339b5ad on n-h2-857467-1 Sep 13 16:43:03.199230 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c100e2cf-d58e-4c9e-bc18-5a6395554949 req-162910b6-3489-46db-94cf-545882dbf53c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209901 Sep 13 16:43:03.201013 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1578/3204] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:43:03.283987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:03.284708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:03.328746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.329235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.332251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.337027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.338639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.342296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.525728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:03.530543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:03.532164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:03.541346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lazy-loading 'fault' on Instance uuid 146ffc03-bef9-43c4-9209-479a2339b5ad {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:03.727865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eff935c2304c649e5b4c7cc7295f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86240d08d58941c58e5c44f5770aacf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:03.749482 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74d18e33-d163-42d6-8417-ee657e86aff5 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 200 len: 1308 microversion: 2.1 time: 0.470154 Sep 13 16:43:03.754336 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1579/3205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:03 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:03.758019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1314be71-724f-4c60-81fd-ce8e6f6f8357 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.677843 Sep 13 16:43:03.759291 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1627/3206] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:43:03 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-interface => generated 284 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:04.081682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:04.082684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:04.106692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:04.117458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:04.118301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:04.154066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:04.155144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:04.155873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:04.749549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:04.773926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02f0890c-c2de-4ad5-9444-2ffc6bc36814 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.691685 Sep 13 16:43:04.775021 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1580/3207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:04 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:04.800278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:04.803089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] [instance: 146ffc03-bef9-43c4-9209-479a2339b5ad] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:04.827818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:04.831464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:04.832254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:04.835571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:04.836778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:04.838238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:04.917279 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] HTTP exception thrown: Instance 146ffc03-bef9-43c4-9209-479a2339b5ad could not be found. Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Request method failure captured: Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad HTTP/1.1 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLDVHWo6arbyeXAI03cV0Qlr08FMhbbGmpP62hO9xSo5Me1DwVcDRtP2W2tU8xfaJ3_lL6fn1uriaC8tOHyiyOzFn-D07vKCohUHHBFhsQtYdJ2dT6tnEgeaR1QbCmPXIbgP12ibDjtF2pR-Dl4J-8S2jUY5-Gedr5gX00UGV-a1xs Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 86240d08d58941c58e5c44f5770aacf2 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-LiveMigrationNegativeTest-266557032 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/86240d08d58941c58e5c44f5770aacf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-LiveMigrationNegativeTest-266557032 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 86240d08d58941c58e5c44f5770aacf2 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-266557032 Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-LiveMigrationNegativeTest-266557032-project Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 46eff935c2304c649e5b4c7cc7295f0f Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-LiveMigrationNegativeTest-266557032-project Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 146ffc03-bef9-43c4-9209-479a2339b5ad could not be found. Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '146ffc03-bef9-43c4-9209-479a2339b5ad'} Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146ffc03-bef9-43c4-9209-479a2339b5ad could not be found. Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146ffc03-bef9-43c4-9209-479a2339b5ad could not be found. Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:04.923899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146ffc03-bef9-43c4-9209-479a2339b5ad could not be found. Sep 13 16:43:04.929715 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:04.932485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] Returning 404 to user: Instance 146ffc03-bef9-43c4-9209-479a2339b5ad could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:04.933745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-586203a6-8390-47ed-a894-d955d58271b0 tempest-LiveMigrationNegativeTest-266557032 tempest-LiveMigrationNegativeTest-266557032-project] 10.222.0.61 "GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad" status: 404 len: 111 microversion: 2.1 time: 0.143209 Sep 13 16:43:04.935318 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1628/3208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:04 2022] GET /compute/v2.1/servers/146ffc03-bef9-43c4-9209-479a2339b5ad => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:43:05.802724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:05.803782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:05.822817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:05.823339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:05.823803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:05.824536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:05.825005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:05.825453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:06.459946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:06.469847 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79b88ccd-fa6f-459a-b954-96bec9aac073 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.671766 Sep 13 16:43:06.472759 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1581/3209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:05 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:06.481796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2828c72e-8cf7-41a4-b14e-6d2179ea0727 req-86d1ba68-b7c3-46f6-91be-660185ebf1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d178d82-e4fa-4f21-a587-26c3e9c7d2bb", "tag": "57452ffb-c696-4d7a-a9a3-9714e404adb4"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:06.504598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2828c72e-8cf7-41a4-b14e-6d2179ea0727 req-86d1ba68-b7c3-46f6-91be-660185ebf1ba service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:06.508900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2828c72e-8cf7-41a4-b14e-6d2179ea0727 req-86d1ba68-b7c3-46f6-91be-660185ebf1ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:06.509479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2828c72e-8cf7-41a4-b14e-6d2179ea0727 req-86d1ba68-b7c3-46f6-91be-660185ebf1ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:06.524775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2828c72e-8cf7-41a4-b14e-6d2179ea0727 req-86d1ba68-b7c3-46f6-91be-660185ebf1ba service nova] Creating event network-changed:57452ffb-c696-4d7a-a9a3-9714e404adb4 for instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb on n-h2-857467-1 Sep 13 16:43:06.530804 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2828c72e-8cf7-41a4-b14e-6d2179ea0727 req-86d1ba68-b7c3-46f6-91be-660185ebf1ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055699 Sep 13 16:43:06.531679 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1582/3210] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:06.558688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-245684844", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:07.500077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:07.500859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:07.545258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:07.545788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:07.546270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:07.547011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:07.547477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:07.547917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:08.099783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:08.103694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:08.117000 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7599b54c-f0b9-4993-9459-861a8193649e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.623946 Sep 13 16:43:08.153728 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1583/3211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:07 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:09.167496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:09.168165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:09.191572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:09.196543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:09.198358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:09.223204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:09.225772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:09.227620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:09.665817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:09.676059 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3150a782-64f9-405d-b86c-36bdd441bbc4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.516275 Sep 13 16:43:09.690420 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1584/3212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:09 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:10.320810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:10.321411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:10.322712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:10.323291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:10.324949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:10.358094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:10.360336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:10.361591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:10.363360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:10.364925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:10.366454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:10.409901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Getting quotas for project b5f6656e6c8e4768a904b8b291f1ac5f. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:10.424653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Getting quotas for user 559e54c1b0cd4030b224ba20f122c731 and project b5f6656e6c8e4768a904b8b291f1ac5f. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:10.444769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:43:10.451284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:43:10.575343 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0b5b75e-6d0c-4336-a092-405004aa2ab2 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 4.385182 Sep 13 16:43:10.579319 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1629/3213] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 16:43:10.589050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-418dd098-68ad-4b85-9686-deea6e2094f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:10.595872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-418dd098-68ad-4b85-9686-deea6e2094f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:10.702955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:10.703494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:10.713256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:10.713795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:10.714276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:10.715002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:10.715471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:10.715908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:10.828791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-418dd098-68ad-4b85-9686-deea6e2094f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:10.841938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-418dd098-68ad-4b85-9686-deea6e2094f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:10.850835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-418dd098-68ad-4b85-9686-deea6e2094f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:10.852350 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-418dd098-68ad-4b85-9686-deea6e2094f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1277 microversion: 2.54 time: 0.267393 Sep 13 16:43:10.856380 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1585/3214] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:10 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:11.568869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:11.579043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc48c04f-d03a-4509-97f4-11b64d1ca58d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1525 microversion: 2.1 time: 0.880128 Sep 13 16:43:11.582663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1630/3215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:10 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1525 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:11.753938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1930518827", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:11.870479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:43:11.897105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:11.899098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:11.915244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:11.918339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:11.919012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:11.922228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:11.924365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:11.925388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:12.154780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:12.169390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:12.182529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:12.185939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:12.196172 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ed04f0a-6960-4e5a-a155-3b8c4dff550a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1281 microversion: 2.54 time: 0.310916 Sep 13 16:43:12.201917 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1631/3216] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:11 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1281 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:12.352545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:12.353223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:12.354149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:12.354775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:12.355606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:12.368026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:12.368768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:12.369380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:12.372466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:12.373365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:12.374024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:12.400225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Getting quotas for project 98fff203b6f44a4d89668e1498016541. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:12.407545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Getting quotas for user 32cf9548ed614a049a5527f6b9b5aed2 and project 98fff203b6f44a4d89668e1498016541. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:12.423304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:43:12.429006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:43:12.510925 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19f1e922-8a87-4570-a5d0-4f4cdb9b540d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959309 Sep 13 16:43:12.512493 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1586/3217] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:43:12.526134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63ec9cd9-23cb-459c-8196-fda97c56dab9 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:12.526765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63ec9cd9-23cb-459c-8196-fda97c56dab9 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:12.607656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:12.608197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:12.621615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:12.623503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:12.626316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:12.626316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:12.626316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:12.626316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:12.666307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-63ec9cd9-23cb-459c-8196-fda97c56dab9 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:12.674186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63ec9cd9-23cb-459c-8196-fda97c56dab9 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1223 microversion: 2.1 time: 0.152155 Sep 13 16:43:12.675361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1632/3218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:12 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:12.860081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:12.869182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bbb7b408-17fe-4bf7-b97a-63ccbf57c2ac tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1507 microversion: 2.1 time: 0.265490 Sep 13 16:43:12.871845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1587/3219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:12 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:13.227842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:13.229254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:13.238844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:13.243375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:13.243933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:13.244762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:13.245328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:13.245889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:13.339202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:13.355005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:13.356702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:13.368073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-751e016a-62b2-4a79-87f6-fbaa231517fb tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1335 microversion: 2.54 time: 0.144719 Sep 13 16:43:13.368687 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1633/3220] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:13 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:13.703356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:13.704165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:13.712409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:13.712871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:13.713533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:13.714290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:13.714958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:13.715408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:13.783041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:13.792008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0f2c6b5-4b4f-4483-9f02-a04dacc0d30d tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1227 microversion: 2.1 time: 0.092804 Sep 13 16:43:13.792602 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1588/3221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:13 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1227 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:13.904472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:13.905455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:13.916815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:13.917244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:13.917698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:13.918529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:13.919053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:13.919827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:14.197749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:14.207184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69d2ce42-0205-4cc7-a858-d0503435763e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1507 microversion: 2.1 time: 0.306673 Sep 13 16:43:14.207753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1634/3222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:13 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:14.408357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:14.410657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:14.427069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:14.429356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:14.431869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:14.434055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:14.435510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:14.436834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:14.537985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:14.549187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:14.550937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:14.553556 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d33973f5-cd3c-4ba3-a641-b99682d7049e tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1335 microversion: 2.54 time: 0.153076 Sep 13 16:43:14.562545 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1589/3223] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:14 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1335 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:14.752547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0e5580e1-8a96-43eb-a7fe-22b9694bff94 req-b8de1c83-7095-43e7-8bf5-c089ef51320d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cdb5ce-4613-4eef-82c8-ac221d8fcf65", "name": "network-vif-unplugged", "status": "completed", "tag": "a711467a-e3c3-4157-bf8c-314e5acff2ae"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:14.767493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0e5580e1-8a96-43eb-a7fe-22b9694bff94 req-b8de1c83-7095-43e7-8bf5-c089ef51320d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:14.768615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0e5580e1-8a96-43eb-a7fe-22b9694bff94 req-b8de1c83-7095-43e7-8bf5-c089ef51320d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:14.769984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0e5580e1-8a96-43eb-a7fe-22b9694bff94 req-b8de1c83-7095-43e7-8bf5-c089ef51320d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:14.784786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0e5580e1-8a96-43eb-a7fe-22b9694bff94 req-b8de1c83-7095-43e7-8bf5-c089ef51320d service nova] Creating event network-vif-unplugged:a711467a-e3c3-4157-bf8c-314e5acff2ae for instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 on n-h2-857467-1 Sep 13 16:43:14.791402 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0e5580e1-8a96-43eb-a7fe-22b9694bff94 req-b8de1c83-7095-43e7-8bf5-c089ef51320d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050349 Sep 13 16:43:14.792496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1635/3224] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:14.817397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:14.818832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:14.827111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:14.827600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:14.828537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:14.829469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:14.830107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:14.830715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:14.920395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:14.931160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-058760fb-0840-4ae0-ae81-46db6b665dda tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1275 microversion: 2.1 time: 0.117647 Sep 13 16:43:14.932496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1590/3225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:14 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:15.234148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:15.235708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:15.260249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.261740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.262459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.264183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.265134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.265902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.489597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:15.500099 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd800e19-9205-48dc-90cd-e917a538ccde tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 200 len: 1510 microversion: 2.1 time: 0.271053 Sep 13 16:43:15.501336 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1636/3226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:15 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:15.533364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:15.535524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:15.543396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.544565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.545517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.546448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.547016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.547567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.580572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:43:15.588420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:15.589412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:15.592200 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Working on deleting snapshot b33d966a-c1c8-43fa-8578-fa63eada7c6c from shelved instance... Sep 13 16:43:15.596503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.597274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.597999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.599069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.599808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.600667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.790283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:15.808791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:15.811161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:15.812435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0945ff6b-6ede-4aea-a7b5-257c89c9e80c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1335 microversion: 2.54 time: 0.228647 Sep 13 16:43:15.819718 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1637/3227] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:15 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1335 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:15.965774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:15.966778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:15.986502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.987022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.987483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:15.988320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:15.988825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:15.989228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:16.183191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:16.202418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1bcdb17-c08c-40b1-b3f0-c57e5796c18e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1281 microversion: 2.1 time: 0.240566 Sep 13 16:43:16.209691 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1638/3228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:15 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:16.768523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Doing local delete in cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=122327) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 13 16:43:16.770121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:16.771576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:16.772368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:16.773074 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 13 16:43:16.778030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] deallocate_for_instance() {{(pid=122327) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 13 16:43:16.856429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:16.857066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:16.872739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:16.873365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:16.873737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:16.874490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:16.885517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:16.886373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:17.050887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:17.063798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:17.084392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:17.091794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-921ce72a-39ed-4f57-b4fc-e895d7a7ed3d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1335 microversion: 2.54 time: 0.233507 Sep 13 16:43:17.097886 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1639/3229] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:16 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1335 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:17.230353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:17.231373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:17.242187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:17.242984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:17.243596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:17.244479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:17.245102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:17.245687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:17.732781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:17.760528 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d81a378-b4ad-46ca-9c05-88e747bfbcce tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.534553 Sep 13 16:43:17.761847 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1640/3230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:17 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:17.986183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Updating instance_info_cache with network_info: [] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:43:17.996108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4205893c-efbf-4053-80bb-9323ef9e8cc8 req-f46be435-b374-411f-862f-68ce15bcd58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cdb5ce-4613-4eef-82c8-ac221d8fcf65", "name": "network-vif-deleted", "tag": "a711467a-e3c3-4157-bf8c-314e5acff2ae"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:18.020218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4205893c-efbf-4053-80bb-9323ef9e8cc8 req-f46be435-b374-411f-862f-68ce15bcd58f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.021820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4205893c-efbf-4053-80bb-9323ef9e8cc8 req-f46be435-b374-411f-862f-68ce15bcd58f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.027692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4205893c-efbf-4053-80bb-9323ef9e8cc8 req-f46be435-b374-411f-862f-68ce15bcd58f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.071851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.server_external_events [req-4205893c-efbf-4053-80bb-9323ef9e8cc8 req-f46be435-b374-411f-862f-68ce15bcd58f service nova] Unable to find a host for instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65. Dropping event network-vif-deleted {{(pid=122328) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 16:43:18.073284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4205893c-efbf-4053-80bb-9323ef9e8cc8 req-f46be435-b374-411f-862f-68ce15bcd58f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.082211 Sep 13 16:43:18.076102 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1641/3231] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 16:43:18.131775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:18.133399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:18.149500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.150326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.150976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.152380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.153067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.153508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.276748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:18.286094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:18.288064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:18.289267 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fcd17659-914f-4151-9c7b-434732248d6a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1356 microversion: 2.54 time: 0.165124 Sep 13 16:43:18.297374 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1642/3232] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:18 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:18.337872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0f1d45d-bcc6-4aa9-b548-a0e83f724f66 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Action: 'create', calling method: .version_select at 0x7fbeb48e4b80>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1265907539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0vc9KJWaurq2D8RYHCHuw66QxAJB2X/tVOMd4D4hQV4qXeg6VpT6AcgIOTf1GqY2dwnjmot8TwKgrKcxkcUVW05KBenwUUDL3SK70GkQTRp64gxQl86uAAqOe+j4HCIg=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:18.372325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d0f1d45d-bcc6-4aa9-b548-a0e83f724f66 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Getting quotas for project b5f6656e6c8e4768a904b8b291f1ac5f. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:18.381252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d0f1d45d-bcc6-4aa9-b548-a0e83f724f66 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Getting quotas for user 559e54c1b0cd4030b224ba20f122c731 and project b5f6656e6c8e4768a904b8b291f1ac5f. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:18.423941 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0f1d45d-bcc6-4aa9-b548-a0e83f724f66 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.091439 Sep 13 16:43:18.425995 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1643/3233] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:43:18 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:43:18.441863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1265907539", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:18.466827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:18.469581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:18.485192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.490761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.491830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.494923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.495711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.497531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.689509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:18.691492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:18.694240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:18.694981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:18.695601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:18.700351 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-efc8cd13-b3de-404f-90d8-6b02cec61416 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 204 len: 0 microversion: 2.1 time: 3.170824 Sep 13 16:43:18.702106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1591/3234] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:43:15 2022] DELETE /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 0 bytes in 3173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:43:18.721695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:18.726140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:18.740868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.741652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.742350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.743619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.744311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.744983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.776123 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 HTTP/1.1 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e4cdb5ce-4613-4eef-82c8-ac221d8fcf65'} Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:18.781297 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:43:18.785473 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:18.787453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:18.788486 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4da82002-91c9-45b3-a77a-8f40c48223e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 404 len: 111 microversion: 2.1 time: 0.082008 Sep 13 16:43:18.793137 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1592/3235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:18 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:43:18.798134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:18.808168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:18.820099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.820882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.823234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.824229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.825422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.827375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.953563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:18.991095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:18.994750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.995785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.996488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:18.997956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:18.998665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:18.999378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:19.045715 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94459989-0ea2-478d-b7e7-b8f05871d2a0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "POST /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504/action" status: 202 len: 1139 microversion: 2.54 time: 0.612541 Sep 13 16:43:19.059385 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1644/3236] 10.222.0.61 () {62 vars in 1320 bytes} [Tue Sep 13 16:43:18 2022] POST /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504/action => generated 1139 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 13 16:43:19.075515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9556809b-1639-4a76-9230-f608273fbff3 req-360d80c1-3f4d-46d0-abc0-3a15058a188a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac28490-404c-4a73-aec5-70256bda77ca", "tag": "a3294947-a467-403a-b077-2cfdff7a17d9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:19.088194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9556809b-1639-4a76-9230-f608273fbff3 req-360d80c1-3f4d-46d0-abc0-3a15058a188a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:19.089096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9556809b-1639-4a76-9230-f608273fbff3 req-360d80c1-3f4d-46d0-abc0-3a15058a188a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:19.089761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9556809b-1639-4a76-9230-f608273fbff3 req-360d80c1-3f4d-46d0-abc0-3a15058a188a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:19.152614 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9556809b-1639-4a76-9230-f608273fbff3 req-360d80c1-3f4d-46d0-abc0-3a15058a188a service nova] Creating event network-changed:a3294947-a467-403a-b077-2cfdff7a17d9 for instance aac28490-404c-4a73-aec5-70256bda77ca on n-h2-857467-1 Sep 13 16:43:19.160786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:19.176697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9556809b-1639-4a76-9230-f608273fbff3 req-360d80c1-3f4d-46d0-abc0-3a15058a188a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115138 Sep 13 16:43:19.183183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1645/3237] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:19.184325 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9f78924-7358-4467-a1ba-e3dc4b5f0f5e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.388416 Sep 13 16:43:19.185228 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1593/3238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:18 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:19.219062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:19.221307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:19.230845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:19.231619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:19.232390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:19.233732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:19.234486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:19.235126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:19.238064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1069498040", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:19.344822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:43:19.404672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:19.442656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:19.448556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:19.451091 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-769c8154-bd18-4c14-8d8f-27a13385950a tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.266382 Sep 13 16:43:19.458878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1646/3239] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:19 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:19.900230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:19.900668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:19.901154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:19.901569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:19.902075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:19.912755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:19.913542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:19.914240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:19.915144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:19.915782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:19.916220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:19.937429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:19.945227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:19.962279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:43:19.964601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:43:20.037855 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cdb81fa7-e972-4130-8a86-c99c1bf00354 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803940 Sep 13 16:43:20.051298 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1594/3240] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:43:20.066666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc047843-4b50-497b-8eaf-ce96d229f41b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:20.069332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc047843-4b50-497b-8eaf-ce96d229f41b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:20.160769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc047843-4b50-497b-8eaf-ce96d229f41b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:20.170013 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc047843-4b50-497b-8eaf-ce96d229f41b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1215 microversion: 2.1 time: 0.114421 Sep 13 16:43:20.178575 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1647/3241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:20 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:20.212601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:20.213293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:20.234082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:20.234548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:20.235265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:20.236191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:20.236855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:20.237466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:20.430089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:20.440188 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f0d9135-29e9-42b7-ac83-ba9705e125bd tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.232390 Sep 13 16:43:20.441423 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1595/3242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:20 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:20.482448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:20.483294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:20.485643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:20.498994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:20.499849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:20.500299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:20.501028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:20.501494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:20.501955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:20.576117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:20.589241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:20.591993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:20.593439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a0a2cf7-fece-4826-90e2-3e54f3ac0e61 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.116885 Sep 13 16:43:20.607805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1648/3243] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:20 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:21.200724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:21.201912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:21.215200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:21.217334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:21.230899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:21.239039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:21.241280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:21.241959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:21.324576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:21.344416 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7f22eb97-020f-4d31-b075-7b1d2690f072 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1267 microversion: 2.1 time: 0.146821 Sep 13 16:43:21.345430 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1596/3244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:21 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:21.467354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:21.469949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:21.481197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:21.482131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:21.482839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:21.483773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:21.484441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:21.485082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:21.626021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:21.627134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:21.642309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:21.643219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:21.643873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:21.644849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:21.645528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:21.646955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:21.658991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:21.710776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:21.731047 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67546678-3c54-4da8-b3b9-b12b961f89e2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.267162 Sep 13 16:43:21.731047 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1649/3245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:21 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:21.775771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:21.791991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:21.797313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:21.799126 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9432e9b7-a332-49ac-9f77-e4a686773449 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.179191 Sep 13 16:43:21.799956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1597/3246] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:21 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:22.375816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:22.376450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:22.385307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:22.386178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:22.387114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:22.388253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:22.391772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:22.393252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:22.488281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:22.518137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-061ecfc6-0947-4c6b-8d57-0e1f6ccad5e4 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1273 microversion: 2.1 time: 0.145891 Sep 13 16:43:22.521470 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1650/3247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:22 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:22.757318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:22.758138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:22.780490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:22.780781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:22.783205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:22.789387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:22.793567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:22.794392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:22.825777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:22.827310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:22.841309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:22.848599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:22.850033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:22.852416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:22.855402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:22.856192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:22.958227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:23.324945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:23.343313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:23.344725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:23.350800 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12f88fbe-3bf8-4196-aa36-b8b22041e52b tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.529773 Sep 13 16:43:23.356682 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1651/3248] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:22 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:23.365412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:23.368349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:23.389478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:23.390361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:23.390825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:23.391595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:23.392073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:23.392509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:23.455424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:23.490870 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b3158f3a-cc5b-4f5a-a937-1e5590805e85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.736931 Sep 13 16:43:23.495721 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1598/3249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:22 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:23.547793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:23.548896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:23.557541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:23.558266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:23.558899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:23.559797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:23.561733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:23.562399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:23.577637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'services' on Instance uuid 52b35670-fff0-424c-ae44-5adf194bb6b2 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:23.782260 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cfddeace-ccbc-4969-a44b-de70ab99d9de tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments/7cef5d09-22c8-4928-94ad-77b5fdfce98d" status: 202 len: 0 microversion: 2.1 time: 0.423989 Sep 13 16:43:23.787420 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1652/3250] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:43:23 2022] DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments/7cef5d09-22c8-4928-94ad-77b5fdfce98d => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:43:23.792340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:23.811577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:23.815301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:23.816446 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-257348e2-13f2-4b5f-9ada-5ad7d1d2e534 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.273645 Sep 13 16:43:23.817508 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1599/3251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:23 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:23.823389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:23.824110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:23.824717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:23.825934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:23.826603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:23.827232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:23.894391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59b68b3f-6374-49c6-9008-e6d99e8b42d3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104922 Sep 13 16:43:23.895090 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1653/3252] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:23 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:24.381379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:24.382327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:24.403688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.404300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.404805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.405598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.406178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.406668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.519229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:24.520285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:24.535051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:24.556419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.557683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:24.558150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.559857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:24.561763 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94743c8e-9b5e-4e7b-a641-65d09ee98833 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.184734 Sep 13 16:43:24.562577 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1600/3253] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:24 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:24.566514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.567620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.568555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.569296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.821368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:24.833480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ae2a1572-b2e5-4b59-9327-f18882bc9647 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.316970 Sep 13 16:43:24.838991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1654/3254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:24 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:24.846066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:24.847565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:24.860750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.861481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.864084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.865762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.869530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.870203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.908469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:24.911823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:24.924185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.926691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.930684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:24.931744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:24.935002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:24.935695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:25.034589 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c0b7a78-4724-46a9-8a9b-272a7a0398b6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130382 Sep 13 16:43:25.035247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1655/3255] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:24 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:43:25.052588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-bf10f591-49fd-4cc2-b572-1b249332b204 req-84640a30-1966-4cbc-8aeb-6cdf8ee64874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12adf32c-7a8f-4dc4-bada-d7d24b0c12b9", "tag": "923873d5-11f7-442c-9204-9a52f2cc8beb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:25.075455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bf10f591-49fd-4cc2-b572-1b249332b204 req-84640a30-1966-4cbc-8aeb-6cdf8ee64874 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:25.075455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bf10f591-49fd-4cc2-b572-1b249332b204 req-84640a30-1966-4cbc-8aeb-6cdf8ee64874 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:25.075883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bf10f591-49fd-4cc2-b572-1b249332b204 req-84640a30-1966-4cbc-8aeb-6cdf8ee64874 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:25.110150 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-bf10f591-49fd-4cc2-b572-1b249332b204 req-84640a30-1966-4cbc-8aeb-6cdf8ee64874 service nova] Creating event network-changed:923873d5-11f7-442c-9204-9a52f2cc8beb for instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 on n-h1-857467-1 Sep 13 16:43:25.120696 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-bf10f591-49fd-4cc2-b572-1b249332b204 req-84640a30-1966-4cbc-8aeb-6cdf8ee64874 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074838 Sep 13 16:43:25.126105 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1656/3256] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:25.129726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:25.139845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9fdc6a52-d434-4f17-8cb8-38c90623b780 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.298106 Sep 13 16:43:25.140644 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1601/3257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:24 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:25.598669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:25.598669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:25.606907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:25.607210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-634566029", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ce305194-1ca7-46c1-b31e-fb165609f4a8"}], "security_groups": [{"name": "tempest-securitygroup--1121150849"}], "key_name": "tempest-keypair-1775191631", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b4eb3f07-4ff8-45cf-a758-5af23d678ece", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:25.607415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:25.607908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:25.608636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:25.609107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:25.609547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:25.726942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:25.742105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:25.744216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:25.748435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ba611f1-4502-44ed-a9bf-91aece79d470 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.160689 Sep 13 16:43:25.749453 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1657/3258] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:25 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:25.763553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] validate_networks() for [('ce305194-1ca7-46c1-b31e-fb165609f4a8', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:43:25.860663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:25.862013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:25.873895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:25.874593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:25.875054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:25.881062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:25.881805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:25.882458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.134434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:26.143645 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9386adc0-66fd-4735-9861-2b7e093db804 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.286999 Sep 13 16:43:26.144851 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1658/3259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:25 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:26.150688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:26.153610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:26.163012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.163845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.164519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.165639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.166355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.167325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.214991 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03ab54e9-a294-4ba5-8001-b0bbd83c8677 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068097 Sep 13 16:43:26.215676 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1659/3260] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:26 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:26.220356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:26.220978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:26.228470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.228977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.229575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.230335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.230820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.231255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.398425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Getting quotas for project 335fc1c923214d4a940ea97bf6a17f55. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:26.425728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Getting quotas for user 5bbeb18d6360416a9fce125f830755e7 and project 335fc1c923214d4a940ea97bf6a17f55. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:26.435958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:26.445453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:26.445754 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-654f9a52-99bd-4012-93d6-d0cf6fc270e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.229016 Sep 13 16:43:26.446385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:26.446522 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1660/3261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:26 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:26.447321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:26.448014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:26.448764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:26.465726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.466544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.467205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.468312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.468980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.469616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.494606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Getting quotas for project 335fc1c923214d4a940ea97bf6a17f55. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:26.502068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Getting quotas for user 5bbeb18d6360416a9fce125f830755e7 and project 335fc1c923214d4a940ea97bf6a17f55. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:26.587893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:43:26.590244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4eb3f07-4ff8-45cf-a758-5af23d678ece',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:43:26.762587 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02fc1a9e-4f53-4a06-b3a6-c4d179da1091 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.160107 Sep 13 16:43:26.763817 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1602/3262] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:43:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:43:26.776639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:26.777284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:26.781972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-11663141-02a3-448f-8af4-d10e21917f49 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:26.783083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-11663141-02a3-448f-8af4-d10e21917f49 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:26.808399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.810931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.811588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.814479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:26.816710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:26.821778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:26.869159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-11663141-02a3-448f-8af4-d10e21917f49 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:26.877354 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-11663141-02a3-448f-8af4-d10e21917f49 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1121 microversion: 2.1 time: 0.103480 Sep 13 16:43:26.887765 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1603/3263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:26 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1121 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:27.017094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:27.020057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d96bc10e-89a1-4631-8a93-d31d689092de req-c97a5da7-bbfb-4463-9f99-bfdfd5f36ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac28490-404c-4a73-aec5-70256bda77ca", "name": "network-vif-plugged", "status": "completed", "tag": "a3294947-a467-403a-b077-2cfdff7a17d9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:27.029626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:27.033918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:27.035808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b46c5e74-857a-4ca8-8e2b-e7c5d878400c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.265311 Sep 13 16:43:27.037651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1661/3264] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:26 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:27.051031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d96bc10e-89a1-4631-8a93-d31d689092de req-c97a5da7-bbfb-4463-9f99-bfdfd5f36ea1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.055220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d96bc10e-89a1-4631-8a93-d31d689092de req-c97a5da7-bbfb-4463-9f99-bfdfd5f36ea1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.056100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d96bc10e-89a1-4631-8a93-d31d689092de req-c97a5da7-bbfb-4463-9f99-bfdfd5f36ea1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.092898 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d96bc10e-89a1-4631-8a93-d31d689092de req-c97a5da7-bbfb-4463-9f99-bfdfd5f36ea1 service nova] Creating event network-vif-plugged:a3294947-a467-403a-b077-2cfdff7a17d9 for instance aac28490-404c-4a73-aec5-70256bda77ca on n-h2-857467-1 Sep 13 16:43:27.105431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d96bc10e-89a1-4631-8a93-d31d689092de req-c97a5da7-bbfb-4463-9f99-bfdfd5f36ea1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092263 Sep 13 16:43:27.106556 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1604/3265] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:27.172697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:27.173591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:27.181595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.182360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.182804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.183808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.184587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.185338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.231489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:27.234292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:27.243670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.244321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.245025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.245814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.246391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.246936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.323056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3dd0cda3-0788-42cb-a339-f39fef3256ff tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098799 Sep 13 16:43:27.330814 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1605/3266] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:27 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:27.429623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:27.440548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b448b04f-fbe8-4931-9b58-44b877d901d2 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.272120 Sep 13 16:43:27.441160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1662/3267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:27 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:27.471730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:27.472367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:27.484619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.485352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.485805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.486697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.487601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.487723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.720070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:27.728295 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7f631143-00e1-4ab2-8d7f-0a27914c1fd6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.261712 Sep 13 16:43:27.734572 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1606/3268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:27 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:27.910538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:27.915087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:27.929460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.932790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.934229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:27.935998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:27.936475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:27.943257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.068571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:28.069606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:28.082023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:28.092126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.093201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6eae96d5-7e16-4c16-a40b-8d3fd0e860aa tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1171 microversion: 2.1 time: 0.193422 Sep 13 16:43:28.093742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.094418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.106934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.107565 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1663/3269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:27 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1171 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:28.113102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.113647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.190680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:28.201132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:28.203118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:28.204570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55bce604-2b50-4678-be9d-e01078193593 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.142223 Sep 13 16:43:28.205668 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1607/3270] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:28 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:28.352194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:28.354584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:28.368104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.368733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.372847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.373643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.374739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.375261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.420394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1de239ad-963e-4e0c-8961-00481dca804a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079391 Sep 13 16:43:28.421980 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1664/3271] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:28 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:28.465095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:28.465784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:28.477926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.479224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.479767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.480570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.481108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.481620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.703161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:28.712779 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e35ddaa-ceb9-4b29-b142-aa2825f3cde1 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1323 microversion: 2.1 time: 0.251610 Sep 13 16:43:28.726846 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1608/3272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:28 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:28.760955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:28.761887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:28.773041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.773895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.776538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:28.779025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:28.779712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:28.781577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.126697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:29.127443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:29.158455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.162765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.165641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.166683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.178755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.180076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.278965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:29.293635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1aa4ac5f-4505-4425-84fb-0ba230d0bf13 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1219 microversion: 2.1 time: 0.177087 Sep 13 16:43:29.309144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1609/3273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:29 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:29.312202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:29.312202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:29.327833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.328549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.328860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.329610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.330120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.330648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.445337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:29.461187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:29.462735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:29.463950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6528cee-3be0-42d2-88c4-ec6025c84794 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.156853 Sep 13 16:43:29.464739 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1610/3274] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:29 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:29.469460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:29.485153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:29.485153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.485153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.486070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.486166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.486587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.487084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.502134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:29.525137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-974ec6c5-482c-41f7-8142-320ccbda1441 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.767663 Sep 13 16:43:29.531385 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1665/3275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:28 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:29.575831 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-44989ca7-1e3c-4cd2-917d-a12e5a70bb53 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109967 Sep 13 16:43:29.576448 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1611/3276] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:29 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:29.738086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:29.738709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:29.747756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.748280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.748734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:29.761075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:29.761886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:29.762524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.169585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:30.286649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:30.298737 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce71cdb5-9ff3-4e24-a1d0-c5f86e008533 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1472 microversion: 2.1 time: 0.561206 Sep 13 16:43:30.299902 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1666/3277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:29 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1472 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:30.327853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:30.330128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:30.331787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:30.332173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:30.350195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.352112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.360230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.361237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.362192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.362648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.363614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.365136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.365985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.366675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.367498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.368195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.426132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Request method failure captured: Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca/diagnostics HTTP/1.1 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILMdBNQa0Dd-9VainYebvzIBFEXqkfCL5cCBRn4yv5AdoF5pRg9-3qYh_QqGXDLmWRGHcJN51p6uY7cIcaP1S9VvoZljQYtcZrgOmcRGRNPkCGtlHfjjgFjmvqOTRCCTzfWxD9JmHZpDDOmsVakINpzpPalucnUjYiao_69WPKKAmdQ Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 98fff203b6f44a4d89668e1498016541 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2069725898 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fff203b6f44a4d89668e1498016541"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98fff203b6f44a4d89668e1498016541"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fff203b6f44a4d89668e1498016541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98fff203b6f44a4d89668e1498016541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2069725898 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 98fff203b6f44a4d89668e1498016541 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2069725898 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerDiagnosticsNegativeTest-2069725898-project Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 32cf9548ed614a049a5527f6b9b5aed2 Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2069725898-project Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': 'aac28490-404c-4a73-aec5-70256bda77ca'} Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:30.441677 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:30.446338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:30.446338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:30.446338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:43:30.446338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:43:30.446338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 13 16:43:30.446338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:30.447961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:30.449070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1fe3253d-9d7e-4515-8369-a5ad675a903e tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.126195 Sep 13 16:43:30.454434 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1667/3278] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:43:30 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca/diagnostics => generated 117 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:43:30.462871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:30.478369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:30.493217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.494130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.494922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.495916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.504438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.506277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.511809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:30.517819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:30.536350 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74498c3a-51d2-4cee-86b1-570095b38adc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1237 microversion: 2.1 time: 0.219903 Sep 13 16:43:30.550399 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1612/3279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:30 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1237 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:30.566490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:30.567368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:30.578439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.581267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.582008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.582962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.586307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.587181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.641667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:43:30.856241 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b848bb86-b5eb-443e-a302-44ec2bd8040f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 204 len: 0 microversion: 2.1 time: 0.304108 Sep 13 16:43:30.860912 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1613/3280] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:43:30 2022] DELETE /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:43:30.868378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:30.870079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:30.876864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.877746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.878383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.880077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:30.881220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:30.882027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:30.910341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:30.992782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.007926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.009309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.015698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.018097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40fc7c8b-7d9c-40e9-902e-eddc8b060141 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2951 microversion: 2.32 time: 0.559413 Sep 13 16:43:31.018863 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1668/3281] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:30 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2951 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:31.021063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.029537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:31.030474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:31.034967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.036323 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6495c543-f06e-4934-8deb-57c59d23ebbf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.173832 Sep 13 16:43:31.037054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1614/3282] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:30 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:31.043038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:31.045346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:31.051612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.052719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.053508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.055728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.058409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.059169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.084812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.085506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.100533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.101370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.108805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.109272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.242821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9dd9dd4b-be8e-44f9-b6b0-a859221be732 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187333 Sep 13 16:43:31.247757 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1615/3283] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:31 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:31.260161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:31.261140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:31.271334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:31.285438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.291194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.291979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.301743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.302903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.303533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.402024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.410493 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c91c130-b50b-4585-98ac-2e9369f63f1b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.389691 Sep 13 16:43:31.411084 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1669/3284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:31 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:31.439160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:31.439643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:31.453472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.454013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.454460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.455178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.458783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.459836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.570405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.585137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b0a49dc-41bd-4076-90cb-43f9dd34677f tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1478 microversion: 2.1 time: 0.337160 Sep 13 16:43:31.586179 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1616/3285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:31 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1478 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:31.594915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:31.597697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:31.610828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.613741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.614955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.620082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:31.620823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:31.621437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:31.714076 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-77d783d1-4583-4566-8cca-67843cd9b379 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.283118 Sep 13 16:43:31.725604 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1670/3286] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 16:43:31 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b/os-interface => generated 1831 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:31.917064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:31.952205 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb20b740-a150-4d03-b9c1-df8f4ba854be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1305 microversion: 2.1 time: 0.360310 Sep 13 16:43:31.952864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1617/3287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:31 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1305 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:32.075742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:32.075742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:32.098082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.098596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.102613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.103623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.104131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.107086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.248776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:32.258240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:32.260035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:32.261514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:32.262678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:32.265009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-574a6725-ba1b-4935-9a20-c6210e29fca5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.197540 Sep 13 16:43:32.272268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.273061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.273736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.274931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.275855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.276634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.281042 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1671/3288] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:32 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:32.336416 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c98e578e-85e4-48c2-8c44-9ade47ca0b28 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083794 Sep 13 16:43:32.337955 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1618/3289] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:43:32 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:43:32.436820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:32.441615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:32.464842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.465671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.466456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.471022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.473913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.474625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.548473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:32.551602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:32.581410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.586896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.587653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.588625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.589471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.590198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.622778 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Cannot 'reboot' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action HTTP/1.1 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 28 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: {"reboot": {"type": "HARD"}} Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: exception: Cannot 'reboot' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e565faab-08c0-45f9-bf95-00526c197668', 'body': {'reboot': {'type': 'HARD'}}} Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e565faab-08c0-45f9-bf95-00526c197668 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:43:32.624750 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:32.629017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:32.632086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 409 to user: Cannot 'reboot' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:32.633196 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-453f8583-d524-4cb6-a595-06bf6c722252 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action" status: 409 len: 145 microversion: 2.1 time: 0.088977 Sep 13 16:43:32.634420 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1619/3290] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:43:32 2022] POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action => generated 145 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:43:32.639389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:32.640610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:32.648438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.649333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.650136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:32.651102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:32.651931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:32.652589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.132778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:33.151723 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8fc81ae7-c610-4663-bfda-96733de5ba3e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.718075 Sep 13 16:43:33.159786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1672/3291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:32 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:33.165983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:33.172125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:33.191061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.191581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.192218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.197113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.198331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.200960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.272713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:33.282787 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cba2b434-e46f-477a-a95a-6e9551a594e7 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1478 microversion: 2.1 time: 0.646351 Sep 13 16:43:33.283580 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1620/3292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:32 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1478 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:33.292079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:33.292771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:33.300447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.301020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.301468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.302640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.303105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.303539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.323507 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Cannot 'rebuild' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action HTTP/1.1 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 65 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'rebuild' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e565faab-08c0-45f9-bf95-00526c197668', 'body': {'rebuild': {'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c'}}} Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e565faab-08c0-45f9-bf95-00526c197668 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:43:33.325578 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 409 to user: Cannot 'rebuild' instance e565faab-08c0-45f9-bf95-00526c197668 while it is in vm_state rescued {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:33.329296 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-701c1bf2-b94d-4c82-812d-0153d37fa9be tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action" status: 409 len: 146 microversion: 2.1 time: 0.165830 Sep 13 16:43:33.351729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1673/3293] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:43:33 2022] POST /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668/action => generated 146 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:43:33.356476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f9747c6b-2b82-4d85-b58b-2ef4fb3b97f0 req-1041bfac-1e83-4b35-9b89-74b8630b68be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12adf32c-7a8f-4dc4-bada-d7d24b0c12b9", "name": "network-vif-plugged", "status": "completed", "tag": "923873d5-11f7-442c-9204-9a52f2cc8beb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:33.385323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9747c6b-2b82-4d85-b58b-2ef4fb3b97f0 req-1041bfac-1e83-4b35-9b89-74b8630b68be service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.386208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9747c6b-2b82-4d85-b58b-2ef4fb3b97f0 req-1041bfac-1e83-4b35-9b89-74b8630b68be service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.389388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9747c6b-2b82-4d85-b58b-2ef4fb3b97f0 req-1041bfac-1e83-4b35-9b89-74b8630b68be service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.415559 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f9747c6b-2b82-4d85-b58b-2ef4fb3b97f0 req-1041bfac-1e83-4b35-9b89-74b8630b68be service nova] Creating event network-vif-plugged:923873d5-11f7-442c-9204-9a52f2cc8beb for instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 on n-h1-857467-1 Sep 13 16:43:33.431710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f9747c6b-2b82-4d85-b58b-2ef4fb3b97f0 req-1041bfac-1e83-4b35-9b89-74b8630b68be service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078773 Sep 13 16:43:33.434848 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1674/3294] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:33.445799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:33.448675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:33.461297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.462156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.462977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.464575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.465315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.466029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.685768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:33.702793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:33.706999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:33.711803 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e3b7ab7-a961-414e-b199-b73abb5710c5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.275569 Sep 13 16:43:33.712723 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1675/3295] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:33 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:33.726350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:33.726956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:33.742597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.743156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.745348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.746136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:33.747755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:33.749750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:33.807868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:43:33.878670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:33.894353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fbb7242-139b-459a-8355-ac228ad53ae9 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1305 microversion: 2.1 time: 0.608201 Sep 13 16:43:33.901095 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1621/3296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:33 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1305 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:34.088362 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5d3b46fd-23c7-45ac-bd16-9541eeab6085 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 204 len: 0 microversion: 2.1 time: 0.366215 Sep 13 16:43:34.092998 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1676/3297] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:43:33 2022] DELETE /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:43:34.103202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:34.103877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:34.112367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.113226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.113869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.116435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.117204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.117815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.200190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:34.202281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:34.226028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.227812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.229792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.230590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.231074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.231511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.666717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:34.676459 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c8732f5-d11a-4793-89d7-8c7536b08264 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.490462 Sep 13 16:43:34.682132 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1677/3298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:34 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:34.687469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-06973897-34f5-42b7-928d-14dbfcfab393 req-0c6257d1-349f-4387-ad9c-bb022af8deb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687d11fc-8748-4bd9-b47f-e81e82540bf6", "tag": "43d54a5a-6675-4935-9785-3ad0ab76217f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:34.715506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06973897-34f5-42b7-928d-14dbfcfab393 req-0c6257d1-349f-4387-ad9c-bb022af8deb1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.716007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06973897-34f5-42b7-928d-14dbfcfab393 req-0c6257d1-349f-4387-ad9c-bb022af8deb1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.719349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06973897-34f5-42b7-928d-14dbfcfab393 req-0c6257d1-349f-4387-ad9c-bb022af8deb1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.749571 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-06973897-34f5-42b7-928d-14dbfcfab393 req-0c6257d1-349f-4387-ad9c-bb022af8deb1 service nova] Creating event network-changed:43d54a5a-6675-4935-9785-3ad0ab76217f for instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 on n-h2-857467-1 Sep 13 16:43:34.755684 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-06973897-34f5-42b7-928d-14dbfcfab393 req-0c6257d1-349f-4387-ad9c-bb022af8deb1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071307 Sep 13 16:43:34.756865 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1678/3299] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:34.779424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:34.782562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:34.799963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.800457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.800894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.801600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.802718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.803155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.902783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:34.903279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:34.903917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:34.904168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lazy-loading 'fault' on Instance uuid aac28490-404c-4a73-aec5-70256bda77ca {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:35.097308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:35.102271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32cf9548ed614a049a5527f6b9b5aed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fff203b6f44a4d89668e1498016541', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:35.110783 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3acff61a-4576-471d-8caf-b4733e56c429 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1691 microversion: 2.1 time: 1.012803 Sep 13 16:43:35.111720 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1622/3300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:34 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1691 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:35.129795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a8bd5968-cc7a-4a67-8e6b-f8b722656d26 req-5e0750e3-4062-414e-a8d9-f45d3cd68d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac28490-404c-4a73-aec5-70256bda77ca", "name": "network-vif-deleted", "tag": "a3294947-a467-403a-b077-2cfdff7a17d9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:35.133155 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0404ac77-ee79-4415-8451-8442183fe859 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 200 len: 1313 microversion: 2.1 time: 0.351637 Sep 13 16:43:35.134485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1679/3301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:34 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:35.139655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:35.140724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:35.149091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.150016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.150615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:35.158668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.160043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.160630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a8bd5968-cc7a-4a67-8e6b-f8b722656d26 req-5e0750e3-4062-414e-a8d9-f45d3cd68d24 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.160899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a8bd5968-cc7a-4a67-8e6b-f8b722656d26 req-5e0750e3-4062-414e-a8d9-f45d3cd68d24 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.162062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:35.162233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a8bd5968-cc7a-4a67-8e6b-f8b722656d26 req-5e0750e3-4062-414e-a8d9-f45d3cd68d24 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:35.184624 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a8bd5968-cc7a-4a67-8e6b-f8b722656d26 req-5e0750e3-4062-414e-a8d9-f45d3cd68d24 service nova] Creating event network-vif-deleted:a3294947-a467-403a-b077-2cfdff7a17d9 for instance aac28490-404c-4a73-aec5-70256bda77ca on n-h2-857467-1 Sep 13 16:43:35.194442 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a8bd5968-cc7a-4a67-8e6b-f8b722656d26 req-5e0750e3-4062-414e-a8d9-f45d3cd68d24 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078542 Sep 13 16:43:35.198387 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1623/3302] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:35.205552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:35.206443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:35.227184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.227401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.238886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:35.240931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.241653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.242957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:35.260904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:35.297678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:35.321333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:35.332094 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61767c6c-5d1c-40df-ad83-a4c3dc1840e6 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.186902 Sep 13 16:43:35.333592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1680/3303] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:35 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:35.459665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:35.469418 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b0695da6-5aea-4535-8037-004751298e10 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1305 microversion: 2.1 time: 0.269248 Sep 13 16:43:35.470738 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1624/3304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:35 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1305 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:35.711864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:35.712761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:35.723072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.723575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.724112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:35.724822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:35.725280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:35.725706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.080363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:36.092926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3bcf4808-cb83-419c-871a-2fba912ac95b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.389292 Sep 13 16:43:36.093863 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1681/3305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:35 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:36.141196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:36.142547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:36.152538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.153429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.154084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.154967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.164811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:36.166270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] [instance: aac28490-404c-4a73-aec5-70256bda77ca] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:36.173797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.176372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.179301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.182101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.182747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.185186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.191466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.194413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.237083 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] HTTP exception thrown: Instance aac28490-404c-4a73-aec5-70256bda77ca could not be found. Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Request method failure captured: Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca HTTP/1.1 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILMdBNQa0Dd-9VainYebvzIBFEXqkfCL5cCBRn4yv5AdoF5pRg9-3qYh_QqGXDLmWRGHcJN51p6uY7cIcaP1S9VvoZljQYtcZrgOmcRGRNPkCGtlHfjjgFjmvqOTRCCTzfWxD9JmHZpDDOmsVakINpzpPalucnUjYiao_69WPKKAmdQ Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 98fff203b6f44a4d89668e1498016541 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2069725898 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fff203b6f44a4d89668e1498016541"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98fff203b6f44a4d89668e1498016541"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fff203b6f44a4d89668e1498016541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98fff203b6f44a4d89668e1498016541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2069725898 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 98fff203b6f44a4d89668e1498016541 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2069725898 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerDiagnosticsNegativeTest-2069725898-project Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 32cf9548ed614a049a5527f6b9b5aed2 Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2069725898-project Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance aac28490-404c-4a73-aec5-70256bda77ca could not be found. Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'aac28490-404c-4a73-aec5-70256bda77ca'} Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac28490-404c-4a73-aec5-70256bda77ca could not be found. Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac28490-404c-4a73-aec5-70256bda77ca could not be found. Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:36.238951 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac28490-404c-4a73-aec5-70256bda77ca could not be found. Sep 13 16:43:36.243379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:36.244492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] Returning 404 to user: Instance aac28490-404c-4a73-aec5-70256bda77ca could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:36.245495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-adac1544-fd25-4595-bf0e-0986ee505a85 tempest-ServerDiagnosticsNegativeTest-2069725898 tempest-ServerDiagnosticsNegativeTest-2069725898-project] 10.222.0.61 "GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca" status: 404 len: 111 microversion: 2.1 time: 0.088740 Sep 13 16:43:36.246541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1682/3306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:36 2022] GET /compute/v2.1/servers/aac28490-404c-4a73-aec5-70256bda77ca => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:43:36.364086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:36.365459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:36.376483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.377900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.378370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.381366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.383144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.383632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.485395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:36.513711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:36.523598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4251c5b0-a1d7-41dd-947f-a9f3d041e1c3 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1691 microversion: 2.1 time: 0.386461 Sep 13 16:43:36.543004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:36.544831 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1625/3307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:36 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1691 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:36.549642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:36.551160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:36.552620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:36.557710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:36.558997 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-04a61f2f-c09c-4efa-871d-e9d67c63799c tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.198935 Sep 13 16:43:36.559535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.559884 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1683/3308] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:36 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:36.560518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.561180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.562154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:36.562839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:36.563527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:36.840868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:36.852548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-218d098c-36b0-4dde-b55a-8688fabf401a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1305 microversion: 2.1 time: 0.306293 Sep 13 16:43:36.853151 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1626/3309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:36 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1305 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:37.117579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:37.118241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:37.126400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.127481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.128085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.129005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.129629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.130917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.344096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:37.358260 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be526cba-2b2a-4700-83e8-d315472d491a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.244204 Sep 13 16:43:37.370908 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1684/3310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:37 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:37.554628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:37.556460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:37.566928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=26 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:37.574094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.576629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.578074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.579991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.580662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.582681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.589486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:37.590333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:37.608204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.608951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.609926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.614979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.615968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.616605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.666850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:37.732124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:37.741104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:37.743771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:37.745249 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8467c7d3-fabb-4c97-9b47-bcaf796deffc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.159740 Sep 13 16:43:37.758471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1685/3311] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:37 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:37.876950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:37.877917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:37.879833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:37.890986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.893243 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7998ffdb-aad7-4e1b-873a-3dfa1d340592 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1691 microversion: 2.1 time: 0.346074 Sep 13 16:43:37.893868 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1627/3312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:37 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1691 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:37.902902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.903673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:37.904622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:37.905230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:37.905747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.102813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:38.112215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff109113-058a-4e1b-9888-7d33bf3ee14e tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1305 microversion: 2.1 time: 0.239490 Sep 13 16:43:38.125853 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1686/3313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:37 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1305 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:38.389785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:38.390782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:38.405668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:38.412335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:38.413101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.414865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:38.415840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:38.417564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.432496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e780d9be-ddf3-407c-9c75-500f712c6807 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Action: 'create', calling method: .version_select at 0x7fbeb49e89d0>, body: {"keypair": {"name": "tempest-keypair-763240098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvPmxqY3Y0yiaTHuRCGNU6wUHnDBz500tVFA276gIQG3lcP4kX+lGr8kC/oyElfFiurI/mpOvlraHi2RAoUzzi6x0mnfcS5ogl1NPp9E/hAN8+38wHTz/WBZ0Gzno598w=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:38.467544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e780d9be-ddf3-407c-9c75-500f712c6807 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Getting quotas for project b7adee868bb5465ba80c35321dd54995. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:38.475186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e780d9be-ddf3-407c-9c75-500f712c6807 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Getting quotas for user ffb753f45a3b4e988189cf326973120b and project b7adee868bb5465ba80c35321dd54995. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:38.513752 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e780d9be-ddf3-407c-9c75-500f712c6807 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.423353 Sep 13 16:43:38.514937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1628/3314] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:43:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:43:38.715613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:38.730127 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db8d36be-ac54-4d23-b9dd-4c5b7b31811a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1315 microversion: 2.1 time: 0.349665 Sep 13 16:43:38.730754 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1687/3315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:38 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:38.776439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:38.777153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:38.800773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:38.818962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:38.819435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.822940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:38.823426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:38.823873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.917738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:38.918410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:38.928894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:38.929339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:38.929787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.930518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:38.937587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:38.938146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:38.994797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:39.011335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:39.012924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:39.014516 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6acf50d0-b332-424e-ac01-b5ac3f3de2d5 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.245227 Sep 13 16:43:39.015902 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1629/3316] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:38 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:39.140775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:39.142318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:39.151324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:39.152235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:39.153586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:39.154581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:39.156038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:39.156826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:39.258570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:39.272153 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7aea7891-b376-42a3-8dab-168ae8359326 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1691 microversion: 2.1 time: 0.357610 Sep 13 16:43:39.273179 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1688/3317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:38 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1691 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:39.391276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:39.402062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ab6a71a-c3aa-4da8-a20b-93278a1a5c39 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.269322 Sep 13 16:43:39.402763 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1630/3318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:39 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:39.758267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:39.759942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:39.771917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:39.773755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:39.774439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:39.775154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:39.776040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:39.776745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:39.777290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:39.838379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2e6c63c8-8b68-4d86-a38a-f8f8679fe995 req-a110997e-996a-403c-a13f-cb9a73f8774d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b35670-fff0-424c-ae44-5adf194bb6b2", "name": "network-vif-deleted", "tag": "eb633aec-7996-4ba1-beff-b41c46875ab2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:39.866667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2e6c63c8-8b68-4d86-a38a-f8f8679fe995 req-a110997e-996a-403c-a13f-cb9a73f8774d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:39.868497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2e6c63c8-8b68-4d86-a38a-f8f8679fe995 req-a110997e-996a-403c-a13f-cb9a73f8774d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:39.868986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2e6c63c8-8b68-4d86-a38a-f8f8679fe995 req-a110997e-996a-403c-a13f-cb9a73f8774d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:39.926962 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2e6c63c8-8b68-4d86-a38a-f8f8679fe995 req-a110997e-996a-403c-a13f-cb9a73f8774d service nova] Creating event network-vif-deleted:eb633aec-7996-4ba1-beff-b41c46875ab2 for instance 52b35670-fff0-424c-ae44-5adf194bb6b2 on n-h1-857467-1 Sep 13 16:43:39.940274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2e6c63c8-8b68-4d86-a38a-f8f8679fe995 req-a110997e-996a-403c-a13f-cb9a73f8774d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108309 Sep 13 16:43:39.942117 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1631/3319] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:40.041678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:40.042609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:40.057599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.058111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.058497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.059698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.072832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.073401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.181821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.193071 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-809e2e0b-0166-4cd1-8ab6-c2d1700eb43f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1502 microversion: 2.1 time: 0.440089 Sep 13 16:43:40.194942 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1689/3320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:39 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1502 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:40.218619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a25befe0-974f-45d8-b025-5069ac9a715e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:40.230141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a25befe0-974f-45d8-b025-5069ac9a715e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.230649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a25befe0-974f-45d8-b025-5069ac9a715e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.231094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a25befe0-974f-45d8-b025-5069ac9a715e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.256004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.265243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.272705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.275446 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a4ea798-61d5-4b37-9881-ea60b486fed0 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.238585 Sep 13 16:43:40.290521 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1632/3321] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:40 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:40.307774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:40.310305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:40.326756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.331469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.331921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.335808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.336790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.338108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.405194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a25befe0-974f-45d8-b025-5069ac9a715e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Going to try to stop instance {{(pid=122328) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:43:40.460899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.462280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.464131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.467336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'fault' on Instance uuid 52b35670-fff0-424c-ae44-5adf194bb6b2 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:40.483194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:40.495302 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a25befe0-974f-45d8-b025-5069ac9a715e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9/action" status: 202 len: 0 microversion: 2.1 time: 0.281499 Sep 13 16:43:40.496149 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1690/3322] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:43:40 2022] POST /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:43:40.505027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:40.506785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:40.514345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.516339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.517297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.518254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.518768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.519394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.549103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.561524 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5304277-6374-415c-9997-e18151da45ac tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 200 len: 1336 microversion: 2.1 time: 0.257718 Sep 13 16:43:40.565301 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1633/3323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:40 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 1336 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:40.572625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:40.573357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:40.607620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.608132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.608653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.609388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:40.609890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:40.610328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:40.731930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.744768 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-acf12e55-a837-4edf-9a44-e28b768b62e7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.247236 Sep 13 16:43:40.745625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1691/3324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:40 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:40.879854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:40.891235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-daa8544d-dd54-4528-b370-d1c1e9d3fbbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.324790 Sep 13 16:43:40.892550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1634/3325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:40 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:40.942561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1002229948", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:41.010007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:41.010759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:41.011446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:41.012066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:41.012738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:41.023263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.024214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.024910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.025946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.027014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.027762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.048146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Getting quotas for project 21f15c9606fc444aaca861b527feab03. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:41.054608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Getting quotas for user a79f72e7bbf4452b90c388e58ca5edec and project 21f15c9606fc444aaca861b527feab03. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:41.072731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:43:41.075424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:43:41.137520 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38e36d1d-dbc5-4b72-8176-9bd1a1d7370a tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.390541 Sep 13 16:43:41.138599 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1692/3326] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:43:41.152634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9e851c7-f2ef-4000-9d81-0d8158a08bcb tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:41.155835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9e851c7-f2ef-4000-9d81-0d8158a08bcb tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:41.264690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9e851c7-f2ef-4000-9d81-0d8158a08bcb tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.275219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9e851c7-f2ef-4000-9d81-0d8158a08bcb tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.276704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9e851c7-f2ef-4000-9d81-0d8158a08bcb tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.282170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9e851c7-f2ef-4000-9d81-0d8158a08bcb tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "PUT /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1359 microversion: 2.75 time: 0.135351 Sep 13 16:43:41.282750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1635/3327] 10.222.0.61 () {62 vars in 1297 bytes} [Tue Sep 13 16:43:41 2022] PUT /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1359 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:41.310485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:41.311082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:41.311474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-561de8c5-dc74-4458-8303-f36ac2cbb5dd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:41.312114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-561de8c5-dc74-4458-8303-f36ac2cbb5dd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:41.320822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.321493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.322016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.322781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.323207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.323543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.401390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-561de8c5-dc74-4458-8303-f36ac2cbb5dd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.409967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-561de8c5-dc74-4458-8303-f36ac2cbb5dd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.412119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-561de8c5-dc74-4458-8303-f36ac2cbb5dd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.418400 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-561de8c5-dc74-4458-8303-f36ac2cbb5dd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1359 microversion: 2.75 time: 0.111257 Sep 13 16:43:41.429914 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1636/3328] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:41 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1359 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:41.433706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.445679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1891350820", "imageRef": "db26aa68-2f93-4a74-9b24-871c9493543a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "438a577e-a635-432f-991f-9e0e2d2c075f"}], "security_groups": [{"name": "tempest-securitygroup--354672071"}], "key_name": "tempest-keypair-763240098", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:41.445953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.445953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:41.445953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a03d58ee-c43e-46de-8843-54f5ed41371d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.138118 Sep 13 16:43:41.458308 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1693/3329] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:41 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:41.568649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] validate_networks() for [('438a577e-a635-432f-991f-9e0e2d2c075f', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:43:41.596688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:41.597656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 52b35670-fff0-424c-ae44-5adf194bb6b2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:41.605636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.606774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.607644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.608660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.609342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.610044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.627833 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 could not be found. Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 HTTP/1.1 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 could not be found. Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '52b35670-fff0-424c-ae44-5adf194bb6b2'} Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 could not be found. Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 could not be found. Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:41.629882 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 could not be found. Sep 13 16:43:41.634421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:43:41.636692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 404 to user: Instance 52b35670-fff0-424c-ae44-5adf194bb6b2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:41.637853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef411fe5-93db-4e35-94ff-8fb06fd03e97 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2" status: 404 len: 111 microversion: 2.1 time: 0.046139 Sep 13 16:43:41.650013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1694/3330] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:41 2022] GET /compute/v2.1/servers/52b35670-fff0-424c-ae44-5adf194bb6b2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:43:41.655039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b57d303-1cff-46de-b471-c0607e913a0e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '.version_select at 0x7fbeb5118b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:41.691124 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b57d303-1cff-46de-b471-c0607e913a0e tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147636200" status: 202 len: 0 microversion: 2.1 time: 0.039637 Sep 13 16:43:41.693981 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1695/3331] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147636200 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:43:41.772923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:41.774461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:41.789984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.790517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.791384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:41.792320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:41.792799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:41.793299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.017048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.025788 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8ae2add2-3f41-46b3-adee-255049322f62 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.257707 Sep 13 16:43:42.026405 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1696/3332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:41 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:42.042951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:42.043624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:42.049975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.050738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.051923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.052891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.053624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.054305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.108873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:42.109988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:42.110635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:42.111215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:42.111670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:42.124373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.124373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.124373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.124373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.124373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.124819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.146458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Getting quotas for project b7adee868bb5465ba80c35321dd54995. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:43:42.152373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Getting quotas for user ffb753f45a3b4e988189cf326973120b and project b7adee868bb5465ba80c35321dd54995. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:43:42.166204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:43:42.168571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db26aa68-2f93-4a74-9b24-871c9493543a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:43:42.220210 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d37e911-9d08-430f-82bb-306eceb1ebce tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.794359 Sep 13 16:43:42.221048 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1637/3333] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:43:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:43:42.232313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-483c8a00-730b-4f86-b6bd-e615bd5abe0a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:42.232941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-483c8a00-730b-4f86-b6bd-e615bd5abe0a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:42.292576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-483c8a00-730b-4f86-b6bd-e615bd5abe0a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.300060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-483c8a00-730b-4f86-b6bd-e615bd5abe0a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1245 microversion: 2.1 time: 0.071917 Sep 13 16:43:42.300654 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1638/3334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:42 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:42.318194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.326674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bbaad463-b9e7-4a05-b55e-bf83998f9bbe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.287613 Sep 13 16:43:42.327242 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1697/3335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:42 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:42.452948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:42.453941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:42.463813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.464715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.477726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.479073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.479857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.480536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.481586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:42.483705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:42.496461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.505932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.506951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.507906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:42.508384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:42.509030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:42.622646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.633931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.636160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.636791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.646795 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a3d79791-0937-4430-a33d-a719729f7677 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1419 microversion: 2.75 time: 0.197329 Sep 13 16:43:42.647639 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1639/3336] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:42 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1419 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:42.661905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.665369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:42.667181 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c756f03e-3fb0-47cc-b928-574e6f2a4820 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.200527 Sep 13 16:43:42.668663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1698/3337] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:42 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:43.048745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:43.049685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:43.058675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.059440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.060234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.061408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.062672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.063385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.233736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.243249 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-084eaac8-968f-492f-a3c7-1ab884d38148 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.198585 Sep 13 16:43:43.243824 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1640/3338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:43 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:43.323023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:43.323877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:43.331377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.331955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.332472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.333781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.334341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.335123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.351638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:43.352261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:43.358686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.359235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.359684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.360394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.360861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.361301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.400496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.410973 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-74c72b7d-3ee1-4b92-9a55-452c682491b3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1297 microversion: 2.1 time: 0.091857 Sep 13 16:43:43.417877 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1699/3339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:43 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:43.501094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.509652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24b9051a-12bc-4efa-8daf-70872ecf2a53 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.162919 Sep 13 16:43:43.510557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1641/3340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:43 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:43.677206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:43.677848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:43.684323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.684820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.685269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.686007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.686474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.686909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.695543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:43.696272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:43.702612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.703120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.703645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.704431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:43.705105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:43.705618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:43.761034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.770485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.772998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.778949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.779139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b65e47f-7ec7-4014-b230-bc141c72ef21 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1417 microversion: 2.75 time: 0.106429 Sep 13 16:43:43.779888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1700/3341] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:43 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1417 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:43.787842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.789305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:43.790743 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-67d7a0b1-e33f-4cdf-8b06-283d9c0dd429 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.100498 Sep 13 16:43:43.791365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1642/3342] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:43 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:44.266915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:44.267463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:44.274608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.275104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.275673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.276388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.276850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.277282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.414522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:44.423017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b9d9790-58ac-46b0-be38-7a31ea60cc5d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.160485 Sep 13 16:43:44.423730 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1701/3343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:44 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:44.435902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:44.437194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:44.445004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.445592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.446134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.447098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.447991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.448437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.513008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:44.521755 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4e28b36-3ca1-45be-b96a-38223d61f5a5 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1297 microversion: 2.1 time: 0.090128 Sep 13 16:43:44.522299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1643/3344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:44 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:44.541158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:44.542480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:44.550233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.550851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.551320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.552132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.552808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.553239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.696981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:44.704928 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14fe9784-dc5a-4f9a-a51b-122e6f4b3d51 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.169640 Sep 13 16:43:44.705774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1702/3345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:44 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:44.808265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:44.808810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:44.811463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:44.817339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.818485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.818944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.819656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:44.819783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.820154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.820595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.821130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:44.829375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.830408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.830911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.831852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:44.832670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:44.833919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:44.859198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:44.904325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:44.916774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:44.918805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:44.925260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-de48a3ff-c856-443b-a40d-c1f21226961c tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1417 microversion: 2.75 time: 0.121187 Sep 13 16:43:44.926638 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1644/3346] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:44 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1417 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:45.249119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:45.258043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:45.259512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:45.260706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66dc47d5-8e48-4fac-91b9-f495762bbd00 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.447537 Sep 13 16:43:45.261644 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1703/3347] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:44 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:45.446667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:45.447211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:45.462062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.462062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.462062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.462611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.462611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.463058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.555942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:45.560004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:45.585096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.585814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.587156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.589762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.591203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.592400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.648163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:45.658065 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a37833da-71bb-4f34-a19f-1f7b7846a715 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.215919 Sep 13 16:43:45.659807 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1645/3348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:45 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:45.678778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:45.688555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f1c3582-06f2-4362-9de6-bed7253b3a2e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1297 microversion: 2.1 time: 0.141441 Sep 13 16:43:45.690249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1704/3349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:45 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:45.730009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:45.730629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:45.736656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.737152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.737595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.738324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.738781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.739213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.877793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:45.885943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a678582-9dc8-41cd-af10-18801d4cd14c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.160036 Sep 13 16:43:45.886516 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1646/3350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:45 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:45.952622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:45.953262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:45.960711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.961224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.961667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:45.962388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:45.963163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:45.963722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.035695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.048270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.050423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.057012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90921bce-1eac-488e-98f6-39b2b664cc43 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1417 microversion: 2.75 time: 0.108335 Sep 13 16:43:46.057745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1705/3351] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:45 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1417 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:46.287406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:46.288180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:46.294746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.295326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.295852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.296650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.297416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.297933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.394506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.406793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.408490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.415317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df172ffd-135e-431f-965e-0a1b6e0162dc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.131958 Sep 13 16:43:46.434961 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1647/3352] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:46 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:46.682149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:46.682777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:46.690735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.691475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.691911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.693147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.693626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.694089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.715368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:46.716743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:46.727603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.728450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.729078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.730108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.730726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.731314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.835038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.844064 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6cd618b0-81ec-48b0-a2c8-e6ebe7ae31b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1315 microversion: 2.1 time: 0.134280 Sep 13 16:43:46.858261 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1648/3353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:46 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:46.873695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:46.886791 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fbc7ba15-63fb-489f-b7f5-be43c226564a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.208610 Sep 13 16:43:46.889717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1706/3354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:46 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:46.912923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:46.913967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:46.922173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.922975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.923487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:46.924507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:46.924983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:46.925721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.070871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.078716 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a11ea41-0bc5-4ee4-b547-6ddc94cdeda8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.170191 Sep 13 16:43:47.079830 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1649/3355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:46 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:47.101238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:47.101959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:47.108236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.108806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.109316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.110119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.110654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.111148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.183495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.192265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.194733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.200544 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0c8ce79-0ac4-4882-bc8c-dee6639d04ec tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1417 microversion: 2.75 time: 0.104155 Sep 13 16:43:47.201209 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1707/3356] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:47 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1417 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:47.443757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:47.444534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:47.452252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.453014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.453802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.454658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.455298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.455861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.544225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.559966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.561484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:47.563232 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-408df813-d56a-4a60-8223-8a425f5e8b39 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.125129 Sep 13 16:43:47.564168 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1650/3357] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:47 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:47.874224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:47.874895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:47.908298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.919778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:47.930753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:47.930976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.931270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.932357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.932846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.933324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.945861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.946761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.947554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:47.957062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:47.959302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:47.961910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.093779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.108253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf454f83-c32d-4fe8-8805-b4ab03a6ba3d tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1303 microversion: 2.1 time: 0.241297 Sep 13 16:43:48.111229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1708/3358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:47 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1303 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:48.141287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:48.151904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:48.179792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.184036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.192593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.201745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.202515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.203146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.385684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.400858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b83e0f80-ad39-45c4-bb31-af2e8ab370eb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.485551 Sep 13 16:43:48.402688 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1651/3359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:47 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:48.413168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:48.413844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:48.431638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.432454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.433094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.436135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.436865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.437772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.584200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.602931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.609056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.612172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.617362 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4dfce96f-047d-4e74-a7c2-465ff40daae0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.490826 Sep 13 16:43:48.618916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1709/3360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:48 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:48.634368 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98b1b79e-29a6-4f68-99bc-6bb24a7f366e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1438 microversion: 2.75 time: 0.218273 Sep 13 16:43:48.634368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1652/3361] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:48 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1438 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:48.634368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:48.634368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:48.637948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.640486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.641352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.642438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.642927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.643369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.682105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:48.695411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:48.723464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.726610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.727589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.730212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:48.732905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:48.733414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:48.800030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.805024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:48.817202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.819414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:48.820681 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9f9fb14-c3e3-4582-a32e-37d0095463fa tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.194712 Sep 13 16:43:48.821458 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1653/3362] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:48 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:48.928369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:43:48.929263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:43:48.929705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:43:48.930160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:43:48.930578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:43:49.120540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:49.142058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.142771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.144152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:49.144806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:49.145328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.147838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.148582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.150102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.159903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.161955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.161955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.167349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.167889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.169533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.274943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.294225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.296886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.309769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ca0ff0f-524a-4016-90df-8f141b095c1d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "POST /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c/action" status: 202 len: 1495 microversion: 2.75 time: 0.642813 Sep 13 16:43:49.310481 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1710/3363] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:43:48 2022] POST /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c/action => generated 1495 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 13 16:43:49.344724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:49.346178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:49.367395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.368238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.371706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.376414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.377516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.381559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.528641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.537800 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dbcf4fbb-4213-4fc8-85f3-0f554a2af6b6 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.399106 Sep 13 16:43:49.539036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1654/3364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:49 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:49.543965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:49.544668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:49.559849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.560716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.561375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.562189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.562722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.563534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.596282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:43:49.618044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.636646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.638171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:49.650046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df562148-fb60-47d1-b1dc-de41dceae234 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.309003 Sep 13 16:43:49.650046 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1711/3365] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:49 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:49.663057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:49.663692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:49.674843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.675299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.675745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.676468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.677531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.686382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.863019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4aa93aaf-b70b-4d0a-8060-2125b178e8d2 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 204 len: 0 microversion: 2.1 time: 0.320931 Sep 13 16:43:49.870891 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1655/3366] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:43:49 2022] DELETE /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:43:49.885228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:49.889408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:49.928786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.929320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.929780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:49.930554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:49.931029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:49.931476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.037599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.058086 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a42c43a-0a00-48ad-a062-b6db7448fd05 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.407266 Sep 13 16:43:50.063785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1712/3367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:49 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:50.080492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:50.085908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:50.096473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.098427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.101575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.102687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.103335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.103938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.238868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.248261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.251542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.260269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.261072 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fecbaef6-403c-468e-b24f-6fd084cd8830 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.388707 Sep 13 16:43:50.262084 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1656/3368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:49 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:50.262219 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-947c17db-1257-4489-b799-ab968b061be7 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1408 microversion: 2.54 time: 0.190936 Sep 13 16:43:50.263260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1713/3369] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:50 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:50.292383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:50.293020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:50.313162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.313686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.318142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.319144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.320181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.320653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.561618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-15caf778-46bd-48f4-9979-23c1d58b59b9 req-0f074021-b8b4-4809-831b-87c5688822dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a435525-7634-4d9e-80cd-0dabbf12a21a", "tag": "3cd8b977-33c4-484c-9df5-aaa7bd38789d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:50.579439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.595417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-15caf778-46bd-48f4-9979-23c1d58b59b9 req-0f074021-b8b4-4809-831b-87c5688822dd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.596097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-15caf778-46bd-48f4-9979-23c1d58b59b9 req-0f074021-b8b4-4809-831b-87c5688822dd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.596226 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-514b5258-dc08-4aba-b042-35020513b59a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1508 microversion: 2.1 time: 0.332832 Sep 13 16:43:50.596939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-15caf778-46bd-48f4-9979-23c1d58b59b9 req-0f074021-b8b4-4809-831b-87c5688822dd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.611876 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1657/3370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:50 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:50.617488 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-15caf778-46bd-48f4-9979-23c1d58b59b9 req-0f074021-b8b4-4809-831b-87c5688822dd service nova] Creating event network-changed:3cd8b977-33c4-484c-9df5-aaa7bd38789d for instance 3a435525-7634-4d9e-80cd-0dabbf12a21a on n-h2-857467-1 Sep 13 16:43:50.627299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-15caf778-46bd-48f4-9979-23c1d58b59b9 req-0f074021-b8b4-4809-831b-87c5688822dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069312 Sep 13 16:43:50.634991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1714/3371] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:50.638495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:50.639148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:50.647121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.647632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.648088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.648817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.649363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.649813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.696426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:50.697207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:50.707211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.707720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.708228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.709161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:50.709630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:50.710097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:50.843265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.864514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.866812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.871848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:50.874985 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-284e71a3-664b-44d2-825d-2d935de5fb09 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.182749 Sep 13 16:43:50.876181 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1715/3372] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:50 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:50.882899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62baeb26-c13a-498c-9caf-2ad3914085f7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.269522 Sep 13 16:43:50.883664 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1658/3373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:50 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:51.094407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:51.095071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:51.101546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:51.102266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:51.103764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.104333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.104782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.105496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.106070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.106515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.278617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6281d90d-236f-4aa5-b34f-ddb89aac50c6 req-bc0c3b82-9e5e-4fd5-a164-2a5836aeae01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687d11fc-8748-4bd9-b47f-e81e82540bf6", "name": "network-vif-plugged", "status": "completed", "tag": "43d54a5a-6675-4935-9785-3ad0ab76217f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:51.318899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6281d90d-236f-4aa5-b34f-ddb89aac50c6 req-bc0c3b82-9e5e-4fd5-a164-2a5836aeae01 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.319655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6281d90d-236f-4aa5-b34f-ddb89aac50c6 req-bc0c3b82-9e5e-4fd5-a164-2a5836aeae01 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.320563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6281d90d-236f-4aa5-b34f-ddb89aac50c6 req-bc0c3b82-9e5e-4fd5-a164-2a5836aeae01 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.345381 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6281d90d-236f-4aa5-b34f-ddb89aac50c6 req-bc0c3b82-9e5e-4fd5-a164-2a5836aeae01 service nova] Creating event network-vif-plugged:43d54a5a-6675-4935-9785-3ad0ab76217f for instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 on n-h2-857467-1 Sep 13 16:43:51.353208 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6281d90d-236f-4aa5-b34f-ddb89aac50c6 req-bc0c3b82-9e5e-4fd5-a164-2a5836aeae01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083695 Sep 13 16:43:51.354885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1659/3374] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 13 16:43:51.360980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:51.362584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:51.372951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.382354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.383134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.385114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.385871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.386844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.395883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:51.418298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31de2789-057e-4e6f-b0fe-f7a9829bcfa7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.333226 Sep 13 16:43:51.422189 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1716/3375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:51 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:51.440275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:51.441290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:51.455509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.456330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.456777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.457593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.458159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.458847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.497300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:51.513097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:51.514610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:51.516108 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e3e6654-7f43-47bc-8442-10d8464b49e1 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1426 microversion: 2.54 time: 0.159618 Sep 13 16:43:51.516686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1660/3376] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:51 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:51.624930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:51.625844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:51.633003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.633003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.633457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.639890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.644254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.644814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.645335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:51.658410 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4def73a5-687c-4199-8d35-6ededa2d27fe tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.233006 Sep 13 16:43:51.659593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1717/3377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:51 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:51.818976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:51.827042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a8e00e46-55f2-41e1-ab6e-716702ae4cea tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1508 microversion: 2.1 time: 0.205920 Sep 13 16:43:51.827821 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1661/3378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:51 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:51.910325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:51.910960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:51.920608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.923906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.924403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.925222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.925709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.926187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.933726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:51.933726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:51.944375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.945208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.951918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.952897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:51.953390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:51.953923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:51.977360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:52.109351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.127718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.129648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.130626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.134770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:52.140994 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e4e75dc9-b14c-4d05-a0c2-b5bd30455b5f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.219016 Sep 13 16:43:52.144561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b692c07b-646c-4bdd-a3c1-7e8dcf4497bc tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.239249 Sep 13 16:43:52.149253 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1718/3379] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:51 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:52.151025 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1662/3380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:51 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:52.442115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:52.443832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:52.452568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.453268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.453923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.454812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.455436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.456029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.544254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:52.545149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:52.547449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=16 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:52.555886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.556406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.556858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.557591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.558249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.558756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.626759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.638548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-744d0827-8b1d-454a-9e13-f795c0881ebf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.200292 Sep 13 16:43:52.640129 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1719/3381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:52 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:52.650365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.660492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.662995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:52.664156 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71c3b23f-c496-47b8-a0bf-d555fd88dfcf tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1414 microversion: 2.54 time: 0.123953 Sep 13 16:43:52.665321 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1663/3382] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:52 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:52.666148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fe9c78fb-44b6-4b55-a2d4-6c774f21e89b req-56893c35-5827-4335-9458-d3583c227b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e565faab-08c0-45f9-bf95-00526c197668", "name": "network-vif-deleted", "tag": "1b19af59-b1ea-4217-b7ff-9214db2d2ffd"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:43:52.680157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fe9c78fb-44b6-4b55-a2d4-6c774f21e89b req-56893c35-5827-4335-9458-d3583c227b18 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.680640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fe9c78fb-44b6-4b55-a2d4-6c774f21e89b req-56893c35-5827-4335-9458-d3583c227b18 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.681082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fe9c78fb-44b6-4b55-a2d4-6c774f21e89b req-56893c35-5827-4335-9458-d3583c227b18 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.684570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:52.685577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:52.693066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.693558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.694273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.695559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.696029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.696469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.696838 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fe9c78fb-44b6-4b55-a2d4-6c774f21e89b req-56893c35-5827-4335-9458-d3583c227b18 service nova] Creating event network-vif-deleted:1b19af59-b1ea-4217-b7ff-9214db2d2ffd for instance e565faab-08c0-45f9-bf95-00526c197668 on n-h1-857467-1 Sep 13 16:43:52.712196 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fe9c78fb-44b6-4b55-a2d4-6c774f21e89b req-56893c35-5827-4335-9458-d3583c227b18 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049661 Sep 13 16:43:52.713069 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1720/3383] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:43:52.851648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:52.852522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:52.871186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.871688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.872139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:52.873447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:52.873941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:52.874443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.023234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.032440 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-488dff0a-750f-4fc2-9e89-7485a310341a tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1466 microversion: 2.1 time: 0.185953 Sep 13 16:43:53.033237 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1721/3384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:52 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1466 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:53.117934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.127963 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0c22cb2-7acd-4f25-ba12-bd37a1da61b9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.447514 Sep 13 16:43:53.131775 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1664/3385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:52 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:53.168007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:53.168675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:53.174805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:53.176425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:53.176717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.177058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:53.177258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.177684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.178755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.179375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.179879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.183950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.184463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.185000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.186844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.186844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.186844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.280259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.289081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.290909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.296889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21a1c84a-5387-4541-8e15-6ccf3def3a62 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.124424 Sep 13 16:43:53.297694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1665/3386] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:53 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:43:53.337875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.346396 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92849404-f8bd-485c-ba5c-1b816968df0f tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.183005 Sep 13 16:43:53.346986 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1722/3387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:53 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:53.663343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:53.664110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:53.670156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.670650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.671099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.671796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.672286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.672715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.693134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:53.693757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:53.701749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.702287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.702882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.703612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:53.704082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:53.704522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:53.783285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.792151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.793630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.794901 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-007b42f9-8c95-4a28-8aa2-5ea14f25cd06 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1414 microversion: 2.54 time: 0.106926 Sep 13 16:43:53.806339 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1723/3388] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:53 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:53.851042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:53.859202 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e627518-aff3-446d-8016-e380628d2cb7 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.201321 Sep 13 16:43:53.860036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1666/3389] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:53 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:54.057250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:54.057946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:54.064652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.065217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.068514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.069341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.069929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.070438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.137372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.146263 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e659739-8a24-4b48-b410-88ea16d28ea8 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1466 microversion: 2.1 time: 0.092921 Sep 13 16:43:54.151433 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1724/3390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:54 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1466 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:54.151821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:54.152460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:54.158877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.159383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.159836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.160555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.161028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.162418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.310994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.320232 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f75376f-0799-4515-ab4d-3bedd1ac06fb tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.172559 Sep 13 16:43:54.320863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1667/3391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:54 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:54.332996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:54.334426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:54.344322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.349160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.349623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.350481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.350964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.353813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.372730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:54.373497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:54.382556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.383770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.384324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.385059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.386010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.386462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.459314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.481181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.482876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.492994 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b53b70b-992b-4723-bf65-de9905df9b16 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.168168 Sep 13 16:43:54.493926 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1725/3392] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:54 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:54.617117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.626931 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd22b668-74cf-44a3-a17f-8cd405f83a3b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.258239 Sep 13 16:43:54.627527 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1668/3393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:54 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:54.821052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:54.822085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:54.828984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.829485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.830011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.830718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.831185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.831628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.884093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:54.884842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:54.893751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.894381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.894836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.895626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:54.896652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:54.896813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:54.904437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.928224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.929871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:54.931131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-385f910d-282a-4c02-89a9-5c8078cf7172 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1414 microversion: 2.54 time: 0.114115 Sep 13 16:43:54.949997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1726/3394] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:54 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:54.950233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:55.067278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.078081 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0cd2e75-49bc-4b71-b64e-c0f5b60fa1bc tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.199437 Sep 13 16:43:55.078686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1669/3395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:54 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:55.170688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:55.171224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:55.178429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.178919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.179359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.180058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.180523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.180956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.221052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.221547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.222023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.222483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'fault' on Instance uuid e565faab-08c0-45f9-bf95-00526c197668 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:55.267182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.275105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-16f236b0-2639-454b-9334-7cc6d5512588 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1312 microversion: 2.1 time: 0.108399 Sep 13 16:43:55.275684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1727/3396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:55 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:55.342789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:55.343417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:55.351303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.351813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.352267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.352993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.353466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.353934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.516688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.521735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:55.523874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:55.528283 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e86251a0-f620-45b7-a028-6e9d3a592e8a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.189556 Sep 13 16:43:55.530659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.530961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.531498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.532221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.532881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.533476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.546556 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1670/3397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:55 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:55.622855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.632079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.633543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.638674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-15b5d220-0ad7-4ab1-9daf-01d6d3cc92ab tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.121735 Sep 13 16:43:55.639265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1728/3398] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:55 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:55.650113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:55.650741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:55.657062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.657566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.659266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.659995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.660461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.660900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.813422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:55.824507 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ef8c60c-8fe7-4e08-aeba-257065a4cc8a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.178439 Sep 13 16:43:55.825101 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1671/3399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:55 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:55.960079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:55.960774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:55.967484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.967982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.968421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:55.969131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:55.969620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:55.970095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.071998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.085243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.087062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.100099 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85a18b39-6e3a-4df0-8852-2f57c7e4e399 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1414 microversion: 2.54 time: 0.143491 Sep 13 16:43:56.101172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:56.101799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:56.102236 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1729/3400] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:55 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:56.125104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.125605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.126081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.126803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.127270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.127708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.299154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:56.299436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:56.307662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.308176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.308635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.309395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.309896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.310346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.377451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.377998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.378450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.378966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'fault' on Instance uuid e565faab-08c0-45f9-bf95-00526c197668 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:43:56.379761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.396099 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-adbfb558-806e-4047-a38f-9bbab8ba8d32 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.298491 Sep 13 16:43:56.397764 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1672/3401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:56 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:56.439641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.446925 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ffdfe9b-73a5-4a48-8ef7-9f200b3c9681 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 200 len: 1312 microversion: 2.1 time: 0.152137 Sep 13 16:43:56.447552 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1730/3402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:56 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:56.553272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:56.553925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:56.561697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.562649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.563119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.563840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.564314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.564753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.667574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:56.668175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:56.674198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.674691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.675136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.675839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.676303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.676733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.693730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.701675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-38b0b02e-d011-4c2d-9a1d-801fac00f99c tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.153128 Sep 13 16:43:56.702376 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1673/3403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:56 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:56.747695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.755887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.757329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.762242 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c8442c0-c703-4e81-8641-7ce92df820d0 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.098575 Sep 13 16:43:56.762822 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1731/3404] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:56 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:56.847439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:56.847989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:56.855077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.855571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.856020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.856724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:56.857189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:56.857626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:56.991755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:56.999489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d265d3d5-e9ab-4ccc-807c-988bf5fb0f4a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.156043 Sep 13 16:43:57.000089 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1674/3405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:56 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:57.128800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.129333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.136575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.137060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.137530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.138285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.138740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.139163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.202996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.212232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.213664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.215265 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d732449a-1a61-4228-90c8-01b3ab5972fc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1399 microversion: 2.54 time: 0.090336 Sep 13 16:43:57.215872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1732/3406] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1399 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:57.245288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4cae125-cccd-48e2-be00-f20214a3ffbc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '.version_select at 0x7fbeb97bd9d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.264850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4cae125-cccd-48e2-be00-f20214a3ffbc tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1265907539" status: 204 len: 0 microversion: 2.54 time: 0.023489 Sep 13 16:43:57.265433 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1675/3407] 10.222.0.61 () {60 vars in 1319 bytes} [Tue Sep 13 16:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1265907539 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 16:43:57.280341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.280856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.288075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.288638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.289077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.289768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.290544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.290976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.317060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:43:57.361239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:57.393122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a6130b3-ad89-4b80-b235-5868976221f3 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 204 len: 0 microversion: 2.54 time: 0.116424 Sep 13 16:43:57.393709 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1733/3408] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:43:57 2022] DELETE /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:43:57.402529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.403154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.410264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.410760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.411723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.412621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.413095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.413536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.420448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.421403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.428223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.428711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.429151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.429866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.430329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.430754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.479923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.488239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.490499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.491705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79b6d2c3-d7a5-42ef-b634-48547cbd9b1d tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1405 microversion: 2.54 time: 0.093704 Sep 13 16:43:57.492283 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1676/3409] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:57.502438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.503159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: e565faab-08c0-45f9-bf95-00526c197668] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.510661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.511171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.511643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.512370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.512871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.513315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.531636 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Instance e565faab-08c0-45f9-bf95-00526c197668 could not be found. Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 HTTP/1.1 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e565faab-08c0-45f9-bf95-00526c197668 could not be found. Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e565faab-08c0-45f9-bf95-00526c197668'} Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e565faab-08c0-45f9-bf95-00526c197668 could not be found. Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e565faab-08c0-45f9-bf95-00526c197668 could not be found. Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:57.533464 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e565faab-08c0-45f9-bf95-00526c197668 could not be found. Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 404 to user: Instance e565faab-08c0-45f9-bf95-00526c197668 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50128ecd-bfe4-45d8-9d02-b2c029f36a47 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668" status: 404 len: 111 microversion: 2.1 time: 0.036720 Sep 13 16:43:57.539564 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1677/3410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/e565faab-08c0-45f9-bf95-00526c197668 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:43:57.543977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.544346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.550523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.551024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.551479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.552865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.553339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.553778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.580292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:43:57.666523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-862dfbdb-b2d9-4e12-bd4a-c4888803fc00 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "DELETE /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 204 len: 0 microversion: 2.1 time: 0.125740 Sep 13 16:43:57.667040 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1678/3411] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:43:57 2022] DELETE /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:43:57.672121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.679777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.680379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9a0aefb-7c54-4144-8fbf-35cd1c626e96 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.264149 Sep 13 16:43:57.680766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.689904 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1734/3412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:57.690081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.690081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.690081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.690081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.690081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.690081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.725392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.726054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.732124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.732806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.733248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.734129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.734593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.735019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.827283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.835909 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a69a020b-e902-4b9e-8ce8-a9b1e9e4f017 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.160788 Sep 13 16:43:57.836674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1679/3413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:57.851115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:57.851735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:57.857767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.858285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.858722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.859425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:57.859885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:57.860315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:57.869965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.877853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39f63b60-61d1-418c-9b76-de90e52681b7 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.157193 Sep 13 16:43:57.878461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1735/3414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:57.931563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.939902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.941347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:57.946978 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef2453b5-a04b-40f1-b8d2-a06d1a86244d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.109439 Sep 13 16:43:57.947549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1680/3415] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:57 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:58.023493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:58.024107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:58.030099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.030587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.031024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.031713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.032167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.032591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.165635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:58.173436 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e5b4683-90e1-4cca-b208-54a8eba847f9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.154573 Sep 13 16:43:58.174036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1736/3416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:58 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:58.520888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:58.521772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:58.528676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.530208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.530660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.531895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.532364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.532800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.599509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:58.607642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:58.609107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:58.610313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77527969-de47-4a2a-a899-7fde02b56b27 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1405 microversion: 2.54 time: 0.097676 Sep 13 16:43:58.610881 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1681/3417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:58 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:58.703565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:58.704218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:58.710821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.711315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.711758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.712459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.712921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.713361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.847304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:58.855808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6bc82cd4-f698-4908-84b5-f92ac04ac626 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.156153 Sep 13 16:43:58.856382 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1737/3418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:58 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:58.859841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:58.860462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:58.867221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.867711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.868152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.868852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.869312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.869742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.900983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:58.901639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:58.907825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.908335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.908817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:58.909606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:58.910147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:58.910588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.001442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.009818 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1547d2fb-3363-45e0-98e5-c16aa4275432 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.153877 Sep 13 16:43:59.010422 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1682/3419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:58 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:43:59.022049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:59.022049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:59.022049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:43:59.026996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.026996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.026996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.026996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.026996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.027484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.043837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.051575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8499445c-2ad4-4ca3-a327-7ea5b68f0fbf tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.154532 Sep 13 16:43:59.056033 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1738/3420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:58 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:59.098522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.107377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.108850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.113652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f64a97a0-930f-43e0-a6fd-1689b44faa99 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.102273 Sep 13 16:43:59.114273 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1683/3421] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:59 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:59.195778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:59.196392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:59.202813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.203298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.203733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.204419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.204872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.205296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.341512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.350535 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-033a8d80-c063-4193-a2b7-cbafa3fe4cb9 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.158525 Sep 13 16:43:59.351098 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1739/3422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:59 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:43:59.636843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:59.637467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:59.644584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.645090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.645544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.647102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.647580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.648014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.713960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.722198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.723670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:43:59.724863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b79d91e7-baa5-4823-aec7-f730035b2923 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1405 microversion: 2.54 time: 0.092076 Sep 13 16:43:59.725427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1684/3423] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:43:59 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:43:59.879226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:43:59.879851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:43:59.887245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.887683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.888128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:43:59.888829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:43:59.889301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:43:59.889737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.020417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.028306 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db13269b-0baa-426a-ac37-f91c62a3581c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.153029 Sep 13 16:44:00.028888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1740/3424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:43:59 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:00.034855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:00.035475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:00.041593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.042140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.042583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.043283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.043744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.044174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.074961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:00.075575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:00.081587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.082120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.082572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.083890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.084359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.084795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.180244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.193185 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db37d622-8901-407b-bc41-cd7b8a798053 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.161757 Sep 13 16:44:00.194006 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1685/3425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:00 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:00.199042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:00.199670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:00.205808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.206372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.206826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.207547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.208023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.209059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.213415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:00.226833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.235016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e5f6315-d97b-4d44-abf1-3f64e0fed712 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.163937 Sep 13 16:44:00.235600 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1741/3426] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:00 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:00.277796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.285992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.287526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.292297 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-657762f9-d17f-44fe-a0bb-ffe6608a2b8e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.097242 Sep 13 16:44:00.292876 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1686/3427] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:00 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:00.373337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:00.373989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:00.380538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.381371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.381846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.382544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.383007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.383440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.512169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.520187 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fb4602b1-8058-479a-bf68-a2b609d53e45 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.150826 Sep 13 16:44:00.521560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1742/3428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:00 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:00.749575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:00.750234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:00.759080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.759576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.760023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.760769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:00.761241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:00.761678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:00.831833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.840206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.841677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:00.842895 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d85ab490-0071-4809-91c8-b6565a2d9659 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1405 microversion: 2.54 time: 0.097266 Sep 13 16:44:00.843477 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1687/3429] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:00 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:01.050724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:01.051472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:01.059260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.059760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.060426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.060906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.061400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.061847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.217359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:01.218049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:01.229276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.229562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.230091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.230985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.231461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.231907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.320400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.340844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4e2e74b-bb1e-45ed-933e-4274384c8a9c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.293971 Sep 13 16:44:01.341975 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1743/3430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:01 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:01.356919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:01.357751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:01.365032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.365626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.366165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.366985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.367471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.367978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.437383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.450622 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08753af5-80a3-4146-b52c-55e97052fe6f tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1520 microversion: 2.1 time: 0.237746 Sep 13 16:44:01.451410 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1688/3431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:01 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:01.456693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:01.457329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:01.465525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.465768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.466173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.466893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.467367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.468324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.545096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.556064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.557815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.562924 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35a97c54-f705-446a-bd8b-270c72d3e574 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.110417 Sep 13 16:44:01.563499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1689/3432] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:01 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:01.584636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:01.585708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:01.592350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.592853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.593301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.594482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.594963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.595438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.706178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.715895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf577ae7-1994-4b2b-aebb-d51e778844e6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.372458 Sep 13 16:44:01.716269 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1744/3433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:01 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:01.734816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:01.743353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-81ffaafc-929c-4671-bfb9-ff1f03c0fb5e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.178859 Sep 13 16:44:01.743927 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1690/3434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:01 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:01.870380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:01.871014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:01.877301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.877805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.878287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.879001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.879646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.880469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.882908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ffba8266-91e8-461d-9f1b-79d2207617f6 req-e4e17528-71e4-4ad8-88f0-1286bd5b2f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c0e9c-0bc9-41bb-a17f-7986492880d5", "name": "network-vif-deleted", "tag": "55c2916e-ebd6-4dcc-b800-4cf6381fe6b6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:01.895908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ffba8266-91e8-461d-9f1b-79d2207617f6 req-e4e17528-71e4-4ad8-88f0-1286bd5b2f26 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.896546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ffba8266-91e8-461d-9f1b-79d2207617f6 req-e4e17528-71e4-4ad8-88f0-1286bd5b2f26 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.897121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ffba8266-91e8-461d-9f1b-79d2207617f6 req-e4e17528-71e4-4ad8-88f0-1286bd5b2f26 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.910866 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ffba8266-91e8-461d-9f1b-79d2207617f6 req-e4e17528-71e4-4ad8-88f0-1286bd5b2f26 service nova] Creating event network-vif-deleted:55c2916e-ebd6-4dcc-b800-4cf6381fe6b6 for instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 on n-h1-857467-1 Sep 13 16:44:01.917529 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ffba8266-91e8-461d-9f1b-79d2207617f6 req-e4e17528-71e4-4ad8-88f0-1286bd5b2f26 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038416 Sep 13 16:44:01.918727 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1691/3435] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:01.931439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:01.931944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:01.932391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:01.932865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lazy-loading 'fault' on Instance uuid f34fc05d-3470-4945-b809-758080fbb504 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:02.008404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.025215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.026832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559e54c1b0cd4030b224ba20f122c731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f6656e6c8e4768a904b8b291f1ac5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.028350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d90c76ad-0c16-4155-89b7-bf07135db609 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 200 len: 1410 microversion: 2.54 time: 0.163943 Sep 13 16:44:02.029006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1745/3436] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:01 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:02.365384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:02.366560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:02.373210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.373702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.374172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.374874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.375337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.375772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.477715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:02.478404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:02.485509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.486655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.486655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.487167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.487876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.488323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.520638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.526813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.527314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.527982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.528615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lazy-loading 'fault' on Instance uuid 384c0e9c-0bc9-41bb-a17f-7986492880d5 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:02.542611 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-024f075d-2e7d-42ca-9e33-0afdb10ee333 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1293 microversion: 2.1 time: 0.181727 Sep 13 16:44:02.543264 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1692/3437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:02 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:02.590767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '780658a6bd6649bf889299f03d80c145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce4b7f916b64240af037c66c8665c53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.592001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:02.592625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:02.599522 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff30a936-cce5-4d4d-b7d3-858ca6a49f32 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 200 len: 1311 microversion: 2.1 time: 0.125742 Sep 13 16:44:02.600227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1746/3438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:02 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:02.603637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.604295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.604749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.605457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.605941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.606375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.679048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.688923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.690439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.696035 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34418614-fac4-4e24-ae29-f5003d7b48d1 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.108627 Sep 13 16:44:02.696616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1693/3439] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:02 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:02.740937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:02.741560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:02.748035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.748379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.748817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.749528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.750044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.750479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.766888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:02.767722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:02.776676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.777472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.778135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.779041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:02.779516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:02.779964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:02.922510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.930561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c932e537-2899-4c89-8a73-a687973b0aa0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.193927 Sep 13 16:44:02.931164 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1747/3440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:02 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:02.932731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:02.950006 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50ecec09-c183-433a-a0e7-6c29abe7a6e8 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.187467 Sep 13 16:44:02.950587 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1694/3441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:02 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:03.056323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.057092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] [instance: f34fc05d-3470-4945-b809-758080fbb504] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.063257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.063920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.064364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.065066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.065564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.066075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.080592 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] HTTP exception thrown: Instance f34fc05d-3470-4945-b809-758080fbb504 could not be found. Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Request method failure captured: Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 HTTP/1.1 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILMZVqDHsBG3cbWfqxajVii2FfhKJhDQu5s-zPTeyU7KZKCitxlmlvNsWGCH7pRe-uaaUhfe2UKeN6DCiyNfcxEhk0CDg3g299WfvMpEFPpzVur_7mBpOwRR99u1iZiBGkx3yqB-5Vs9GhgO2hMp4RTQ9Xl3J95IUd_LbE6JuizYXs0 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.54 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b5f6656e6c8e4768a904b8b291f1ac5f Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerShowV254Test-1638028596 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5f6656e6c8e4768a904b8b291f1ac5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b5f6656e6c8e4768a904b8b291f1ac5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5f6656e6c8e4768a904b8b291f1ac5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b5f6656e6c8e4768a904b8b291f1ac5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerShowV254Test-1638028596 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b5f6656e6c8e4768a904b8b291f1ac5f Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerShowV254Test-1638028596 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerShowV254Test-1638028596-project Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 559e54c1b0cd4030b224ba20f122c731 Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerShowV254Test-1638028596-project Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance f34fc05d-3470-4945-b809-758080fbb504 could not be found. Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'f34fc05d-3470-4945-b809-758080fbb504'} Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34fc05d-3470-4945-b809-758080fbb504 could not be found. Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34fc05d-3470-4945-b809-758080fbb504 could not be found. Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:03.082333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34fc05d-3470-4945-b809-758080fbb504 could not be found. Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] Returning 404 to user: Instance f34fc05d-3470-4945-b809-758080fbb504 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e18591a6-4ddc-4fbc-941d-79034d7afdc9 tempest-ServerShowV254Test-1638028596 tempest-ServerShowV254Test-1638028596-project] 10.222.0.61 "GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504" status: 404 len: 111 microversion: 2.54 time: 0.032437 Sep 13 16:44:03.087760 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1748/3442] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/f34fc05d-3470-4945-b809-758080fbb504 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:44:03.573331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.574005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.580017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.580515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.580965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.581987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.582488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.582935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.623236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.623853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] [instance: 384c0e9c-0bc9-41bb-a17f-7986492880d5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.631000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.631490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.631957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.632668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.633129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.633556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.649599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] HTTP exception thrown: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 could not be found. Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Request method failure captured: Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 HTTP/1.1 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILHauvQaGw_imnKjpvjXYrRVoYOkelBfmbe_tEjNcSemBTpPbKOqj7A65jqFtvrEk0KMIRX3g6na3gISoRXQzJDgnd1BvvG7HorF_itRKME2xgCUXQQLc9u1P3rz2ghaKURx-D3K3WJ4qI1qmtySn3b8Bowi85lIymN_Q_ixKWWuiUE Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ce4b7f916b64240af037c66c8665c53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1ce4b7f916b64240af037c66c8665c53 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-385790505 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 780658a6bd6649bf889299f03d80c145 Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-385790505-project Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 could not be found. Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '384c0e9c-0bc9-41bb-a17f-7986492880d5'} Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 could not be found. Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 could not be found. Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.651212 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 could not be found. Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] Returning 404 to user: Instance 384c0e9c-0bc9-41bb-a17f-7986492880d5 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:03.656325 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a2da6381-e76a-4088-b363-db5ff1fc7bc6 tempest-ServerRescueNegativeTestJSON-385790505 tempest-ServerRescueNegativeTestJSON-385790505-project] 10.222.0.61 "GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5" status: 404 len: 111 microversion: 2.1 time: 0.034214 Sep 13 16:44:03.658348 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1749/3443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/384c0e9c-0bc9-41bb-a17f-7986492880d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:03.724794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.725528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.733601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.734137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.734589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.735311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.735782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.736224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.740341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:03.749701 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fb92d4d-3645-4e01-a3c6-dbb73880ae8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1484 microversion: 2.1 time: 0.180590 Sep 13 16:44:03.750585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1695/3444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1484 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:03.775828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.776419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.782527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.783017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.783457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.784150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.784610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.785037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.844785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:03.848793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:03.855954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:03.857415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:03.863147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3bb9358a-fbeb-472b-8518-452215750b18 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.143596 Sep 13 16:44:03.863734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1750/3445] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:03.871911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-009730af-90d2-48e7-a98e-4fa11b3aa6cf tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099963 Sep 13 16:44:03.872880 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1696/3446] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:03.953644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.954389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.961206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.961702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.962189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.962881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.963339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.963767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.977654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:03.978952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:03.987938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.990406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:03.991308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:03.994305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:03.995458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:04.003147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:04.167854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:04.179039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.207948 Sep 13 16:44:04.180127 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1697/3447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:04.673157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:04.682316 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a187a4df-9ff4-4d2c-807c-84407722f883 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.732591 Sep 13 16:44:04.696212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1751/3448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:03 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:04.778923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:04.780175 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37137bca-9ea1-42b4-80b0-7bd8dd566ada tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001578 Sep 13 16:44:04.780634 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1698/3449] 10.222.0.61 () {56 vars in 886 bytes} [Tue Sep 13 16:44:04 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 13 16:44:04.899113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:04.900133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:04.906852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:04.907830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:04.908562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:04.909592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:04.910541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:04.912370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:05.044394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:05.056605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:05.058331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:05.064183 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c2aecbd6-ea56-46b2-bae2-4492d56d9ca9 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.169566 Sep 13 16:44:05.065322 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1752/3450] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:04 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:05.203056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:05.204398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:05.213625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:05.214341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:05.214991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:05.215904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:05.216556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:05.217159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:05.708756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:05.709556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:05.718918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:05.719730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:05.720439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:05.721245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:05.721942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:05.722618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:05.731792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:05.742158 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c1de55c-d065-49b3-9b71-0c4d8dc815b4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.543215 Sep 13 16:44:05.742755 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1699/3451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:05 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:06.094803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:06.095439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:06.102295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.102968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.103540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.104326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.104550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:06.105150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.105658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.119473 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53f8489e-5152-4017-871e-1936f9064129 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1512 microversion: 2.1 time: 0.414920 Sep 13 16:44:06.121335 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1753/3452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:05 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:06.152652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:06.153289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:06.162173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.162720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.163361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.164249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.164878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.165476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.190771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:06.205369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:06.208285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:06.222317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fdbc4609-4251-4730-b349-185cf98ef9c4 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.131700 Sep 13 16:44:06.222919 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1700/3453] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:06 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:06.253679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5d106de6-e22c-4cc7-89a8-a66187150177 req-a5934c01-6ea0-4e9c-a24e-5c9000826698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687d11fc-8748-4bd9-b47f-e81e82540bf6", "tag": "43d54a5a-6675-4935-9785-3ad0ab76217f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:06.265195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5d106de6-e22c-4cc7-89a8-a66187150177 req-a5934c01-6ea0-4e9c-a24e-5c9000826698 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.267398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5d106de6-e22c-4cc7-89a8-a66187150177 req-a5934c01-6ea0-4e9c-a24e-5c9000826698 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.268110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5d106de6-e22c-4cc7-89a8-a66187150177 req-a5934c01-6ea0-4e9c-a24e-5c9000826698 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.282429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5d106de6-e22c-4cc7-89a8-a66187150177 req-a5934c01-6ea0-4e9c-a24e-5c9000826698 service nova] Creating event network-changed:43d54a5a-6675-4935-9785-3ad0ab76217f for instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 on n-h2-857467-1 Sep 13 16:44:06.288614 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5d106de6-e22c-4cc7-89a8-a66187150177 req-a5934c01-6ea0-4e9c-a24e-5c9000826698 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043971 Sep 13 16:44:06.290011 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1701/3454] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:06.571141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:06.579716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d86a836-1b69-49ff-a9f3-244425514c8c tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1484 microversion: 2.1 time: 0.433866 Sep 13 16:44:06.602616 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1754/3455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:06 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1484 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:06.769682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:06.771334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:06.780056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.780950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.781615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.784358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:06.785062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:06.785579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:06.961203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:06.970306 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c15dce6-5e0a-4494-9fb1-1b1b227ac2b2 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.207747 Sep 13 16:44:06.974351 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1702/3456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:06 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:07.150435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:07.151674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:07.159817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.160510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.161187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.162274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.162932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.163528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.261658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:07.262702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:07.271343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.271870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.272329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.273065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.273541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.274066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.375738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:07.388252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:07.392241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:07.408234 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c864615-c1f3-4ca0-9ff9-639a6d602157 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.153040 Sep 13 16:44:07.422088 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1703/3457] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:07 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:07.517166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:07.533435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96591634-0d3d-4756-8d29-930c8479d612 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1489 microversion: 2.1 time: 0.388212 Sep 13 16:44:07.550583 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1755/3458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:07 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1489 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:07.560925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:07.561551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:07.573547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.580880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.581755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.583921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.584724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.585418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.645050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:44:07.700847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:07.787943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0d2b1b6-f49c-4ff6-afa4-424ec353b9d8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 204 len: 0 microversion: 2.1 time: 0.226891 Sep 13 16:44:07.792255 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1704/3459] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:07 2022] DELETE /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:44:07.813038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:07.816603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:07.829975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.833431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.834063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:07.837103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:07.837553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:07.838187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.007052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:08.008549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:08.024937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:08.030772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:08.033680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:08.034355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.036681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b291ebab-4f85-494e-a2e7-e33f51adf313 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1495 microversion: 2.1 time: 0.239442 Sep 13 16:44:08.036839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:08.037130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:08.037625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.038294 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1756/3460] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:07 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:08.393259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:08.402819 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-300a63db-1930-4321-af72-2a4c2a0d15d7 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.411320 Sep 13 16:44:08.418770 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1705/3461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:07 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:08.440809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:08.441693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:08.448758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:08.449568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:08.450271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.451087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:08.451691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:08.452216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:08.531234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:08.540669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:08.542693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:08.549039 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e62a8fb2-ee13-46e0-88dd-6ae2381a08b7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.112313 Sep 13 16:44:08.549961 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1757/3462] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:08 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:09.064344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:09.064978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:09.078359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.079361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.080067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.080967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.081699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.082339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.375091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:09.389608 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c07f2615-394b-492e-be05-5007a530f756 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1495 microversion: 2.1 time: 0.331719 Sep 13 16:44:09.391824 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1706/3463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:09 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1495 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:09.428893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:09.430882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:09.438801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.440245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.441099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.443195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.443975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.444633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.584211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:09.586250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:09.606109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.609443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.611406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.612972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.613663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.614353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.794018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:09.817094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:09.826713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:09.829927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:09.834026 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-28c75217-55cf-4c2d-a1bb-461f875b5bdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.258348 Sep 13 16:44:09.846612 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4502aa93-1df6-4155-884d-9b3e74a68d7e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.423575 Sep 13 16:44:09.847877 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1758/3464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:09 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:09.852623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-505a29e9-6142-4957-b2d1-9427760df576 req-ec6ddd55-ec15-4677-9de6-accc68be744d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a435525-7634-4d9e-80cd-0dabbf12a21a", "name": "network-vif-plugged", "status": "completed", "tag": "3cd8b977-33c4-484c-9df5-aaa7bd38789d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:09.857988 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1707/3465] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:09 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:09.882259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:09.892559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-505a29e9-6142-4957-b2d1-9427760df576 req-ec6ddd55-ec15-4677-9de6-accc68be744d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:09.893064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-505a29e9-6142-4957-b2d1-9427760df576 req-ec6ddd55-ec15-4677-9de6-accc68be744d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:09.893512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-505a29e9-6142-4957-b2d1-9427760df576 req-ec6ddd55-ec15-4677-9de6-accc68be744d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:09.919673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-505a29e9-6142-4957-b2d1-9427760df576 req-ec6ddd55-ec15-4677-9de6-accc68be744d service nova] Creating event network-vif-plugged:3cd8b977-33c4-484c-9df5-aaa7bd38789d for instance 3a435525-7634-4d9e-80cd-0dabbf12a21a on n-h2-857467-1 Sep 13 16:44:09.940931 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-505a29e9-6142-4957-b2d1-9427760df576 req-ec6ddd55-ec15-4677-9de6-accc68be744d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088666 Sep 13 16:44:09.941675 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1759/3466] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:10.418635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:10.419404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:10.441067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.443573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.446237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.447258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.448723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.449619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.547791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-86ba0e1f-dcc3-4d00-8f63-83372963874c req-947cdbd3-bae9-43fc-a081-1d34d8d24605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12adf32c-7a8f-4dc4-bada-d7d24b0c12b9", "name": "network-vif-deleted", "tag": "923873d5-11f7-442c-9204-9a52f2cc8beb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:10.570782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:10.582053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ceae07c-53b9-44ca-944d-625c9bc078b8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 200 len: 1453 microversion: 2.1 time: 0.171326 Sep 13 16:44:10.582776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1708/3467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:10 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:10.611806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-86ba0e1f-dcc3-4d00-8f63-83372963874c req-947cdbd3-bae9-43fc-a081-1d34d8d24605 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.612703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-86ba0e1f-dcc3-4d00-8f63-83372963874c req-947cdbd3-bae9-43fc-a081-1d34d8d24605 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.618518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-86ba0e1f-dcc3-4d00-8f63-83372963874c req-947cdbd3-bae9-43fc-a081-1d34d8d24605 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.650229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-86ba0e1f-dcc3-4d00-8f63-83372963874c req-947cdbd3-bae9-43fc-a081-1d34d8d24605 service nova] Creating event network-vif-deleted:923873d5-11f7-442c-9204-9a52f2cc8beb for instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 on n-h1-857467-1 Sep 13 16:44:10.673311 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-86ba0e1f-dcc3-4d00-8f63-83372963874c req-947cdbd3-bae9-43fc-a081-1d34d8d24605 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131395 Sep 13 16:44:10.674514 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1760/3468] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:10.866169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:10.867752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:10.876194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:10.877206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:10.895433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.896645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.897324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.902965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.903605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.904067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.904799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.908020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:10.908444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.910612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:10.912297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:10.912777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:11.038134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:11.052398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:11.054242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:11.069682 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a60d7a3-1733-40b3-b5c8-921850b844f6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.208118 Sep 13 16:44:11.070324 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1709/3469] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:10 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:11.231448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:11.243796 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03b7cc31-7e95-4558-ba72-c1d50bde8061 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1370 microversion: 2.1 time: 0.371976 Sep 13 16:44:11.245242 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1761/3470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:10 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:11.610579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:11.611203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:11.619575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:11.620263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:11.620873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:11.621746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:11.622384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:11.623202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 HTTP/1.1 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '12adf32c-7a8f-4dc4-bada-d7d24b0c12b9'} Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:11.654924 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8a2edf0-39a2-49c1-a16c-54961f21bf7f tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 404 len: 111 microversion: 2.1 time: 0.048952 Sep 13 16:44:11.659019 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1710/3471] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:11 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:11.788191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-730760682", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "0002228d-ed44-42ed-96d4-8e888068f55b"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:11.854088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] validate_networks() for [('0002228d-ed44-42ed-96d4-8e888068f55b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:44:12.102865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:12.103528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:12.118264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.119424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.119904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.120640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.121128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.121564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.290683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:12.302484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:12.305322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:12.313270 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c59d62a4-304d-48c1-b8d1-e7516eda9c0e tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.215205 Sep 13 16:44:12.314367 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1711/3472] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:12 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:12.322162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:12.323054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:12.330834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.331987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.332604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.334499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.336506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.337232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.665596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:44:12.666162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:12.667279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:44:12.667783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:44:12.668232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:44:12.668658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:44:12.675808 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-97da073a-eff3-4ab1-a931-5138ba778383 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1556 microversion: 2.1 time: 0.359996 Sep 13 16:44:12.676627 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1712/3473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:12 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1556 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:12.698565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.699269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.699907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.700941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.701073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:12.701406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.701536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:12.702204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.713704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.714366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.714815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.715536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:12.716004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:12.716437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:12.723297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:12.730720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Getting quotas for user f19489a86e5047198a0068987c04f6ad and project f882b6826fe548d8801770e3e2db96f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:12.745101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:44:12.748786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:44:12.815356 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee5165a6-9aef-4432-82e9-1a09290b64c9 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031723 Sep 13 16:44:12.818043 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1762/3474] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:44:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:44:12.830696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7deaf162-7415-4dc3-bb96-368368f82e66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:12.831671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7deaf162-7415-4dc3-bb96-368368f82e66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:12.872256 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bce2e52b-2e52-4ad0-ae0d-ec2d8991ee66 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174470 Sep 13 16:44:12.872877 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1713/3475] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:44:12 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:12.936619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7deaf162-7415-4dc3-bb96-368368f82e66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:12.963177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7deaf162-7415-4dc3-bb96-368368f82e66 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1214 microversion: 2.1 time: 0.136293 Sep 13 16:44:12.963843 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1763/3476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:12 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:13.347218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:13.347850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:13.355272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:13.355994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:13.356672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:13.357620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:13.358403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:13.359064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:13.448361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:13.458629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:13.464705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:13.473547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4591babd-4827-42ed-bb54-d9cf2bf4f0e5 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.131371 Sep 13 16:44:13.475431 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1714/3477] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:13 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:13.988712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:13.989856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:14.005611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.006166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.007019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.010829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.011721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.012612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.263522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:14.276594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f928f581-43f4-4bd0-8844-cf95565216d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1210 microversion: 2.1 time: 0.293187 Sep 13 16:44:14.278719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1764/3478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:13 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1210 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:14.511192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:14.512401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:14.526805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-8a37dd2a-c9b7-4e69-b7b0-f65b2be82d51 req-9702df2f-6ef5-49d4-b344-283d02f02dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a435525-7634-4d9e-80cd-0dabbf12a21a", "tag": "3cd8b977-33c4-484c-9df5-aaa7bd38789d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:14.542659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.543164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.543609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.544337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.544806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.545558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.559359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a37dd2a-c9b7-4e69-b7b0-f65b2be82d51 req-9702df2f-6ef5-49d4-b344-283d02f02dc2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:14.560455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a37dd2a-c9b7-4e69-b7b0-f65b2be82d51 req-9702df2f-6ef5-49d4-b344-283d02f02dc2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:14.561438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a37dd2a-c9b7-4e69-b7b0-f65b2be82d51 req-9702df2f-6ef5-49d4-b344-283d02f02dc2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:14.600731 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8a37dd2a-c9b7-4e69-b7b0-f65b2be82d51 req-9702df2f-6ef5-49d4-b344-283d02f02dc2 service nova] Creating event network-changed:3cd8b977-33c4-484c-9df5-aaa7bd38789d for instance 3a435525-7634-4d9e-80cd-0dabbf12a21a on n-h2-857467-1 Sep 13 16:44:14.624234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-8a37dd2a-c9b7-4e69-b7b0-f65b2be82d51 req-9702df2f-6ef5-49d4-b344-283d02f02dc2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103482 Sep 13 16:44:14.625932 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1765/3479] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:14.748612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:14.775646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:14.783592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:14.805249 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2ea6638-9143-4562-8f88-12d08d291bef tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.302915 Sep 13 16:44:14.806228 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1715/3480] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:14 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:15.306885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:15.307667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:15.322766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:15.323260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:15.323823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:15.324790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:15.325465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:15.335895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:15.570512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:15.583977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fecef6d9-ddb1-4181-8eb0-771dbdd077df tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1272 microversion: 2.1 time: 0.282257 Sep 13 16:44:15.584799 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1766/3481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:15 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:15.857054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:15.858222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:15.874487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:15.880660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:15.881363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:15.882377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:15.883027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:15.883479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:16.013998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:16.026682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:16.032953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:16.042290 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af7c041b-7b56-4d49-978c-5d2322f28232 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.189368 Sep 13 16:44:16.047879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1716/3482] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:15 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:16.611205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c230690-d745-4acc-8aad-abbf4e23916d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: .version_select at 0x7fbeb97e34c0>, body: {"keypair": {"name": "tempest-keypair-730285479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Vm4+nGoxtN0ZrMXr++UEFXKgbjfWEnWM6IoJijvvFWUDvasWwPfgfVMHFvXUSvU06xpwTyJv4aaA7AcnEnE9l/2dVMISkf7wPrM1QfINrV5M4zyZJZNK3vhK8Zea3mw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:16.612515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:16.613532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:16.629046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:16.631220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:16.631757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:16.633736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:16.636030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:16.636587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:16.655721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-3c230690-d745-4acc-8aad-abbf4e23916d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:16.665780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-3c230690-d745-4acc-8aad-abbf4e23916d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for user e2620846244d4943925ca47225a9eb36 and project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:16.701428 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c230690-d745-4acc-8aad-abbf4e23916d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.517915 Sep 13 16:44:16.702587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1767/3483] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:44:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:17.078786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:17.082308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:17.092336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:17.093195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:17.093933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:17.094868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:17.095494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:17.096099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:17.120398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:17.140436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-04c0491e-c9e2-4237-a0c6-0aef221358e5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.535208 Sep 13 16:44:17.142057 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1717/3484] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:16 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:17.499744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:17.513821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:17.517760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:17.530391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c73f368a-1410-41fc-a363-59d6c4ab479b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.456010 Sep 13 16:44:17.532522 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1768/3485] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:17 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:18.168715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:18.170303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:18.179886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.180905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.181741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.182807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.183339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.184335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.404301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2602d3d9-9e6b-4147-a742-4b8640254c4b req-29f0f936-cc21-446a-8ba8-2623efd0200c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9898a900-179f-41b5-91a1-66a85a393f29", "tag": "ec6de870-2bd8-44cd-9ad8-892277e8063c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:18.433194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2602d3d9-9e6b-4147-a742-4b8640254c4b req-29f0f936-cc21-446a-8ba8-2623efd0200c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.434003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2602d3d9-9e6b-4147-a742-4b8640254c4b req-29f0f936-cc21-446a-8ba8-2623efd0200c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.434785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2602d3d9-9e6b-4147-a742-4b8640254c4b req-29f0f936-cc21-446a-8ba8-2623efd0200c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.461657 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2602d3d9-9e6b-4147-a742-4b8640254c4b req-29f0f936-cc21-446a-8ba8-2623efd0200c service nova] Creating event network-changed:ec6de870-2bd8-44cd-9ad8-892277e8063c for instance 9898a900-179f-41b5-91a1-66a85a393f29 on n-h1-857467-1 Sep 13 16:44:18.470158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2602d3d9-9e6b-4147-a742-4b8640254c4b req-29f0f936-cc21-446a-8ba8-2623efd0200c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076237 Sep 13 16:44:18.471093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1769/3486] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:18.485799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:18.496536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5cc3368-ca34-439d-9653-0390f51fbcbd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.332709 Sep 13 16:44:18.497497 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1718/3487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:18 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:18.566347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:18.567043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:18.585301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.587608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.588624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.589995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:18.591191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:18.592158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:18.705292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:18.716711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:18.718988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:18.726454 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f97b91a7-de8d-40d0-93a8-98ed09c1f795 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.165413 Sep 13 16:44:18.743238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1770/3488] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:18 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:19.317497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2011021370", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01fb7c7f-f3fb-4070-839d-66b52fab6029"}], "security_groups": [{"name": "tempest-securitygroup--816967117"}], "key_name": "tempest-keypair-730285479", "user_data": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:19.329285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:19.441151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] validate_networks() for [('01fb7c7f-f3fb-4070-839d-66b52fab6029', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:44:19.519563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:19.521029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:19.528679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.532732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.533233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.534014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.534499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.534937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.711621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:19.721592 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ec90b16-1ec2-49b5-8dc0-420fc84393f8 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.206433 Sep 13 16:44:19.722852 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1771/3489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:19 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:19.760340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:19.761503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:19.768608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.769332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.769778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.771187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.772142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.772780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.865664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:19.869334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:19.879764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:19.882731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:19.890284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e29d7f9-969d-43b0-b52b-d2d9a2d7baf6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.134151 Sep 13 16:44:19.891165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1772/3490] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:19 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:19.971736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:44:19.972352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:44:19.972833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:44:19.973248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:44:19.973923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:44:19.987470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.987970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.988415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:19.989446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:19.990138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:19.990761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.020208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:20.027319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for user e2620846244d4943925ca47225a9eb36 and project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:20.041623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:44:20.044009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:44:20.120389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e10aad2b-0f78-4a0a-a6bd-69744ddbd790 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.807468 Sep 13 16:44:20.126840 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1719/3491] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:44:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:44:20.139148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43b92bf3-6a7a-4507-bf35-62ce1874ee0b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:20.139867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-43b92bf3-6a7a-4507-bf35-62ce1874ee0b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:20.243296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-43b92bf3-6a7a-4507-bf35-62ce1874ee0b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:20.252731 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43b92bf3-6a7a-4507-bf35-62ce1874ee0b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1237 microversion: 2.1 time: 0.117448 Sep 13 16:44:20.262622 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1773/3492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:20 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:20.748417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:20.749740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:20.758470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:20.758701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:20.761460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.763457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:20.765654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:20.766775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.930592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:20.932921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:20.943770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:20.948010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:20.948682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.950233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:20.950945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:20.951548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:20.962401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:20.972071 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5e12d30-c140-439d-b431-339b7ef762d2 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.229454 Sep 13 16:44:20.972680 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1720/3493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:20 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:21.045565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:21.056796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:21.063351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:21.074593 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5afea117-927e-4e6a-b909-b91815ac9935 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.152023 Sep 13 16:44:21.075375 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1774/3494] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:20 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:21.277239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:21.277889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:21.285068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:21.285570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:21.286083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:21.286818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:21.287380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:21.288056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:21.430947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:21.446259 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7a2f5e3-4fab-4d56-bf7e-04d8d82fd4c6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1241 microversion: 2.1 time: 0.172760 Sep 13 16:44:21.456604 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1721/3495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:21 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:21.996257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:21.996889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:22.003574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.004161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.004610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.006172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.006731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.007173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.111075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:22.112290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:22.138467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.140228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.142013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.143307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.144203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.144793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.151223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:22.238956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:22.249980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:22.261396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:22.276019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8181645b-bac5-41d5-a620-b6205702b038 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1447 microversion: 2.75 time: 0.169199 Sep 13 16:44:22.290532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1722/3496] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:22 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:22.333764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:22.345605 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7dd1a556-1bbd-49ca-952e-905a9791cd85 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.353394 Sep 13 16:44:22.353926 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1775/3497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:21 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:22.469818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:22.470580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:22.477656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.478231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.478680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.479599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.480436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.480881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.551362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:22.561326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b754d37f-044e-4419-8865-efe23a16cb60 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1295 microversion: 2.1 time: 0.095440 Sep 13 16:44:22.562638 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1723/3498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:22 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:22.927967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76851f09-927d-474f-90ec-92f70a5d9f40"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:22.931965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:22.934756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:22.942195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.943482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.944090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:22.944705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:22.945175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:22.945599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.319763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:23.320413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:23.336454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.337795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.338905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.340033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.340677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.341270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.368045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bcfd77da-d8d6-4adc-8c2f-8c5e12c4fa8c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "POST /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444773 Sep 13 16:44:23.373984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1776/3499] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:44:22 2022] POST /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:23.403686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:23.404870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:23.432082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.435735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.437391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.438882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.440501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.443877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.469559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:23.493773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:23.496241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:23.503486 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08df43ea-11c2-4b29-8a3a-04936849fe0d tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1453 microversion: 2.75 time: 0.187779 Sep 13 16:44:23.504467 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1724/3500] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:23 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1453 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:23.589029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:23.590860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:23.600638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.603346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.604049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.605195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:23.605980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:23.609435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:23.737273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:23.746221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4ee9b69-b19f-4715-a1f4-cd40be4ad1ca tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.375838 Sep 13 16:44:23.747266 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1777/3501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:23 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:23.874925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:23.886791 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90edae63-5417-4bfa-ad80-5489ea872f27 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.305045 Sep 13 16:44:23.887540 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1725/3502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:23 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:24.405020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-bffaa9b4-7226-4d21-8b4a-28fa7ab00d7c req-31c6e7c1-dea7-496e-88f9-2a8795c25606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cec120-ddf3-4621-8ccc-88bd968deba0", "tag": "c5388a65-7a5a-4e42-a528-6f7a4104a680"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:24.417298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bffaa9b4-7226-4d21-8b4a-28fa7ab00d7c req-31c6e7c1-dea7-496e-88f9-2a8795c25606 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.417898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bffaa9b4-7226-4d21-8b4a-28fa7ab00d7c req-31c6e7c1-dea7-496e-88f9-2a8795c25606 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.418258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bffaa9b4-7226-4d21-8b4a-28fa7ab00d7c req-31c6e7c1-dea7-496e-88f9-2a8795c25606 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.431877 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-bffaa9b4-7226-4d21-8b4a-28fa7ab00d7c req-31c6e7c1-dea7-496e-88f9-2a8795c25606 service nova] Creating event network-changed:c5388a65-7a5a-4e42-a528-6f7a4104a680 for instance 76cec120-ddf3-4621-8ccc-88bd968deba0 on n-h1-857467-1 Sep 13 16:44:24.438009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-bffaa9b4-7226-4d21-8b4a-28fa7ab00d7c req-31c6e7c1-dea7-496e-88f9-2a8795c25606 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037019 Sep 13 16:44:24.439572 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1778/3503] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:24.555966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:24.556884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:24.563703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.564501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.565060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.566297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.567136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.567866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.665623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:24.679910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:24.681404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:24.687232 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36dad287-e9c7-4bc9-8ea4-da3bace98209 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1453 microversion: 2.75 time: 0.149272 Sep 13 16:44:24.687823 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1726/3504] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:24 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:24.775877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:24.776859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:24.785609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.788298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.788867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.790284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.790880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.791431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.913623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:24.914472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:24.928519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.930540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.931268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:24.932267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:24.932909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:24.933581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:25.002413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:25.012559 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6aae4185-9447-4b8a-b5b5-61833ca001cc tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.243719 Sep 13 16:44:25.023777 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1779/3505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:24 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:25.228235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:25.241308 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-efa5be9e-597e-44a0-b96f-9635a912947f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.333462 Sep 13 16:44:25.242020 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1727/3506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:24 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:25.532431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a0ec3511-8c40-4fad-bf24-cbd2c0b05960 req-79e53f81-2380-45f3-95e6-a9c5b22c8246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9898a900-179f-41b5-91a1-66a85a393f29", "name": "network-vif-plugged", "status": "completed", "tag": "ec6de870-2bd8-44cd-9ad8-892277e8063c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:25.548384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a0ec3511-8c40-4fad-bf24-cbd2c0b05960 req-79e53f81-2380-45f3-95e6-a9c5b22c8246 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:25.549206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a0ec3511-8c40-4fad-bf24-cbd2c0b05960 req-79e53f81-2380-45f3-95e6-a9c5b22c8246 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:25.550014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a0ec3511-8c40-4fad-bf24-cbd2c0b05960 req-79e53f81-2380-45f3-95e6-a9c5b22c8246 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:25.566670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a0ec3511-8c40-4fad-bf24-cbd2c0b05960 req-79e53f81-2380-45f3-95e6-a9c5b22c8246 service nova] Creating event network-vif-plugged:ec6de870-2bd8-44cd-9ad8-892277e8063c for instance 9898a900-179f-41b5-91a1-66a85a393f29 on n-h1-857467-1 Sep 13 16:44:25.574970 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a0ec3511-8c40-4fad-bf24-cbd2c0b05960 req-79e53f81-2380-45f3-95e6-a9c5b22c8246 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048251 Sep 13 16:44:25.576087 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1780/3507] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:25.718640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:25.720140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:25.728674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:25.729205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:25.729660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:25.730440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:25.731147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:25.731756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:25.827510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:25.837979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:25.839490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:25.844801 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc436255-b484-4a8b-8fe9-67ff7a50c4e7 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1453 microversion: 2.75 time: 0.131036 Sep 13 16:44:25.858128 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1728/3508] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:25 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:26.039026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:26.040673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:26.048573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.049251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.049963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.051009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.069259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.069722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.217602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:26.226958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4af6cb2d-be7c-4680-91fe-862f2ce2e21d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.193326 Sep 13 16:44:26.242072 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1781/3509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:26 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:26.268762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:26.269391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:26.278060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.278477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.279195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.280163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.280791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.281235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.431830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:26.443173 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1cf57e11-fec3-4ef6-b767-04b3b6037f81 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.177502 Sep 13 16:44:26.443834 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1729/3510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:26 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:26.884859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:26.886303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:26.895880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.896468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.897374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.898237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:26.899277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:26.899711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:26.993669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:27.003614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:27.006921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:27.012224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-435909ab-9471-444c-b373-8399ab60125f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1453 microversion: 2.75 time: 0.139315 Sep 13 16:44:27.013206 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1782/3511] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:26 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:27.252336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:27.253232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:27.262778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:27.263408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:27.263930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:27.264727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:27.265272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:27.265783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:27.432540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:27.441317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8f3c855-e668-4e54-b4e9-61484c8f1539 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.193429 Sep 13 16:44:27.442329 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1730/3512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:27 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:27.466562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:27.467317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:27.474816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:27.475568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:27.476283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:27.477093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:27.477624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:27.478463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:27.674406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:27.688774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e6deb47-f2e3-4adc-9c98-099818554eca tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.225817 Sep 13 16:44:27.690379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1783/3513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:27 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:28.042937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:28.043903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:28.062335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.063097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.063716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.064687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.065169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.066001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.157603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:28.167339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:28.169147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:28.176056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-767a599a-05fe-41cd-a168-bcb06fe07324 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1438 microversion: 2.75 time: 0.139348 Sep 13 16:44:28.199447 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1731/3514] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:28 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:28.453080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:28.457112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:28.465351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:28.466807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:28.468118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.469003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.469644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.471543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.472473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.473303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.482725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.483530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.484075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.485165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.485895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.486709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.593839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:44:28.594482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:44:28.594975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:44:28.595493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:44:28.596078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:44:28.686313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:28.688562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:28.696696 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-41ac156c-914b-452c-8847-050c9892f1d6 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1314 microversion: 2.1 time: 0.235225 Sep 13 16:44:28.697718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1732/3515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:28 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:28.710226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.710226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.710226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.710226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.712366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.716960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.732613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:28.746878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:28.761165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.764843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.765611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.768666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:28.771921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:28.772998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:28.959825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:28.995823 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6eae658-c0d7-4376-b86b-9119a4ceab38 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c/action" status: 202 len: 1942 microversion: 2.75 time: 0.792539 Sep 13 16:44:28.997259 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1784/3516] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:44:28 2022] POST /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c/action => generated 1942 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 13 16:44:29.026636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:29.027543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:29.034592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:29.035493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:29.036505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:29.037597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:29.038403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:29.039053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:29.118491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:29.130895 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-553dbbaa-5e9f-4636-8012-d459b59fdfbe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.409844 Sep 13 16:44:29.131823 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1733/3517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:28 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:29.184416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:29.242547 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07ca405b-1ee7-4372-973f-d1696b3fe1a2 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.220346 Sep 13 16:44:29.246301 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1785/3518] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:29 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:29.726083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:29.727497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:29.734532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:29.735044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:29.735541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:29.736357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:29.736849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:29.737460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:29.885803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:29.894472 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0bd78ef1-c821-43d6-bca4-5dc9aab76dfd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1501 microversion: 2.1 time: 0.174127 Sep 13 16:44:29.895053 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1734/3519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:29 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:29.922480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:29.923083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:29.926541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:29.934357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:29.937387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:29.937890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:29.938937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:29.939129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:29.939793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:29.968651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'flavor' on Instance uuid 9898a900-179f-41b5-91a1-66a85a393f29 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:30.012948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:30.067780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-adba5f68-c85e-4adb-b292-5756e99e5507 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "POST /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29/action" status: 202 len: 0 microversion: 2.1 time: 0.152475 Sep 13 16:44:30.069786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1786/3520] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:44:29 2022] POST /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:44:30.088249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:30.089188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:30.102601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:30.105114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:30.107128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:30.107637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:30.108086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:30.109261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:30.110127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:30.110571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:30.163808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:30.164704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:30.172589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:30.173279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:30.173779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:30.174735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:30.175355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:30.175931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:30.252275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:30.296614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:30.306900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9059431-1f8f-4f13-b302-0380fcc33f2b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1509 microversion: 2.1 time: 0.228179 Sep 13 16:44:30.322019 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1735/3521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:30 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:30.330059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:30.330669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:30.338125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:30.338699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:30.338866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:30.339107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:30.340158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:30.340329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:30.341179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:30.347960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-945d366c-7753-46cc-a9a6-0dd257ea4efd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.193664 Sep 13 16:44:30.348958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1787/3522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:30 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:30.427124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:30.446257 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-145468d2-c4d0-46e7-ba83-593424a65439 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.122880 Sep 13 16:44:30.446960 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1736/3523] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:30 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:31.340563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:31.341476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:31.357507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.358351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.359421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.360342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.362133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.362884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.387317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:31.392992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:31.413374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.413939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.414539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.415544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.416065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.416507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.643932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:31.655621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6dfac20e-964b-40f7-9adc-e1c492192a04 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1492 microversion: 2.1 time: 0.322646 Sep 13 16:44:31.656470 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1788/3524] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:31 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1492 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:31.662562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ce10f8ed-9cea-40b3-a81e-356bc975ddde req-56d89c7e-6569-49c7-b892-b44bdf10f30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cec120-ddf3-4621-8ccc-88bd968deba0", "name": "network-vif-plugged", "status": "completed", "tag": "c5388a65-7a5a-4e42-a528-6f7a4104a680"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:31.667397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:31.680899 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a8a68608-e758-4444-9f4a-3817cf7cfd69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.311259 Sep 13 16:44:31.683635 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1737/3525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:31 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:31.690799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ce10f8ed-9cea-40b3-a81e-356bc975ddde req-56d89c7e-6569-49c7-b892-b44bdf10f30f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.691291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ce10f8ed-9cea-40b3-a81e-356bc975ddde req-56d89c7e-6569-49c7-b892-b44bdf10f30f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.691746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ce10f8ed-9cea-40b3-a81e-356bc975ddde req-56d89c7e-6569-49c7-b892-b44bdf10f30f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.697803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:31.698449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:31.710004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.710724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.711366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.712324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.712955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.713571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.715903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ce10f8ed-9cea-40b3-a81e-356bc975ddde req-56d89c7e-6569-49c7-b892-b44bdf10f30f service nova] Creating event network-vif-plugged:c5388a65-7a5a-4e42-a528-6f7a4104a680 for instance 76cec120-ddf3-4621-8ccc-88bd968deba0 on n-h1-857467-1 Sep 13 16:44:31.724706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ce10f8ed-9cea-40b3-a81e-356bc975ddde req-56d89c7e-6569-49c7-b892-b44bdf10f30f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066513 Sep 13 16:44:31.725490 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1789/3526] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:31.734678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:31.735275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:31.742583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.743191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.743831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.744543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.745227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.745355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:31.745669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.777870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:44:31.814491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:31.834489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9f6fd121-54a8-407b-a2d5-2a2f9a464f01 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.149626 Sep 13 16:44:31.835475 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1738/3527] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:31 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:31.890046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec5a1820-fe3e-4354-8cfe-e134964afc4a tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 204 len: 0 microversion: 2.1 time: 0.157855 Sep 13 16:44:31.891413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1790/3528] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:31 2022] DELETE /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:44:31.901260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:31.903362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:31.914388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.915159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.916013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:31.917106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:31.918423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:31.919241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:32.075418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:32.084785 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-765d3d7f-e25e-4b17-8941-cb4b5a46581d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1498 microversion: 2.1 time: 0.187674 Sep 13 16:44:32.085428 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1739/3529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:31 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:32.707918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:32.709477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:32.716405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:32.716991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:32.717404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:32.718184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:32.718640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:32.719090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:32.865054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:32.866118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:32.867967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:32.873538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:32.874134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:32.874528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:32.875625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:32.876137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:32.876567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:32.877358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07ca7c7d-9950-437d-82c7-65137ed813bd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.173947 Sep 13 16:44:32.877906 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1791/3530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:32 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:32.955628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:32.990339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5745f05-de95-4f98-8a9c-e82805a51c4a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.129592 Sep 13 16:44:32.991204 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1740/3531] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:32 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:33.109941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:33.110636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:33.118463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:33.118965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:33.119477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:33.120263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:33.120732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:33.121263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:33.359094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:33.368593 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d33f56d7-b380-4c38-a92f-5118f5227e27 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1498 microversion: 2.1 time: 0.263216 Sep 13 16:44:33.369365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1792/3532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:33 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:33.903269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:33.904077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:33.912916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:33.914074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:33.914713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:33.915855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:33.916519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:33.917181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:34.023259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:34.024260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:34.032200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:34.033119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:34.033860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:34.035132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:34.035799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:34.037007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:34.101464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:34.109649 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a72eee69-2fec-4be0-8625-a7ef57c75e72 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1362 microversion: 2.1 time: 0.211164 Sep 13 16:44:34.110661 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1741/3533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:33 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:34.126931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:34.144532 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0b15d45-ac07-4f7f-bc2c-670f835ea752 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.127436 Sep 13 16:44:34.145296 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1793/3534] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:34 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:34.392973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:34.393672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:34.401043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:34.401671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:34.402247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:34.403357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:34.403836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:34.404280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:34.658377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:34.670010 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e24a8c9-9a4d-4b1a-bb8b-f1f02e4b7b15 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1498 microversion: 2.1 time: 0.280949 Sep 13 16:44:34.670599 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1742/3535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:34 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:35.031149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-679db5cb-df95-49dd-9d8c-21644b43fd3c req-96c89ee3-83f5-4eeb-a78a-a82bf5724d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9898a900-179f-41b5-91a1-66a85a393f29", "name": "network-vif-deleted", "tag": "ec6de870-2bd8-44cd-9ad8-892277e8063c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:35.045360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-679db5cb-df95-49dd-9d8c-21644b43fd3c req-96c89ee3-83f5-4eeb-a78a-a82bf5724d25 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.046223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-679db5cb-df95-49dd-9d8c-21644b43fd3c req-96c89ee3-83f5-4eeb-a78a-a82bf5724d25 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.046871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-679db5cb-df95-49dd-9d8c-21644b43fd3c req-96c89ee3-83f5-4eeb-a78a-a82bf5724d25 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.074786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-679db5cb-df95-49dd-9d8c-21644b43fd3c req-96c89ee3-83f5-4eeb-a78a-a82bf5724d25 service nova] Creating event network-vif-deleted:ec6de870-2bd8-44cd-9ad8-892277e8063c for instance 9898a900-179f-41b5-91a1-66a85a393f29 on n-h1-857467-1 Sep 13 16:44:35.092872 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-679db5cb-df95-49dd-9d8c-21644b43fd3c req-96c89ee3-83f5-4eeb-a78a-a82bf5724d25 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065020 Sep 13 16:44:35.093497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1794/3536] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:35.136654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:35.137312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:35.154528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.155038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.155480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.156205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.156665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.164059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.180990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:35.182142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:35.203459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.204896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.205852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.207363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.212719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.213966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.408232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:35.418771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:35.428288 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-731f835a-9061-473c-a455-1a0b09ba59f3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1548 microversion: 2.1 time: 0.295657 Sep 13 16:44:35.429443 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1743/3537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:35 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1548 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:35.464808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-171cbd24-ee11-4b55-9e56-070315559756 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.291471 Sep 13 16:44:35.465443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:35.465994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:35.475911 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1795/3538] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:35 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:35.490375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.491249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.491688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.493022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.494724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.498493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.614970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e3c2993-b24b-4905-8052-193ab2f414c8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160186 Sep 13 16:44:35.616718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1744/3539] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:44:35 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:35.695729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:35.696723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:35.705041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.705813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.706539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.707418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.708768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.709415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.747531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:35.748632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:35.749448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:35.750147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lazy-loading 'fault' on Instance uuid 9898a900-179f-41b5-91a1-66a85a393f29 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:35.819213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19489a86e5047198a0068987c04f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f882b6826fe548d8801770e3e2db96f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:35.831117 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6b9e5ca8-0e74-4113-828a-1385caf95f4b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 200 len: 1304 microversion: 2.1 time: 0.140008 Sep 13 16:44:35.831717 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1745/3540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:35 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:36.007237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "245ff46d-0c66-4411-a022-93c50175b255"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:36.009935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.017634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.018335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.018782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.021024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.022591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.023099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.171849 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] HTTP exception thrown: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Request method failure captured: Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments/76851f09-927d-474f-90ec-92f70a5d9f40 HTTP/1.1 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 74 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLu28IdIMn5IgWn6uqw32p3RI4sZLn2cCaRKHE7FO4rKoSFDW8e4rzEyNgUvAxgddDKAwGLBN0I3pFF_duOjmQy9X4_TYS3gIBq-yu6YVetFSKaELK6MX8Un4a5SotXI8I8mcjsZnSpFUNHEqQAQUSndzMtdWxJjRHYPJyLU8gFbMA Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b538f8b01a1849869d7c782b6b78f5c3 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesAdminNegativeTest-387575563 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesAdminNegativeTest-387575563 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b538f8b01a1849869d7c782b6b78f5c3 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-387575563 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesAdminNegativeTest-387575563-project-admin Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 559053ddae864fd39cf5263baed108b9 Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesAdminNegativeTest-387575563-project-admin Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: {"volumeAttachment": {"volumeId": "245ff46d-0c66-4411-a022-93c50175b255"}} Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: exception: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '9d178d82-e4fa-4f21-a587-26c3e9c7d2bb', 'id': '76851f09-927d-474f-90ec-92f70a5d9f40', 'body': {'volumeAttachment': {'volumeId': '245ff46d-0c66-4411-a022-93c50175b255'}}} Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. (HTTP 404) (Request-ID: req-6b606be2-f3f3-450f-a8da-0bc1bebb9358) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:44:36.211038 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Returning 400 to user: Volume 245ff46d-0c66-4411-a022-93c50175b255 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bac63db7-22e3-4fe4-9e87-1dba009d7fa6 tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] 10.222.0.61 "PUT /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments/76851f09-927d-474f-90ec-92f70a5d9f40" status: 400 len: 107 microversion: 2.1 time: 0.646952 Sep 13 16:44:36.216789 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1796/3541] 10.222.0.61 () {60 vars in 1433 bytes} [Tue Sep 13 16:44:35 2022] PUT /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments/76851f09-927d-474f-90ec-92f70a5d9f40 => generated 107 bytes in 649 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:44:36.301901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.302979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.310882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.311570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.312120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.313131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.313929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.314490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.423542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lazy-loading 'services' on Instance uuid 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:36.496704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.497349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.503863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.504600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.505440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.506434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.507065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.507518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.527658 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aac60b40-b088-4990-bbee-f581760a3f55 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments/76851f09-927d-474f-90ec-92f70a5d9f40" status: 202 len: 0 microversion: 2.1 time: 0.230470 Sep 13 16:44:36.528656 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1746/3542] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:44:36 2022] DELETE /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments/76851f09-927d-474f-90ec-92f70a5d9f40 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:44:36.538351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.549814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.562640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.563382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.563855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.564992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.565746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.566435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.605292 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74d48a70-10b4-4694-af21-f51689765f2d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071707 Sep 13 16:44:36.606490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1747/3543] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:36 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:36.632951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:36.653584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abaece83-848b-4007-a7e0-a0faab46b795 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.160809 Sep 13 16:44:36.654289 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1797/3544] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:36 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:36.858154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.859065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.865540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.866335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.866924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.867873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.868331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.868938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.886005 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 HTTP/1.1 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9898a900-179f-41b5-91a1-66a85a393f29'} Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.888596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55de5e82-a4fd-4809-ada5-01b6364bfaf1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 404 len: 111 microversion: 2.1 time: 0.035898 Sep 13 16:44:36.897815 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1748/3545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:36 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:36.902941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.905359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.916091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.916595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.917125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.917787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.918288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.918716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.935383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 HTTP/1.1 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9898a900-179f-41b5-91a1-66a85a393f29'} Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:36.937302 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47ba08c6-94f1-4a8c-b248-48b30e895cc0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 404 len: 111 microversion: 2.1 time: 0.040352 Sep 13 16:44:36.945686 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1798/3546] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:36 2022] DELETE /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:44:36.950491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.951202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 9898a900-179f-41b5-91a1-66a85a393f29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:36.958608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.959231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.960048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.960861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:36.961468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:36.961971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:36.979191 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 HTTP/1.1 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9898a900-179f-41b5-91a1-66a85a393f29'} Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:36.980826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. Sep 13 16:44:36.985213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:36.985743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 9898a900-179f-41b5-91a1-66a85a393f29 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:36.986962 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ecefc4e-bfdf-4f1a-9afd-3dda5cadc2cd tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29" status: 404 len: 111 microversion: 2.1 time: 0.041993 Sep 13 16:44:36.991075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1749/3547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:36 2022] GET /compute/v2.1/servers/9898a900-179f-41b5-91a1-66a85a393f29 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:36.998198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:36.998892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.008497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.009023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.009477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.010467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.010945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.011387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.027748 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 HTTP/1.1 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '12adf32c-7a8f-4dc4-bada-d7d24b0c12b9'} Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.029430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08068043-5899-4a57-bc4d-80d32e33a162 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 404 len: 111 microversion: 2.1 time: 0.038108 Sep 13 16:44:37.037395 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1799/3548] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:36 2022] DELETE /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.045248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.046237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.053963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.054521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.054969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.055744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.056209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.056825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.074403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 HTTP/1.1 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '12adf32c-7a8f-4dc4-bada-d7d24b0c12b9'} Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.075949 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0187718e-17bb-4308-ac5c-c4868248041d tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9" status: 404 len: 111 microversion: 2.1 time: 0.036862 Sep 13 16:44:37.082130 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1750/3549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:37 2022] GET /compute/v2.1/servers/12adf32c-7a8f-4dc4-bada-d7d24b0c12b9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.090665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.091219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.100316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.100883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.101522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.102561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.103485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.104163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.121742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 HTTP/1.1 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e4cdb5ce-4613-4eef-82c8-ac221d8fcf65'} Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.123490 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a8ccb69-607a-4451-bf87-0ef4076bdc40 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 404 len: 111 microversion: 2.1 time: 0.038554 Sep 13 16:44:37.133173 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1800/3550] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:37 2022] DELETE /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.139767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.140343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: e4cdb5ce-4613-4eef-82c8-ac221d8fcf65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.148187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.149121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.149121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.149889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.150527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.150966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.167061 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 HTTP/1.1 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e4cdb5ce-4613-4eef-82c8-ac221d8fcf65'} Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.168827 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-de3fe163-30ca-4aa1-b7e3-65601d83ad9e tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65" status: 404 len: 111 microversion: 2.1 time: 0.034706 Sep 13 16:44:37.176276 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1751/3551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:37 2022] GET /compute/v2.1/servers/e4cdb5ce-4613-4eef-82c8-ac221d8fcf65 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.179752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.180266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.186703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.187245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.187708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.188460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.188971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.189314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.205571 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 HTTP/1.1 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'f2556308-a5f0-42af-a4be-5bf3d32b0961'} Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.207144 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e2b6f45-80e3-4528-a9c5-40cbf49bef50 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 404 len: 111 microversion: 2.1 time: 0.034130 Sep 13 16:44:37.215073 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1801/3552] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:37 2022] DELETE /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.220989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.222244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: f2556308-a5f0-42af-a4be-5bf3d32b0961] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.223930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:37.244151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.244730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.245318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.252321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.252673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.253284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.272598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 HTTP/1.1 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f2556308-a5f0-42af-a4be-5bf3d32b0961'} Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.274615 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.280083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance f2556308-a5f0-42af-a4be-5bf3d32b0961 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.281971 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-372e0c7d-1c0c-4793-bd6a-7247295da1d1 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961" status: 404 len: 111 microversion: 2.1 time: 0.066022 Sep 13 16:44:37.282855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1752/3553] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:37 2022] GET /compute/v2.1/servers/f2556308-a5f0-42af-a4be-5bf3d32b0961 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.291927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.293381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.304127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.304794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.305577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.306724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.307523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.308270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.326164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 HTTP/1.1 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b9099f6f-71a5-4f4c-b297-7681f9e3e472'} Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.328899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.333755 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.337250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.340727 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f5a8721-83e9-4461-98fd-c9cb561aa956 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 404 len: 111 microversion: 2.1 time: 0.051375 Sep 13 16:44:37.352612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.353864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: b9099f6f-71a5-4f4c-b297-7681f9e3e472] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.357202 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1802/3554] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:37 2022] DELETE /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.360727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.361392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.362019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.363185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.363828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.365028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.390691 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 HTTP/1.1 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'b9099f6f-71a5-4f4c-b297-7681f9e3e472'} Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:37.407661 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. Sep 13 16:44:37.414033 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:37.417327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance b9099f6f-71a5-4f4c-b297-7681f9e3e472 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:37.418761 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d185421-98bc-4614-85d2-352aef423ea5 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472" status: 404 len: 111 microversion: 2.1 time: 0.072586 Sep 13 16:44:37.421130 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1753/3555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:37 2022] GET /compute/v2.1/servers/b9099f6f-71a5-4f4c-b297-7681f9e3e472 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:37.619105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.621459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.632044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.632615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.632971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.633685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.634174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.634647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.685023 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39026239-20d3-4c4d-8f35-1830b959a4c9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070608 Sep 13 16:44:37.685882 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1803/3556] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:37 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:37.703904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:37.708629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:37.721853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.724296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.727546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.729767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:37.730561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:37.732070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:37.848253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:37.872955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4abdfc0f-cc2c-49be-8bc0-f244c149f72f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.189086 Sep 13 16:44:37.873811 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1754/3557] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:37 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:38.163013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-85e3f727-1746-452b-885f-c83eca91173e req-87707931-00f5-4054-83f9-bfeeec80e3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cec120-ddf3-4621-8ccc-88bd968deba0", "tag": "c5388a65-7a5a-4e42-a528-6f7a4104a680"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:38.174103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85e3f727-1746-452b-885f-c83eca91173e req-87707931-00f5-4054-83f9-bfeeec80e3ba service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.174586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85e3f727-1746-452b-885f-c83eca91173e req-87707931-00f5-4054-83f9-bfeeec80e3ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.175214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85e3f727-1746-452b-885f-c83eca91173e req-87707931-00f5-4054-83f9-bfeeec80e3ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.194322 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-85e3f727-1746-452b-885f-c83eca91173e req-87707931-00f5-4054-83f9-bfeeec80e3ba service nova] Creating event network-changed:c5388a65-7a5a-4e42-a528-6f7a4104a680 for instance 76cec120-ddf3-4621-8ccc-88bd968deba0 on n-h1-857467-1 Sep 13 16:44:38.205651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-85e3f727-1746-452b-885f-c83eca91173e req-87707931-00f5-4054-83f9-bfeeec80e3ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046399 Sep 13 16:44:38.206314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1804/3558] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:38.701622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:38.704218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:38.728741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.729504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.731819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.733102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.734345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.735078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.830943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1372b16e-48fe-4302-955e-c5e9d13c35d6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135109 Sep 13 16:44:38.834451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1755/3559] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:38 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:38.904822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:38.910326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:38.925455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.926506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.927403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.928470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:38.929271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:38.929913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:38.959842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:39.139700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:39.169466 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e973c6f0-8a09-4f1a-b45f-e90c42deaf8b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.270180 Sep 13 16:44:39.170058 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1805/3560] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:38 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:39.846683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:39.850206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:39.864625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:39.865198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:39.868688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:39.869470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:39.869981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:39.870427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:39.917934 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34efde97-5a06-46ec-afc9-f6ec47a628b3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075847 Sep 13 16:44:39.919647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1756/3561] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:39 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:40.200779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:40.201501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:40.210330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:40.210844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:40.211452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:40.212497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:40.213079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:40.213848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:40.300759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:40.325058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-859f00cc-7ad0-464f-a289-0cbaf10471d1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.128188 Sep 13 16:44:40.334028 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1806/3562] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:40 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:40.932969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:40.936502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:40.944520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:40.945310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:40.946076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:40.946789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:40.947338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:40.947787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:40.969605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:40.991791 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-edcf9013-2aa3-4caf-81d4-984cb43233ff tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063146 Sep 13 16:44:40.996585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1757/3563] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:40 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:41.355293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:41.355981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:41.362966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:41.363465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:41.363942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:41.364880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:41.365350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:41.365788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:41.449542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:41.469018 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b1b7b67-0b19-4b18-bcdf-0952b90f9744 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.117670 Sep 13 16:44:41.469731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1807/3564] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:41 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:42.005762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:42.008948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:42.016888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:42.018428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:42.018960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:42.019804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:42.020748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:42.021540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:42.064758 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbc0dca4-f8b1-4aa9-ba35-c6a819448de8 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063907 Sep 13 16:44:42.071762 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1758/3565] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:41 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:42.497311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:42.498537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:42.505451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:42.506342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:42.507460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:42.508220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:42.508843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:42.509456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:42.602355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:42.621571 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1a4c00dd-878d-4b58-bce6-360c5682c4df tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.127982 Sep 13 16:44:42.622458 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1808/3566] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:42 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:43.078974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:43.081185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:43.090146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:43.090678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:43.091132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:43.091853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:43.092358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:43.092800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:43.126158 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00ecb8be-874b-46d9-b2cb-9bce789ff876 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050900 Sep 13 16:44:43.126537 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1759/3567] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:44:43 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:44:43.314524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-11556546", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "4c66442d-d451-4eb5-af1f-230379be5cc5"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:43.377670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] validate_networks() for [('4c66442d-d451-4eb5-af1f-230379be5cc5', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:44:43.651296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:43.652247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:43.659823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:43.661940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:43.664146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:43.668211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:43.668798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:43.669328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:43.759384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:43.780597 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47c954cc-f633-4268-b0e9-d6e17563db00 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.133512 Sep 13 16:44:43.781518 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1760/3568] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:43 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:43.825903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:44:43.826369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:44:43.826895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:44:43.827209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:44:43.827642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:44:43.837650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:43.838459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:43.839020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:43.839903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:43.840532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:43.840969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:43.865006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Getting quotas for project 50f324180b2c4db6b10898b623098bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:44:43.875883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Getting quotas for user d9b7e0d5309849ab8a8ff78447780461 and project 50f324180b2c4db6b10898b623098bec. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:44:43.890554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:44:43.894476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:44:43.958615 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-21a72443-1949-4044-82ab-fd99668ca32e tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645345 Sep 13 16:44:43.961396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1809/3569] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:44:43.974352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9f2bb25-ce4b-4150-b990-9a04e5c532b5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:43.974978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9f2bb25-ce4b-4150-b990-9a04e5c532b5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:44.111502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d9f2bb25-ce4b-4150-b990-9a04e5c532b5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:44.123636 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9f2bb25-ce4b-4150-b990-9a04e5c532b5 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1216 microversion: 2.1 time: 0.155185 Sep 13 16:44:44.124253 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1761/3570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:43 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:44.810962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:44.811522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:44.819627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:44.820365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:44.821104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:44.822184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:44.822864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:44.823483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:44.937980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:44.968428 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8fb2cd3-678e-4072-af0d-10abdd167b85 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.161415 Sep 13 16:44:44.969032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1810/3571] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:44 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:45.151339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:45.152136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:45.171439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:45.172150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:45.173782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:45.175182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:45.175675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:45.176329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:45.255974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:45.272195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74e549bb-a53d-4433-b4a7-956085dba712 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1268 microversion: 2.1 time: 0.126698 Sep 13 16:44:45.282693 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1762/3572] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:45 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:45.999862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.000588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.010223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.011087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.011752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.012699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.013394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.013958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.116690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:46.149140 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd51bb59-b405-43a0-894e-ede885807092 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.152492 Sep 13 16:44:46.149716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1811/3573] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:45 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:46.172041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.172041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.172041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.172783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.173300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.174579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.175362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.175817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.196345 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 HTTP/1.1 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '97440adf-b971-4533-8e5a-49a5b5937d02'} Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:46.198296 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.203307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.205480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:46.207752 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ed5e009-4965-46ea-a6e6-ca41bd1cc869 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 404 len: 111 microversion: 2.1 time: 0.049330 Sep 13 16:44:46.209000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1763/3574] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:46 2022] DELETE /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:46.218874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.219712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 97440adf-b971-4533-8e5a-49a5b5937d02] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.228622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.229852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.231267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.232470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.233247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.233865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.257982 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 HTTP/1.1 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '97440adf-b971-4533-8e5a-49a5b5937d02'} Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.259940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. Sep 13 16:44:46.266247 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.268634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 97440adf-b971-4533-8e5a-49a5b5937d02 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:46.270918 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cc3bdb6-89ca-4e6a-b4a1-7133ef5f047b tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02" status: 404 len: 111 microversion: 2.1 time: 0.057571 Sep 13 16:44:46.272017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1812/3575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:46 2022] GET /compute/v2.1/servers/97440adf-b971-4533-8e5a-49a5b5937d02 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:46.282306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.283243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.293919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.294707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.295365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.296269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.296922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.297379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.297781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.298046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.307817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.308669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.313551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.314532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.315729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.316379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.324317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 HTTP/1.1 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3951324b-72cd-43d4-8a55-42c110f05a47'} Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:46.326352 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.330272 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.332393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:46.334506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7c147ea-dcba-4280-b51b-476fe87f0167 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 404 len: 111 microversion: 2.1 time: 0.057311 Sep 13 16:44:46.335154 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1764/3576] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:46 2022] DELETE /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:44:46.343118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:46.344432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] [instance: 3951324b-72cd-43d4-8a55-42c110f05a47] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:46.352895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.353907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.355474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.356470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:46.357127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:46.357751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:46.373865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] HTTP exception thrown: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Request method failure captured: Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 HTTP/1.1 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILIdwrr-VXaYfd6DE7hCoMgEeLzwLIdKa5YdKPFMXvFLLx8MG2hiGQ37AZXTGqHJEchNVQKnrkIw-Nz3e6_iTFzCCXYRSEtjcPBNHxbpjdpCWko0_sYg0es-lNY0l-Bg-2Xi9dRXctLUxKFOaRxpU1rVep2KBETGfwKEC9PV56wiX8E Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f882b6826fe548d8801770e3e2db96f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f882b6826fe548d8801770e3e2db96f3 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1919471842 Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f19489a86e5047198a0068987c04f6ad Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1919471842-project Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3951324b-72cd-43d4-8a55-42c110f05a47'} Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:44:46.376669 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. Sep 13 16:44:46.382278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:44:46.383695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] Returning 404 to user: Instance 3951324b-72cd-43d4-8a55-42c110f05a47 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:44:46.384560 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3255216-48fc-4b83-9b6d-4cb5d7b83ab0 tempest-DeleteServersTestJSON-1919471842 tempest-DeleteServersTestJSON-1919471842-project] 10.222.0.61 "GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47" status: 404 len: 111 microversion: 2.1 time: 0.045318 Sep 13 16:44:46.385963 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1765/3577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:46 2022] GET /compute/v2.1/servers/3951324b-72cd-43d4-8a55-42c110f05a47 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:44:46.429584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:46.439806 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8c92331-4bec-4cee-b1b8-ead4889183ca tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1274 microversion: 2.1 time: 0.146364 Sep 13 16:44:46.458369 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1813/3578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:46 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:44:47.181862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:47.182558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:47.192339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.193678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.194301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.195269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.196066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.196636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.311404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:47.334797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-241b6dee-f9c3-4e67-9b75-96be19e69888 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.160180 Sep 13 16:44:47.338722 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1766/3579] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:47 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:47.472351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:47.474178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:47.487611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.488120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.488568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.494047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.494566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.495016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.652838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-080552be-fdc4-4f7c-85f2-836223aa09f7 req-9c5f2788-e9a9-4513-8ae3-dd44184df3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9272b66-0b2c-4091-882c-2f026edc8a82", "tag": "ebe8daf1-9ac5-474c-88f6-0c5c2c481af0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:47.672078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-080552be-fdc4-4f7c-85f2-836223aa09f7 req-9c5f2788-e9a9-4513-8ae3-dd44184df3d2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:47.673375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-080552be-fdc4-4f7c-85f2-836223aa09f7 req-9c5f2788-e9a9-4513-8ae3-dd44184df3d2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:47.675994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-080552be-fdc4-4f7c-85f2-836223aa09f7 req-9c5f2788-e9a9-4513-8ae3-dd44184df3d2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:47.703032 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-080552be-fdc4-4f7c-85f2-836223aa09f7 req-9c5f2788-e9a9-4513-8ae3-dd44184df3d2 service nova] Creating event network-changed:ebe8daf1-9ac5-474c-88f6-0c5c2c481af0 for instance b9272b66-0b2c-4091-882c-2f026edc8a82 on n-h2-857467-1 Sep 13 16:44:47.710707 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-080552be-fdc4-4f7c-85f2-836223aa09f7 req-9c5f2788-e9a9-4513-8ae3-dd44184df3d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061149 Sep 13 16:44:47.713168 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1767/3580] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:47.747661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:47.784337 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a948c8ee-73da-4585-b8bc-0cec552affbd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.319384 Sep 13 16:44:47.789288 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1814/3581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:47 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:48.371907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:48.372697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:48.380541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:48.381208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:48.390822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:48.390822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:48.390822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:48.390822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:48.513226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:48.557098 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76ebf12e-03fa-4de2-9996-a45bb6ad7527 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.191961 Sep 13 16:44:48.563032 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1768/3582] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:48 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:48.813993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:48.814546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:48.831107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:48.831745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:48.833509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:48.837164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:48.838014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:48.838725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:49.033613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:49.044925 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5d6a32b-d6fb-485f-bbe2-93d8306c60bd tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.234933 Sep 13 16:44:49.055947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1815/3583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:48 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:49.588675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:49.589318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:49.600276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:49.601319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:49.602158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:49.603179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:49.603954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:49.604417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:49.708327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:49.736709 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3cb614c0-8896-46f5-a59b-eae3295ddda3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.152709 Sep 13 16:44:49.737985 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1769/3584] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:49 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:50.070166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:50.071409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:50.087324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.088112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.088784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.091154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.093169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.094202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.344116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:50.363989 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a61d43ce-02b1-4260-a3a7-97efd2822392 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.296145 Sep 13 16:44:50.394762 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1816/3585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:50 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:50.769226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:50.769226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:50.776364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.776864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.777309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.778061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.778531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.778976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.889483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:50.897080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:50.901952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:50.906727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Searching by: {'deleted': False, 'project_id': '335fc1c923214d4a940ea97bf6a17f55'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:44:50.909967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:50.914671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.915400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.916038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.916949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:50.917595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:50.918241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:50.935014 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7b9da0e4-d7ad-47c4-8dab-95941556b98b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.171147 Sep 13 16:44:50.935806 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1770/3586] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:50 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:51.010251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:44:51.093147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fef22c38-daf3-4742-81eb-837a46f703bb tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218912 Sep 13 16:44:51.094582 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1817/3587] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:44:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:51.110369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:51.115877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:51.116949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Searching by: {'deleted': False, 'project_id': '335fc1c923214d4a940ea97bf6a17f55'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:44:51.123091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.123091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.123722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.124604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.125429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.125793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.235352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:44:51.330447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:51.338056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.339067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.339701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.398420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:51.400353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:51.413061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.415291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.416156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.418615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.420294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.421496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.487408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7b757151-d423-4256-82cc-7e693178f471 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.381253 Sep 13 16:44:51.488259 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1771/3588] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:44:51 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:51.518729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a53b798-6408-4030-893c-5c90dc3b246a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:51.530295 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a53b798-6408-4030-893c-5c90dc3b246a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015543 Sep 13 16:44:51.531071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1772/3589] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:44:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:51.847171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:51.856501 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c21cfb81-c1f5-45ad-97eb-74a8b86320ee tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.464299 Sep 13 16:44:51.857103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1818/3590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:51 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:51.966143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:51.966767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:51.973709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.974233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.974793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:51.975674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:51.976918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:51.977534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.039548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:52.040220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:52.053281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.053791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.054255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.054969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.055440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.055850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.070528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:52.088942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:44:52.098058 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-584ba1c6-ddbd-47dd-bfe0-f8eb180f3960 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.137178 Sep 13 16:44:52.098694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1773/3591] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:51 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:52.139845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:52.180197 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-740bec57-7617-4e7b-a337-6946d0f26c9a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 204 len: 0 microversion: 2.1 time: 0.145027 Sep 13 16:44:52.180844 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1819/3592] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:44:52 2022] DELETE /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:44:52.201802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:52.203061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:52.210585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.211396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.211942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.212838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.214226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.214690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.356635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:52.366010 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3ad6eb6-d294-4c6c-953a-9ff96592acbe tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1609 microversion: 2.1 time: 0.180099 Sep 13 16:44:52.366823 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1774/3593] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:52 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1609 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:52.880298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:52.881427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:52.893674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.894358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.894981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:52.896762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:52.897339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:52.898778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.124553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:53.125179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:53.133435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.133971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.134419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.135133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.135758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.136203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.147751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:53.166331 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9729ed6d-116d-4d9e-b592-d11c9ebe84a9 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.289964 Sep 13 16:44:53.167437 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1820/3594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:52 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:53.226996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:53.230558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:53.246265 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-006216c3-a7c1-4561-a609-d4043082239b tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.125478 Sep 13 16:44:53.246862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1775/3595] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:53 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:53.390791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:53.391688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:53.398257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.398759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.399205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.400113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:53.400750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:53.401192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:53.567608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:53.587335 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9908af63-22f5-4b78-ace2-71ab4cdc122b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1609 microversion: 2.1 time: 0.201717 Sep 13 16:44:53.590368 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1821/3596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:53 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1609 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:54.191295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:54.194160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:54.202823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.204184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.204834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.205795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.206630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.207274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.275599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:54.277032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:54.279329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:44:54.285630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.286461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.287272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.288224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.288917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.289717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.389746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:54.413752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-843266d1-d3d9-4064-9315-c3444cda4da3 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.142944 Sep 13 16:44:54.415404 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1822/3597] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:54 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:44:54.620085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:54.623919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:54.627307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:54.634511 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac550901-664e-40d0-8011-c3a01b07a582 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.447082 Sep 13 16:44:54.635124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1776/3598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:54 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:54.638150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.639714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.640459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.641447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:54.642167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:54.645155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:54.938756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:54.952556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92423bee-ddc3-484a-808a-6d538195f22d tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1609 microversion: 2.1 time: 0.343099 Sep 13 16:44:54.953967 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1823/3599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:54 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1609 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:55.332204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a82ffc08-3d9c-43ef-8cc6-962c6a448d70 req-ba2d2697-2fc8-4ffc-9fd9-dbfa86c74869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687d11fc-8748-4bd9-b47f-e81e82540bf6", "name": "network-vif-deleted", "tag": "43d54a5a-6675-4935-9785-3ad0ab76217f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:55.352574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a82ffc08-3d9c-43ef-8cc6-962c6a448d70 req-ba2d2697-2fc8-4ffc-9fd9-dbfa86c74869 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.358339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a82ffc08-3d9c-43ef-8cc6-962c6a448d70 req-ba2d2697-2fc8-4ffc-9fd9-dbfa86c74869 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.358822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a82ffc08-3d9c-43ef-8cc6-962c6a448d70 req-ba2d2697-2fc8-4ffc-9fd9-dbfa86c74869 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.373427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a82ffc08-3d9c-43ef-8cc6-962c6a448d70 req-ba2d2697-2fc8-4ffc-9fd9-dbfa86c74869 service nova] Creating event network-vif-deleted:43d54a5a-6675-4935-9785-3ad0ab76217f for instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 on n-h2-857467-1 Sep 13 16:44:55.383482 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a82ffc08-3d9c-43ef-8cc6-962c6a448d70 req-ba2d2697-2fc8-4ffc-9fd9-dbfa86c74869 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058475 Sep 13 16:44:55.384194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1777/3600] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:44:55.445231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:55.446694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:55.460482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.462276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.465481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.466514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.467171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.468213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.612927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:55.646639 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82050baf-5b3e-4600-a0ed-3f4ecde4bd58 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.205745 Sep 13 16:44:55.647592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1824/3601] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:55 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:55.667838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:55.668794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:55.686783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.687511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.688130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.689025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.689680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.690311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.977086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:55.978331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:55.991916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.992721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.994968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:55.998524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:55.999132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:55.999681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:56.016210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:56.025552 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-473d0b97-6c96-4775-9a60-88d6b0471b52 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.361895 Sep 13 16:44:56.026182 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1778/3602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:55 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:56.177192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:56.191677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfa0ee8b-9c89-4120-bea2-24f45782d183 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1252 microversion: 2.1 time: 0.215872 Sep 13 16:44:56.194656 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1825/3603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:55 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1252 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:56.340928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5f092697-8527-446f-825a-b747b9d31a7f req-6a2bb69f-871c-4543-aa3d-b0ececdff37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9272b66-0b2c-4091-882c-2f026edc8a82", "name": "network-vif-plugged", "status": "completed", "tag": "ebe8daf1-9ac5-474c-88f6-0c5c2c481af0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:44:56.361903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5f092697-8527-446f-825a-b747b9d31a7f req-6a2bb69f-871c-4543-aa3d-b0ececdff37d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:56.362406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5f092697-8527-446f-825a-b747b9d31a7f req-6a2bb69f-871c-4543-aa3d-b0ececdff37d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:56.362850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5f092697-8527-446f-825a-b747b9d31a7f req-6a2bb69f-871c-4543-aa3d-b0ececdff37d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:56.390661 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5f092697-8527-446f-825a-b747b9d31a7f req-6a2bb69f-871c-4543-aa3d-b0ececdff37d service nova] Creating event network-vif-plugged:ebe8daf1-9ac5-474c-88f6-0c5c2c481af0 for instance b9272b66-0b2c-4091-882c-2f026edc8a82 on n-h2-857467-1 Sep 13 16:44:56.400192 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5f092697-8527-446f-825a-b747b9d31a7f req-6a2bb69f-871c-4543-aa3d-b0ececdff37d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063380 Sep 13 16:44:56.402499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1779/3604] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:44:56.684061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:56.688038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:56.711839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:56.713878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:56.716484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:56.720329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:56.722088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:56.726600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:56.956402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:57.016926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e8a852e-2ee8-4b22-9542-2d9c8ced82e7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.336667 Sep 13 16:44:57.033939 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1826/3605] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:56 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:57.071850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:57.072761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:57.087268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:57.088319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:57.088789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:57.089528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:57.090565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:57.091016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:57.217932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:57.218715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:57.226375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:57.226880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:57.227584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:57.228534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:57.229800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:57.230285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:57.334797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:57.354427 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-91efdf9a-bb50-432e-a12f-93622bdef48f tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1252 microversion: 2.1 time: 0.141306 Sep 13 16:44:57.357744 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1827/3606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:57 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1252 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:57.894294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:57.939991 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d211c5c1-5174-4e6d-ac48-ad20c3004e3a tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1316 microversion: 2.1 time: 0.891335 Sep 13 16:44:57.954705 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1780/3607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:57 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1316 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:58.052036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:58.053536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:58.077312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.077953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.078328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.079064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.079534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.079976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.249318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:58.292663 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-385449f0-e748-421a-90f5-a8080b1d7468 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.245389 Sep 13 16:44:58.293350 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1828/3608] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:58 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:58.381550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:58.382370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:58.400137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.400759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.401368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.402238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.402769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.403432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.586294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:58.597436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9240eb02-e105-4cbf-a41d-c856ddb22bae tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1252 microversion: 2.1 time: 0.220700 Sep 13 16:44:58.598163 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1781/3609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:58 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1252 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:58.965413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:58.966394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:58.976029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.976559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.978180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:58.978932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:58.982899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:58.983380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.273394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:59.313678 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6927398-744f-4655-acd4-4f9887ed33f3 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1506 microversion: 2.1 time: 0.352035 Sep 13 16:44:59.334601 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1829/3610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:58 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:44:59.338689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:59.339506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:59.352681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:59.353254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:59.353767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.354602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:59.355132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:59.355634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.488107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:44:59.528570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-615b3e94-0225-46e8-b72d-013f18375e54 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.192894 Sep 13 16:44:59.530365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1782/3611] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:44:59 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:44:59.622506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:44:59.626052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:44:59.636810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:59.637667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:59.638339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.639879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:44:59.640539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:44:59.641171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:44:59.800809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:44:59.815794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3c6de32-896f-419d-92b2-766ca56d86c8 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1252 microversion: 2.1 time: 0.197748 Sep 13 16:44:59.819223 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1830/3612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:44:59 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1252 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:00.558711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:00.559910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:00.570948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:00.571986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:00.572658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:00.574241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:00.574947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:00.575556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:00.684309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:00.708987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb268bca-8766-4096-af9e-54765be08be8 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.153970 Sep 13 16:45:00.710121 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1783/3613] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:00 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:00.842234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:00.843659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:00.850315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:00.850814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:00.851252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:00.851964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:00.852421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:00.852851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:00.950109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:00.958191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:00.968687 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9853578-55ab-49a3-a323-6f2ee3304c8b tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1252 microversion: 2.1 time: 0.133091 Sep 13 16:45:00.969281 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1784/3614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:00 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1252 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:01.178576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-293464471", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0142df08-ad11-496a-bba2-7c9d52433a3c"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:01.249873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] validate_networks() for [('0142df08-ad11-496a-bba2-7c9d52433a3c', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:45:01.737882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:01.741316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:01.745608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:01.749255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:01.756482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:45:01.756910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:45:01.757389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:45:01.757806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:45:01.758245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:45:01.764603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.765391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.766112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.768012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.769346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.770047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.775615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.776114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.776556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.777301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:01.777773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:01.778247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:01.819137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Getting quotas for project a8e36660ed7043cca297e45a4da60b8e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:45:01.825534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Getting quotas for user 80d59a70488047bda3a1a7bef628348e and project a8e36660ed7043cca297e45a4da60b8e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:45:01.844139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Going to run 3 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:45:01.846695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:45:01.885231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:01.907794 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33a48722-cc49-4f9b-b6d4-05ed0f5735ca tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1929 microversion: 2.75 time: 0.174785 Sep 13 16:45:01.909213 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1785/3615] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:01 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1929 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:01.930145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=1d020772-acd1-4064-a5f0-31d1d1361165,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:45:01.979289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=7e5e4482-b5e4-4b7c-816d-0407466ed25c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:45:02.002035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:02.003934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:02.022304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.029043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.030279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.035224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.042104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.042642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.127957 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b073edf-59cd-4f22-85ed-46a57d338654 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300737 Sep 13 16:45:02.133847 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1831/3616] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:45:02.139508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f1927b8a-f245-46dc-8f90-29c12a9f6861"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:02.171438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:02.186857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.187376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.187821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.194359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:02.199033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.199821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.200277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.205182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f478c683-8ec0-4479-9470-e0a6378ad651 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1252 microversion: 2.1 time: 0.216758 Sep 13 16:45:02.205777 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1786/3617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:01 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1252 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:02.234729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:02.250544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:02.262891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:02.320285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] HTTP exception thrown: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. Sep 13 16:45:02.321604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.322706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Request method failure captured: Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82/os-volume_attachments/0b6f854f-78d4-4a82-8117-68298725c1ef HTTP/1.1 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 74 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLu28IdIMn5IgWn6uqw32p3RI4sZLn2cCaRKHE7FO4rKoSFDW8e4rzEyNgUvAxgddDKAwGLBN0I3pFF_duOjmQy9X4_TYS3gIBq-yu6YVetFSKaELK6MX8Un4a5SotXI8I8mcjsZnSpFUNHEqQAQUSndzMtdWxJjRHYPJyLU8gFbMA Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b538f8b01a1849869d7c782b6b78f5c3 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesAdminNegativeTest-387575563 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b538f8b01a1849869d7c782b6b78f5c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesAdminNegativeTest-387575563 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b538f8b01a1849869d7c782b6b78f5c3 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-387575563 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesAdminNegativeTest-387575563-project-admin Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 559053ddae864fd39cf5263baed108b9 Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesAdminNegativeTest-387575563-project-admin Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: {"volumeAttachment": {"volumeId": "f1927b8a-f245-46dc-8f90-29c12a9f6861"}} Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: exception: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': 'b9272b66-0b2c-4091-882c-2f026edc8a82', 'id': '0b6f854f-78d4-4a82-8117-68298725c1ef', 'body': {'volumeAttachment': {'volumeId': 'f1927b8a-f245-46dc-8f90-29c12a9f6861'}}} Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. (HTTP 404) (Request-ID: req-470f61be-5895-4316-9877-119a87dc3677) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:45:02.322881 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. Sep 13 16:45:02.327728 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:02.334094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.334094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.334094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.334094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.334682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] Returning 404 to user: Volume 0b6f854f-78d4-4a82-8117-68298725c1ef could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:02.334682 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-20640b3d-d810-435b-acda-5e894a4908cf tempest-VolumesAdminNegativeTest-387575563 tempest-VolumesAdminNegativeTest-387575563-project-admin] 10.222.0.61 "PUT /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82/os-volume_attachments/0b6f854f-78d4-4a82-8117-68298725c1ef" status: 404 len: 109 microversion: 2.1 time: 0.197823 Sep 13 16:45:02.334682 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1832/3618] 10.222.0.61 () {60 vars in 1433 bytes} [Tue Sep 13 16:45:02 2022] PUT /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82/os-volume_attachments/0b6f854f-78d4-4a82-8117-68298725c1ef => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:02.354799 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64330a7a-dc0f-4a94-b79a-9b81a6e72b1c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.133321 Sep 13 16:45:02.355409 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1787/3619] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:45:02 2022] GET /compute/v2.1/servers => generated 1015 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:02.369542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e403afe9-2633-4e49-a8e8-c42f59f9c166 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:02.370451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e403afe9-2633-4e49-a8e8-c42f59f9c166 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:02.463363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e403afe9-2633-4e49-a8e8-c42f59f9c166 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:02.476348 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e403afe9-2633-4e49-a8e8-c42f59f9c166 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1222 microversion: 2.1 time: 0.112160 Sep 13 16:45:02.479110 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1833/3620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:02 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:02.940885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:02.942825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:02.960844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.962604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.963229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:02.964384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:02.966118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:02.967609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.150088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:03.173910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:03.176137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-041c9532-9faf-4e6a-b165-315e5c0d3682 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1935 microversion: 2.75 time: 0.241048 Sep 13 16:45:03.177811 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1788/3621] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:02 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1935 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:03.231480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:03.232971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:03.250631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:03.254625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:03.255248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.257847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:03.259299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:03.261497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.316538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:03.317247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:03.318313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:03.319062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lazy-loading 'fault' on Instance uuid 687d11fc-8748-4bd9-b47f-e81e82540bf6 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:03.403438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:03.415381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c5508e2-b62a-4a18-99dd-89b68136716a tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1257 microversion: 2.1 time: 0.189634 Sep 13 16:45:03.415987 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1834/3622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:03 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1257 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:03.503549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f69bea8d-8cbe-4f8d-96c3-e26aafedb17f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:03.504436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f69bea8d-8cbe-4f8d-96c3-e26aafedb17f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:03.596285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f69bea8d-8cbe-4f8d-96c3-e26aafedb17f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:03.608432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f69bea8d-8cbe-4f8d-96c3-e26aafedb17f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1222 microversion: 2.1 time: 0.109040 Sep 13 16:45:03.626801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1789/3623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:03 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:04.214094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:04.214877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:04.225296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.227500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.229392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.231326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.231825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.232371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.389342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:04.414107 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93bc7f24-8ee6-42d6-9f3a-fd5be63e358a tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1935 microversion: 2.75 time: 0.203604 Sep 13 16:45:04.415289 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1835/3624] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:04 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1935 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:04.441009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:04.441651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:04.453639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.454207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.454649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.455520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.456068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.456502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.504478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.505068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.506029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.506498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lazy-loading 'fault' on Instance uuid 687d11fc-8748-4bd9-b47f-e81e82540bf6 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:04.603548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbeb18d6360416a9fce125f830755e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335fc1c923214d4a940ea97bf6a17f55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:04.616331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ba0f326-47dd-4b29-bef9-29c8f907d1af tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 200 len: 1257 microversion: 2.1 time: 0.180145 Sep 13 16:45:04.618339 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1790/3625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:04 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:04.640854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:04.641632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:04.648920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.649699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.650369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.651260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:04.651895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:04.652499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:04.657162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:04.775020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:04.799714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-672581fe-2a15-462b-9014-8d216be7a05d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1218 microversion: 2.1 time: 0.163337 Sep 13 16:45:04.800318 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1836/3626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:04 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:05.443479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:05.444098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:05.450905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.451403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.451845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.452558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.453024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.453457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.642128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:05.643009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] [instance: 687d11fc-8748-4bd9-b47f-e81e82540bf6] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:05.659232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:05.675535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.676218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.677236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.687137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.687863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.688352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.720099 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-542b3573-f4b9-4a2c-b62b-466f555cadb7 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1935 microversion: 2.75 time: 0.277873 Sep 13 16:45:05.721208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1791/3627] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:05 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1935 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:45:05.736413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] HTTP exception thrown: Instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 could not be found. Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Request method failure captured: Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 HTTP/1.1 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILMEvVWjnUlkHVMGCoxWTJUn8TAxsrQc-N62IjuO1ZLkVJMVSwNr-a6mUG17mEkilnFbUIFTed6CrDaojlO5tGLNcDhRKMi6fHgDRvxqrYwOWhnGsFsf23H-DjN_XcCDmS1qF_FubTy0_RwaqIuY1WefL-TSAf8sxdDW9W4SFLCDsI0 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 335fc1c923214d4a940ea97bf6a17f55 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestBootFromVolume-768565893 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/335fc1c923214d4a940ea97bf6a17f55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_335fc1c923214d4a940ea97bf6a17f55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/335fc1c923214d4a940ea97bf6a17f55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/335fc1c923214d4a940ea97bf6a17f55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestBootFromVolume-768565893 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 335fc1c923214d4a940ea97bf6a17f55 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestBootFromVolume-768565893 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestBootFromVolume-768565893-project Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5bbeb18d6360416a9fce125f830755e7 Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestBootFromVolume-768565893-project Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 could not be found. Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '687d11fc-8748-4bd9-b47f-e81e82540bf6'} Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 could not be found. Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 could not be found. Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:05.745890 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 could not be found. Sep 13 16:45:05.752077 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:05.756849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Returning 404 to user: Instance 687d11fc-8748-4bd9-b47f-e81e82540bf6 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:05.759674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-771b1b17-0e95-4120-bfc8-8f94ec568e20 tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6" status: 404 len: 111 microversion: 2.1 time: 0.121516 Sep 13 16:45:05.761512 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1837/3628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:05 2022] GET /compute/v2.1/servers/687d11fc-8748-4bd9-b47f-e81e82540bf6 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:05.771582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e05292d-2991-4e5b-b6d7-18fb8f5823be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] Calling method '.version_select at 0x7fbeb9703430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:05.808888 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e05292d-2991-4e5b-b6d7-18fb8f5823be tempest-ServersTestBootFromVolume-768565893 tempest-ServersTestBootFromVolume-768565893-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775191631" status: 202 len: 0 microversion: 2.1 time: 0.042516 Sep 13 16:45:05.814622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1792/3629] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775191631 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:45:05.824540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:05.825782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:05.834842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.836570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.837506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:05.838502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:05.839112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:05.839649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:06.042397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:06.056471 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-04f7fe4e-f4f1-4044-b864-0e39a5b85510 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1274 microversion: 2.1 time: 0.234507 Sep 13 16:45:06.061998 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1838/3630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:05 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:06.761054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:06.761673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:06.775282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:06.784408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:06.784979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:06.785949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:06.790078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:06.790676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.021794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:07.022874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:07.041614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.047300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.047748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.053675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.056327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.056811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.080362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:07.124434 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e17c746a-b322-492e-880c-23dccbf6f39f tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1935 microversion: 2.75 time: 0.369230 Sep 13 16:45:07.139228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:07.146248 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1793/3631] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:06 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1935 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:07.155575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:07.157060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:07.167937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.174746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.175361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.176289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.177270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.178092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.229437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:07.316183 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b452f42b-659e-4a94-a446-5505fafe4b84 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 204 len: 0 microversion: 2.1 time: 0.301696 Sep 13 16:45:07.317104 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1839/3632] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:07 2022] DELETE /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:45:07.325869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:07.327048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:07.339360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.342895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.343656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.350008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:07.350697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:07.351264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:07.507549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:07.524030 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-86cf246d-4cbb-45b7-b83f-4ac89c1e0431 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1280 microversion: 2.1 time: 0.376395 Sep 13 16:45:07.530816 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1794/3633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:07 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1280 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:07.888513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:07.904394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58601c0b-bdc0-4a56-8326-41e0fb91090c tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1512 microversion: 2.1 time: 0.582619 Sep 13 16:45:07.905409 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1840/3634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:07 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:08.164706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:08.167626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:08.185252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.185763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.189963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.190750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.191242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.191690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.555504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:08.556053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:08.581222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] Lazy-loading 'services' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:08.596777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.597393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.600473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.601298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.601795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.610566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.665303 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e47bacad-1c30-4ac5-aa97-0ba005c6dad1 tempest-ServersAdmin275Test-1390017456 tempest-ServersAdmin275Test-1390017456-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1920 microversion: 2.75 time: 0.510125 Sep 13 16:45:08.681870 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1795/3635] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:08 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1920 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:08.712135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:08.712656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:08.719234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.719767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.720170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.720896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.721342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.722460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.756518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:08.894122 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-613bca3d-3abc-406d-a8f7-af5897ae9604 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 204 len: 0 microversion: 2.75 time: 0.183829 Sep 13 16:45:08.897496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1796/3636] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:45:08 2022] DELETE /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:45:08.908484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:08.909891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:08.919444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.920424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.921180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:08.922653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:08.923343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:08.924378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:09.023841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:09.037919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:09.043177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:09.057550 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ffbf4dc0-2f66-4ab1-b00e-2280da9d1a2b tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1444 microversion: 2.75 time: 0.150733 Sep 13 16:45:09.057550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1797/3637] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:08 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:09.080723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:09.081604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:09.090833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:09.091513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:09.092066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:09.092885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:09.093456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:09.094038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:09.365428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:09.376221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ae6a7290-a50c-4ced-84e5-2603518c1b4a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.826068 Sep 13 16:45:09.377612 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1841/3638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:08 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:09.656120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:09.668270 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c184c94-cb03-41b4-8612-bcc9077bafd1 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1512 microversion: 2.1 time: 0.611888 Sep 13 16:45:09.669078 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1798/3639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:09 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:10.056506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0fde71ae-d931-49ac-bf72-10cfc41af99c req-2e477caa-6abd-4fca-bd2b-0c023cbfaa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d020772-acd1-4064-a5f0-31d1d1361165", "tag": "eb6e69d4-d150-490c-abdf-ab269b0386c5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:10.076233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0fde71ae-d931-49ac-bf72-10cfc41af99c req-2e477caa-6abd-4fca-bd2b-0c023cbfaa17 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.077204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0fde71ae-d931-49ac-bf72-10cfc41af99c req-2e477caa-6abd-4fca-bd2b-0c023cbfaa17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.078346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0fde71ae-d931-49ac-bf72-10cfc41af99c req-2e477caa-6abd-4fca-bd2b-0c023cbfaa17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.082585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:10.084296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:10.093847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.094926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.095735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.096645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.097370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.099004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.104017 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0fde71ae-d931-49ac-bf72-10cfc41af99c req-2e477caa-6abd-4fca-bd2b-0c023cbfaa17 service nova] Creating event network-changed:eb6e69d4-d150-490c-abdf-ab269b0386c5 for instance 1d020772-acd1-4064-a5f0-31d1d1361165 on n-h1-857467-1 Sep 13 16:45:10.112577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0fde71ae-d931-49ac-bf72-10cfc41af99c req-2e477caa-6abd-4fca-bd2b-0c023cbfaa17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059683 Sep 13 16:45:10.113371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1842/3640] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:10.238700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:10.248328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:10.254498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:10.264235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14b4d46c-0335-4b21-9938-c6b63dd815b6 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1444 microversion: 2.75 time: 0.185988 Sep 13 16:45:10.270022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1799/3641] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:10 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1444 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:45:10.399850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:10.400821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:10.404110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:10.408089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.408877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.409503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.410433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.411628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.412234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.691382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:10.694201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:10.700478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.701189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.701810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.702766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:10.703387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:10.703975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:10.755724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:10.771559 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-589fc034-7fc5-4d4b-a621-9e0ea4636648 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.375092 Sep 13 16:45:10.773324 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1843/3642] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:10 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:11.220308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:11.251001 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d812769-aee1-4cc4-aa50-8fd02ce0583d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1512 microversion: 2.1 time: 0.563311 Sep 13 16:45:11.266950 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1800/3643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:10 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1512 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:11.297450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:11.298130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:11.318373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.318883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.321227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:11.322013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.325490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.325982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:11.348522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-53463cbd-ce78-4582-802e-f765d6045ea5 req-5993395f-7e1f-4c9e-80cc-485f296450d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9272b66-0b2c-4091-882c-2f026edc8a82", "name": "network-vif-deleted", "tag": "ebe8daf1-9ac5-474c-88f6-0c5c2c481af0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:11.368878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-53463cbd-ce78-4582-802e-f765d6045ea5 req-5993395f-7e1f-4c9e-80cc-485f296450d1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.370232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-53463cbd-ce78-4582-802e-f765d6045ea5 req-5993395f-7e1f-4c9e-80cc-485f296450d1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.371640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-53463cbd-ce78-4582-802e-f765d6045ea5 req-5993395f-7e1f-4c9e-80cc-485f296450d1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:11.411498 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-53463cbd-ce78-4582-802e-f765d6045ea5 req-5993395f-7e1f-4c9e-80cc-485f296450d1 service nova] Creating event network-vif-deleted:ebe8daf1-9ac5-474c-88f6-0c5c2c481af0 for instance b9272b66-0b2c-4091-882c-2f026edc8a82 on n-h2-857467-1 Sep 13 16:45:11.418421 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-53463cbd-ce78-4582-802e-f765d6045ea5 req-5993395f-7e1f-4c9e-80cc-485f296450d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074671 Sep 13 16:45:11.422948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1801/3644] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:11.512441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:11.524925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:11.528800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:11.541367 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1c5d1377-db8c-4eb5-8d44-5a6a8d93d087 tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1444 microversion: 2.75 time: 0.248427 Sep 13 16:45:11.554012 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1844/3645] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:11 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1444 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:11.802944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:11.804916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:11.824385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.824991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.826699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:11.827622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:11.830577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:11.832162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.109157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:12.118605 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1d8ac8b6-d130-43d4-a266-9687e141499c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.320968 Sep 13 16:45:12.132825 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1802/3646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:11 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:12.279022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:12.280589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:12.288150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:12.297365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.300247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.301636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.302925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.304702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.311419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.380226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.381249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.381960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.382794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lazy-loading 'fault' on Instance uuid b9272b66-0b2c-4091-882c-2f026edc8a82 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:12.476712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:12.483294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:12.501253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee6f90a1-5fac-4e0b-ac3f-b347d0279aaa tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 200 len: 1306 microversion: 2.1 time: 0.227734 Sep 13 16:45:12.501965 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1845/3647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:12 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 1306 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:12.521806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b5c66749-c9cb-4870-a988-4c06d05d7554 req-98e3aa12-8ed0-46c5-a538-114104119371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5e4482-b5e4-4b7c-816d-0407466ed25c", "tag": "9f934bfc-0d95-47ca-ab67-f0e48d458542"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:12.529567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:12.534570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b5c66749-c9cb-4870-a988-4c06d05d7554 req-98e3aa12-8ed0-46c5-a538-114104119371 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.535342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b5c66749-c9cb-4870-a988-4c06d05d7554 req-98e3aa12-8ed0-46c5-a538-114104119371 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.536848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b5c66749-c9cb-4870-a988-4c06d05d7554 req-98e3aa12-8ed0-46c5-a538-114104119371 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.550442 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b5c66749-c9cb-4870-a988-4c06d05d7554 req-98e3aa12-8ed0-46c5-a538-114104119371 service nova] Creating event network-changed:9f934bfc-0d95-47ca-ab67-f0e48d458542 for instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c on n-h2-857467-1 Sep 13 16:45:12.556601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b5c66749-c9cb-4870-a988-4c06d05d7554 req-98e3aa12-8ed0-46c5-a538-114104119371 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040634 Sep 13 16:45:12.557662 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1803/3648] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:12.570848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:12.571899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:12.579068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.579811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.580526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.581450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.582169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.583819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.620231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:12.621091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:12.621747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:12.622425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lazy-loading 'fault' on Instance uuid 0fad0b68-8bde-4e82-a11d-ea3752fab70c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:12.694796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:12.705978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:12.708386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a79f72e7bbf4452b90c388e58ca5edec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f15c9606fc444aaca861b527feab03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:12.714313 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3b5f661-e3a5-4b0e-9e91-8577572c8a2f tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 200 len: 1449 microversion: 2.75 time: 0.148333 Sep 13 16:45:12.715245 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1846/3649] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:12 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:45:13.144806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:13.147000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:13.164552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.166102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.168582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.169561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.170994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.172160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.456415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2dc4759a-11ee-4413-958f-cc4c03cc957d req-aaf571d8-b5e6-4940-9c98-41d791ded544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1caecc-7f4b-4aa7-8800-eb92f808e753", "tag": "6472330e-5a15-4249-9230-14e63f8ba470"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:13.468916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2dc4759a-11ee-4413-958f-cc4c03cc957d req-aaf571d8-b5e6-4940-9c98-41d791ded544 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.469760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2dc4759a-11ee-4413-958f-cc4c03cc957d req-aaf571d8-b5e6-4940-9c98-41d791ded544 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.470630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2dc4759a-11ee-4413-958f-cc4c03cc957d req-aaf571d8-b5e6-4940-9c98-41d791ded544 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.487365 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2dc4759a-11ee-4413-958f-cc4c03cc957d req-aaf571d8-b5e6-4940-9c98-41d791ded544 service nova] Creating event network-changed:6472330e-5a15-4249-9230-14e63f8ba470 for instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 on n-h1-857467-1 Sep 13 16:45:13.493374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2dc4759a-11ee-4413-958f-cc4c03cc957d req-aaf571d8-b5e6-4940-9c98-41d791ded544 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046290 Sep 13 16:45:13.494667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1847/3650] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:13.532342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:13.533758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: b9272b66-0b2c-4091-882c-2f026edc8a82] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:13.543861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.544747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.545538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.547429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.548442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.549957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.569351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] HTTP exception thrown: Instance b9272b66-0b2c-4091-882c-2f026edc8a82 could not be found. Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Request method failure captured: Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 HTTP/1.1 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLiDSXT-M0QZofATPqd3NZUXVcLEbVGnbKpU8KnNNMfhKbmhI54qtgbecSoR9AcrNcZFjEQcphKeFWJIAjsIELZRZVnN_f5rIP5Recg5xVJB188kD44zGQoyuKUl56T1-g8mrZAv8v7_H5kvbdj7TxlefPabaf-BS1ct2WRcRY5rhs Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 50f324180b2c4db6b10898b623098bec Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesAdminNegativeTest-865623108 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/50f324180b2c4db6b10898b623098bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_50f324180b2c4db6b10898b623098bec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/50f324180b2c4db6b10898b623098bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/50f324180b2c4db6b10898b623098bec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesAdminNegativeTest-865623108 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 50f324180b2c4db6b10898b623098bec Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-865623108 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesAdminNegativeTest-865623108-project Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d9b7e0d5309849ab8a8ff78447780461 Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesAdminNegativeTest-865623108-project Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b9272b66-0b2c-4091-882c-2f026edc8a82 could not be found. Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b9272b66-0b2c-4091-882c-2f026edc8a82'} Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9272b66-0b2c-4091-882c-2f026edc8a82 could not be found. Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9272b66-0b2c-4091-882c-2f026edc8a82 could not be found. Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:13.572270 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9272b66-0b2c-4091-882c-2f026edc8a82 could not be found. Sep 13 16:45:13.577465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.579431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Returning 404 to user: Instance b9272b66-0b2c-4091-882c-2f026edc8a82 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:13.580745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8911f5f3-190e-4c5d-a019-e912927899ec tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82" status: 404 len: 111 microversion: 2.1 time: 0.056925 Sep 13 16:45:13.581877 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1848/3651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:13 2022] GET /compute/v2.1/servers/b9272b66-0b2c-4091-882c-2f026edc8a82 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:13.599705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:13.602250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:13.620566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb2a4be7-4afb-49d0-9332-5622abe39ebc tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.480887 Sep 13 16:45:13.621746 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1804/3652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:13 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:13.744220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:13.744846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] [instance: 0fad0b68-8bde-4e82-a11d-ea3752fab70c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:13.754754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.758117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.758978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.760020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:13.762420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:13.763047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:13.789019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] HTTP exception thrown: Instance 0fad0b68-8bde-4e82-a11d-ea3752fab70c could not be found. Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Request method failure captured: Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c HTTP/1.1 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILM7AacX1hO0d_XlIBwCSskJp3IN-fjkvjbEHjCTpH0h0PZN8f6FDayuMU-0Of0iQ9cahf5N-FBixBFr0dLFhqZVxA1OaVB4VqK3oC5EFnBkwSU15sQE9gfGt3IirZpAt7yTGJiL0ktPLzfjVfRK4Xt-byj34L5q5ifpoyt_sRrD6t4 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.75 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 21f15c9606fc444aaca861b527feab03 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdmin275Test-2117077081 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21f15c9606fc444aaca861b527feab03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21f15c9606fc444aaca861b527feab03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21f15c9606fc444aaca861b527feab03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21f15c9606fc444aaca861b527feab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdmin275Test-2117077081 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 21f15c9606fc444aaca861b527feab03 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdmin275Test-2117077081 Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdmin275Test-2117077081-project Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a79f72e7bbf4452b90c388e58ca5edec Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdmin275Test-2117077081-project Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 0fad0b68-8bde-4e82-a11d-ea3752fab70c could not be found. Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '0fad0b68-8bde-4e82-a11d-ea3752fab70c'} Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fad0b68-8bde-4e82-a11d-ea3752fab70c could not be found. Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fad0b68-8bde-4e82-a11d-ea3752fab70c could not be found. Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:13.790911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fad0b68-8bde-4e82-a11d-ea3752fab70c could not be found. Sep 13 16:45:13.795732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:13.797109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] Returning 404 to user: Instance 0fad0b68-8bde-4e82-a11d-ea3752fab70c could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:13.798187 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75560179-b254-41a5-88c7-4d373db3ecdd tempest-ServersAdmin275Test-2117077081 tempest-ServersAdmin275Test-2117077081-project] 10.222.0.61 "GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c" status: 404 len: 111 microversion: 2.75 time: 0.058099 Sep 13 16:45:13.799232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1849/3653] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:13 2022] GET /compute/v2.1/servers/0fad0b68-8bde-4e82-a11d-ea3752fab70c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:14.644971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:14.645808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:14.657052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:14.658506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:14.659139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:14.661759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:14.662447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:14.675075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:14.943605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:14.952944 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5730c8b0-3efc-4491-b85c-f9b12620af79 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.312587 Sep 13 16:45:14.967004 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1805/3654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:14 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:15.986833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:15.989091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:16.007688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:16.009265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:16.010370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:16.013401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:16.013924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:16.014805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:16.253728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:16.263681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3160a4d-5946-4d8d-9473-aee72480e115 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.287869 Sep 13 16:45:16.265147 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1850/3655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:15 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:16.666544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c39ef24e-1af7-4686-b176-07e75f7a5dbe req-909e0b71-5338-42da-a98b-b689fc8bbb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d020772-acd1-4064-a5f0-31d1d1361165", "name": "network-vif-plugged", "status": "completed", "tag": "eb6e69d4-d150-490c-abdf-ab269b0386c5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:16.699288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c39ef24e-1af7-4686-b176-07e75f7a5dbe req-909e0b71-5338-42da-a98b-b689fc8bbb5c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:16.702469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c39ef24e-1af7-4686-b176-07e75f7a5dbe req-909e0b71-5338-42da-a98b-b689fc8bbb5c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:16.704109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c39ef24e-1af7-4686-b176-07e75f7a5dbe req-909e0b71-5338-42da-a98b-b689fc8bbb5c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:16.742756 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c39ef24e-1af7-4686-b176-07e75f7a5dbe req-909e0b71-5338-42da-a98b-b689fc8bbb5c service nova] Creating event network-vif-plugged:eb6e69d4-d150-490c-abdf-ab269b0386c5 for instance 1d020772-acd1-4064-a5f0-31d1d1361165 on n-h1-857467-1 Sep 13 16:45:16.757462 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c39ef24e-1af7-4686-b176-07e75f7a5dbe req-909e0b71-5338-42da-a98b-b689fc8bbb5c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095190 Sep 13 16:45:16.764628 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1806/3656] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:17.294620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:17.295372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:17.306123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:17.306795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:17.307334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:17.308417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:17.310712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:17.311195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:17.603672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:17.617396 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-979cdfed-55aa-4bc9-b354-ba8558fb081f tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.328912 Sep 13 16:45:17.618779 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1851/3657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:17 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:18.120783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:18.121639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:18.130156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.131220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.132128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.132974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.133533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.134102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.203407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:18.338833 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-104ea49c-0eab-46c2-becf-8a76996aa15d tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 204 len: 0 microversion: 2.1 time: 0.221861 Sep 13 16:45:18.340551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1807/3658] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:18 2022] DELETE /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:45:18.351222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:18.351859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:18.360022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.361300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.361766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.362512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.362979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.363555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.586947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:18.600234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-971b17b7-336b-49a1-ae45-f11509d6dbc6 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1682 microversion: 2.1 time: 0.255166 Sep 13 16:45:18.600848 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1852/3659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:18 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:18.644833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:18.646364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:18.657892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.658628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.659257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.660753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:18.662093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:18.663009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:18.881615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:18.894827 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-290964ad-b6c8-488f-ab39-8b024a6a6e45 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.255702 Sep 13 16:45:18.901611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1808/3660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:18 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:19.259587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03a48e11-ff94-4a39-bbc7-ceca61fb770d tempest-TenantUsagesNegativeTestJSON-1500024710 tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-12T16%3A45%3A19.105039&end=2022-09-14T16%3A45%3A19.105039" status: 404 len: 112 microversion: - time: 0.150762 Sep 13 16:45:19.264884 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1853/3661] 10.222.0.61 () {58 vars in 1316 bytes} [Tue Sep 13 16:45:19 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-12T16%3A45%3A19.105039&end=2022-09-14T16%3A45%3A19.105039 => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 16:45:19.269611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6906d66a-0f38-4691-b505-22ec7bdd9650 tempest-TenantUsagesNegativeTestJSON-1500024710 tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin] Calling method '.version_select at 0x7fbeb9723dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:19.275692 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-6906d66a-0f38-4691-b505-22ec7bdd9650 tempest-TenantUsagesNegativeTestJSON-1500024710 tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6906d66a-0f38-4691-b505-22ec7bdd9650 tempest-TenantUsagesNegativeTestJSON-1500024710 tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin] Request method failure captured: Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-simple-tenant-usage/1211a2ec32a9469ab7c1dd94da0b17cb?start=2022-09-14T16%3A45%3A19.105039&end=2022-09-12T16%3A45%3A19.105039 HTTP/1.1 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILOfjzvJSdbrhTVTuYJDugB6t-yPTqQhZwrq0i3XmGnWI4BVmf81pj4XIjga3j0ynjX_Lft4Df6Iwfef6cynZWCO_wVvS7CjTUzxB-K52cjpGuoThOgvH4E6LnenyiytfuwZ0XU0Z88RLC4hmVy8JKAY0dXRBa8etTLJ4KXhlCffEgI Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e80e66348dfa42babf76dd77c5d300cd Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1500024710 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e80e66348dfa42babf76dd77c5d300cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e80e66348dfa42babf76dd77c5d300cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e80e66348dfa42babf76dd77c5d300cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e80e66348dfa42babf76dd77c5d300cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1500024710 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e80e66348dfa42babf76dd77c5d300cd Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1500024710 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 75ee649b8cc7452ca7180e99d816b556 Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid start time. The start time cannot occur after the end time. Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1211a2ec32a9469ab7c1dd94da0b17cb'} Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 13 16:45:19.279825 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:19.284538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6906d66a-0f38-4691-b505-22ec7bdd9650 tempest-TenantUsagesNegativeTestJSON-1500024710 tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:19.284538 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6906d66a-0f38-4691-b505-22ec7bdd9650 tempest-TenantUsagesNegativeTestJSON-1500024710 tempest-TenantUsagesNegativeTestJSON-1500024710-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/1211a2ec32a9469ab7c1dd94da0b17cb?start=2022-09-14T16%3A45%3A19.105039&end=2022-09-12T16%3A45%3A19.105039" status: 400 len: 111 microversion: 2.1 time: 0.015552 Sep 13 16:45:19.284538 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1809/3662] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Sep 13 16:45:19 2022] GET /compute/v2.1/os-simple-tenant-usage/1211a2ec32a9469ab7c1dd94da0b17cb?start=2022-09-14T16%3A45%3A19.105039&end=2022-09-12T16%3A45%3A19.105039 => generated 111 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:19.583911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ca189ee-0223-478c-aac0-2dc2f1911838 tempest-TenantUsagesNegativeTestJSON-807591292 tempest-TenantUsagesNegativeTestJSON-807591292-project] Calling method '.version_select at 0x7fbeb4774160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:19.587385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ca189ee-0223-478c-aac0-2dc2f1911838 tempest-TenantUsagesNegativeTestJSON-807591292 tempest-TenantUsagesNegativeTestJSON-807591292-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd932a1477725468b91fe2c9c7d4dc32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1211a2ec32a9469ab7c1dd94da0b17cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ca189ee-0223-478c-aac0-2dc2f1911838 tempest-TenantUsagesNegativeTestJSON-807591292 tempest-TenantUsagesNegativeTestJSON-807591292-project] Request method failure captured: Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-12T16%3A45%3A19.105039&end=2022-09-14T16%3A45%3A19.105039&detailed=1 HTTP/1.1 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILOdj2vfclU6_FTquzmGOOLRL-AMalPMa50JKJfttk4YJ8w9wZ91hNLo4OKEz91gOZy0nIqOxDa09FHRDgPq8KsYDlCuSSy6sL6EUMeEdAp0-yVfhaAEEo6P9ysqbXacIelbR0uMt7s7Sj74xYXVY6If62jCvCJ2dLWoP5WO_OBqio0 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 1211a2ec32a9469ab7c1dd94da0b17cb Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-807591292 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1211a2ec32a9469ab7c1dd94da0b17cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1211a2ec32a9469ab7c1dd94da0b17cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1211a2ec32a9469ab7c1dd94da0b17cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1211a2ec32a9469ab7c1dd94da0b17cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-807591292 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 1211a2ec32a9469ab7c1dd94da0b17cb Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-807591292 Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TenantUsagesNegativeTestJSON-807591292-project Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d932a1477725468b91fe2c9c7d4dc32e Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-807591292-project Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: action_args: {} Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 13 16:45:19.589301 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ca189ee-0223-478c-aac0-2dc2f1911838 tempest-TenantUsagesNegativeTestJSON-807591292 tempest-TenantUsagesNegativeTestJSON-807591292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ca189ee-0223-478c-aac0-2dc2f1911838 tempest-TenantUsagesNegativeTestJSON-807591292 tempest-TenantUsagesNegativeTestJSON-807591292-project] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-12T16%3A45%3A19.105039&end=2022-09-14T16%3A45%3A19.105039&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.301824 Sep 13 16:45:19.593587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1854/3663] 10.222.0.61 () {58 vars in 1335 bytes} [Tue Sep 13 16:45:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-12T16%3A45%3A19.105039&end=2022-09-14T16%3A45%3A19.105039&detailed=1 => generated 123 bytes in 303 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:19.627543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:19.628200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:19.640012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:19.641035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:19.641511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:19.642537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:19.643332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:19.643784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:19.680224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:19.921389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:19.922840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:19.925061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:19.935111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:19.936540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-681551af-4451-4300-a240-5e080a994692 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1682 microversion: 2.1 time: 0.315961 Sep 13 16:45:19.937077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:19.938049 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1810/3664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:19 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1682 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:19.938448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:19.939539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:19.940373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:19.941073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:20.184614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:20.189115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:20.204189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dbba5476-a40b-412c-81ac-352709bf3f22 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.285138 Sep 13 16:45:20.206705 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1855/3665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:19 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:20.971921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:20.973142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:20.981093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:20.981856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:20.982490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:20.983380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:20.983989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:20.984590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:21.231328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:21.231986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:21.244227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:21.246352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:21.247092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:21.247966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:21.248440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:21.249018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:21.351549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:21.397669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d2a6f42e-9eda-4da0-b828-50cf94902b1b tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1682 microversion: 2.1 time: 0.429622 Sep 13 16:45:21.418063 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1811/3666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:20 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1682 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:21.589811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:21.601799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6eb719ec-ab6b-4c50-b03a-06493a89e990 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.374837 Sep 13 16:45:21.602541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1856/3667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:21 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:22.155898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-96202c0e-14ac-4d0f-8bcd-541280f05953 req-167c5a40-753a-468a-a1b2-e5de5cd0352f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d178d82-e4fa-4f21-a587-26c3e9c7d2bb", "name": "network-vif-deleted", "tag": "57452ffb-c696-4d7a-a9a3-9714e404adb4"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:22.188484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-96202c0e-14ac-4d0f-8bcd-541280f05953 req-167c5a40-753a-468a-a1b2-e5de5cd0352f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.188955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-96202c0e-14ac-4d0f-8bcd-541280f05953 req-167c5a40-753a-468a-a1b2-e5de5cd0352f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.201284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-96202c0e-14ac-4d0f-8bcd-541280f05953 req-167c5a40-753a-468a-a1b2-e5de5cd0352f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:22.263068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-96202c0e-14ac-4d0f-8bcd-541280f05953 req-167c5a40-753a-468a-a1b2-e5de5cd0352f service nova] Creating event network-vif-deleted:57452ffb-c696-4d7a-a9a3-9714e404adb4 for instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb on n-h2-857467-1 Sep 13 16:45:22.286576 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-96202c0e-14ac-4d0f-8bcd-541280f05953 req-167c5a40-753a-468a-a1b2-e5de5cd0352f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133725 Sep 13 16:45:22.288406 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1812/3668] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:22.428291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:22.430253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:22.450934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.451437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.458225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:22.459421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.467112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.467714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:22.556418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.556418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.556418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:22.557034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lazy-loading 'fault' on Instance uuid 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:22.623493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7f63198c-e272-4f09-8888-461752c841b7 req-a2f58e03-2b30-49ef-baef-d8d05521f360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5e4482-b5e4-4b7c-816d-0407466ed25c", "name": "network-vif-plugged", "status": "completed", "tag": "9f934bfc-0d95-47ca-ab67-f0e48d458542"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:22.653132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7f63198c-e272-4f09-8888-461752c841b7 req-a2f58e03-2b30-49ef-baef-d8d05521f360 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.654557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7f63198c-e272-4f09-8888-461752c841b7 req-a2f58e03-2b30-49ef-baef-d8d05521f360 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.658678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7f63198c-e272-4f09-8888-461752c841b7 req-a2f58e03-2b30-49ef-baef-d8d05521f360 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:22.694997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7f63198c-e272-4f09-8888-461752c841b7 req-a2f58e03-2b30-49ef-baef-d8d05521f360 service nova] Creating event network-vif-plugged:9f934bfc-0d95-47ca-ab67-f0e48d458542 for instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c on n-h2-857467-1 Sep 13 16:45:22.711740 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7f63198c-e272-4f09-8888-461752c841b7 req-a2f58e03-2b30-49ef-baef-d8d05521f360 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093097 Sep 13 16:45:22.712773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1813/3669] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:22.732119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:22.733012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:22.751132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.752297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.753660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:22.756218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:22.759587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:22.760250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:23.206159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b7e0d5309849ab8a8ff78447780461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f324180b2c4db6b10898b623098bec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:23.218299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-95f0f16f-de19-498e-bd95-ccfaa07f5d4f tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 200 len: 1331 microversion: 2.1 time: 0.794555 Sep 13 16:45:23.234905 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1857/3670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:22 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 1331 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:23.313618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:23.353701 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0928839-d57b-4797-b516-deaa2faf8ef2 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.631773 Sep 13 16:45:23.354560 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1814/3671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:22 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:24.246294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:24.246961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] [instance: 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:24.276363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:24.277156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:24.278016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:24.279113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:24.279972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:24.280627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:24.314843 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] HTTP exception thrown: Instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb could not be found. Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Request method failure captured: Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb HTTP/1.1 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILLiDSXT-M0QZofATPqd3NZUXVcLEbVGnbKpU8KnNNMfhKbmhI54qtgbecSoR9AcrNcZFjEQcphKeFWJIAjsIELZRZVnN_f5rIP5Recg5xVJB188kD44zGQoyuKUl56T1-g8mrZAv8v7_H5kvbdj7TxlefPabaf-BS1ct2WRcRY5rhs Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 50f324180b2c4db6b10898b623098bec Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesAdminNegativeTest-865623108 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/50f324180b2c4db6b10898b623098bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_50f324180b2c4db6b10898b623098bec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/50f324180b2c4db6b10898b623098bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/50f324180b2c4db6b10898b623098bec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesAdminNegativeTest-865623108 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 50f324180b2c4db6b10898b623098bec Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-865623108 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesAdminNegativeTest-865623108-project Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d9b7e0d5309849ab8a8ff78447780461 Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesAdminNegativeTest-865623108-project Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb could not be found. Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9d178d82-e4fa-4f21-a587-26c3e9c7d2bb'} Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb could not be found. Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb could not be found. Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:24.318155 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb could not be found. Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Returning 404 to user: Instance 9d178d82-e4fa-4f21-a587-26c3e9c7d2bb could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:24.325628 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1c9c77c0-bcc9-4f64-a66f-9bf781c4a4bf tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb" status: 404 len: 111 microversion: 2.1 time: 0.079388 Sep 13 16:45:24.329085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-265cae83-70ec-4f23-ba2a-6934267a27e7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] Calling method '.version_select at 0x7fbeb56b2280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:24.333908 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1858/3672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:24 2022] GET /compute/v2.1/servers/9d178d82-e4fa-4f21-a587-26c3e9c7d2bb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:24.363408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-265cae83-70ec-4f23-ba2a-6934267a27e7 tempest-VolumesAdminNegativeTest-865623108 tempest-VolumesAdminNegativeTest-865623108-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-733134686" status: 202 len: 0 microversion: 2.1 time: 0.038418 Sep 13 16:45:24.367783 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1815/3673] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-733134686 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:45:24.378671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:24.379399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:24.389960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:24.390472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:24.390915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:24.393482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:24.394006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:24.394454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:24.778378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9fb24dc3-4cc0-484f-ba55-d9fb3daa76f1 req-d756e516-3284-45d4-9a7f-f71b84bf256d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1caecc-7f4b-4aa7-8800-eb92f808e753", "name": "network-vif-plugged", "status": "completed", "tag": "6472330e-5a15-4249-9230-14e63f8ba470"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:24.802317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9fb24dc3-4cc0-484f-ba55-d9fb3daa76f1 req-d756e516-3284-45d4-9a7f-f71b84bf256d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:24.802916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9fb24dc3-4cc0-484f-ba55-d9fb3daa76f1 req-d756e516-3284-45d4-9a7f-f71b84bf256d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:24.803374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9fb24dc3-4cc0-484f-ba55-d9fb3daa76f1 req-d756e516-3284-45d4-9a7f-f71b84bf256d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:24.852637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9fb24dc3-4cc0-484f-ba55-d9fb3daa76f1 req-d756e516-3284-45d4-9a7f-f71b84bf256d service nova] Creating event network-vif-plugged:6472330e-5a15-4249-9230-14e63f8ba470 for instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 on n-h1-857467-1 Sep 13 16:45:24.873259 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9fb24dc3-4cc0-484f-ba55-d9fb3daa76f1 req-d756e516-3284-45d4-9a7f-f71b84bf256d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097149 Sep 13 16:45:24.873948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1816/3674] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:25.180818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:25.194141 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5d584c78-7a02-4a9d-a8e3-99cf764dba2c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.819875 Sep 13 16:45:25.195333 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1859/3675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:24 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:26.221757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:26.224499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:26.236705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:26.237553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:26.239607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:26.241173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:26.241945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:26.242675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:26.535377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:26.545807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe926f6e-c431-41fa-8925-52b5394665fb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1322 microversion: 2.1 time: 0.330340 Sep 13 16:45:26.550912 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1817/3676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:26 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:27.492120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0acee6ed-235c-4087-a663-8f7e56c17c12 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Action: 'create', calling method: .version_select at 0x7fbeb4715160>, body: {"keypair": {"name": "tempest-keypair-349807728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9TVF6sKV5B0DeY3wiXiI2ikCLXXxllvx6q2VJby6ob8px4n7vrOv2Wf8XpGvo7fFPivL4O8cU+6krpmvARlHTz7wfpgV0oTuAzqZvRXPvw83MI8qIqqoyZke7LGk46pQ=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:27.528883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0acee6ed-235c-4087-a663-8f7e56c17c12 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Getting quotas for project f63e62adef134ca181d1d5c4c5b09880. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:45:27.544574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0acee6ed-235c-4087-a663-8f7e56c17c12 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Getting quotas for user 31fc33e81e6d4f52875b369833ff7b5b and project f63e62adef134ca181d1d5c4c5b09880. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:45:27.573951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:27.574757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:27.587000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:27.595309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:27.595953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:27.596281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0acee6ed-235c-4087-a663-8f7e56c17c12 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.366325 Sep 13 16:45:27.596715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:27.597196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:27.597427 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1860/3677] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:45:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:27.597634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:28.028984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:28.039218 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-880d2419-0e74-4c0b-8554-53967f5397fd tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 200 len: 1515 microversion: 2.1 time: 0.470169 Sep 13 16:45:28.042575 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1818/3678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:27 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:28.071990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:28.072220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:28.091591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:28.094671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:28.095311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:28.096974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:28.099230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:28.103464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:28.676542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:28.689818 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57289ecc-2ef4-4097-bb3d-0fbd161b5502 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 200 len: 1514 microversion: 2.1 time: 0.627655 Sep 13 16:45:28.696498 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1861/3679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:28 2022] GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 1514 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:28.716052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:28.716599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:28.728214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:28.728214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:28.730254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:28.733162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:28.736034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:28.736714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:29.107207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:29.116281 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33208267-8673-4fa4-81db-e6b231de0773 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 200 len: 1514 microversion: 2.1 time: 0.404686 Sep 13 16:45:29.116888 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1819/3680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:28 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:29.148747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:29.149344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:29.175289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:29.175826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:29.178320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:29.179150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:29.182785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:29.183317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:29.285213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:29.476332 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9dc9e21b-5674-4486-b0bd-fa770e5c7923 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 204 len: 0 microversion: 2.1 time: 0.334538 Sep 13 16:45:29.476977 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1862/3681] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:29 2022] DELETE /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:45:29.485331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:29.489627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:29.505696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:29.515942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:29.517576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:29.519879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:29.523376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:29.524194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:29.925203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:29.942817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55298a2c-0358-484b-a2e4-d452ca425f8d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 200 len: 1520 microversion: 2.1 time: 0.460647 Sep 13 16:45:29.945553 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1820/3682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:29 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:30.971702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:30.973666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:30.991767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:30.998861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:30.999715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:31.004716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:31.005481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:31.008262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:31.817916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:31.832529 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c24dec12-9844-49be-b6c6-1e151513cd9b tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 200 len: 1520 microversion: 2.1 time: 0.865653 Sep 13 16:45:31.850108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1863/3683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:30 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 1520 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:32.858306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:32.859590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:32.873942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:32.875127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:32.878576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:32.880562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:32.881297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:32.883757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:33.466242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:33.483381 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4440ca64-6057-4aee-a7de-ede9cf310a30 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 200 len: 1520 microversion: 2.1 time: 0.629887 Sep 13 16:45:33.507653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1821/3684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:32 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:33.869538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f3f16e-09ca-4112-881e-1c7deef50bd8"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:33.872043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:33.883921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:33.884777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:33.887268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:33.889694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:33.890436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:33.891297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:33.961386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6d6ff5ba-da12-4e4e-8dfd-3cbc5b532170 req-1490b6eb-2eee-48c0-85ce-f65939abd10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d020772-acd1-4064-a5f0-31d1d1361165", "name": "network-vif-deleted", "tag": "eb6e69d4-d150-490c-abdf-ab269b0386c5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:33.977863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:33.992810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6d6ff5ba-da12-4e4e-8dfd-3cbc5b532170 req-1490b6eb-2eee-48c0-85ce-f65939abd10e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:33.994090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6d6ff5ba-da12-4e4e-8dfd-3cbc5b532170 req-1490b6eb-2eee-48c0-85ce-f65939abd10e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:34.005358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6d6ff5ba-da12-4e4e-8dfd-3cbc5b532170 req-1490b6eb-2eee-48c0-85ce-f65939abd10e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:34.032367 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6d6ff5ba-da12-4e4e-8dfd-3cbc5b532170 req-1490b6eb-2eee-48c0-85ce-f65939abd10e service nova] Creating event network-vif-deleted:eb6e69d4-d150-490c-abdf-ab269b0386c5 for instance 1d020772-acd1-4064-a5f0-31d1d1361165 on n-h1-857467-1 Sep 13 16:45:34.043518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6d6ff5ba-da12-4e4e-8dfd-3cbc5b532170 req-1490b6eb-2eee-48c0-85ce-f65939abd10e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086253 Sep 13 16:45:34.048817 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1822/3685] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:34.400322 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6bea521-bbe2-410a-b312-9e6fc2c8a368 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "POST /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538857 Sep 13 16:45:34.401643 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1864/3686] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:45:33 2022] POST /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:34.513682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:34.514571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:34.545778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:34.547185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:34.547752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:34.548694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:34.549274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:34.552380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:34.648569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:34.648569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:34.648569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:34.648569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lazy-loading 'fault' on Instance uuid 1d020772-acd1-4064-a5f0-31d1d1361165 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:34.827514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:34.838160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ba46f260-2901-435b-8355-862f95a72194 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 200 len: 1312 microversion: 2.1 time: 0.330381 Sep 13 16:45:34.846981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1823/3687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:34 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 1312 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:34.884337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-972845711", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8a44112d-9562-45ae-bee1-afa6541aa4f5"}], "security_groups": [{"name": "tempest-securitygroup--1332185259"}], "key_name": "tempest-keypair-349807728", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:35.381916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] validate_networks() for [('8a44112d-9562-45ae-bee1-afa6541aa4f5', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:45:35.878839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:35.880952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:35.906283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:35.906803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:35.907261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:35.908016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:35.908496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:35.908951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:35.939555 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] HTTP exception thrown: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 HTTP/1.1 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1d020772-acd1-4064-a5f0-31d1d1361165'} Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:35.941572 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:35.947682 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:35.960859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 404 to user: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:35.962085 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ecc97658-ff93-4b69-bd92-b4d5be4b7765 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 404 len: 111 microversion: 2.1 time: 0.087266 Sep 13 16:45:35.986330 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1824/3688] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:35 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:35.995797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.013431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:36.014833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:36.026728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.027149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.027600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.028342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.028809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.029244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.177616 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-81d14ed8-8cc6-48f7-bed6-d942542812e7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.189733 Sep 13 16:45:36.178281 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1825/3689] 10.222.0.61 () {58 vars in 1230 bytes} [Tue Sep 13 16:45:35 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:36.191074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35b2b41c-a67a-404c-8b37-cac7e236b282 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35b2b41c-a67a-404c-8b37-cac7e236b282 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: action_args: {} Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 13 16:45:36.202810 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35b2b41c-a67a-404c-8b37-cac7e236b282 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35b2b41c-a67a-404c-8b37-cac7e236b282 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017352 Sep 13 16:45:36.214243 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1826/3690] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:36.216696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.222580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:36.223587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:36.231642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.232446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.233104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.234217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.234903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.235552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.267100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:45:36.307884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e0db962-a2e1-4d4d-b52d-6616acf6a203 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.097135 Sep 13 16:45:36.309177 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1827/3691] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers => generated 681 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:36.322012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.329112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:36.330019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.servers [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Removing options 'limit' from query {{(pid=122327) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 13 16:45:36.331315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:36.337523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.338383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.339063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.340050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.340747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.341740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.379463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:45:36.421211 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3584a7d-7a2c-43fa-8644-da79622e81d7 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.103842 Sep 13 16:45:36.431784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1828/3692] 10.222.0.61 () {58 vars in 1144 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:36.439783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a89e05b2-244d-4b6f-844d-d3392ae64552 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a89e05b2-244d-4b6f-844d-d3392ae64552 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: action_args: {} Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '-1' Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 13 16:45:36.450897 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 13 16:45:36.455642 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.459426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a89e05b2-244d-4b6f-844d-d3392ae64552 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:36.460577 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a89e05b2-244d-4b6f-844d-d3392ae64552 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024755 Sep 13 16:45:36.468821 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1829/3693] 10.222.0.61 () {58 vars in 1142 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:36.475445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-946eb1ce-4712-4e2e-a94e-6d229475ef93 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-946eb1ce-4712-4e2e-a94e-6d229475ef93 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: action_args: {} Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'testing' Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 13 16:45:36.480435 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 13 16:45:36.485805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:45:36.488472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-946eb1ce-4712-4e2e-a94e-6d229475ef93 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:36.490433 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-946eb1ce-4712-4e2e-a94e-6d229475ef93 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020265 Sep 13 16:45:36.496073 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1830/3694] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:45:36.512131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b126c546-c486-4ac1-bce3-e6b7d1ecf3cb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.529408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b126c546-c486-4ac1-bce3-e6b7d1ecf3cb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:36.530954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b126c546-c486-4ac1-bce3-e6b7d1ecf3cb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:36.539560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.servers [None req-b126c546-c486-4ac1-bce3-e6b7d1ecf3cb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Flavor 'non_existing_flavor' could not be found {{(pid=122327) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 13 16:45:36.540845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b126c546-c486-4ac1-bce3-e6b7d1ecf3cb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.034115 Sep 13 16:45:36.541803 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1831/3695] 10.222.0.61 () {58 vars in 1178 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:36.555636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.560970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:36.561722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:36.573601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.574235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.575924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.576906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.578106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.578742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.763064 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa83ff87-3694-41ab-8548-cf375e8e67ec tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.209965 Sep 13 16:45:36.764288 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1832/3696] 10.222.0.61 () {58 vars in 1174 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:45:36.802952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:36.809073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:36.809740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:36.821043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.821405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.821906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.822739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:36.834240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:36.834990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:36.968636 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2fa31eca-66a1-49fb-8056-794bd19396bb tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.193063 Sep 13 16:45:36.979467 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1833/3697] 10.222.0.61 () {58 vars in 1184 bytes} [Tue Sep 13 16:45:36 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:37.217463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Getting quotas for project f63e62adef134ca181d1d5c4c5b09880. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:45:37.231817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Getting quotas for user 31fc33e81e6d4f52875b369833ff7b5b and project f63e62adef134ca181d1d5c4c5b09880. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:45:37.263948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:45:37.264388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:45:37.264873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:45:37.265490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:45:37.266107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:45:37.277777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.286797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.287274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.288120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.288607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.289045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.315573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:37.316305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:37.328685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.329510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.330471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.331235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.332085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.332219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.333162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Getting quotas for project f63e62adef134ca181d1d5c4c5b09880. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:45:37.339643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Getting quotas for user 31fc33e81e6d4f52875b369833ff7b5b and project f63e62adef134ca181d1d5c4c5b09880. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:45:37.365446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:37.369755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:45:37.372560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:45:37.463814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:37.482934 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a727d0e7-2e92-4c4d-95c7-2ae04e298231 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.613114 Sep 13 16:45:37.483943 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1865/3698] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:45:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 2615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:45:37.493287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:37.506030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:37.507017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:37.544849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.546092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.552144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.553267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.554396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.556587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.571503 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79f71b05-7bb6-4896-87d6-3c22f760a37f tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 204 len: 0 microversion: 2.32 time: 0.590188 Sep 13 16:45:37.575566 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1834/3699] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:45:36 2022] DELETE /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:45:37.592470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f39d6c8c-5a5b-4b9c-907d-1241cbe73df1 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:37.593250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f39d6c8c-5a5b-4b9c-907d-1241cbe73df1 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:37.627588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:45:37.716045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:37.733028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.733750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.734393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.759002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f39d6c8c-5a5b-4b9c-907d-1241cbe73df1 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:37.767078 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f39d6c8c-5a5b-4b9c-907d-1241cbe73df1 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1276 microversion: 2.1 time: 0.190218 Sep 13 16:45:37.769346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1835/3700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:37 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:37.787209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:37.787915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:37.799256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.802756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.803338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:37.806380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:37.806879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:37.807329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.607881 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c41839cd-d9e5-40fb-a771-ddd8fba2cfac tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 1.122628 Sep 13 16:45:38.618727 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1866/3701] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:45:37 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:38.643061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bcb9de35-60ba-47f8-aadb-8fd165640905 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:38.649045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bcb9de35-60ba-47f8-aadb-8fd165640905 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:38.669690 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bcb9de35-60ba-47f8-aadb-8fd165640905 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011944 Sep 13 16:45:38.670361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1867/3702] 10.222.0.61 () {58 vars in 1178 bytes} [Tue Sep 13 16:45:38 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:38.683739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:38.684445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:38.689430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:38.704978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Searching by: {'deleted': False, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:45:38.709571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:38.713454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:38.717351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:38.717883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:38.718338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.719082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:38.719552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:38.719979 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af1f2204-6a07-4fb0-9cc8-53c18f26b426 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2957 microversion: 2.32 time: 0.946544 Sep 13 16:45:38.720112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.734346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1836/3703] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:37 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2957 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:38.793926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:38.794956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:38.807566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:38.809661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:38.810455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.811410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:38.814432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:38.815126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.823725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:45:38.884585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7378dbc5-8322-4748-a3e2-72f00189bcc3 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.203768 Sep 13 16:45:38.885195 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1868/3704] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:45:38 2022] GET /compute/v2.1/servers => generated 681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:38.898706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:38.899213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:38.931796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:38.932508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:38.933141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.934064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:38.934682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:38.935264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:38.973682 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] HTTP exception thrown: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 HTTP/1.1 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1d020772-acd1-4064-a5f0-31d1d1361165'} Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:38.975723 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 404 to user: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:38.980170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-704b9fb3-f3fa-45ca-a588-765ebd6da4f4 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 404 len: 111 microversion: 2.1 time: 0.082970 Sep 13 16:45:38.990312 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1869/3705] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:38 2022] DELETE /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:38.995332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:38.995843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:39.003798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:39.010057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.010568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.011013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.011738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.012198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.012631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.090532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:39.099615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:39.117613 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be02e176-e9b7-4205-b7f6-ec3c7036e8a7 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1272 microversion: 2.1 time: 0.328066 Sep 13 16:45:39.118776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1837/3706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:38 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:39.198576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:39.288076 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62d10104-4bce-40f1-bb75-9b064b97214d tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 204 len: 0 microversion: 2.1 time: 0.293901 Sep 13 16:45:39.295645 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1870/3707] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:38 2022] DELETE /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:45:39.298219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:39.298922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:39.307564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.313302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.313971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.314905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.315561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.316168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.345761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:39.471325 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-22db6c62-224f-4497-8eb8-bf2df687380c tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 204 len: 0 microversion: 2.1 time: 0.176564 Sep 13 16:45:39.472406 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1838/3708] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:39 2022] DELETE /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:45:39.485660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:39.486094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 1d020772-acd1-4064-a5f0-31d1d1361165] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:39.501504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.502347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.503363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.505140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.506325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.507016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.528042 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] HTTP exception thrown: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 HTTP/1.1 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1d020772-acd1-4064-a5f0-31d1d1361165'} Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:39.531393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. Sep 13 16:45:39.535442 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:39.540784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 404 to user: Instance 1d020772-acd1-4064-a5f0-31d1d1361165 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:39.541979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf34b6bd-d1a9-4a30-9237-1ff37480238a tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165" status: 404 len: 111 microversion: 2.1 time: 0.063097 Sep 13 16:45:39.543083 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1871/3709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:39 2022] GET /compute/v2.1/servers/1d020772-acd1-4064-a5f0-31d1d1361165 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:39.553024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:39.554177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:39.569044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.569559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.570041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.583448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.584515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.585159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.754493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:39.755741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:39.768156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.776491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.777237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:39.778750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:39.780516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:39.781149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:40.114401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:40.128128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a0567a4-db35-491b-aab6-64aff6f21432 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 200 len: 1520 microversion: 2.1 time: 0.580492 Sep 13 16:45:40.132190 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1839/3710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:39 2022] GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:40.145084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:40.146159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:40.158067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:40.159280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:40.159650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:40.160522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:40.163621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:40.164099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:40.168524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:40.181340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:40.198083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:40.199423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9e0ccfb-f644-4445-be48-3c412fb55522 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2957 microversion: 2.32 time: 0.452058 Sep 13 16:45:40.202187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1872/3711] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:39 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2957 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:40.345483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:40.354649 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb9caa93-2218-4a68-933c-9195a4b87544 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1328 microversion: 2.1 time: 0.213969 Sep 13 16:45:40.359042 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1840/3712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:40 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1328 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:41.158162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:41.158957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:41.174657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:41.181919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:41.183012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:41.186922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:41.187468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:41.187920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:41.230938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:41.231556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:41.245409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:41.246009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:41.246853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:41.247175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:41.247643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:41.248083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:41.675968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:41.688426 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d83a0724-e938-4523-b71b-43adb74c1fad tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 200 len: 1520 microversion: 2.1 time: 0.535588 Sep 13 16:45:41.689028 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1873/3713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:41 2022] GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:41.699902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:41.702728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:41.718452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:41.719075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:41.719533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:41.720319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:41.721501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:41.722895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:41.851044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:41.860905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-24d2a65d-1f86-4fa0-a6e9-58eb3c30ab64 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1334 microversion: 2.1 time: 0.170808 Sep 13 16:45:41.861515 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1874/3714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:41 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:42.167882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:42.190156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:42.194237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:42.197763 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c17787f8-a0d1-4350-814d-f8954ebc6f60 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2957 microversion: 2.32 time: 0.970051 Sep 13 16:45:42.199016 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1841/3715] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:41 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2957 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:45:42.712627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:42.713254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:42.726904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:42.727410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:42.727856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:42.730098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:42.730616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:42.731473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:42.884649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:42.885292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:42.905457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:42.906358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:42.906960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:42.908437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:42.910375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:42.911912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:43.547981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:43.560119 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-889090ec-94d7-4b5a-937a-47baef145f51 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 200 len: 1520 microversion: 2.1 time: 0.852185 Sep 13 16:45:43.581368 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1875/3716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:42 2022] GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 1520 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:43.590599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:43.594541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:43.616519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:43.617454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:43.618102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:43.619108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:43.622578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:43.623272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:43.713440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:43.735817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ca43d2c-920b-4e8e-a2d9-acc34c18d9af tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1334 microversion: 2.1 time: 0.855990 Sep 13 16:45:43.736445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1842/3717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:42 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1334 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:44.320799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-25006489-9447-4e2a-a1ae-181ba2ffd741 req-27d3e500-9b23-4ad7-91db-2eaa88e78e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5e4482-b5e4-4b7c-816d-0407466ed25c", "name": "network-vif-deleted", "tag": "9f934bfc-0d95-47ca-ab67-f0e48d458542"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:44.343113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-25006489-9447-4e2a-a1ae-181ba2ffd741 req-27d3e500-9b23-4ad7-91db-2eaa88e78e15 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.343609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-25006489-9447-4e2a-a1ae-181ba2ffd741 req-27d3e500-9b23-4ad7-91db-2eaa88e78e15 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.346036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-25006489-9447-4e2a-a1ae-181ba2ffd741 req-27d3e500-9b23-4ad7-91db-2eaa88e78e15 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.375795 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-25006489-9447-4e2a-a1ae-181ba2ffd741 req-27d3e500-9b23-4ad7-91db-2eaa88e78e15 service nova] Creating event network-vif-deleted:9f934bfc-0d95-47ca-ab67-f0e48d458542 for instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c on n-h2-857467-1 Sep 13 16:45:44.392227 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-25006489-9447-4e2a-a1ae-181ba2ffd741 req-27d3e500-9b23-4ad7-91db-2eaa88e78e15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075720 Sep 13 16:45:44.394099 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1843/3718] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:44.446235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-81e833ea-4209-40ef-85de-2fb19c4a64f1 req-bd2c9cf3-0576-4c67-b090-becbe69cfb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1caecc-7f4b-4aa7-8800-eb92f808e753", "name": "network-vif-deleted", "tag": "6472330e-5a15-4249-9230-14e63f8ba470"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:44.463154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81e833ea-4209-40ef-85de-2fb19c4a64f1 req-bd2c9cf3-0576-4c67-b090-becbe69cfb1c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.469046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81e833ea-4209-40ef-85de-2fb19c4a64f1 req-bd2c9cf3-0576-4c67-b090-becbe69cfb1c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.469652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81e833ea-4209-40ef-85de-2fb19c4a64f1 req-bd2c9cf3-0576-4c67-b090-becbe69cfb1c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.499634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-81e833ea-4209-40ef-85de-2fb19c4a64f1 req-bd2c9cf3-0576-4c67-b090-becbe69cfb1c service nova] Creating event network-vif-deleted:6472330e-5a15-4249-9230-14e63f8ba470 for instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 on n-h1-857467-1 Sep 13 16:45:44.513582 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-81e833ea-4209-40ef-85de-2fb19c4a64f1 req-bd2c9cf3-0576-4c67-b090-becbe69cfb1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072143 Sep 13 16:45:44.514899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1844/3719] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:44.548751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:44.565503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:44.568466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:44.573736 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5616f3f-453d-4481-a018-95fcf4b19fac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2957 microversion: 2.32 time: 0.990211 Sep 13 16:45:44.576464 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1876/3720] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:43 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2957 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:44.595895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:44.597264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:44.612265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.617562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.619863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.621038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.625361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.626174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.766894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:44.768320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:44.793867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.794373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.794874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.795533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.808957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.810676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.814875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:44.835655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:44.841591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:44.846656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lazy-loading 'fault' on Instance uuid 7e5e4482-b5e4-4b7c-816d-0407466ed25c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:45.019178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d59a70488047bda3a1a7bef628348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e36660ed7043cca297e45a4da60b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:45.030884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ba1b3732-3bac-4852-afe1-66151a452259 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 200 len: 1312 microversion: 2.1 time: 0.439399 Sep 13 16:45:45.031486 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1845/3721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:44 2022] GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 1312 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:45.188706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:45.203826 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5c31136-b866-44db-8213-4c51d4baee47 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1334 microversion: 2.1 time: 0.447377 Sep 13 16:45:45.226700 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1877/3722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:44 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1334 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:45.260625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-926748536", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "de36c228-169a-4e26-92cd-cb49c35f2833"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:45.392214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] validate_networks() for [('de36c228-169a-4e26-92cd-cb49c35f2833', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:45:45.575285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d19da175-c53f-472b-8f92-4146b6803374 req-c60e8044-d7aa-49cc-87e1-34fefaa78fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-unplugged", "status": "completed", "tag": "43111ac9-cc42-4b8e-b068-0c286448e068"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:45.603417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d19da175-c53f-472b-8f92-4146b6803374 req-c60e8044-d7aa-49cc-87e1-34fefaa78fa3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:45.604642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d19da175-c53f-472b-8f92-4146b6803374 req-c60e8044-d7aa-49cc-87e1-34fefaa78fa3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:45.606939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d19da175-c53f-472b-8f92-4146b6803374 req-c60e8044-d7aa-49cc-87e1-34fefaa78fa3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:45.642250 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d19da175-c53f-472b-8f92-4146b6803374 req-c60e8044-d7aa-49cc-87e1-34fefaa78fa3 service nova] Creating event network-vif-unplugged:43111ac9-cc42-4b8e-b068-0c286448e068 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:45.652610 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d19da175-c53f-472b-8f92-4146b6803374 req-c60e8044-d7aa-49cc-87e1-34fefaa78fa3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082347 Sep 13 16:45:45.658026 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1878/3723] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:45.673336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:45.674513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:45.684393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:45.685337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:45.686091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:45.687693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:45.688409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:45.689227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.332157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:46.362982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:46.371283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:46.372987 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7e90e9d-b339-4f3e-a6d9-38411d8bd1fe tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2957 microversion: 2.32 time: 0.713460 Sep 13 16:45:46.386177 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1879/3724] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:45 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2957 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:46.399739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.402622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 7e5e4482-b5e4-4b7c-816d-0407466ed25c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:46.418359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:46.418885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:46.419330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.420064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:46.422891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:46.423375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.456978 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] HTTP exception thrown: Instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c could not be found. Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c HTTP/1.1 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c could not be found. Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '7e5e4482-b5e4-4b7c-816d-0407466ed25c'} Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c could not be found. Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c could not be found. Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.460229 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c could not be found. Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.464398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 404 to user: Instance 7e5e4482-b5e4-4b7c-816d-0407466ed25c could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:46.465365 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59c46427-66d5-4c56-8e63-20c6d5d05379 tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c" status: 404 len: 111 microversion: 2.1 time: 0.081275 Sep 13 16:45:46.467665 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1880/3725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/servers/7e5e4482-b5e4-4b7c-816d-0407466ed25c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:46.479197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.482022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:46.493262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:46.494118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:46.495803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.496740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:46.497427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:46.498262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.800007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:46.856979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0c4866e5-c877-4428-b5f0-2a041a22246c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.387817 Sep 13 16:45:46.863669 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1881/3726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:46.882483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=10 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:46.887109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:46.888015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] [instance: 4f1caecc-7f4b-4aa7-8800-eb92f808e753] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:46.908200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:46.911203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:46.912092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.914382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:46.915243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:46.917141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:46.959446 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] HTTP exception thrown: Instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 could not be found. Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Request method failure captured: Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 HTTP/1.1 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILOM00mDUrIeqNCszk9-6NHwz-1VNEoDw4DdoyQwvWVhyrIsmFWFXvIithaA759FD8jO5YvI58IRZEyqQj3LMpXAKB3SqsTdwBrMHKsT0tB64R8psYVzp0VhTc2XACjoe0ynvhDdmYeOgrvz7YXHiyWaM_p_djTVFRJoWYk_abxwdYE Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8e36660ed7043cca297e45a4da60b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a8e36660ed7043cca297e45a4da60b8e Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1261312137 Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 80d59a70488047bda3a1a7bef628348e Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServersNegativeTestJSON-1261312137-project Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 could not be found. Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4f1caecc-7f4b-4aa7-8800-eb92f808e753'} Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 could not be found. Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 could not be found. Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.962097 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 could not be found. Sep 13 16:45:46.966363 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:45:46.968159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] Returning 404 to user: Instance 4f1caecc-7f4b-4aa7-8800-eb92f808e753 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:45:46.970257 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-200a2c11-a9fe-41b0-8b6e-57c987b9c5aa tempest-ListServersNegativeTestJSON-1261312137 tempest-ListServersNegativeTestJSON-1261312137-project] 10.222.0.61 "GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753" status: 404 len: 111 microversion: 2.1 time: 0.097864 Sep 13 16:45:46.972110 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1882/3727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:46 2022] GET /compute/v2.1/servers/4f1caecc-7f4b-4aa7-8800-eb92f808e753 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:45:47.406755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:47.407625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:47.427472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:47.427993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:47.428449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:47.429258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:47.429737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:47.430389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:47.715229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=16 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:47.767247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:47.814643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:45:47.816102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:45:47.816793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:45:47.817885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:45:47.818521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:45:47.834299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:47.836831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:47.837715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:47.840556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:47.842846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:47.845687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:47.898525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Getting quotas for project 67831491241246a5961d8b9c417662ed. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:45:47.913734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Getting quotas for user 20ecc8b135b34ef89a828f600a534e2c and project 67831491241246a5961d8b9c417662ed. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:45:47.953587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:45:47.963031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:45:48.078176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a592796-fb46-4087-86fe-01317dc37224 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.950546 Sep 13 16:45:48.089124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1846/3728] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:45:48.105678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-unplugged", "status": "completed", "tag": "6199766c-27f4-49fb-92e6-fc117ebbbc52"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7a4126e-90a5-4a5b-80a4-1cb57c0445d8"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-unplugged", "status": "completed", "tag": "3b88ed2f-d58e-4333-a77c-43db1fd0a0d2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:48.140950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:48.141436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:48.141889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:48.183858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Creating event network-vif-unplugged:6199766c-27f4-49fb-92e6-fc117ebbbc52 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:48.184374 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Creating event network-vif-unplugged:d7a4126e-90a5-4a5b-80a4-1cb57c0445d8 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:48.184879 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] Creating event network-vif-unplugged:3b88ed2f-d58e-4333-a77c-43db1fd0a0d2 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:48.191824 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d5f96201-eb6a-4c6d-ab20-2fcc91139685 req-1d97d30c-0fb8-4dc6-a93d-f6afcf466365 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.101368 Sep 13 16:45:48.193021 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1847/3729] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:48.201326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:48.205232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:48.205981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:48.211293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:48.212765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:48.214088 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4a3df8c-604b-4aa7-81fd-7aadcbe0ef71 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2936 microversion: 2.32 time: 0.811235 Sep 13 16:45:48.224329 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1883/3730] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:47 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2936 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:45:48.241242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:48.241740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:48.242222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:48.242660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9838ef1c-c5e0-408d-9abf-7274db8e8cdb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:48.242934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:48.243292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9838ef1c-c5e0-408d-9abf-7274db8e8cdb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:48.243412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:48.243809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:48.329848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9838ef1c-c5e0-408d-9abf-7274db8e8cdb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:48.345930 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9838ef1c-c5e0-408d-9abf-7274db8e8cdb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1223 microversion: 2.1 time: 0.120056 Sep 13 16:45:48.346849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1884/3731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:48 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:48.865134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:48.874198 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-312fba8d-e9d3-4667-8336-b68526f67149 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.678849 Sep 13 16:45:48.883324 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1848/3732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:48 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:49.245754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:49.247017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:49.250188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:49.289984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:49.291142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:49.294248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:49.295439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:49.296434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:49.297614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:49.368565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:49.369479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:49.381815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:49.398628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:49.399093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:49.399885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:49.400348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:49.400776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:49.743509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:49.756139 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-188ac729-5551-4592-bbcb-da31e55f1430 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1219 microversion: 2.1 time: 0.390785 Sep 13 16:45:49.773044 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1849/3733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:49 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1219 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:49.908749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:49.909370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:49.927117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:49.927890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:49.928520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:49.929423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:49.930172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:49.930641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:49.955832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:49.969371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:49.971898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:49.973573 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2141e55e-d79b-42c9-8f6b-0558cb51f03c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2915 microversion: 2.32 time: 0.731832 Sep 13 16:45:49.975431 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1885/3734] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:49 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2915 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:50.248889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-unplugged", "status": "completed", "tag": "816a7944-a34a-4fc7-b0b0-05133c00a7c5"}, {"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-unplugged", "status": "completed", "tag": "8feb22e4-a248-4a18-a706-2ff409d8f154"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:50.264982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.270990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.271866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.298368 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] Creating event network-vif-unplugged:816a7944-a34a-4fc7-b0b0-05133c00a7c5 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:50.299196 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] Creating event network-vif-unplugged:8feb22e4-a248-4a18-a706-2ff409d8f154 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:50.311607 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-443f2699-fa5b-4519-8baa-3a9c850d1238 req-56021e39-30ae-4111-8920-2f2562a2231f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.066657 Sep 13 16:45:50.312803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1886/3735] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:50.526967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6e050787-3912-494e-95b6-1cd8d18a9e31 req-6059f136-9740-4869-a809-f47c904cd030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec311cf7-6f46-495d-80d1-20502b938058", "tag": "11069db3-4dff-4247-9982-c890ada7e407"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:50.554739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e050787-3912-494e-95b6-1cd8d18a9e31 req-6059f136-9740-4869-a809-f47c904cd030 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.555519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e050787-3912-494e-95b6-1cd8d18a9e31 req-6059f136-9740-4869-a809-f47c904cd030 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.556159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e050787-3912-494e-95b6-1cd8d18a9e31 req-6059f136-9740-4869-a809-f47c904cd030 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.570537 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6e050787-3912-494e-95b6-1cd8d18a9e31 req-6059f136-9740-4869-a809-f47c904cd030 service nova] Creating event network-changed:11069db3-4dff-4247-9982-c890ada7e407 for instance ec311cf7-6f46-495d-80d1-20502b938058 on n-h2-857467-1 Sep 13 16:45:50.578022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6e050787-3912-494e-95b6-1cd8d18a9e31 req-6059f136-9740-4869-a809-f47c904cd030 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059586 Sep 13 16:45:50.579261 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1887/3736] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:50.647527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:50.653190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:50.661304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.662188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.662938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.663823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.664599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.665221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.720290 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d463378-5989-4740-a103-b5bb0b483bc4 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087563 Sep 13 16:45:50.721625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1888/3737] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:45:50 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:50.735641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:50.743134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:50.761883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.762594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.763679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.764558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.765310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.766034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.831627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:50.855345 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52f85884-f260-40fa-862c-5ac731990a52 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.950377 Sep 13 16:45:50.856226 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1850/3738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:49 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:45:50.861861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:50.862691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:50.878335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.879162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.880357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.881221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:50.881719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:50.882327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:50.943896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lazy-loading 'services' on Instance uuid 3a435525-7634-4d9e-80cd-0dabbf12a21a {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:45:51.049216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:51.063249 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-474ef143-8343-4392-ba04-b93424b68f76 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1281 microversion: 2.1 time: 0.205624 Sep 13 16:45:51.067440 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1851/3739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:50 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:51.075365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:51.081744 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cf8a8e0-b7e8-4e8d-b8a0-01f790559836 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments/55f3f16e-09ca-4112-881e-1c7deef50bd8" status: 202 len: 0 microversion: 2.1 time: 0.350946 Sep 13 16:45:51.084463 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1889/3740] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:45:50 2022] DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments/55f3f16e-09ca-4112-881e-1c7deef50bd8 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:45:51.084610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:51.116245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:51.116747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:51.117187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:51.118049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:51.118622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:51.119064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:51.843447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:51.847442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:51.862339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:51.866013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:51.867380 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6108bfd4-d00d-4fe9-aa6c-aff74a998d65 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2868 microversion: 2.32 time: 0.795838 Sep 13 16:45:51.872983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1852/3741] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:51 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2868 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:51.883561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:51.884304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:51.904073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:51.906702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:51.907223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:51.907982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:51.918261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:51.919527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.090427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:52.091125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:52.103335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.104797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.106389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.108915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.108915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.108915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.262543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:52.278362 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1a2baf6-9392-4c29-b8b1-205c14c041eb tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.395155 Sep 13 16:45:52.279084 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1890/3742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:51 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:52.645501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4315944e-c039-4e72-a03c-8e6ff6920515 req-b1b2646d-f2fe-47aa-8d82-386f37590bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-deleted", "tag": "d7a4126e-90a5-4a5b-80a4-1cb57c0445d8"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:52.662409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4315944e-c039-4e72-a03c-8e6ff6920515 req-b1b2646d-f2fe-47aa-8d82-386f37590bc4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.666260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4315944e-c039-4e72-a03c-8e6ff6920515 req-b1b2646d-f2fe-47aa-8d82-386f37590bc4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.668899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4315944e-c039-4e72-a03c-8e6ff6920515 req-b1b2646d-f2fe-47aa-8d82-386f37590bc4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.700422 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4315944e-c039-4e72-a03c-8e6ff6920515 req-b1b2646d-f2fe-47aa-8d82-386f37590bc4 service nova] Creating event network-vif-deleted:d7a4126e-90a5-4a5b-80a4-1cb57c0445d8 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:52.722648 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4315944e-c039-4e72-a03c-8e6ff6920515 req-b1b2646d-f2fe-47aa-8d82-386f37590bc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078222 Sep 13 16:45:52.729862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1891/3743] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:52.909285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:52.910185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:52.917280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.917963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.918517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.919326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:52.919914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:52.920446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:52.926879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:53.138708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:53.148746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:53.150613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:53.152131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-597375b3-e4ce-4d2b-98d2-93ad15584a16 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2754 microversion: 2.32 time: 0.248444 Sep 13 16:45:53.169284 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1892/3744] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:52 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2754 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:45:53.304348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:53.305252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:53.319752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:53.320264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:53.320708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:53.321501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:53.321899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:53.322344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:53.477504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:53.486584 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-146c24ca-916e-418d-bb15-3e027f87775a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 1.400341 Sep 13 16:45:53.488263 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1853/3745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:52 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:53.630646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:53.644381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3aea3463-70b9-45c9-9d79-230cd423ed53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.344380 Sep 13 16:45:53.645229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1893/3746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:53 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:53.859688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-84f16ee3-decf-4360-b473-ba6d14df067d req-52784d49-aef6-4ca5-aa08-826043c462e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:53.870480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-84f16ee3-decf-4360-b473-ba6d14df067d req-52784d49-aef6-4ca5-aa08-826043c462e1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:53.871152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-84f16ee3-decf-4360-b473-ba6d14df067d req-52784d49-aef6-4ca5-aa08-826043c462e1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:53.871809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-84f16ee3-decf-4360-b473-ba6d14df067d req-52784d49-aef6-4ca5-aa08-826043c462e1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:53.885031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-84f16ee3-decf-4360-b473-ba6d14df067d req-52784d49-aef6-4ca5-aa08-826043c462e1 service nova] Creating event network-changed:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:45:53.892999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-84f16ee3-decf-4360-b473-ba6d14df067d req-52784d49-aef6-4ca5-aa08-826043c462e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140133 Sep 13 16:45:53.894126 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1854/3747] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:54.182421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:54.183247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:54.199389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.199878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.200318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.201031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.201670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.202280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.265224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:54.265960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:54.277732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.280417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.280972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.281797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.282385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.284302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.315315 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2ea1584-561f-4325-99d1-f6fcc11eb06f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/ips" status: 200 len: 146 microversion: 2.1 time: 0.054240 Sep 13 16:45:54.317224 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1855/3748] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:45:54 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/ips => generated 146 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:54.514610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:54.516772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:54.527129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.528142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.531882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.532906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.534868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.535620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.635674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:54.647321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:54.648922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:54.658005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d466f3a-e18e-42b7-9cfa-6e1bb9d38107 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2707 microversion: 2.32 time: 0.479558 Sep 13 16:45:54.670550 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1894/3749] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:54 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2707 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:54.700799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:54.703387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:54.716602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.717441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.718101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:54.719304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:54.719941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:54.720531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.221030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:55.229565 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99ff79d7-b835-4da1-85e3-bfc511ce15c5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.720948 Sep 13 16:45:55.243569 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1856/3750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:54 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:55.249021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-75b1874e-abfb-4295-bcce-35ca8214bd35 req-c2890670-9bca-4b4e-a095-a3c2f562a992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-deleted", "tag": "43111ac9-cc42-4b8e-b068-0c286448e068"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:55.267388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-75b1874e-abfb-4295-bcce-35ca8214bd35 req-c2890670-9bca-4b4e-a095-a3c2f562a992 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.267990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-75b1874e-abfb-4295-bcce-35ca8214bd35 req-c2890670-9bca-4b4e-a095-a3c2f562a992 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.268463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-75b1874e-abfb-4295-bcce-35ca8214bd35 req-c2890670-9bca-4b4e-a095-a3c2f562a992 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.308507 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-75b1874e-abfb-4295-bcce-35ca8214bd35 req-c2890670-9bca-4b4e-a095-a3c2f562a992 service nova] Creating event network-vif-deleted:43111ac9-cc42-4b8e-b068-0c286448e068 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:55.324638 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-75b1874e-abfb-4295-bcce-35ca8214bd35 req-c2890670-9bca-4b4e-a095-a3c2f562a992 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085236 Sep 13 16:45:55.329516 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1857/3751] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:45:55.506657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:55.529859 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3e16d8c-a568-4eea-b6cc-92aaea3e6012 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.857829 Sep 13 16:45:55.533381 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1895/3752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:54 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:55.693487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:55.694377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:55.707810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.710045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.710612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:55.725800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:55.726513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:55.727079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.257873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:56.260431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:56.292789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.295150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.295864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.296831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.298875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.302188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.588758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:56.614032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:56.616487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:56.618057 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea714700-2bf6-4d7d-9f66-24637b22ef0c tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2707 microversion: 2.32 time: 0.929165 Sep 13 16:45:56.631098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1858/3753] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:55 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2707 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:56.650627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:56.651470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:56.658587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:56.660319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.665989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.666553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.668206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:56.668696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:56.671330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:56.959103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:56.978884 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-21c2265e-6e06-4348-9c4b-fc1b74e8d986 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.726958 Sep 13 16:45:56.991060 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1896/3754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:56 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:57.644242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e5cab3e-5eab-4a2e-a2c3-1d563a69036e"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:57.647891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:57.671158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:57.677049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:57.679643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:57.680509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:57.681001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:57.681445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:57.860543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:57.931856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:58.108819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:58.142154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-97fffbd8-3650-436b-8151-19e4c4ff1b00 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 1.509390 Sep 13 16:45:58.144659 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1859/3755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:56 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:58.223999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:58.224833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:58.258551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:58.259066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:58.259523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:58.260246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:58.260719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:58.261195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:58.340766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:45:58.351644 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b844e68-6a52-4dcf-89b0-c23fc5edcded tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710594 Sep 13 16:45:58.353701 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1897/3756] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:45:57 2022] POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:58.382162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:58.384507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:58.402332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:58.402904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:58.403543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:58.404521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:58.405868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:58.407663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:58.843157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:58.858549 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d329e56e-29aa-492a-bff6-11b009d186d0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.496434 Sep 13 16:45:58.859156 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1898/3757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:58 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:59.102119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6f119f61-d8d4-4fe0-ac5d-c2f9de18b7c3 req-f7085d7c-18b0-42da-89ee-d008044a835a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-deleted", "tag": "816a7944-a34a-4fc7-b0b0-05133c00a7c5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:45:59.118647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:59.122849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6f119f61-d8d4-4fe0-ac5d-c2f9de18b7c3 req-f7085d7c-18b0-42da-89ee-d008044a835a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.124926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6f119f61-d8d4-4fe0-ac5d-c2f9de18b7c3 req-f7085d7c-18b0-42da-89ee-d008044a835a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.125527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6f119f61-d8d4-4fe0-ac5d-c2f9de18b7c3 req-f7085d7c-18b0-42da-89ee-d008044a835a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.141784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:59.143299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:59.145374 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60826dff-7024-4fcd-baab-68d5bf0854cb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2546 microversion: 2.32 time: 0.957820 Sep 13 16:45:59.145981 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1860/3758] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:45:58 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2546 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:45:59.158653 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6f119f61-d8d4-4fe0-ac5d-c2f9de18b7c3 req-f7085d7c-18b0-42da-89ee-d008044a835a service nova] Creating event network-vif-deleted:816a7944-a34a-4fc7-b0b0-05133c00a7c5 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:45:59.166030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.172224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6f119f61-d8d4-4fe0-ac5d-c2f9de18b7c3 req-f7085d7c-18b0-42da-89ee-d008044a835a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075543 Sep 13 16:45:59.173918 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1899/3759] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:45:59.182076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.183202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.184830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.195533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.196464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.197238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.198790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.199525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.200252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.203511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.204007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.204462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.205167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.210868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.211404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.284473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32a885df-9b37-44b1-ac08-2c29975812ec tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137413 Sep 13 16:45:59.286817 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1861/3760] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:45:59 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:59.423735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.426538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.449086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.449605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.450485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.454226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.454903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.455582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.479963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:45:59.498843 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e6cc95c-fdbd-4f95-ad26-8ca7b3373d07 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.323374 Sep 13 16:45:59.499731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1900/3761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:59 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:45:59.569186 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89a6563c-1879-427c-bce8-287acc97d010 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153303 Sep 13 16:45:59.575729 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1862/3762] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:45:59 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:45:59.671664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.672159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.684342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.685119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.685726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.686660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.695289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.695754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.752539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:45:59.873507 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb7a9407-fcf3-45ff-b784-69d5aea5e4c3 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 204 len: 0 microversion: 2.1 time: 0.203959 Sep 13 16:45:59.876666 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1901/3763] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:45:59 2022] DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:45:59.887572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.888686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.929817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.932629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.933875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:45:59.934681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:45:59.934997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.937239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.938995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.939704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.943387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.947834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.948704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:45:59.949160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:45:59.949790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:45:59.950605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:00.500798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:00.513041 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9b5539b-16fe-4107-9811-5f8364633ed0 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.630736 Sep 13 16:46:00.516262 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1863/3764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:59 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:00.529739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:00.531497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:00.545031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:00.548303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:00.548953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:00.550593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:00.552520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:00.553145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:00.636742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:00.650570 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cae6785d-9ed4-4bde-853c-0972739c234e tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1681 microversion: 2.1 time: 0.760193 Sep 13 16:46:00.658704 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1902/3765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:45:59 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1681 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:00.680749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:00.681699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:00.699658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:00.700189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:00.700643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:00.701383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:00.704343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:00.704796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:01.240033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:01.248485 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62f1e909-d657-4bbc-8267-462c00faecdc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.587799 Sep 13 16:46:01.249067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:01.254965 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1903/3766] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:00 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:01.261468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:01.262974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:01.264203 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b354ec87-5711-4bcb-8e94-07cbd88db702 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2260 microversion: 2.32 time: 0.745972 Sep 13 16:46:01.264763 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1864/3767] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:00 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2260 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:01.269636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a9b963a4-4789-4d56-bfb2-17c38a43b0fe req-3a0e5d33-c508-4de0-bf69-030cf3270ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec311cf7-6f46-495d-80d1-20502b938058", "name": "network-vif-plugged", "status": "completed", "tag": "11069db3-4dff-4247-9982-c890ada7e407"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:01.283965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a9b963a4-4789-4d56-bfb2-17c38a43b0fe req-3a0e5d33-c508-4de0-bf69-030cf3270ad9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:01.284447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a9b963a4-4789-4d56-bfb2-17c38a43b0fe req-3a0e5d33-c508-4de0-bf69-030cf3270ad9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:01.290783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a9b963a4-4789-4d56-bfb2-17c38a43b0fe req-3a0e5d33-c508-4de0-bf69-030cf3270ad9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:01.308689 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a9b963a4-4789-4d56-bfb2-17c38a43b0fe req-3a0e5d33-c508-4de0-bf69-030cf3270ad9 service nova] Creating event network-vif-plugged:11069db3-4dff-4247-9982-c890ada7e407 for instance ec311cf7-6f46-495d-80d1-20502b938058 on n-h2-857467-1 Sep 13 16:46:01.323135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a9b963a4-4789-4d56-bfb2-17c38a43b0fe req-3a0e5d33-c508-4de0-bf69-030cf3270ad9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064621 Sep 13 16:46:01.324068 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1904/3768] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:01.430081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-02e0b495-18f8-4537-8ae2-7723a392d9de req-f4c5b70d-f40b-4313-b4f6-7416232a8fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-deleted", "tag": "8feb22e4-a248-4a18-a706-2ff409d8f154"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:01.459918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02e0b495-18f8-4537-8ae2-7723a392d9de req-f4c5b70d-f40b-4313-b4f6-7416232a8fee service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:01.460408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02e0b495-18f8-4537-8ae2-7723a392d9de req-f4c5b70d-f40b-4313-b4f6-7416232a8fee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:01.460845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-02e0b495-18f8-4537-8ae2-7723a392d9de req-f4c5b70d-f40b-4313-b4f6-7416232a8fee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:01.492294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-02e0b495-18f8-4537-8ae2-7723a392d9de req-f4c5b70d-f40b-4313-b4f6-7416232a8fee service nova] Creating event network-vif-deleted:8feb22e4-a248-4a18-a706-2ff409d8f154 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:46:01.514039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-02e0b495-18f8-4537-8ae2-7723a392d9de req-f4c5b70d-f40b-4313-b4f6-7416232a8fee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086784 Sep 13 16:46:01.518162 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1865/3769] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:01.541997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:01.542826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:01.555130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:01.565253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:01.565917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:01.567363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:01.567919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:01.570207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:01.686612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:01.687665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:01.697221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:01.702336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:01.703049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:01.703973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:01.704603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:01.706200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:02.178140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:02.191694 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4d31800-7c08-4736-881b-3e6dd10464af tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1681 microversion: 2.1 time: 0.509405 Sep 13 16:46:02.192868 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1866/3770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:01 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1681 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:02.213914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:02.231149 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c8110b36-a9a2-46c4-93ea-fea684550000 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.686109 Sep 13 16:46:02.232166 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1905/3771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:01 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:02.283405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:02.284033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:02.296264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:02.297928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:02.301516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:02.302027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:02.302483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:02.303173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:02.303637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:02.304068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:02.311266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:02.311806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:02.314988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:02.318248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:02.318928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:02.322050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:02.736764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:02.757022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:02.759026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:02.760486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c530c64-dbb1-4688-8fd9-929026c599df tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 2099 microversion: 2.32 time: 0.469381 Sep 13 16:46:02.762242 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1906/3772] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:02 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 2099 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:46:03.172138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:03.186534 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f460336e-192e-4fed-926e-321f59799cb4 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1402 microversion: 2.1 time: 0.908692 Sep 13 16:46:03.187508 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1867/3773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:02 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1402 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:03.221591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:03.222392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:03.239575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:03.240485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:03.242404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:03.245953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:03.246937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:03.247882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:03.255455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:03.259983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:03.259983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:03.277342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:03.277869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:03.278306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:03.279014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:03.279969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:03.280564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:03.977933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:03.991225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3560d78-7819-4cb8-b108-4cdf5c5f1b40 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.735648 Sep 13 16:46:03.991871 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1868/3774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:03 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:04.008883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-65faf0d4-87dd-46c2-afe3-6f4a5dcdd73f req-d8fb8e9b-88fb-4d0a-b4e1-009944882509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "name": "network-vif-plugged", "status": "completed", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:04.041347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-65faf0d4-87dd-46c2-afe3-6f4a5dcdd73f req-d8fb8e9b-88fb-4d0a-b4e1-009944882509 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:04.042138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-65faf0d4-87dd-46c2-afe3-6f4a5dcdd73f req-d8fb8e9b-88fb-4d0a-b4e1-009944882509 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:04.044172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-65faf0d4-87dd-46c2-afe3-6f4a5dcdd73f req-d8fb8e9b-88fb-4d0a-b4e1-009944882509 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:04.075820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-65faf0d4-87dd-46c2-afe3-6f4a5dcdd73f req-d8fb8e9b-88fb-4d0a-b4e1-009944882509 service nova] Creating event network-vif-plugged:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:46:04.094599 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-65faf0d4-87dd-46c2-afe3-6f4a5dcdd73f req-d8fb8e9b-88fb-4d0a-b4e1-009944882509 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101117 Sep 13 16:46:04.103458 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1869/3775] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:04.117018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c655874b-4baa-4650-a9c9-1efeca8ea076 req-1ffed38e-f13d-4500-bab9-982e087166a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8341b773-8811-490a-a75f-da1dd07dbf5b", "name": "network-vif-deleted", "tag": "6199766c-27f4-49fb-92e6-fc117ebbbc52"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:04.142018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c655874b-4baa-4650-a9c9-1efeca8ea076 req-1ffed38e-f13d-4500-bab9-982e087166a4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:04.142557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c655874b-4baa-4650-a9c9-1efeca8ea076 req-1ffed38e-f13d-4500-bab9-982e087166a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:04.144219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c655874b-4baa-4650-a9c9-1efeca8ea076 req-1ffed38e-f13d-4500-bab9-982e087166a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:04.171892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c655874b-4baa-4650-a9c9-1efeca8ea076 req-1ffed38e-f13d-4500-bab9-982e087166a4 service nova] Creating event network-vif-deleted:6199766c-27f4-49fb-92e6-fc117ebbbc52 for instance 8341b773-8811-490a-a75f-da1dd07dbf5b on n-h1-857467-1 Sep 13 16:46:04.174342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:04.185186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5956ea0a-e0b1-4a43-b54d-6affec2e0206 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1681 microversion: 2.1 time: 0.967955 Sep 13 16:46:04.185852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c655874b-4baa-4650-a9c9-1efeca8ea076 req-1ffed38e-f13d-4500-bab9-982e087166a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078240 Sep 13 16:46:04.188059 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1907/3776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:03 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1681 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:04.188562 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1870/3777] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:04.204279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:04.205251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:04.215289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:04.216352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:04.220432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:04.221162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:04.222543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:04.227151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:04.227838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:04.228775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:04.229425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:04.230089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:04.231685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:04.234043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:04.235213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:04.236193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:04.377681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:04.396586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:04.412437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:04.416383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31533495-7e03-458b-8718-7da22707df03 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.226317 Sep 13 16:46:04.418592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1908/3778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:04 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:05.015236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:05.016221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:05.026980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.027208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:05.037757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.038858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.039871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.040588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.041233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.058484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a04d38d4-9195-4654-a10f-614d6da5d974 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1590 microversion: 2.1 time: 0.845518 Sep 13 16:46:05.063099 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1871/3779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:04 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1590 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:05.097419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:05.098780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:05.112376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.117996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.120051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.122999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.123686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.125815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.291835 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ea983b7-229b-47fc-81de-0fa4cf2a87e6 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201594 Sep 13 16:46:05.292818 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1872/3780] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:46:05 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:05.297979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:05.298849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:05.318495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.319209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.319811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.320685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.321306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.322001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.367452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:05.467670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:05.477858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f4c36d5-fb6a-45d8-a305-fea191e5eeef tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1614 microversion: 2.1 time: 0.183773 Sep 13 16:46:05.488974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1873/3781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:05 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1614 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:05.507262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:05.508175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:05.520879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.522636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.525167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.526495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:05.534625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:05.535707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:05.751720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:05.766330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:05.774382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d51ca47d-0891-42f8-879b-9335cfd3ecc5 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1323 microversion: 2.1 time: 0.761138 Sep 13 16:46:05.775712 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1909/3782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:05 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1323 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:05.797764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:05.799874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:05.804642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e2430db-7035-4991-9b95-a703dfe1c4b9 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.310499 Sep 13 16:46:05.810507 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1874/3783] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:05 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:06.353106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d47a9005-d1fb-4f50-9fc9-b493cf2dea56 req-176de955-ef75-45d4-89a7-ec73b03e07d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a435525-7634-4d9e-80cd-0dabbf12a21a", "name": "network-vif-deleted", "tag": "3cd8b977-33c4-484c-9df5-aaa7bd38789d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:06.388523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d47a9005-d1fb-4f50-9fc9-b493cf2dea56 req-176de955-ef75-45d4-89a7-ec73b03e07d4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:06.389421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d47a9005-d1fb-4f50-9fc9-b493cf2dea56 req-176de955-ef75-45d4-89a7-ec73b03e07d4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:06.390023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d47a9005-d1fb-4f50-9fc9-b493cf2dea56 req-176de955-ef75-45d4-89a7-ec73b03e07d4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:06.434925 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d47a9005-d1fb-4f50-9fc9-b493cf2dea56 req-176de955-ef75-45d4-89a7-ec73b03e07d4 service nova] Creating event network-vif-deleted:3cd8b977-33c4-484c-9df5-aaa7bd38789d for instance 3a435525-7634-4d9e-80cd-0dabbf12a21a on n-h2-857467-1 Sep 13 16:46:06.444742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d47a9005-d1fb-4f50-9fc9-b493cf2dea56 req-176de955-ef75-45d4-89a7-ec73b03e07d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098295 Sep 13 16:46:06.445541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1910/3784] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:06.516655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:06.517720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:06.530783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:06.531461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:06.538440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:06.539760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:06.540867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:06.541704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:06.626343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:06.626922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:06.627444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:06.628134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lazy-loading 'fault' on Instance uuid 3a435525-7634-4d9e-80cd-0dabbf12a21a {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:46:06.805027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:06.809476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:06.824094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:06.829470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:06.830324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:06.831214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:06.831957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:06.833298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:07.238183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb753f45a3b4e988189cf326973120b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7adee868bb5465ba80c35321dd54995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:07.250077 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98789a53-386c-4849-9b23-bc32557957c0 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 200 len: 1331 microversion: 2.1 time: 0.737134 Sep 13 16:46:07.252160 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1875/3785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:06 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 1331 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:07.264427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:07.275481 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3126405c-5ce1-4c4b-918b-96f7fd577c30 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1519 microversion: 2.1 time: 0.476438 Sep 13 16:46:07.277102 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1911/3786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:06 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1519 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:07.290158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:07.290158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:07.299077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:07.305104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:07.305623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-af4d24da-5688-4090-803c-010392d09f45 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'create', calling method: .version_select at 0x7fbeb4715dc0>, body: {"pool": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:07.305800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:07.306469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:07.306991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:07.307438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:07.466270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:07.489389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:07.490891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:07.493776 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36257861-5c28-4d91-885a-16efcff36966 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.240395 Sep 13 16:46:07.497299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1876/3787] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:07 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:08.279283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:08.281150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:08.298517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:08.300129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:08.304901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:08.305874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:08.308752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:08.309886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:08.352329 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] HTTP exception thrown: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Request method failure captured: Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a HTTP/1.1 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILMH8FTEYKk63pIwY0T4ELUDrZMerw3FqDOmQZxiuvJqtLtTAuc0yy3Yt3HJPv6i5mZeDuxv2YwgcTiDmGK4YWtYZcWKTT767PcFZqXHnaqZrEJpKypcaOE8pFGpKAF7tdgWE1ScslCtE1AjYAusRWpTHo1tLtd-DJ1_sTEr75tKnOk Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7adee868bb5465ba80c35321dd54995 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7adee868bb5465ba80c35321dd54995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7adee868bb5465ba80c35321dd54995 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachSCSIVolumeTestJSON-296901760-project Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ffb753f45a3b4e988189cf326973120b Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-296901760-project Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3a435525-7634-4d9e-80cd-0dabbf12a21a'} Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:08.354323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:08.359732 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:08.360525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Returning 404 to user: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:08.374195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-561d121a-fa9d-404b-a34e-46d109c90e26 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 404 len: 111 microversion: 2.1 time: 0.094530 Sep 13 16:46:08.375051 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1877/3788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:08 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:46:08.387933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6af1803c-57fa-419f-85b8-0d347850a914 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '.version_select at 0x7fbeb4cd2af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:08.439107 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6af1803c-57fa-419f-85b8-0d347850a914 tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763240098" status: 202 len: 0 microversion: 2.1 time: 0.059470 Sep 13 16:46:08.441299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1878/3789] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763240098 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:46:08.528724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:08.530619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:08.546157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:08.549630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:08.551807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:08.553590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:08.555301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:08.556001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:08.793308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:08.803456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:08.804928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:08.806155 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a9967a1-fa0f-4cfd-9271-ee0154365bdd tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.282260 Sep 13 16:46:08.824477 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1879/3790] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:08 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:46:09.794294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:09.794933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:09.804162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:09.808595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:09.819056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:09.820332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:09.820836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:09.821537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:10.548713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:10.558768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f433eb0-b5ed-48cc-9b02-ff4ba68f9b01 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1590 microversion: 2.1 time: 0.768683 Sep 13 16:46:10.563119 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1880/3791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:09 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1590 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:10.577716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-053075bc-398d-4f9f-b054-3f29b4edb0c4 req-8365a15d-f6b6-4bc6-800c-a3a6dbf3c2ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec311cf7-6f46-495d-80d1-20502b938058", "tag": "11069db3-4dff-4247-9982-c890ada7e407"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:10.598996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-053075bc-398d-4f9f-b054-3f29b4edb0c4 req-8365a15d-f6b6-4bc6-800c-a3a6dbf3c2ba service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:10.599777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-053075bc-398d-4f9f-b054-3f29b4edb0c4 req-8365a15d-f6b6-4bc6-800c-a3a6dbf3c2ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:10.603503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-053075bc-398d-4f9f-b054-3f29b4edb0c4 req-8365a15d-f6b6-4bc6-800c-a3a6dbf3c2ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:10.642290 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-053075bc-398d-4f9f-b054-3f29b4edb0c4 req-8365a15d-f6b6-4bc6-800c-a3a6dbf3c2ba service nova] Creating event network-changed:11069db3-4dff-4247-9982-c890ada7e407 for instance ec311cf7-6f46-495d-80d1-20502b938058 on n-h2-857467-1 Sep 13 16:46:10.667689 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-053075bc-398d-4f9f-b054-3f29b4edb0c4 req-8365a15d-f6b6-4bc6-800c-a3a6dbf3c2ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098971 Sep 13 16:46:10.668375 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1881/3792] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:10.683428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:10.686632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:10.726675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:10.730568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:10.733941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:10.736290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:10.739202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:10.739948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:10.903069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:10.936158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:10.939833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:10.947761 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7069294-cec8-4aa7-ac88-31efb7321237 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.275720 Sep 13 16:46:10.948382 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1882/3793] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:10 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:11.978047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:11.978819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:12.000786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:12.001266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:12.003015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:12.003791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:12.004486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:12.011520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:12.576004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:12.587352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:12.601993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:12.605613 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c46ed32c-deb3-4350-a72d-7bc98a7f0397 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.632469 Sep 13 16:46:12.631938 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1883/3794] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:11 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:46:13.655749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:13.658262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:13.673167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:13.676552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:13.678080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:13.679969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:13.683468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:13.684525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:13.962063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:13.971674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:13.976506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:13.978354 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b44c9d3-e9a9-49c5-97f6-e05af22f95ac tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.333423 Sep 13 16:46:13.979888 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1884/3795] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:13 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:14.909872 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-af4d24da-5688-4090-803c-010392d09f45 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.611146 Sep 13 16:46:14.910683 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1912/3796] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:46:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:15.011023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:15.012110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:15.026894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:15.027972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:15.029358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:15.030329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:15.030968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:15.031693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:15.118364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-305736295", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "de36c228-169a-4e26-92cd-cb49c35f2833"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:15.132450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:15.210238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] validate_networks() for [('de36c228-169a-4e26-92cd-cb49c35f2833', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:46:15.336845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:15.354367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:15.361371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:15.364886 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c4e4426-d8af-455f-bbe6-12e33aeb0f34 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.360073 Sep 13 16:46:15.370884 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1885/3797] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:15 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:16.144102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:46:16.151817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:46:16.152606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:46:16.153234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:46:16.154835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:46:16.168745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:16.169475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:16.170210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:16.171129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:16.171762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:16.172598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:16.208802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Getting quotas for project 67831491241246a5961d8b9c417662ed. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:16.236368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Getting quotas for user 20ecc8b135b34ef89a828f600a534e2c and project 67831491241246a5961d8b9c417662ed. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:16.244496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-44071880", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d8c64b9f-3991-4e81-b7b0-379d17e2e8bb"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:16.252255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:46:16.255046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:16.319489 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f15eac0-8dd2-4969-bd46-c6eb6989767b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206788 Sep 13 16:46:16.320743 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1913/3798] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:46:16.357998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] validate_networks() for [('d8c64b9f-3991-4e81-b7b0-379d17e2e8bb', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:46:16.487258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1598c170-9f79-4e68-af0d-0b05086709c6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Action: 'create', calling method: .version_select at 0x7fbeb4693820>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1800101117", "policies": ["affinity"]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:16.552695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1598c170-9f79-4e68-af0d-0b05086709c6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:16.574207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1598c170-9f79-4e68-af0d-0b05086709c6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:16.676001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1598c170-9f79-4e68-af0d-0b05086709c6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:16.695976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1598c170-9f79-4e68-af0d-0b05086709c6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:16.742709 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1598c170-9f79-4e68-af0d-0b05086709c6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.418983 Sep 13 16:46:16.744825 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1914/3799] 10.222.0.61 () {60 vars in 1174 bytes} [Tue Sep 13 16:46:16 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:16.756709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afb4e8bb-4c5c-4899-bf9f-fb955055955a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:16.758997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-afb4e8bb-4c5c-4899-bf9f-fb955055955a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:16.883288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afb4e8bb-4c5c-4899-bf9f-fb955055955a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:16.899848 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-afb4e8bb-4c5c-4899-bf9f-fb955055955a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1223 microversion: 2.1 time: 0.148815 Sep 13 16:46:16.901934 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1915/3800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:16 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:16.908043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:16.908663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:16.917242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:16.917746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:16.918216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:16.918925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:16.919597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:16.920196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:17.479542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:46:17.480700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:46:17.481442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:46:17.482125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:46:17.482778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:46:17.497595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:17.498577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:17.500996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:17.506163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:17.507546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:17.508472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:17.580564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Getting quotas for project 1d126690fdf34b20b071a80a25893169. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:17.607757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Getting quotas for user 71087bb4bd804ee8af20a8249aeadc1e and project 1d126690fdf34b20b071a80a25893169. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:17.654774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Going to run 2 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:46:17.661189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 868bf5b8-ad14-4833-a74e-71fdb37d1229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:17.688239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:17.707818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:17.717684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:17.729287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-158719ae-5207-4255-b1a0-c0e3626af926 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.816285 Sep 13 16:46:17.731483 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1916/3801] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:16 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:17.748206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=868bf5b8-ad14-4833-a74e-71fdb37d1229,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:17.759388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d391dc28-738f-4307-ba2b-0e562ff526cf tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Action: 'create', calling method: .version_select at 0x7fbeb4693b80>, body: {"server_group": {"name": "tempest-server-group-373121581", "policies": ["affinity"]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:17.855908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d391dc28-738f-4307-ba2b-0e562ff526cf tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:17.880290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d391dc28-738f-4307-ba2b-0e562ff526cf tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:17.913495 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a674a3a-e528-4973-b86b-da0a5be311b5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952022 Sep 13 16:46:17.921969 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1886/3802] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:46:17.929539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:17.930534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:17.939580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:17.940639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:17.942253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:17.943590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:17.944333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:17.945341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:18.108321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d391dc28-738f-4307-ba2b-0e562ff526cf tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:18.129506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:18.138403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d391dc28-738f-4307-ba2b-0e562ff526cf tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:18.145693 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94e48bfb-bacd-4d33-b6ae-6ad366a308ef tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1275 microversion: 2.1 time: 0.218115 Sep 13 16:46:18.146796 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1887/3803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:17 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:18.152409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.158066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:18.159405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Searching by: {'deleted': False, 'project_id': '1d126690fdf34b20b071a80a25893169'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:46:18.177882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:18.178502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:18.179429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:18.180864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:18.181594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:18.182596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:18.206533 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d391dc28-738f-4307-ba2b-0e562ff526cf tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.465274 Sep 13 16:46:18.210642 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1917/3804] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Sep 13 16:46:17 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:18.221147 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2fc0b972-73c9-4e96-b913-8693c898e911 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.072743 Sep 13 16:46:18.222112 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1888/3805] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:46:18 2022] GET /compute/v2.1/servers => generated 673 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:18.234435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b51f354f-6b32-4aeb-999a-21e662c2a9fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Action: 'create', calling method: .version_select at 0x7fbeb46d2700>, body: {"server_group": {"name": "tempest-server-group-373121581", "policies": ["affinity"]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:18.234683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83076172-b4de-487b-b104-a1979cd4157b tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.236466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83076172-b4de-487b-b104-a1979cd4157b tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:18.288468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b51f354f-6b32-4aeb-999a-21e662c2a9fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:18.306396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b51f354f-6b32-4aeb-999a-21e662c2a9fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:18.431406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b51f354f-6b32-4aeb-999a-21e662c2a9fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:18.442264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b51f354f-6b32-4aeb-999a-21e662c2a9fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:18.452154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:18.487772 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b51f354f-6b32-4aeb-999a-21e662c2a9fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.257056 Sep 13 16:46:18.491403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1918/3806] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Sep 13 16:46:18 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:18.513304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f86c100-8006-4f26-8f86-ed2acb620856 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.599835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83076172-b4de-487b-b104-a1979cd4157b tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:18.615869 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83076172-b4de-487b-b104-a1979cd4157b tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1218 microversion: 2.1 time: 0.385640 Sep 13 16:46:18.617177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f86c100-8006-4f26-8f86-ed2acb620856 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/6b0b0c0c-8e76-4ba1-9e74-f531148d6c48" status: 204 len: 0 microversion: 2.1 time: 0.117802 Sep 13 16:46:18.618069 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1889/3807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:18 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1218 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:18.636126 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1919/3808] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:18 2022] DELETE /compute/v2.1/os-server-groups/6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:46:18.650307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c4f91e2-52e5-4d94-9744-8dfc792fbc5a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.716399 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c4f91e2-52e5-4d94-9744-8dfc792fbc5a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.075514 Sep 13 16:46:18.718206 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1890/3809] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:46:18 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:18.729373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-428a5c21-2613-47f2-855f-fe67967445fa tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.763758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.764396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:18.776968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:18.777471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:18.777953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:18.778678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:18.779141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:18.803979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:18.837346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-428a5c21-2613-47f2-855f-fe67967445fa tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/310d0a25-3072-43e8-b4b6-368580014d7b" status: 204 len: 0 microversion: 2.1 time: 0.112074 Sep 13 16:46:18.846505 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1920/3810] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:18 2022] DELETE /compute/v2.1/os-server-groups/310d0a25-3072-43e8-b4b6-368580014d7b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:46:18.871251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b7cba2f-3920-4f8f-aae6-71364137e41b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:18.936610 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b7cba2f-3920-4f8f-aae6-71364137e41b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.085208 Sep 13 16:46:18.937541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1921/3811] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:46:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:18.961429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9a72c1a0-bdb8-47d3-8d30-bba988eb69c7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Action: 'create', calling method: .version_select at 0x7fbeb46e2ee0>, body: {"server_group": {"name": "tempest-server-group-1917309810", "policies": ["affinity"]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:19.024011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9a72c1a0-bdb8-47d3-8d30-bba988eb69c7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:19.048882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9a72c1a0-bdb8-47d3-8d30-bba988eb69c7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:19.174611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9a72c1a0-bdb8-47d3-8d30-bba988eb69c7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:19.200086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9a72c1a0-bdb8-47d3-8d30-bba988eb69c7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:19.248455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:19.252772 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9a72c1a0-bdb8-47d3-8d30-bba988eb69c7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.303011 Sep 13 16:46:19.258146 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1922/3812] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Sep 13 16:46:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:19.267051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:19.271876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:19.274387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:19.276011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:19.279009 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ed50e1d-5519-4507-ad04-145eb51f63d0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.520307 Sep 13 16:46:19.295832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:19.296342 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1891/3813] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:18 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:19.297816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:19.300205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:19.301701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:19.303687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:19.305074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:19.328185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b81a75ab-8532-4ae7-8005-f6fb1f3f07fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:19.409747 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b81a75ab-8532-4ae7-8005-f6fb1f3f07fe tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361" status: 204 len: 0 microversion: 2.1 time: 0.100276 Sep 13 16:46:19.412104 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1892/3814] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:19 2022] DELETE /compute/v2.1/os-server-groups/bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:46:19.426961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04cb13d9-c710-44a1-a46f-4018c2f19085 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:19.460531 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-04cb13d9-c710-44a1-a46f-4018c2f19085 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043905 Sep 13 16:46:19.462045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1893/3815] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:46:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:19.482080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b744d486-6acd-4df9-b725-b8749107c4b1 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Action: 'create', calling method: .version_select at 0x7fbeb4e40280>, body: {"server_group": {"name": "tempest-server-group-537988957", "policies": ["anti-affinity"]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:19.508391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:19.536118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b744d486-6acd-4df9-b725-b8749107c4b1 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:19.552767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b744d486-6acd-4df9-b725-b8749107c4b1 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:19.692505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b744d486-6acd-4df9-b725-b8749107c4b1 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:19.706843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b744d486-6acd-4df9-b725-b8749107c4b1 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_groups'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:19.738156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:19.747805 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b744d486-6acd-4df9-b725-b8749107c4b1 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.274266 Sep 13 16:46:19.750519 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1894/3816] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Sep 13 16:46:19 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:19.765329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:19.767379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:19.768671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f93faa4b-56a2-4876-bf36-6ff05ddbc609 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1281 microversion: 2.1 time: 0.507603 Sep 13 16:46:19.770961 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1923/3817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:19 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1281 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:19.794921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:19.795437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:19.795944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:19.797386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:19.797987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:19.798442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:19.808302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9487157d-13c0-4c02-82df-ae5d53ede930 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:19.876779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9487157d-13c0-4c02-82df-ae5d53ede930 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a" status: 204 len: 0 microversion: 2.1 time: 0.097705 Sep 13 16:46:19.879641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1924/3818] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:19 2022] DELETE /compute/v2.1/os-server-groups/c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:46:19.891736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76d339b3-878e-42f5-8b1b-686cd36137a7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:19.930298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76d339b3-878e-42f5-8b1b-686cd36137a7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043840 Sep 13 16:46:19.941242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:19.941970 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1925/3819] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:46:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:19.962201 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98dca3b9-5ff9-4872-9dad-bffd414922e6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1222 microversion: 2.1 time: 0.206613 Sep 13 16:46:19.963539 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1895/3820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:19 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:20.077960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-597274919", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "c94a5f29-d978-4dca-8dbd-ca7db772e7ff"}]}, "os:scheduler_hints": {"group": "a1df822b-9e47-4fbb-a6a7-4fd5fabf6828"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:20.256637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] validate_networks() for [('c94a5f29-d978-4dca-8dbd-ca7db772e7ff', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:46:20.328537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:20.330962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:20.358735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:20.359457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:20.362273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:20.365096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:20.365870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:20.368792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:20.677912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:20.710245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:20.718389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:20.727269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e795873-f954-4a93-98e3-0191ca5c9264 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.412396 Sep 13 16:46:20.732900 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1896/3821] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:20 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:20.796943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:20.798040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:20.830283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:20.831127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:20.840568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:20.841600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:20.842193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:20.845430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:22.548148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:46:22.548653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:46:22.549111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:46:22.549631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:46:22.550151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:46:22.612648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:22.617409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:22.618261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:22.619573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:22.620272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:22.621972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:22.712012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:22.729010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:22.769226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:46:22.772875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:22.785765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:22.832730 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-17212f73-8010-4d41-a8ef-271b602c135b tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 2.036351 Sep 13 16:46:22.834142 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1897/3822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:20 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:22.867323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:22.869268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:22.878465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:22.880086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:22.889787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:22.890845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:22.910992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:22.912543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:22.914194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:22.942323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:22.980730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:23.027492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for project 47b3ce04a125495a956906486780c76c. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:23.039838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Getting quotas for user a5f0ae8200b64b57bf60fc4f4b9e4c8c and project 47b3ce04a125495a956906486780c76c. Resources: {'server_group_members'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:23.065858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:23.108046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-800b3326-1932-4a0b-ba57-9b79ebe928f0 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.034171 Sep 13 16:46:23.109088 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1926/3823] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:46:23.116381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:23.118690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:23.139754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.140515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.142364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:23.143424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.151252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.151993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:23.290148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:23.308077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:23.310977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:23.312514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2aeafd0f-55d0-4451-bbd0-46e6bbd346bf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.202209 Sep 13 16:46:23.313341 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1927/3824] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:23 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:23.321505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8a167a3-4cee-43fe-9a71-9afc0a3153f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:23.352853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8a167a3-4cee-43fe-9a71-9afc0a3153f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.353717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8a167a3-4cee-43fe-9a71-9afc0a3153f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.354928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8a167a3-4cee-43fe-9a71-9afc0a3153f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:23.383994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8a167a3-4cee-43fe-9a71-9afc0a3153f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Going to try to stop instance {{(pid=122328) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:46:23.435567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:23.443710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8a167a3-4cee-43fe-9a71-9afc0a3153f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action" status: 202 len: 0 microversion: 2.1 time: 0.124921 Sep 13 16:46:23.445288 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1928/3825] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:46:23 2022] POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:46:23.451312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9af2e69d-fd7c-4376-b5c3-c86acf8a78aa tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:23.452470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9af2e69d-fd7c-4376-b5c3-c86acf8a78aa tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:23.476084 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be2f08df-f31d-4eb6-9dc2-0b12cd8b49ba tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1276 microversion: 2.1 time: 0.637598 Sep 13 16:46:23.486369 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1898/3826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:22 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1276 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:23.515055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:23.521199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:23.533526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.537321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.537790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:23.555121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9af2e69d-fd7c-4376-b5c3-c86acf8a78aa tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:23.555871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.556525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.561036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:23.567552 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9af2e69d-fd7c-4376-b5c3-c86acf8a78aa tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1212 microversion: 2.1 time: 0.119647 Sep 13 16:46:23.584673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1929/3827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:23 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:23.860908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:23.861525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:23.876967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.878029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.879316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:23.880495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:23.881220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:23.882232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:24.552911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:24.592520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-698d1ad8-ec24-43e5-b9a1-0e4a98245edf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 1.101064 Sep 13 16:46:24.594278 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1899/3828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:23 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:24.612822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:24.612822 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be4e7385-af12-4aed-b798-12fb92df008f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.755527 Sep 13 16:46:24.612822 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1930/3829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:23 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:24.648467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:24.649888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:24.662257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:24.663274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:24.664769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:24.666568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:24.667501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:24.668450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:24.675967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:24.679486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:24.694215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:24.703524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:24.704105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:24.705114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:24.708970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:24.709783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:24.870931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:24.887921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:24.902710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:24.905204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e211d821-3fe8-463f-9163-5e26f1fd6feb tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.291722 Sep 13 16:46:24.921870 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1931/3830] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:24 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:24.922724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:24.925170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:24.949098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:24.952500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:24.953773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:24.954841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:24.958973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:24.959943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.128592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:25.165137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-274b04b0-5ccd-464c-b429-b3dc6cbacc15 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1208 microversion: 2.1 time: 0.251994 Sep 13 16:46:25.180516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1932/3831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:24 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1208 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:25.194334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:25.195138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:25.223144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:25.230095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.231837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.237577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.239474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e472a3c5-2165-4f21-b3e4-25ec4d2e44e5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1276 microversion: 2.1 time: 0.609324 Sep 13 16:46:25.239674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.240735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.241558 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1900/3832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:24 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1276 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:25.242014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.292458 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] HTTP exception thrown: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Request method failure captured: Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a HTTP/1.1 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILMH8FTEYKk63pIwY0T4ELUDrZMerw3FqDOmQZxiuvJqtLtTAuc0yy3Yt3HJPv6i5mZeDuxv2YwgcTiDmGK4YWtYZcWKTT767PcFZqXHnaqZrEJpKypcaOE8pFGpKAF7tdgWE1ScslCtE1AjYAusRWpTHo1tLtd-DJ1_sTEr75tKnOk Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7adee868bb5465ba80c35321dd54995 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7adee868bb5465ba80c35321dd54995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7adee868bb5465ba80c35321dd54995 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachSCSIVolumeTestJSON-296901760-project Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: ffb753f45a3b4e988189cf326973120b Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-296901760-project Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3a435525-7634-4d9e-80cd-0dabbf12a21a'} Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:25.295602 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.301489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Returning 404 to user: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:25.310208 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e9e0a10-1418-4b85-a2bd-a8d78029637b tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 404 len: 111 microversion: 2.1 time: 0.116177 Sep 13 16:46:25.311688 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1933/3833] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:46:25 2022] DELETE /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:25.322031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:25.322838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] [instance: 3a435525-7634-4d9e-80cd-0dabbf12a21a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:25.332647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.336285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.336869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.338821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.339562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.346598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.371031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] HTTP exception thrown: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Request method failure captured: Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a HTTP/1.1 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILMH8FTEYKk63pIwY0T4ELUDrZMerw3FqDOmQZxiuvJqtLtTAuc0yy3Yt3HJPv6i5mZeDuxv2YwgcTiDmGK4YWtYZcWKTT767PcFZqXHnaqZrEJpKypcaOE8pFGpKAF7tdgWE1ScslCtE1AjYAusRWpTHo1tLtd-DJ1_sTEr75tKnOk Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7adee868bb5465ba80c35321dd54995 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7adee868bb5465ba80c35321dd54995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7adee868bb5465ba80c35321dd54995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7adee868bb5465ba80c35321dd54995 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-296901760 Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachSCSIVolumeTestJSON-296901760-project Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ffb753f45a3b4e988189cf326973120b Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-296901760-project Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3a435525-7634-4d9e-80cd-0dabbf12a21a'} Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:25.373008 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. Sep 13 16:46:25.377514 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:25.382902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] Returning 404 to user: Instance 3a435525-7634-4d9e-80cd-0dabbf12a21a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:25.384111 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b26fd14-251f-47d2-adb2-de878b1b408a tempest-AttachSCSIVolumeTestJSON-296901760 tempest-AttachSCSIVolumeTestJSON-296901760-project] 10.222.0.61 "GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a" status: 404 len: 111 microversion: 2.1 time: 0.066448 Sep 13 16:46:25.385374 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1901/3834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:25 2022] GET /compute/v2.1/servers/3a435525-7634-4d9e-80cd-0dabbf12a21a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:25.639432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:25.640725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:25.642763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:25.643381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:25.654475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.655279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.655908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.657081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.657608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.658148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.658597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.658805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.659329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:25.659745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:25.659886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:25.660899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.305663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.318814 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8412b7cd-31ec-40f6-b9d7-080b866a5a64 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.685390 Sep 13 16:46:26.320593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1934/3835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:25 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:26.338749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:26.339648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:26.354346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:26.355114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:26.355745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.356661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:26.365072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:26.366095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.449177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.462832 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2d52454c-fb31-43b9-9eea-68740a099bba tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.822401 Sep 13 16:46:26.465591 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1902/3836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:25 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:26.471451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:26.472292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:26.481451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:26.482326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:26.482939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.484354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:26.484990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:26.485763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.539137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.549193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.550678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.556900 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4579d4d9-ce54-46c7-9b12-2c17bc3012b0 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.235001 Sep 13 16:46:26.562064 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1935/3837] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:26 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:26.568664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:26.569602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:26.581683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:26.584384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:26.585140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.586151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:26.586854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:26.587567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:26.721024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.736128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13764961-c568-4659-92b1-36c0fa6dc088 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1270 microversion: 2.1 time: 0.269116 Sep 13 16:46:26.750696 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1903/3838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:26 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1270 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:26.833684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:26.846438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-77ceba0f-afc8-4f03-b655-2a9e41fd84c2 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.281756 Sep 13 16:46:26.850753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1936/3839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:26 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:27.363244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:27.364011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:27.383618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:27.385302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:27.388552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:27.390928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:27.391508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:27.393659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:27.496696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:27.497410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:27.511621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:27.513974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:27.515784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:27.518505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:27.519079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:27.529077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:28.200840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:28.223835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:28.581253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:28.594251 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b20b1d7-0f75-4c77-9f40-e8cf73d006f6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 1.243027 Sep 13 16:46:28.595080 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1904/3840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:27 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:28.606603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:28.607782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:28.619708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:28.620612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:28.620994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:28.625688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:28.626553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:28.627239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:28.688180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:28.701965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b00dab75-ebcc-4394-bd2b-6fcfa40ce131 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 1.215260 Sep 13 16:46:28.703340 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1937/3841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:27 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:28.711611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:28.714077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:28.727401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:28.728116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:28.729296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:28.733062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:28.733774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:28.734994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:28.803675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:28.845799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:28.847476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:28.849581 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-446dc22f-d160-474e-adce-bfc9ff866407 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.251916 Sep 13 16:46:28.857858 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1905/3842] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:28 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:28.857858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:28.857858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:28.876529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:28.880276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:28.881082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:28.882048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:28.882669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:28.883261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:29.016471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:29.028786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62f180fc-f48a-420c-80da-6ac7339d3fdb tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 0.324022 Sep 13 16:46:29.042086 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1938/3843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:28 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:29.056858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0bc3594b-b1e3-4775-bd4d-e3ff321e7c76 req-97340994-3cbe-4fcc-846e-dea6a5bb78b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e228a7f-5ea1-4292-a25f-0a1731fe5183", "tag": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:29.076971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0bc3594b-b1e3-4775-bd4d-e3ff321e7c76 req-97340994-3cbe-4fcc-846e-dea6a5bb78b6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:29.077465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0bc3594b-b1e3-4775-bd4d-e3ff321e7c76 req-97340994-3cbe-4fcc-846e-dea6a5bb78b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:29.077941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0bc3594b-b1e3-4775-bd4d-e3ff321e7c76 req-97340994-3cbe-4fcc-846e-dea6a5bb78b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:29.103199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0bc3594b-b1e3-4775-bd4d-e3ff321e7c76 req-97340994-3cbe-4fcc-846e-dea6a5bb78b6 service nova] Creating event network-changed:ae5fc826-ce3d-4e3b-bda1-1e822f52549d for instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 on n-h2-857467-1 Sep 13 16:46:29.116889 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0bc3594b-b1e3-4775-bd4d-e3ff321e7c76 req-97340994-3cbe-4fcc-846e-dea6a5bb78b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073468 Sep 13 16:46:29.118176 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1939/3844] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:29.205391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-65cdec8e-3b1f-4d68-a004-ad8e002261fa req-159f61b3-86c7-4832-b610-b6fe59a70f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e526fbc5-395c-4320-9bfb-27c0ee45dad0", "tag": "1dd558bc-05c1-4909-b04f-d53ee00f589d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:29.237266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-65cdec8e-3b1f-4d68-a004-ad8e002261fa req-159f61b3-86c7-4832-b610-b6fe59a70f5f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:29.241611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-65cdec8e-3b1f-4d68-a004-ad8e002261fa req-159f61b3-86c7-4832-b610-b6fe59a70f5f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:29.242297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-65cdec8e-3b1f-4d68-a004-ad8e002261fa req-159f61b3-86c7-4832-b610-b6fe59a70f5f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:29.265187 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-65cdec8e-3b1f-4d68-a004-ad8e002261fa req-159f61b3-86c7-4832-b610-b6fe59a70f5f service nova] Creating event network-changed:1dd558bc-05c1-4909-b04f-d53ee00f589d for instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 on n-h1-857467-1 Sep 13 16:46:29.272193 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-65cdec8e-3b1f-4d68-a004-ad8e002261fa req-159f61b3-86c7-4832-b610-b6fe59a70f5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077791 Sep 13 16:46:29.278365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1940/3845] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:29.630628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:29.632048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:29.642416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:29.652688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:29.653566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:29.654632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:29.657243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:29.660833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:29.729750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=16 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:29.773175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:29.783122 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-150e6d1e-6588-4a38-9bd0-5b0157c68a01 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.930499 Sep 13 16:46:29.786856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1906/3846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:28 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:29.797667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:29.802477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:29.814017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:29.816293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:29.818759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:29.820417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:29.822367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:29.822928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:30.039111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:30.048224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f04649b-6443-40f7-b784-3951aa7b8bf7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.423471 Sep 13 16:46:30.049201 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1941/3847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:29 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:30.056441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:30.057301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:30.084245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:30.085132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:30.085769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:30.086715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:30.087359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:30.087968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:30.176019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:30.188240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:30.190075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:30.192693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34016e48-b717-40f3-a06f-5f1139bc6040 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.141310 Sep 13 16:46:30.193854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1942/3848] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:30 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:30.201402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:30.202497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:30.212689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:30.213393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:30.214134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:30.215121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:30.216771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:30.217383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:30.422122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:30.434791 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45e2ff01-6bbc-4fbe-ae0b-94cf58c95082 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 0.239504 Sep 13 16:46:30.445301 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1943/3849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:30 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:30.579863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:30.594111 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78457ab7-ac7d-48ee-9111-ba1dcd74471a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.804552 Sep 13 16:46:30.606456 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1907/3850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:29 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:30.812595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:30.813530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:30.822124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:30.823004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:30.823604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:30.824504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:30.825118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:30.825715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.091611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:31.102358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52e7b5d8-33d3-4999-901b-d2493b3896c3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.293468 Sep 13 16:46:31.105068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:31.106159 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1944/3851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:30 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:31.106475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:31.112792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.114088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.114705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.115590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.116208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.116795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.225217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:31.226286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:31.232625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.233562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.234287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.235227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.235880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.236494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.557568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:31.581655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:31.620440 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40d1b138-0024-4c47-bd0f-6aeb84b560e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.519072 Sep 13 16:46:31.626124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1908/3852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:31 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:31.630160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:31.644015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:31.652385 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9992efe2-c49e-432d-ac10-8f36ae3d1319 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.428853 Sep 13 16:46:31.654442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:31.655786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1945/3853] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:31 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:46:31.657599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:31.679856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.681159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.681889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.683686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.684633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.685245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.786132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-291a80ab-8921-43d0-922b-4a5962b269ba req-b7ff94fa-8a7e-48ad-861a-f3a9654c4023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d8d622-9ef0-48f4-8f67-2711636701b5", "tag": "41f2305e-37c2-46f1-9e8b-23f3068347d0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:31.799111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-291a80ab-8921-43d0-922b-4a5962b269ba req-b7ff94fa-8a7e-48ad-861a-f3a9654c4023 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.800327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-291a80ab-8921-43d0-922b-4a5962b269ba req-b7ff94fa-8a7e-48ad-861a-f3a9654c4023 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.802349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-291a80ab-8921-43d0-922b-4a5962b269ba req-b7ff94fa-8a7e-48ad-861a-f3a9654c4023 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.820126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-291a80ab-8921-43d0-922b-4a5962b269ba req-b7ff94fa-8a7e-48ad-861a-f3a9654c4023 service nova] Creating event network-changed:41f2305e-37c2-46f1-9e8b-23f3068347d0 for instance 90d8d622-9ef0-48f4-8f67-2711636701b5 on n-h2-857467-1 Sep 13 16:46:31.825667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-291a80ab-8921-43d0-922b-4a5962b269ba req-b7ff94fa-8a7e-48ad-861a-f3a9654c4023 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166781 Sep 13 16:46:31.826890 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1946/3854] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:31.840766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:31.841931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:31.850307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.851526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.852171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:31.853081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:31.853716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:31.855096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:32.015582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:32.046395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20a19f15-1a88-42a9-b6f7-67e37b035e3a tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 0.412155 Sep 13 16:46:32.047679 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1909/3855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:31 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:32.141499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:32.143488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:32.153335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:32.154135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:32.154762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:32.156652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:32.157280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:32.157981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:32.262150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:32.275729 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10404563-f5aa-452a-b1ff-4ca6191e51cb tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.446769 Sep 13 16:46:32.280320 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1947/3856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:31 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:32.654069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:32.656431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:32.665751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:32.667170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:32.667849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:32.668903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:32.698291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:32.699879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:32.704462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:33.066253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:33.084184 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-395cf1a3-bd19-4f13-829d-d1cfe6b27c17 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.955836 Sep 13 16:46:33.102329 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1910/3857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:32 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:33.118848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:33.120371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:33.142753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.143632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.147406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.148569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.151856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.152608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.303720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:33.315305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:33.319639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:33.323825 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6cb5c6c-c874-4087-be44-073d6432e2f6 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.219659 Sep 13 16:46:33.329459 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1911/3858] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:33 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:33.341095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:33.343586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:33.354455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:33.356216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.357031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.359348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.362369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.363009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.363201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb98cee4-310e-41e6-bd79-135ac56049eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.713307 Sep 13 16:46:33.365061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.368465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1948/3859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:32 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:33.377756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:33.390420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:33.412976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.413512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.414021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.414748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.415215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.415658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.565023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=56 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:33.760667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:33.774367 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ac84421-6b24-4bab-8c9e-1b7745ac50af tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.404698 Sep 13 16:46:33.788443 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1949/3860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:33 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:33.875852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fb4edcc6-22ca-4b12-989c-5d09a172fdee req-cbebc13b-11e1-4c7f-ae35-5e17c2182cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868bf5b8-ad14-4833-a74e-71fdb37d1229", "tag": "0436fa78-673a-4d33-9439-458cea3d72cc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:33.902743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fb4edcc6-22ca-4b12-989c-5d09a172fdee req-cbebc13b-11e1-4c7f-ae35-5e17c2182cb6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:33.904248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fb4edcc6-22ca-4b12-989c-5d09a172fdee req-cbebc13b-11e1-4c7f-ae35-5e17c2182cb6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:33.904248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fb4edcc6-22ca-4b12-989c-5d09a172fdee req-cbebc13b-11e1-4c7f-ae35-5e17c2182cb6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:33.931203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fb4edcc6-22ca-4b12-989c-5d09a172fdee req-cbebc13b-11e1-4c7f-ae35-5e17c2182cb6 service nova] Creating event network-changed:0436fa78-673a-4d33-9439-458cea3d72cc for instance 868bf5b8-ad14-4833-a74e-71fdb37d1229 on n-h1-857467-1 Sep 13 16:46:33.937722 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fb4edcc6-22ca-4b12-989c-5d09a172fdee req-cbebc13b-11e1-4c7f-ae35-5e17c2182cb6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065861 Sep 13 16:46:33.939046 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1950/3861] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:34.115012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:34.116304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:34.133153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.133684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.134167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.134902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.135373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.135803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.246393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:34.255772 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b61aaf24-d96f-4237-9179-01bdb6a9cf59 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 0.925794 Sep 13 16:46:34.261845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1912/3862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:33 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:34.369568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:34.370478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:34.376818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.377568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.378259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.380425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.381082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.381677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.487834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:34.514608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:34.516608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:34.518037 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9edf15d-8f44-4616-86b1-709a6737e2c2 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.158967 Sep 13 16:46:34.543409 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1913/3863] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:34 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:34.549630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:34.550541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:34.560713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.561496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.562192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.563089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.563552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.564374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.652479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:34.682561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c1bfa3c-eea8-48e8-97ea-6e6c8da26b8f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.576279 Sep 13 16:46:34.699349 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1951/3864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:34 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:34.804773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:34.806614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:34.818904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.819707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.820348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.821239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:34.821898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:34.822516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:34.933934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:34.948748 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b12e362a-0c6e-4fca-bdce-fc1a8a09de40 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.403120 Sep 13 16:46:34.962993 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1914/3865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:34 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:35.218444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:35.232158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7a4e221-210c-44c7-97a4-254e6d775ef4 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.432110 Sep 13 16:46:35.232767 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1952/3866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:34 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:35.280238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:35.280940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:35.295382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.295906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.301890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.303729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.306163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.306683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.549595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:35.551311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:35.565554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.570320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.572846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.573845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.574954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.576289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.717320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:35.746372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:35.748531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:35.753268 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e0dc6bc-96c3-4387-9be2-0bce950aa178 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1605 microversion: 2.32 time: 0.208479 Sep 13 16:46:35.757372 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1953/3867] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:35 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:35.771695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:35.772333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:35.797167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.797691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.798199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.798936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.803088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.823284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.929006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:35.932447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:35.942970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ab9d155-7397-4925-b2cd-9c9f01f69e00 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 0.666037 Sep 13 16:46:35.944969 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1915/3868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:35 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:35.975415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:35.976104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:35.996006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.996629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.997100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:35.997875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:35.998356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:35.998797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.110836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:36.120179 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fdb614c1-e7ff-4f6b-a6c3-42482b62d566 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.361485 Sep 13 16:46:36.120780 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1954/3869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:35 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:36.261038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:36.261627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:36.265767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:36.268076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.269247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.270269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.271263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.271923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.272539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.280467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0fd47894-70a3-4e0f-a74b-e80dcb028b2a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.306536 Sep 13 16:46:36.281266 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1916/3870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:35 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:36.667909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:36.679940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b32321c-e59d-4536-bf36-82302216a93f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.423844 Sep 13 16:46:36.682514 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1955/3871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:36 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:36.783948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:36.784565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:36.795672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.796174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.796615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.797417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.797772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.806572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.902953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.903725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.903997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.904495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lazy-loading 'fault' on Instance uuid 8341b773-8811-490a-a75f-da1dd07dbf5b {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:46:36.975409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:36.976772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:36.987824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.989755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.990831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:36.991842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:36.992915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:36.996596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:37.017093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:37.057066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:37.057066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435b8c15842a44f2be3674fce942cb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd5c8269404586979c1009c106c0e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:37.057066 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29c67617-9e33-40e2-9728-8705e21fb284 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 200 len: 1610 microversion: 2.32 time: 0.275931 Sep 13 16:46:37.060978 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1917/3872] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:36 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 1610 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:46:37.142924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:37.150661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:37.163093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:37.163768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:37.166360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:37.167475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:37.168217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:37.173601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:37.675238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:37.695627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eef90f84-8b0d-49c6-8533-2bfc21e69209 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.556454 Sep 13 16:46:37.698458 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1918/3873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:37 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:37.706131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:37.715337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:37.724323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:37.725026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:37.725874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:37.726764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:37.727681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:37.729924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:37.984934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:37.989304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:37.994242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:38.002920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d37e2bba-b4c1-462c-a325-0222c8b69091 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.303345 Sep 13 16:46:38.010614 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1919/3874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:37 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:38.022861 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b62d6096-6223-4d83-9f0d-53f2a2f05f28 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 1.053056 Sep 13 16:46:38.034117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1956/3875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:36 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:38.040385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:38.040385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:38.058550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.059044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.059642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:38.060666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.061149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.072684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:38.126692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-14999a01-9d17-4982-8cf5-c5f26afd0231 req-559a6fc1-e1a4-4087-82bf-cb60c3c23f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e526fbc5-395c-4320-9bfb-27c0ee45dad0", "name": "network-vif-plugged", "status": "completed", "tag": "1dd558bc-05c1-4909-b04f-d53ee00f589d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:38.144234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-14999a01-9d17-4982-8cf5-c5f26afd0231 req-559a6fc1-e1a4-4087-82bf-cb60c3c23f76 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.145861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-14999a01-9d17-4982-8cf5-c5f26afd0231 req-559a6fc1-e1a4-4087-82bf-cb60c3c23f76 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.149811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-14999a01-9d17-4982-8cf5-c5f26afd0231 req-559a6fc1-e1a4-4087-82bf-cb60c3c23f76 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:38.174355 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-14999a01-9d17-4982-8cf5-c5f26afd0231 req-559a6fc1-e1a4-4087-82bf-cb60c3c23f76 service nova] Creating event network-vif-plugged:1dd558bc-05c1-4909-b04f-d53ee00f589d for instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 on n-h1-857467-1 Sep 13 16:46:38.185921 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-14999a01-9d17-4982-8cf5-c5f26afd0231 req-559a6fc1-e1a4-4087-82bf-cb60c3c23f76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173775 Sep 13 16:46:38.196125 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1920/3876] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:38.202132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:38.202859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:38.232959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.234560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.235265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:38.236236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.237093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.237637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:38.277112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] HTTP exception thrown: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Request method failure captured: Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b HTTP/1.1 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILI5jl_kxWDF5BUZnHJfk8X3KlSyMG_LCDKAyjaC_uL5m6tmJmMFnZvmE2DIpCxAyTUSyhugXN-8ZO69EtGPCZN8NRbciZ9Tr42FNxLhq9PwEkxJiDV_ZzpUX_n7wB9F52qb6UHyY7cmpmp2LKzabqlc8C945idSMjyP9mkQ7EB5eLg Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.32 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dbcd5c8269404586979c1009c106c0e0 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dbcd5c8269404586979c1009c106c0e0 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TaggedBootDevicesTest-138578346-project Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 435b8c15842a44f2be3674fce942cb3c Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TaggedBootDevicesTest-138578346-project Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8341b773-8811-490a-a75f-da1dd07dbf5b'} Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:38.279342 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:38.284392 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:38.290789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Returning 404 to user: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:38.291996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-56f1a0e7-66f3-4da2-8755-346c931a5010 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 404 len: 111 microversion: 2.32 time: 0.094502 Sep 13 16:46:38.297515 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1921/3877] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:38 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:46:38.308656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98705e02-9c84-46a0-ac2a-104b1be340cf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '.version_select at 0x7fbeb4c8a4c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:38.354618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98705e02-9c84-46a0-ac2a-104b1be340cf tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336227260" status: 204 len: 0 microversion: 2.32 time: 0.050930 Sep 13 16:46:38.355577 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1922/3878] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:46:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336227260 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:46:38.716304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:38.723961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:38.727379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:38.740161 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f73d13b8-3c89-4606-954b-ab210d7508dc tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.712090 Sep 13 16:46:38.741025 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1957/3879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:38 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:38.741421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.742173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.742627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:38.743357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:38.743822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:38.744257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:39.038777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:39.040168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:39.047896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:39.048551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:39.049069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:39.049880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:39.050646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:39.051162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:39.143092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:39.152571 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62b648f7-0215-4ee9-9a60-8fec6d676fe7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.433668 Sep 13 16:46:39.164306 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1923/3880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:38 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:39.169541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:39.170199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:39.181453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:39.181990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:39.182629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:39.183591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:39.184367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:39.184984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:39.264544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:39.275633 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a89f6741-2e33-4036-9f90-585b623bc7e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.241255 Sep 13 16:46:39.276576 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1958/3881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:39 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:39.492740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:39.506856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff9d438f-2719-4adf-9ffc-3cfdb9eed57e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1312 microversion: 2.1 time: 0.341011 Sep 13 16:46:39.508240 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1924/3882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:39 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:39.764006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:39.764645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:39.784056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:39.784572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:39.785115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:39.785854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:39.786412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:39.787083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.127201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:40.147708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a666d58-f9cd-4853-8681-3f7180298b19 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.387767 Sep 13 16:46:40.156022 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1959/3883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:39 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:40.175225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:40.175939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:40.187939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.188543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.189221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.190346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.190887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.192176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.216557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-32b14b64-f283-4653-a386-100e8a9ead78 req-384e0568-8ac6-4bd1-bad1-6ee76d24bac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e228a7f-5ea1-4292-a25f-0a1731fe5183", "name": "network-vif-plugged", "status": "completed", "tag": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:40.240278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-32b14b64-f283-4653-a386-100e8a9ead78 req-384e0568-8ac6-4bd1-bad1-6ee76d24bac2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.241694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-32b14b64-f283-4653-a386-100e8a9ead78 req-384e0568-8ac6-4bd1-bad1-6ee76d24bac2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.242472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-32b14b64-f283-4653-a386-100e8a9ead78 req-384e0568-8ac6-4bd1-bad1-6ee76d24bac2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.282392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-32b14b64-f283-4653-a386-100e8a9ead78 req-384e0568-8ac6-4bd1-bad1-6ee76d24bac2 service nova] Creating event network-vif-plugged:ae5fc826-ce3d-4e3b-bda1-1e822f52549d for instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 on n-h2-857467-1 Sep 13 16:46:40.293869 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-32b14b64-f283-4653-a386-100e8a9ead78 req-384e0568-8ac6-4bd1-bad1-6ee76d24bac2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082147 Sep 13 16:46:40.294812 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1960/3884] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:40.312779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:40.313521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:40.329025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.331289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.332387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.333913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.336348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.338440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.630606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:40.639592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ccf3e8a8-7a31-4246-b336-73fed2c6a630 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.468208 Sep 13 16:46:40.646723 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1925/3885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:40 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:40.652088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:40.666810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:40.678139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.689234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.689717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.690717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:40.691734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:40.692643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:40.969272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:40.985020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67cba433-2bca-4ab6-b124-46211618d8e2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.685810 Sep 13 16:46:40.985856 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1961/3886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:40 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:41.022034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:41.030126 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08acce28-7849-42ca-9388-7f051d9d322e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1497 microversion: 2.1 time: 0.381769 Sep 13 16:46:41.030701 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1926/3887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:40 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:41.056819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1afa2857-e4da-4d28-bc1f-a7b974ddb9b5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:41.086345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.server_groups [None req-1afa2857-e4da-4d28-bc1f-a7b974ddb9b5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Querying cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) for 1 instances {{(pid=122328) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 13 16:46:41.087321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1afa2857-e4da-4d28-bc1f-a7b974ddb9b5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.088138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1afa2857-e4da-4d28-bc1f-a7b974ddb9b5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.088768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1afa2857-e4da-4d28-bc1f-a7b974ddb9b5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.123742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1afa2857-e4da-4d28-bc1f-a7b974ddb9b5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/a1df822b-9e47-4fbb-a6a7-4fd5fabf6828" status: 200 len: 222 microversion: 2.1 time: 0.070893 Sep 13 16:46:41.132367 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1962/3888] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:46:41 2022] GET /compute/v2.1/os-server-groups/a1df822b-9e47-4fbb-a6a7-4fd5fabf6828 => generated 222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:41.146429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:41.147326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:41.155577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.156605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.157232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.158145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.158762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.159341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.172108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:41.173046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:41.183444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.184250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.187123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.188416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.192929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.194061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.237648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:46:41.368943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:41.387025 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff85264f-21a1-4c9c-932c-d2af0088bcad tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 204 len: 0 microversion: 2.1 time: 0.245119 Sep 13 16:46:41.388209 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1927/3889] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:46:41 2022] DELETE /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:46:41.401521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:41.403634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:41.414414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.415152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.416210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.417477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.418177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.418834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.446733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:41.456315 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cd7da04-dedd-4f50-8625-f7ec4b6ea7d8 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1323 microversion: 2.1 time: 0.287838 Sep 13 16:46:41.470746 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1963/3890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:41 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1323 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:41.671455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:41.672503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:41.690658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.692028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.692724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.693810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:41.694406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:41.695264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:41.875982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:41.886372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03dade59-d3c1-4102-ab3a-c2ac48815109 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1503 microversion: 2.1 time: 0.492600 Sep 13 16:46:41.888637 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1928/3891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:41 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1503 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:41.893149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:41.903320 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f77ecb43-e664-4342-a550-e4357b1cdf25 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.236356 Sep 13 16:46:41.904227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1964/3892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:41 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:42.013603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:42.014755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:42.024386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.026394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.027988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.029596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.030811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.031639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.323071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9971bd7a-1b54-4b9f-a61d-7bd856d0a073 req-d738be30-fbdf-4f40-ba67-2dba2aa77df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868bf5b8-ad14-4833-a74e-71fdb37d1229", "name": "network-vif-plugged", "status": "completed", "tag": "0436fa78-673a-4d33-9439-458cea3d72cc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:42.341790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9971bd7a-1b54-4b9f-a61d-7bd856d0a073 req-d738be30-fbdf-4f40-ba67-2dba2aa77df6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.342325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9971bd7a-1b54-4b9f-a61d-7bd856d0a073 req-d738be30-fbdf-4f40-ba67-2dba2aa77df6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.342963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9971bd7a-1b54-4b9f-a61d-7bd856d0a073 req-d738be30-fbdf-4f40-ba67-2dba2aa77df6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.357599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9971bd7a-1b54-4b9f-a61d-7bd856d0a073 req-d738be30-fbdf-4f40-ba67-2dba2aa77df6 service nova] Creating event network-vif-plugged:0436fa78-673a-4d33-9439-458cea3d72cc for instance 868bf5b8-ad14-4833-a74e-71fdb37d1229 on n-h1-857467-1 Sep 13 16:46:42.377946 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9971bd7a-1b54-4b9f-a61d-7bd856d0a073 req-d738be30-fbdf-4f40-ba67-2dba2aa77df6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058450 Sep 13 16:46:42.379482 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1965/3893] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:42.416088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:42.429698 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21eba7c2-f061-4a02-bd2c-a3cca3428498 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.420752 Sep 13 16:46:42.430844 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1929/3894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:42 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:42.481372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:42.482829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:42.510244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.512946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.514282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.521279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.522666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.523396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.912372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:42.913760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:42.929754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.930240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.930877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.932152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:42.932623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:42.933060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:42.961274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:42.976465 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-af287e86-702f-4dab-9f09-318452958948 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 200 len: 1519 microversion: 2.1 time: 0.499037 Sep 13 16:46:42.978592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1966/3895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:42 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 1519 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:42.990159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:42.992913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:43.011105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:43.012851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:43.013552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:43.015814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:43.018072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:43.019252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:43.382763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:43.396572 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d26f7eaf-d99c-4430-9d50-0f6d84b76a9e tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.416784 Sep 13 16:46:43.399673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1967/3896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:42 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:43.413371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'action', calling method: .version_select at 0x7fbeb7177790>, body: {"addFloatingIp": {"address": "172.25.7.221"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:43.418188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:43.421770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:43.428089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:43.429098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:43.429760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:43.431701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:43.433406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:43.434075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:43.448536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75039cc1-eafc-4a92-89b5-fc28178076a2 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1503 microversion: 2.1 time: 0.529710 Sep 13 16:46:43.452368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1930/3897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:42 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1503 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:43.461991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:43.467127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:43.482249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:43.485497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:43.485981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:43.487059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:43.487521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:43.487950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:43.503701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:46:43.505053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquired lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:46:44.242618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:44.260289 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-427e9707-5195-4f09-93b6-a7e8c322d685 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.805971 Sep 13 16:46:44.262402 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1931/3898] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:43 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:44.415587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c82a46c2-743d-4bb2-91a3-cdf33c5e7bdb req-9ad18629-e6db-415b-b782-be5b04ed0995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8d622-9ef0-48f4-8f67-2711636701b5", "name": "network-vif-plugged", "status": "completed", "tag": "41f2305e-37c2-46f1-9e8b-23f3068347d0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:44.443005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c82a46c2-743d-4bb2-91a3-cdf33c5e7bdb req-9ad18629-e6db-415b-b782-be5b04ed0995 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:44.444234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c82a46c2-743d-4bb2-91a3-cdf33c5e7bdb req-9ad18629-e6db-415b-b782-be5b04ed0995 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:44.444842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c82a46c2-743d-4bb2-91a3-cdf33c5e7bdb req-9ad18629-e6db-415b-b782-be5b04ed0995 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:44.457410 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c82a46c2-743d-4bb2-91a3-cdf33c5e7bdb req-9ad18629-e6db-415b-b782-be5b04ed0995 service nova] Creating event network-vif-plugged:41f2305e-37c2-46f1-9e8b-23f3068347d0 for instance 90d8d622-9ef0-48f4-8f67-2711636701b5 on n-h2-857467-1 Sep 13 16:46:44.462749 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c82a46c2-743d-4bb2-91a3-cdf33c5e7bdb req-9ad18629-e6db-415b-b782-be5b04ed0995 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050634 Sep 13 16:46:44.468038 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1932/3899] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:46:44.477353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:44.478357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:44.485483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:44.486362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:44.486990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:44.488169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:44.488902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:44.489574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:44.515438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:44.997359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:45.015466 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-185d99fc-2c9e-403b-905e-0cb4972d8257 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.545282 Sep 13 16:46:45.017275 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1933/3900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:44 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:45.027082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:45.028145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:45.038550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:45.039362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:45.040799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:45.042045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:45.043281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:45.044390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:45.388943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:45.407502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1e2e6a3-b657-4695-90db-ced3b91684d3 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1503 microversion: 2.1 time: 0.386364 Sep 13 16:46:45.411421 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1934/3901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:45 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1503 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:45.423061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:45.426926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:45.440799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:45.442464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:45.443578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:45.444811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:45.445497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:45.446012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:45.710135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:45.727848 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35bb118d-368b-4ebf-a426-5e57da65da70 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.314460 Sep 13 16:46:45.728445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1935/3902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:45 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:45.734556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5569ca4e-b181-402b-8b2a-48f5d96f3760 req-e787ebc9-0896-4a0d-a926-c65e6e8abb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e526fbc5-395c-4320-9bfb-27c0ee45dad0", "name": "network-vif-deleted", "tag": "1dd558bc-05c1-4909-b04f-d53ee00f589d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:45.758740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5569ca4e-b181-402b-8b2a-48f5d96f3760 req-e787ebc9-0896-4a0d-a926-c65e6e8abb81 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:45.759615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5569ca4e-b181-402b-8b2a-48f5d96f3760 req-e787ebc9-0896-4a0d-a926-c65e6e8abb81 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:45.760353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5569ca4e-b181-402b-8b2a-48f5d96f3760 req-e787ebc9-0896-4a0d-a926-c65e6e8abb81 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:45.779777 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5569ca4e-b181-402b-8b2a-48f5d96f3760 req-e787ebc9-0896-4a0d-a926-c65e6e8abb81 service nova] Creating event network-vif-deleted:1dd558bc-05c1-4909-b04f-d53ee00f589d for instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 on n-h1-857467-1 Sep 13 16:46:45.784772 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5569ca4e-b181-402b-8b2a-48f5d96f3760 req-e787ebc9-0896-4a0d-a926-c65e6e8abb81 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054942 Sep 13 16:46:45.785674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1936/3903] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:46.043860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:46.044659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:46.056380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.056380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.056380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.056380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.057240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.057240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.246763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:46.259433 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71dd02aa-aa1e-479c-b126-efbbcde5255d tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1318 microversion: 2.1 time: 0.220244 Sep 13 16:46:46.261277 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1937/3904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:46 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:46.274244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:46.274667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:46.283977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.284483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.285495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.286777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.287417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.287853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.309515 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] HTTP exception thrown: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Request method failure captured: Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b HTTP/1.1 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILI5jl_kxWDF5BUZnHJfk8X3KlSyMG_LCDKAyjaC_uL5m6tmJmMFnZvmE2DIpCxAyTUSyhugXN-8ZO69EtGPCZN8NRbciZ9Tr42FNxLhq9PwEkxJiDV_ZzpUX_n7wB9F52qb6UHyY7cmpmp2LKzabqlc8C945idSMjyP9mkQ7EB5eLg Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.32 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dbcd5c8269404586979c1009c106c0e0 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dbcd5c8269404586979c1009c106c0e0 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TaggedBootDevicesTest-138578346-project Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 435b8c15842a44f2be3674fce942cb3c Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TaggedBootDevicesTest-138578346-project Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8341b773-8811-490a-a75f-da1dd07dbf5b'} Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:46.311668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Returning 404 to user: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d1940e1-616d-4bf5-b101-dd42fd1bf625 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 404 len: 111 microversion: 2.32 time: 0.052711 Sep 13 16:46:46.317674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1938/3905] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:46:46 2022] DELETE /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:46:46.326213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:46.327098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] [instance: 8341b773-8811-490a-a75f-da1dd07dbf5b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:46.335636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.336325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.336842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.337796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.338387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.338881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.358008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] HTTP exception thrown: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Request method failure captured: Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b HTTP/1.1 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILI5jl_kxWDF5BUZnHJfk8X3KlSyMG_LCDKAyjaC_uL5m6tmJmMFnZvmE2DIpCxAyTUSyhugXN-8ZO69EtGPCZN8NRbciZ9Tr42FNxLhq9PwEkxJiDV_ZzpUX_n7wB9F52qb6UHyY7cmpmp2LKzabqlc8C945idSMjyP9mkQ7EB5eLg Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.32 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dbcd5c8269404586979c1009c106c0e0 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dbcd5c8269404586979c1009c106c0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dbcd5c8269404586979c1009c106c0e0 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TaggedBootDevicesTest-138578346 Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TaggedBootDevicesTest-138578346-project Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 435b8c15842a44f2be3674fce942cb3c Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TaggedBootDevicesTest-138578346-project Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8341b773-8811-490a-a75f-da1dd07dbf5b'} Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:46.359679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] Returning 404 to user: Instance 8341b773-8811-490a-a75f-da1dd07dbf5b could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:46.366369 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48a52939-476c-47cb-a8fd-6afc4b3adad8 tempest-TaggedBootDevicesTest-138578346 tempest-TaggedBootDevicesTest-138578346-project] 10.222.0.61 "GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b" status: 404 len: 111 microversion: 2.32 time: 0.043112 Sep 13 16:46:46.385812 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1939/3906] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:46:46 2022] GET /compute/v2.1/servers/8341b773-8811-490a-a75f-da1dd07dbf5b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:46:46.439483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:46.440521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:46.454698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.456046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.456676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.458589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.459097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.459462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.535068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.535815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.536503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.537170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lazy-loading 'fault' on Instance uuid e526fbc5-395c-4320-9bfb-27c0ee45dad0 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:46:46.600851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f0ae8200b64b57bf60fc4f4b9e4c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b3ce04a125495a956906486780c76c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:46.608408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c735997c-6c89-4f2d-8146-b7e519b16c5c tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 200 len: 1302 microversion: 2.1 time: 0.173402 Sep 13 16:46:46.628116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1940/3907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:46 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 1302 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:46.752792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:46.753428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:46.768827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.770231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.771083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.771948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:46.772415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:46.772916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:46.838290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Building network info cache for instance {{(pid=122328) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:46:47.105247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:47.120838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-511d6556-b35e-48cd-97f4-f4f7795e8d99 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.371745 Sep 13 16:46:47.121812 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1941/3908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:46 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:47.148001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9200547e-52e2-411b-aa24-e905fc0a71f8 req-1fdec10d-43de-40aa-8748-ccc374b22a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:47.167830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9200547e-52e2-411b-aa24-e905fc0a71f8 req-1fdec10d-43de-40aa-8748-ccc374b22a00 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.172710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9200547e-52e2-411b-aa24-e905fc0a71f8 req-1fdec10d-43de-40aa-8748-ccc374b22a00 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.173696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9200547e-52e2-411b-aa24-e905fc0a71f8 req-1fdec10d-43de-40aa-8748-ccc374b22a00 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:47.207642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9200547e-52e2-411b-aa24-e905fc0a71f8 req-1fdec10d-43de-40aa-8748-ccc374b22a00 service nova] Creating event network-changed:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:46:47.237855 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9200547e-52e2-411b-aa24-e905fc0a71f8 req-1fdec10d-43de-40aa-8748-ccc374b22a00 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110353 Sep 13 16:46:47.240158 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1942/3909] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:47.286580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:47.288043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:47.306982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.307855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.308473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:47.310748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.312804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.313369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:47.794133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:47.814854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9dfe5440-d1a2-4dfb-8a68-8d299c5aa7c7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 200 len: 1505 microversion: 2.1 time: 0.533858 Sep 13 16:46:47.830025 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1943/3910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:47 2022] GET /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:47.839733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:47.840554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:47.847038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.847825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.848452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:47.849338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.850005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.850603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:47.874229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 HTTP/1.1 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e526fbc5-395c-4320-9bfb-27c0ee45dad0'} Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:47.879830 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:47.884861 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:46:47.891292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:47.892341 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5336dfe-2da1-432f-921c-04ef366e107e tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 404 len: 111 microversion: 2.1 time: 0.061161 Sep 13 16:46:47.899194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1944/3911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:47 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:47.907170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:47.918762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 868bf5b8-ad14-4833-a74e-71fdb37d1229] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:47.926124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.926838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.927441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:47.928317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:47.938674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:47.939451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.294302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:48.310714 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff076222-eb3b-4028-affc-5430bcb9453f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/868bf5b8-ad14-4833-a74e-71fdb37d1229" status: 200 len: 1506 microversion: 2.1 time: 0.405172 Sep 13 16:46:48.311358 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1945/3912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:47 2022] GET /compute/v2.1/servers/868bf5b8-ad14-4833-a74e-71fdb37d1229 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:48.319216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2dfc766-f022-4613-9167-aa0c37408fcc tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:48.343790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Updating instance_info_cache with network_info: [{"id": "12f6ea71-466c-48bf-8c97-03a1d13a26d3", "address": "fa:16:3e:c8:48:45", "network": {"id": "de36c228-169a-4e26-92cd-cb49c35f2833", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1319757258-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67831491241246a5961d8b9c417662ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap12f6ea71-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122328) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:46:48.367355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Releasing lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:46:48.368747 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2cadc4ab-d999-4a15-9081-f4257b21ffff tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action" status: 202 len: 0 microversion: 2.1 time: 4.966686 Sep 13 16:46:48.370546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.server_groups [None req-f2dfc766-f022-4613-9167-aa0c37408fcc tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Querying cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) for 1 instances {{(pid=122327) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 13 16:46:48.372762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2dfc766-f022-4613-9167-aa0c37408fcc tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.374467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1968/3913] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:46:43 2022] POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action => generated 0 bytes in 4974 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:46:48.374741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2dfc766-f022-4613-9167-aa0c37408fcc tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.375805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2dfc766-f022-4613-9167-aa0c37408fcc tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.400720 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2dfc766-f022-4613-9167-aa0c37408fcc tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.087955 Sep 13 16:46:48.401077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:48.403032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:48.414202 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1946/3914] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:46:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:48.421300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:48.423397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 868bf5b8-ad14-4833-a74e-71fdb37d1229] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:48.427434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.428252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.428811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.429719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.432385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.433138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.436934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.439224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.442443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.443297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.443743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.444187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.501041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 868bf5b8-ad14-4833-a74e-71fdb37d1229] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:46:48.707465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c071d1f9-99cb-4164-9d40-45774f3712be tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "DELETE /compute/v2.1/servers/868bf5b8-ad14-4833-a74e-71fdb37d1229" status: 204 len: 0 microversion: 2.1 time: 0.291358 Sep 13 16:46:48.710061 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1947/3915] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:46:48 2022] DELETE /compute/v2.1/servers/868bf5b8-ad14-4833-a74e-71fdb37d1229 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:46:48.725431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.221"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:48.731585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:48.745230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.750097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.750845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.751872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:48.752549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:48.753209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:48.815511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "refresh_cache-1e228a7f-5ea1-4292-a25f-0a1731fe5183" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:46:48.817999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquired lock "refresh_cache-1e228a7f-5ea1-4292-a25f-0a1731fe5183" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:46:49.026456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:49.036769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8974743-c287-4217-a8c1-8c825a792e9e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1723 microversion: 2.1 time: 0.654632 Sep 13 16:46:49.037939 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1969/3916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:48 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1723 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:49.043238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35f67502-fed6-4836-9385-8e2c8b200fb5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.060477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.server_groups [None req-35f67502-fed6-4836-9385-8e2c8b200fb5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Querying cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) for 1 instances {{(pid=122328) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 13 16:46:49.061771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35f67502-fed6-4836-9385-8e2c8b200fb5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.062547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35f67502-fed6-4836-9385-8e2c8b200fb5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.064199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35f67502-fed6-4836-9385-8e2c8b200fb5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.077671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35f67502-fed6-4836-9385-8e2c8b200fb5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/a1df822b-9e47-4fbb-a6a7-4fd5fabf6828" status: 200 len: 184 microversion: 2.1 time: 0.038453 Sep 13 16:46:49.078396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1970/3917] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:46:49 2022] GET /compute/v2.1/os-server-groups/a1df822b-9e47-4fbb-a6a7-4fd5fabf6828 => generated 184 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:49.089467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.090058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:49.099278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.099803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.100263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.100995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.102201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.102699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.134659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 90d8d622-9ef0-48f4-8f67-2711636701b5] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:46:49.262710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:49.267792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1a67c94b-af87-40a4-b5cd-3159150ca91f tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "DELETE /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5" status: 204 len: 0 microversion: 2.1 time: 0.188149 Sep 13 16:46:49.268873 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1971/3918] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:46:49 2022] DELETE /compute/v2.1/servers/90d8d622-9ef0-48f4-8f67-2711636701b5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:46:49.288343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.290081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:49.296925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.297756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.298486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.299577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.301253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.302001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.321732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 HTTP/1.1 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e526fbc5-395c-4320-9bfb-27c0ee45dad0'} Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:49.323849 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.328125 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.330420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:49.332449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8821f026-2f8b-4c2f-8ad4-d393ac1d39c5 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 404 len: 111 microversion: 2.1 time: 0.060592 Sep 13 16:46:49.336782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1972/3919] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:46:49 2022] DELETE /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:49.342160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.343144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] [instance: e526fbc5-395c-4320-9bfb-27c0ee45dad0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:49.351351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.352252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.352935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.354066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:49.354772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:49.355479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:49.372740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 HTTP/1.1 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e526fbc5-395c-4320-9bfb-27c0ee45dad0'} Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.374492 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance e526fbc5-395c-4320-9bfb-27c0ee45dad0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:49.380632 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b69cd12f-363b-4158-b155-da80751fcfb7 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0" status: 404 len: 111 microversion: 2.1 time: 0.038084 Sep 13 16:46:49.381942 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1973/3920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:49 2022] GET /compute/v2.1/servers/e526fbc5-395c-4320-9bfb-27c0ee45dad0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:49.387324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e0ecf01-eb5c-4bf9-bf2b-9404aac5ec5f tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.394119 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4e0ecf01-eb5c-4bf9-bf2b-9404aac5ec5f tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance group c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a could not be found. Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e0ecf01-eb5c-4bf9-bf2b-9404aac5ec5f tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-server-groups/c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a HTTP/1.1 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance group c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a could not be found. Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a'} Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a could not be found. Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a could not be found. Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.405944 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a could not be found. Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e0ecf01-eb5c-4bf9-bf2b-9404aac5ec5f tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance group c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e0ecf01-eb5c-4bf9-bf2b-9404aac5ec5f tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a" status: 404 len: 117 microversion: 2.1 time: 0.025099 Sep 13 16:46:49.410940 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1974/3921] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:49 2022] DELETE /compute/v2.1/os-server-groups/c1cc9be3-4ec4-4a1e-86eb-7bd37b45e52a => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:49.416990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3308466b-cbb6-45e2-863b-2a8e1cd62529 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:49.428599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3308466b-cbb6-45e2-863b-2a8e1cd62529 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance group bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 could not be found. Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3308466b-cbb6-45e2-863b-2a8e1cd62529 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-server-groups/bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 HTTP/1.1 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance group bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 could not be found. Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361'} Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 could not be found. Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 could not be found. Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.430331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 could not be found. Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3308466b-cbb6-45e2-863b-2a8e1cd62529 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance group bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:49.434702 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3308466b-cbb6-45e2-863b-2a8e1cd62529 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361" status: 404 len: 117 microversion: 2.1 time: 0.019270 Sep 13 16:46:49.435791 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1975/3922] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:49 2022] DELETE /compute/v2.1/os-server-groups/bcfbaf97-bd3c-4ab4-8a7e-6bb8a5c78361 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:49.440891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-754182703", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d8c64b9f-3991-4e81-b7b0-379d17e2e8bb"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:49.505205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] validate_networks() for [('d8c64b9f-3991-4e81-b7b0-379d17e2e8bb', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:46:50.230646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:46:50.231095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:46:50.231587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:46:50.232203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:46:50.232954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:46:50.251945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:50.253564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:50.256187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:50.257220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:50.260193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:50.260838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:50.304225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Getting quotas for project 1d126690fdf34b20b071a80a25893169. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:46:50.320126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Getting quotas for user 71087bb4bd804ee8af20a8249aeadc1e and project 1d126690fdf34b20b071a80a25893169. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:46:50.360915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Going to run 2 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:46:50.366758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:50.461663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=63e4dd8f-7e7d-4a04-9132-76e3ba1f7096,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:46:50.600782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf9a1972-cb5c-4807-8cc1-43173654c7ed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.162464 Sep 13 16:46:50.602670 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1976/3923] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:46:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:46:50.616611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19efe7cf-3b4e-4fa9-a397-370d400e6b3b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:50.639235 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-19efe7cf-3b4e-4fa9-a397-370d400e6b3b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance group 310d0a25-3072-43e8-b4b6-368580014d7b could not be found. Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19efe7cf-3b4e-4fa9-a397-370d400e6b3b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-server-groups/310d0a25-3072-43e8-b4b6-368580014d7b HTTP/1.1 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance group 310d0a25-3072-43e8-b4b6-368580014d7b could not be found. Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '310d0a25-3072-43e8-b4b6-368580014d7b'} Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 310d0a25-3072-43e8-b4b6-368580014d7b could not be found. Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 310d0a25-3072-43e8-b4b6-368580014d7b could not be found. Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:50.651731 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:50.656946 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:50.656946 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:50.656946 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:50.656946 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:50.656946 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 310d0a25-3072-43e8-b4b6-368580014d7b could not be found. Sep 13 16:46:50.656946 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:50.686782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19efe7cf-3b4e-4fa9-a397-370d400e6b3b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance group 310d0a25-3072-43e8-b4b6-368580014d7b could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:50.687674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19efe7cf-3b4e-4fa9-a397-370d400e6b3b tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/310d0a25-3072-43e8-b4b6-368580014d7b" status: 404 len: 117 microversion: 2.1 time: 0.083951 Sep 13 16:46:50.688489 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1977/3924] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:50 2022] DELETE /compute/v2.1/os-server-groups/310d0a25-3072-43e8-b4b6-368580014d7b => generated 117 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:50.707777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:50.709544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:50.726344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:50.728048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:50.728789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:50.732435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:50.733762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:50.734448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:50.798218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:51.145674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:51.167392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e44847df-99d8-481e-bbcb-cf9580cdf7b8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1700 microversion: 2.1 time: 0.478036 Sep 13 16:46:51.167985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1978/3925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:50 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1700 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:51.190869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:51.198168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:51.199700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Searching by: {'deleted': False, 'project_id': '1d126690fdf34b20b071a80a25893169'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:46:51.267021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.268767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.270947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.273862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.282097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.286089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.399336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:46:51.490669 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7a9be1dd-7bff-450c-8de2-bceb65ce1634 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.307117 Sep 13 16:46:51.491317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1979/3926] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:46:51 2022] GET /compute/v2.1/servers => generated 1331 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:51.517898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01b92d46-a93a-4be7-bb34-088f4b737ea6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:51.532545 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-01b92d46-a93a-4be7-bb34-088f4b737ea6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] HTTP exception thrown: Instance group 6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 could not be found. Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01b92d46-a93a-4be7-bb34-088f4b737ea6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Request method failure captured: Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-server-groups/6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 HTTP/1.1 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILPXHDy8ILt13661d2qs_7XBLY_M4lveWW8h2J-dHWotdBG_vRga1PssKJRFBcQNrAb3oIa9D7HuovCCFGGTlnV5XCRlixhPWURwoO5FFGGZPGCdvCsyQFhfUJX-nC7-Ut3xoyLGIFCIKPJZABXk9YtdveP09mp8ljYPeDhbce8lv4U Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47b3ce04a125495a956906486780c76c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47b3ce04a125495a956906486780c76c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 47b3ce04a125495a956906486780c76c Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerGroupTestJSON-2108421688 Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a5f0ae8200b64b57bf60fc4f4b9e4c8c Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerGroupTestJSON-2108421688-project Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance group 6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 could not be found. Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6b0b0c0c-8e76-4ba1-9e74-f531148d6c48'} Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 could not be found. Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 could not be found. Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:51.541430 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:46:51.548450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:46:51.548450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:46:51.548450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:46:51.548450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:46:51.548450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 could not be found. Sep 13 16:46:51.548450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:46:51.550428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01b92d46-a93a-4be7-bb34-088f4b737ea6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Returning 404 to user: Instance group 6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:46:51.551759 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-01b92d46-a93a-4be7-bb34-088f4b737ea6 tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/6b0b0c0c-8e76-4ba1-9e74-f531148d6c48" status: 404 len: 117 microversion: 2.1 time: 0.047082 Sep 13 16:46:51.558650 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1980/3927] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:51 2022] DELETE /compute/v2.1/os-server-groups/6b0b0c0c-8e76-4ba1-9e74-f531148d6c48 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:46:51.566947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19c9aac4-bc8c-43d4-a737-359e201c8b1a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:51.603892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19c9aac4-bc8c-43d4-a737-359e201c8b1a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.604348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19c9aac4-bc8c-43d4-a737-359e201c8b1a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.604767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19c9aac4-bc8c-43d4-a737-359e201c8b1a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.664106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19c9aac4-bc8c-43d4-a737-359e201c8b1a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Going to try to start instance {{(pid=122328) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 16:46:51.802368 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19c9aac4-bc8c-43d4-a737-359e201c8b1a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action" status: 202 len: 0 microversion: 2.1 time: 0.240231 Sep 13 16:46:51.805900 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1981/3928] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:46:51 2022] POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:46:51.829804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1a3f17df-2f63-4dce-8784-2ddee4c6abf1 req-8b515b76-91de-4dee-8dea-46badc646e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868bf5b8-ad14-4833-a74e-71fdb37d1229", "name": "network-vif-deleted", "tag": "0436fa78-673a-4d33-9439-458cea3d72cc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:51.872623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a3f17df-2f63-4dce-8784-2ddee4c6abf1 req-8b515b76-91de-4dee-8dea-46badc646e89 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:51.873313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a3f17df-2f63-4dce-8784-2ddee4c6abf1 req-8b515b76-91de-4dee-8dea-46badc646e89 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:51.873996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a3f17df-2f63-4dce-8784-2ddee4c6abf1 req-8b515b76-91de-4dee-8dea-46badc646e89 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:51.889762 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1a3f17df-2f63-4dce-8784-2ddee4c6abf1 req-8b515b76-91de-4dee-8dea-46badc646e89 service nova] Creating event network-vif-deleted:0436fa78-673a-4d33-9439-458cea3d72cc for instance 868bf5b8-ad14-4833-a74e-71fdb37d1229 on n-h1-857467-1 Sep 13 16:46:51.896032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1a3f17df-2f63-4dce-8784-2ddee4c6abf1 req-8b515b76-91de-4dee-8dea-46badc646e89 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087122 Sep 13 16:46:51.897014 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1982/3929] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:51.904424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a812f3e0-1b7c-4dc7-91f2-9ea6d2570c74 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:51.905963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a812f3e0-1b7c-4dc7-91f2-9ea6d2570c74 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:52.016837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a812f3e0-1b7c-4dc7-91f2-9ea6d2570c74 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:52.033744 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a812f3e0-1b7c-4dc7-91f2-9ea6d2570c74 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1217 microversion: 2.1 time: 0.135136 Sep 13 16:46:52.038138 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1983/3930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:51 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:52.054164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58729282-28f3-4aa8-81d7-3fde6fbf677d tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:52.105092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58729282-28f3-4aa8-81d7-3fde6fbf677d tempest-ServerGroupTestJSON-2108421688 tempest-ServerGroupTestJSON-2108421688-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/a1df822b-9e47-4fbb-a6a7-4fd5fabf6828" status: 204 len: 0 microversion: 2.1 time: 0.065309 Sep 13 16:46:52.106459 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1984/3931] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Sep 13 16:46:52 2022] DELETE /compute/v2.1/os-server-groups/a1df822b-9e47-4fbb-a6a7-4fd5fabf6828 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:46:52.132427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:52.135042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:52.153943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:52.155336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:52.157304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:52.159597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:52.163542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:52.164877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.127921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:53.155085 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d8aeb4b9-57cb-482a-97a7-24eaca165797 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1709 microversion: 2.1 time: 1.046911 Sep 13 16:46:53.172963 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1985/3932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:52 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1709 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:53.185267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:53.186209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:53.210296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.211183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.211810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.212712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:53.213343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:53.213970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:53.361469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:53.379470 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19601a6f-4e5c-43bd-9dd3-fac77b440775 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1269 microversion: 2.1 time: 0.204768 Sep 13 16:46:53.393867 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1986/3933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:53 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1269 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:54.183298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:54.184670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:54.201580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:54.202422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:54.203039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:54.203932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:54.204577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:54.205195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.004295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:55.022394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-da2740fe-b29f-4ab3-a702-104dadd7ab43 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1709 microversion: 2.1 time: 0.842902 Sep 13 16:46:55.022998 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1987/3934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:54 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1709 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:55.028015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:55.038419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:55.045396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:55.045812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:55.046478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.047419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:55.047871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:55.058221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:55.148562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:55.160743 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e9f9e6e5-e841-4975-8ec4-13e64a623b37 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1275 microversion: 2.1 time: 0.135772 Sep 13 16:46:55.166665 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1988/3935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:55 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:56.055351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:56.055984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:56.067664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.068166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.068621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.079017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.079527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.079989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.484850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:56.493718 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a615025-1997-40a8-b340-c600bf33cd85 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1713 microversion: 2.1 time: 0.448951 Sep 13 16:46:56.506207 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1989/3936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:56 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1713 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:46:56.511845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:56.512894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:56.523345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.525149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.537129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.539715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.542234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.542716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.680644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:56.695373 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b1e8ceb-34f0-43fc-984d-f29cab9cd15c tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1275 microversion: 2.1 time: 0.183029 Sep 13 16:46:56.696648 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1990/3937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:56 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:46:56.705365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d5b0a175-6e3e-4805-bd27-c87971943ce8 req-70765888-28e1-4ebd-8e6c-2afb8413c1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d8d622-9ef0-48f4-8f67-2711636701b5", "name": "network-vif-deleted", "tag": "41f2305e-37c2-46f1-9e8b-23f3068347d0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:46:56.732276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d5b0a175-6e3e-4805-bd27-c87971943ce8 req-70765888-28e1-4ebd-8e6c-2afb8413c1bd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:56.732764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d5b0a175-6e3e-4805-bd27-c87971943ce8 req-70765888-28e1-4ebd-8e6c-2afb8413c1bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:56.738838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d5b0a175-6e3e-4805-bd27-c87971943ce8 req-70765888-28e1-4ebd-8e6c-2afb8413c1bd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:56.765469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d5b0a175-6e3e-4805-bd27-c87971943ce8 req-70765888-28e1-4ebd-8e6c-2afb8413c1bd service nova] Creating event network-vif-deleted:41f2305e-37c2-46f1-9e8b-23f3068347d0 for instance 90d8d622-9ef0-48f4-8f67-2711636701b5 on n-h2-857467-1 Sep 13 16:46:56.776146 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d5b0a175-6e3e-4805-bd27-c87971943ce8 req-70765888-28e1-4ebd-8e6c-2afb8413c1bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078006 Sep 13 16:46:56.781489 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1991/3938] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:46:57.731652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:46:57.736982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:46:57.748787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:57.749678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:57.759436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:57.760615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:46:57.761294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:46:57.762045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:46:58.749378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=52 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:58.805026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:46:59.622320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:46:59.653725 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ee99d85-4ae7-4f64-a175-cd2aac7936b3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 1.927573 Sep 13 16:46:59.656390 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1992/3939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:46:57 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:47:00.704808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:00.707678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:00.721784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:00.723555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:00.726522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:00.727839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:00.728789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:00.729733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:01.112676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:01.125529 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2259da24-fe5d-4d0e-8928-fd8d05f6ef55 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.446312 Sep 13 16:47:01.134560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1993/3940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:00 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:01.896448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a28f46da-ec75-49e4-adf1-df2eef31185a req-5aa6d904-65f5-4014-afe6-781f879a7fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:01.903054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:01.923802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a28f46da-ec75-49e4-adf1-df2eef31185a req-5aa6d904-65f5-4014-afe6-781f879a7fe5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:01.924484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a28f46da-ec75-49e4-adf1-df2eef31185a req-5aa6d904-65f5-4014-afe6-781f879a7fe5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:01.925045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a28f46da-ec75-49e4-adf1-df2eef31185a req-5aa6d904-65f5-4014-afe6-781f879a7fe5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:01.950903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a28f46da-ec75-49e4-adf1-df2eef31185a req-5aa6d904-65f5-4014-afe6-781f879a7fe5 service nova] Creating event network-changed:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:47:01.967530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a28f46da-ec75-49e4-adf1-df2eef31185a req-5aa6d904-65f5-4014-afe6-781f879a7fe5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075740 Sep 13 16:47:01.970381 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1994/3941] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:02.156101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:02.157213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:02.159608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:02.169858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:02.179916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:02.180565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:02.181467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:02.183755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:02.184523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:02.218977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.network.neutron [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] re-assign floating IP 172.25.7.221 from instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd Sep 13 16:47:02.321074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Building network info cache for instance {{(pid=122327) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:47:03.499639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:03.524497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a56231b9-ae84-4405-ba2d-41ba80b46962 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 1.373000 Sep 13 16:47:03.564597 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1995/3942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:02 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:04.031061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e228a7f-5ea1-4292-a25f-0a1731fe5183", "tag": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d"}, {"name": "network-changed", "server_uuid": "63e4dd8f-7e7d-4a04-9132-76e3ba1f7096", "tag": "229fe924-4f86-4dfe-8c07-6dc7339d54bc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:04.057049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.058386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.063109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:04.094414 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] Creating event network-changed:ae5fc826-ce3d-4e3b-bda1-1e822f52549d for instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 on n-h2-857467-1 Sep 13 16:47:04.104136 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] Creating event network-changed:229fe924-4f86-4dfe-8c07-6dc7339d54bc for instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 on n-h1-857467-1 Sep 13 16:47:04.119212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e2bc7553-8f7b-42ea-8b9c-caca47b88d2b req-c90f7c23-3ece-48fd-ba76-d3a534be9f3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089836 Sep 13 16:47:04.120258 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1996/3943] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:04.586384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:04.587872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:04.606416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.607826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.609119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:04.612222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:04.613854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:04.614803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:05.216613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:05.229183 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-181f9a4f-c9cc-4f0c-952f-0500fed27653 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.648010 Sep 13 16:47:05.230577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1997/3944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:04 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:47:06.211741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Updating instance_info_cache with network_info: [{"id": "12f6ea71-466c-48bf-8c97-03a1d13a26d3", "address": "fa:16:3e:c8:48:45", "network": {"id": "de36c228-169a-4e26-92cd-cb49c35f2833", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1319757258-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67831491241246a5961d8b9c417662ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap12f6ea71-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:47:06.220360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Building network info cache for instance {{(pid=122327) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:47:06.252734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:06.253968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:06.267416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:06.268178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:06.268920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:06.271218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:06.271711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:06.272340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:06.559078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:06.572259 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90210efa-b67b-4b16-8aa7-41316db25af0 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.323487 Sep 13 16:47:06.573605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1998/3945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:06 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:06.672287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2d404efb-19dc-4c00-9f81-379ab9ed3b9c req-033f3332-6b22-4611-a5c6-2e5acc740f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bf0988-cfc9-487e-928e-b545ad9f33d1", "tag": "06b6e3b9-fdb1-448e-b59b-9d2c74ae9576"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:06.687607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2d404efb-19dc-4c00-9f81-379ab9ed3b9c req-033f3332-6b22-4611-a5c6-2e5acc740f98 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:06.700770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2d404efb-19dc-4c00-9f81-379ab9ed3b9c req-033f3332-6b22-4611-a5c6-2e5acc740f98 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:06.702144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2d404efb-19dc-4c00-9f81-379ab9ed3b9c req-033f3332-6b22-4611-a5c6-2e5acc740f98 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:06.721220 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2d404efb-19dc-4c00-9f81-379ab9ed3b9c req-033f3332-6b22-4611-a5c6-2e5acc740f98 service nova] Creating event network-changed:06b6e3b9-fdb1-448e-b59b-9d2c74ae9576 for instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 on n-h2-857467-1 Sep 13 16:47:06.728941 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2d404efb-19dc-4c00-9f81-379ab9ed3b9c req-033f3332-6b22-4611-a5c6-2e5acc740f98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060309 Sep 13 16:47:06.729928 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 1999/3946] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:07.127510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1efd91a-32bf-42d1-8563-7af843f2e7d1 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Calling method '.version_select at 0x7fbeb4aa0670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:07.559020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1efd91a-32bf-42d1-8563-7af843f2e7d1 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.640551 Sep 13 16:47:07.569062 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2000/3947] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:47:06 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:47:07.577317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc64fd97-ede3-4138-be2f-74c61a9c4095 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Action: 'create', calling method: .version_select at 0x7fbeb4715af0>, body: {"pool": "non_exist_pool"} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:07.697100 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-bc64fd97-ede3-4138-be2f-74c61a9c4095 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] HTTP exception thrown: Floating IP pool not found. Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc64fd97-ede3-4138-be2f-74c61a9c4095 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Request method failure captured: Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 26 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILQKK5d47PTgapKGEdovjETnA-WBdqyBKEVE5gMYJX1rp6i3zxrXfIBthzLlXpEH4fcppSWxRaJtPkaCxLQHF57THxeYtoMyCNp52PYjmHLLyNBAHAU5MDh8iYtNo7jkM18xEckmqTrw7FWd9ao19Xb-zhOd-3JvicdPvpQIc3uLay4 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 55486a1cedc3481b807d9f6b93641680 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1334489021 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55486a1cedc3481b807d9f6b93641680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55486a1cedc3481b807d9f6b93641680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55486a1cedc3481b807d9f6b93641680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55486a1cedc3481b807d9f6b93641680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1334489021 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 55486a1cedc3481b807d9f6b93641680 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1334489021 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsNegativeTestJSON-1334489021-project Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 9156ac26e28747739c1f54c7ad1159f8 Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1334489021-project Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: {"pool": "non_exist_pool"} Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: exception: Floating IP pool not found. Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:07.699663 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:07.708831 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 13 16:47:07.708831 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:07.712668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc64fd97-ede3-4138-be2f-74c61a9c4095 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Returning 404 to user: Floating IP pool not found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:07.713856 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc64fd97-ede3-4138-be2f-74c61a9c4095 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.143108 Sep 13 16:47:07.715520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2001/3948] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:47:07 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:47:07.729183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:07.730252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:07.744030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:07.745142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:07.745751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:07.747115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:07.748460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:07.749279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:07.756842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:08.075681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:08.087445 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6546eb7-40dd-41ec-b81a-d0f7124c32c5 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.370642 Sep 13 16:47:08.089433 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2002/3949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:07 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:08.095199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f79fb8d-a7ec-4d2a-9562-6365529c2c08 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Calling method '.version_select at 0x7fbeb4b0dc10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:08.161067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG neutronclient.v2_0.client [None req-5f79fb8d-a7ec-4d2a-9562-6365529c2c08 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 could not be found", "detail": ""}} {{(pid=122328) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:47:08.162084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-5f79fb8d-a7ec-4d2a-9562-6365529c2c08 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] HTTP exception thrown: Floating IP not found for ID a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f79fb8d-a7ec-4d2a-9562-6365529c2c08 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Request method failure captured: Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-floating-ips/a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 HTTP/1.1 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILQKK5d47PTgapKGEdovjETnA-WBdqyBKEVE5gMYJX1rp6i3zxrXfIBthzLlXpEH4fcppSWxRaJtPkaCxLQHF57THxeYtoMyCNp52PYjmHLLyNBAHAU5MDh8iYtNo7jkM18xEckmqTrw7FWd9ao19Xb-zhOd-3JvicdPvpQIc3uLay4 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 55486a1cedc3481b807d9f6b93641680 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1334489021 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55486a1cedc3481b807d9f6b93641680"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55486a1cedc3481b807d9f6b93641680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55486a1cedc3481b807d9f6b93641680"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55486a1cedc3481b807d9f6b93641680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1334489021 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 55486a1cedc3481b807d9f6b93641680 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1334489021 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsNegativeTestJSON-1334489021-project Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 9156ac26e28747739c1f54c7ad1159f8 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1334489021-project Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: exception: Floating IP not found for ID a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61'} Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 could not be found Sep 13 16:47:08.167201 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd279031-2017-4e1a-a27d-aa6645119199'] Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61. Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f79fb8d-a7ec-4d2a-9562-6365529c2c08 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] Returning 404 to user: Floating IP not found for ID a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f79fb8d-a7ec-4d2a-9562-6365529c2c08 tempest-FloatingIPsNegativeTestJSON-1334489021 tempest-FloatingIPsNegativeTestJSON-1334489021-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61" status: 404 len: 111 microversion: 2.1 time: 0.078085 Sep 13 16:47:08.175634 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2003/3950] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:47:08 2022] DELETE /compute/v2.1/os-floating-ips/a757aac0-a1ce-4e1b-ba8f-0dd88d71bb61 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:08.663019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Updating instance_info_cache with network_info: [{"id": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d", "address": "fa:16:3e:71:c2:25", "network": {"id": "de36c228-169a-4e26-92cd-cb49c35f2833", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1319757258-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67831491241246a5961d8b9c417662ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapae5fc826-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:47:08.675419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Releasing lock "refresh_cache-1e228a7f-5ea1-4292-a25f-0a1731fe5183" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:47:08.677652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca0e8eaa-08ea-40a0-9e63-a884c8dc3d8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183/action" status: 202 len: 0 microversion: 2.1 time: 19.962769 Sep 13 16:47:08.680208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1948/3951] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:46:48 2022] POST /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183/action => generated 0 bytes in 19969 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:47:08.697359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.221"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:09.066639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:09.073343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:09.073863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:09.074318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:09.075044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:09.075521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:09.075959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:09.118214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:09.118938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:09.152880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:09.154048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:09.154951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:09.156264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:09.157049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:09.157588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:09.598112 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] HTTP exception thrown: Floating IP 172.25.7.221 is not associated with instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd. Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Request method failure captured: Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action HTTP/1.1 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 49 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILO4fcJL_ktWI9nTGPGZIyol6w-I08PsZaOnje6H491j_ZzMw-YzSLKEMv37iBKP8tVuee39LrdHfBYnppMtrRB7VuAzEyr4LBgEtiEP99gyy_se5gn9tEHGAe0BqfTp7CYREqJqblnnD21cy7nR_nizqXzELEsp5tXkw0ir4S4YRHc Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67831491241246a5961d8b9c417662ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 20ecc8b135b34ef89a828f600a534e2c Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: {"removeFloatingIp": {"address": "172.25.7.221"}} Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: exception: Floating IP 172.25.7.221 is not associated with instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd. Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '900d3791-ef2c-42dd-9229-15cd3c67bbcd', 'body': {'removeFloatingIp': {'address': '172.25.7.221'}}} Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.221 is not associated with instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd. Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.221 is not associated with instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd. Sep 13 16:47:09.600822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:09.608559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Returning 409 to user: Floating IP 172.25.7.221 is not associated with instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:09.610536 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d12e634d-e026-4c2f-8319-dd5564675f0e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action" status: 409 len: 146 microversion: 2.1 time: 0.926448 Sep 13 16:47:09.614628 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2004/3952] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:47:08 2022] POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action => generated 146 bytes in 931 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:47:09.627554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.221"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:09.847919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:09.882427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-45dcbc6f-b66a-46e6-9278-2057c66176a3 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.770043 Sep 13 16:47:09.886527 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1949/3953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:09 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:09.900176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:09.908246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:09.910875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:09.911329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:09.912126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:09.912537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:09.912974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:10.393811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "refresh_cache-1e228a7f-5ea1-4292-a25f-0a1731fe5183" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:47:10.394853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquired lock "refresh_cache-1e228a7f-5ea1-4292-a25f-0a1731fe5183" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:47:10.908959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:10.910135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:10.930051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:10.930555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:10.930994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:10.931715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:10.932225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:10.932583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:12.649328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Building network info cache for instance {{(pid=122328) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:47:13.031735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:13.039910 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a5bf155-4d0f-42e4-9e42-07ee3bfd1ba1 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 2.135022 Sep 13 16:47:13.040503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1950/3954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:10 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:47:13.058462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2b691b7a-0dab-4ec8-a7b3-d255fffdaa1a req-b1da8322-3bdc-4055-8c70-c7c2544fafe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e228a7f-5ea1-4292-a25f-0a1731fe5183", "tag": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:13.079427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2b691b7a-0dab-4ec8-a7b3-d255fffdaa1a req-b1da8322-3bdc-4055-8c70-c7c2544fafe6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:13.079937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2b691b7a-0dab-4ec8-a7b3-d255fffdaa1a req-b1da8322-3bdc-4055-8c70-c7c2544fafe6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:13.088630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2b691b7a-0dab-4ec8-a7b3-d255fffdaa1a req-b1da8322-3bdc-4055-8c70-c7c2544fafe6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:13.127478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2b691b7a-0dab-4ec8-a7b3-d255fffdaa1a req-b1da8322-3bdc-4055-8c70-c7c2544fafe6 service nova] Creating event network-changed:ae5fc826-ce3d-4e3b-bda1-1e822f52549d for instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 on n-h2-857467-1 Sep 13 16:47:13.146858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2b691b7a-0dab-4ec8-a7b3-d255fffdaa1a req-b1da8322-3bdc-4055-8c70-c7c2544fafe6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105093 Sep 13 16:47:13.149408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1951/3955] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:14.078227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:14.080347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:14.088514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:14.095675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:14.096510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:14.099239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:14.102150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:14.102904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:14.583032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Updating instance_info_cache with network_info: [{"id": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d", "address": "fa:16:3e:71:c2:25", "network": {"id": "de36c228-169a-4e26-92cd-cb49c35f2833", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1319757258-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67831491241246a5961d8b9c417662ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapae5fc826-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122328) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:47:14.608920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Releasing lock "refresh_cache-1e228a7f-5ea1-4292-a25f-0a1731fe5183" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:47:14.613982 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f4e1320-797d-4e45-bcc8-26534a13953a tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183/action" status: 202 len: 0 microversion: 2.1 time: 4.990968 Sep 13 16:47:14.614728 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2005/3956] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:47:09 2022] POST /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183/action => generated 0 bytes in 4996 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:47:14.626340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:14.638179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:14.664644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:14.666211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:14.667302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:14.668429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:14.669076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:14.669685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:14.764195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:47:14.897995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e75cd040-7507-4615-a723-e7a301cc92c3 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 204 len: 0 microversion: 2.1 time: 0.277845 Sep 13 16:47:14.899374 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2006/3957] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:47:14 2022] DELETE /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:14.918316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.221"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:14.921666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:14.928702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:14.930731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:14.931541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:14.932451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:14.933379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:14.934115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:14.934781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:14.986971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:47:14.987550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquired lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:47:15.174868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:15.187727 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9767d402-8c4d-4ed7-893a-f9c3c3ad398a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 1.118018 Sep 13 16:47:15.188954 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1952/3958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:14 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:15.362640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:15.368462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:15.374064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Searching by: {'deleted': False, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:47:15.387687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:15.388119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:15.388570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:15.389479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:15.390040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:15.391580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:15.467036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:47:15.516690 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4904a9f2-fa17-4512-90a2-b265447a378d tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.158540 Sep 13 16:47:15.532344 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1953/3959] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:47:15 2022] GET /compute/v2.1/servers => generated 339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:15.537629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:15.544460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:15.545502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Searching by: {'deleted': False, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:47:15.552247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:15.552748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:15.553194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:15.554005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:15.554477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:15.554912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:15.618607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:47:15.689813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:15.714944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:15.716194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:15.716820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:16.186060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b94ac04d-459b-48b1-88a0-e8fe6f97f7a5 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.652294 Sep 13 16:47:16.187381 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1954/3960] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:47:15 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:16.198154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-61a245a1-07b7-4033-b2e2-2f9f480ae40d req-6cc7baeb-8f41-4dda-a724-ab76dcfcaad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e4dd8f-7e7d-4a04-9132-76e3ba1f7096", "name": "network-vif-plugged", "status": "completed", "tag": "229fe924-4f86-4dfe-8c07-6dc7339d54bc"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:16.214270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-61a245a1-07b7-4033-b2e2-2f9f480ae40d req-6cc7baeb-8f41-4dda-a724-ab76dcfcaad2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:16.215135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-61a245a1-07b7-4033-b2e2-2f9f480ae40d req-6cc7baeb-8f41-4dda-a724-ab76dcfcaad2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:16.215653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-61a245a1-07b7-4033-b2e2-2f9f480ae40d req-6cc7baeb-8f41-4dda-a724-ab76dcfcaad2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:16.228189 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-61a245a1-07b7-4033-b2e2-2f9f480ae40d req-6cc7baeb-8f41-4dda-a724-ab76dcfcaad2 service nova] Creating event network-vif-plugged:229fe924-4f86-4dfe-8c07-6dc7339d54bc for instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 on n-h1-857467-1 Sep 13 16:47:16.233670 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-61a245a1-07b7-4033-b2e2-2f9f480ae40d req-6cc7baeb-8f41-4dda-a724-ab76dcfcaad2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044943 Sep 13 16:47:16.235178 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1955/3961] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:16.242193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7622b0e4-9165-4f49-b30c-7331695f0218 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:16.250599 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7622b0e4-9165-4f49-b30c-7331695f0218 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013665 Sep 13 16:47:16.251338 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1956/3962] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:47:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:16.256524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:16.257726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:16.264770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:16.265607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:16.266160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:16.267162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:16.267755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:16.268337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:16.897427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:16.957747 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-23b71030-b78e-4cd5-a954-98e1ee37c177 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.703790 Sep 13 16:47:16.958575 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1957/3963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:16 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:16.996231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:17.007024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:17.019596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:17.020155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:17.020873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:17.033121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:17.034001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:17.034340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:17.070422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:47:17.202028 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c4cb65a-cbef-4430-b27c-22cfd332f80e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 204 len: 0 microversion: 2.1 time: 0.220792 Sep 13 16:47:17.202843 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1958/3964] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:47:16 2022] DELETE /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:17.214784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:17.216200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:17.225472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:17.226226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:17.227447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:17.229396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:17.230244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:17.231623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:17.612674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:17.674387 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99ee09b3-37eb-4073-ac4b-8224b5c104d2 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1715 microversion: 2.1 time: 0.436544 Sep 13 16:47:17.676527 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1959/3965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:17 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1715 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:17.987035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:17.988861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:18.001490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:18.003092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:18.005408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:18.006645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:18.009491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:18.010165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:18.523863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:18.555058 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7cf9a91b-dff7-4ae4-990a-89a99e1a4aed tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.567720 Sep 13 16:47:18.556464 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1960/3966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:17 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:18.573205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-99fe4630-6644-48b3-9d3b-168ccc310cf4 req-f17c8ccb-da11-4c0b-bb03-383d3fd640ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62bf0988-cfc9-487e-928e-b545ad9f33d1", "name": "network-vif-plugged", "status": "completed", "tag": "06b6e3b9-fdb1-448e-b59b-9d2c74ae9576"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:18.605944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-99fe4630-6644-48b3-9d3b-168ccc310cf4 req-f17c8ccb-da11-4c0b-bb03-383d3fd640ff service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:18.606553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-99fe4630-6644-48b3-9d3b-168ccc310cf4 req-f17c8ccb-da11-4c0b-bb03-383d3fd640ff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:18.607636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-99fe4630-6644-48b3-9d3b-168ccc310cf4 req-f17c8ccb-da11-4c0b-bb03-383d3fd640ff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:18.633042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-99fe4630-6644-48b3-9d3b-168ccc310cf4 req-f17c8ccb-da11-4c0b-bb03-383d3fd640ff service nova] Creating event network-vif-plugged:06b6e3b9-fdb1-448e-b59b-9d2c74ae9576 for instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 on n-h2-857467-1 Sep 13 16:47:18.641069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-99fe4630-6644-48b3-9d3b-168ccc310cf4 req-f17c8ccb-da11-4c0b-bb03-383d3fd640ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081957 Sep 13 16:47:18.642744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1961/3967] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:18.706092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:18.707738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:18.717768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:18.718657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:18.719288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:18.722778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:18.723509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:18.724138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:19.185591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Building network info cache for instance {{(pid=122328) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:47:19.638326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:19.647745 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e928877-a1e4-4230-b458-30d251ddd2df tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1715 microversion: 2.1 time: 0.947745 Sep 13 16:47:19.652301 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1962/3968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:18 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1715 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:19.658254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a96fb797-7a08-4039-83ac-4d6adbdf7f2c req-2d3e74ae-9e9a-40ba-85b5-00dea605da0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e228a7f-5ea1-4292-a25f-0a1731fe5183", "name": "network-vif-deleted", "tag": "ae5fc826-ce3d-4e3b-bda1-1e822f52549d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:19.685995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a96fb797-7a08-4039-83ac-4d6adbdf7f2c req-2d3e74ae-9e9a-40ba-85b5-00dea605da0e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:19.690515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a96fb797-7a08-4039-83ac-4d6adbdf7f2c req-2d3e74ae-9e9a-40ba-85b5-00dea605da0e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:19.691275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a96fb797-7a08-4039-83ac-4d6adbdf7f2c req-2d3e74ae-9e9a-40ba-85b5-00dea605da0e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:19.713401 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a96fb797-7a08-4039-83ac-4d6adbdf7f2c req-2d3e74ae-9e9a-40ba-85b5-00dea605da0e service nova] Creating event network-vif-deleted:ae5fc826-ce3d-4e3b-bda1-1e822f52549d for instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 on n-h2-857467-1 Sep 13 16:47:19.735994 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a96fb797-7a08-4039-83ac-4d6adbdf7f2c req-2d3e74ae-9e9a-40ba-85b5-00dea605da0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081137 Sep 13 16:47:19.760121 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1963/3969] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:19.765702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:19.770776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:19.793811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:19.795291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:19.796292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:19.797938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:19.806236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:19.807046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:19.812981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:20.477164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:20.490013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9d54b3e-06f3-4bb0-9c75-ec86d5eccaf7 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1317 microversion: 2.1 time: 0.728258 Sep 13 16:47:20.505907 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1964/3970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:19 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:20.679489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:20.680188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:20.696693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:20.697378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:20.702923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:20.707020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:20.707527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:20.710551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:21.355042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:21.366968 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27c3d2dc-14dd-4b8d-95da-8b8bad8b84bc tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1715 microversion: 2.1 time: 0.692307 Sep 13 16:47:21.371296 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1965/3971] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:20 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1715 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:21.389608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-023ca690-3039-4d13-8700-a33013165583 req-8f83d732-2071-41df-98fc-452172080ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec311cf7-6f46-495d-80d1-20502b938058", "name": "network-vif-unplugged", "status": "completed", "tag": "11069db3-4dff-4247-9982-c890ada7e407"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:21.415962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-023ca690-3039-4d13-8700-a33013165583 req-8f83d732-2071-41df-98fc-452172080ce3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:21.419928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-023ca690-3039-4d13-8700-a33013165583 req-8f83d732-2071-41df-98fc-452172080ce3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:21.420629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-023ca690-3039-4d13-8700-a33013165583 req-8f83d732-2071-41df-98fc-452172080ce3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:21.444576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Updating instance_info_cache with network_info: [{"id": "12f6ea71-466c-48bf-8c97-03a1d13a26d3", "address": "fa:16:3e:c8:48:45", "network": {"id": "de36c228-169a-4e26-92cd-cb49c35f2833", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1319757258-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67831491241246a5961d8b9c417662ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap12f6ea71-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122328) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:47:21.451144 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-023ca690-3039-4d13-8700-a33013165583 req-8f83d732-2071-41df-98fc-452172080ce3 service nova] Creating event network-vif-unplugged:11069db3-4dff-4247-9982-c890ada7e407 for instance ec311cf7-6f46-495d-80d1-20502b938058 on n-h2-857467-1 Sep 13 16:47:21.456785 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-023ca690-3039-4d13-8700-a33013165583 req-8f83d732-2071-41df-98fc-452172080ce3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082733 Sep 13 16:47:21.459844 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1966/3972] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:21.466301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Releasing lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:47:21.470068 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b86e8d18-122b-4c10-965b-8b85e4e16bbd tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action" status: 202 len: 0 microversion: 2.1 time: 6.560103 Sep 13 16:47:21.470068 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2007/3973] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:47:14 2022] POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action => generated 0 bytes in 6562 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:47:21.477574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-466e8533-c43a-4c1e-a258-1cbb08e8ec43 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '.version_select at 0x7fbeb95d1700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:21.706124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07774f99-b5b3-42cb-95d3-520cbdd52d63 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb4ba8d30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp7VTY/YVkVkxL7Fhw9OzHcs3xPtBTModxTc1yIQ94+bmcWNuQ0GxmMi3HidmKKucdcNJl7BW+NjPI65e3yWfmd5KiRvrV75ljU+VgSyPrikZK9B25NjddX5a/q9933aA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07774f99-b5b3-42cb-95d3-520cbdd52d63 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 257 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp7VTY/YVkVkxL7Fhw9OzHcs3xPtBTModxTc1yIQ94+bmcWNuQ0GxmMi3HidmKKucdcNJl7BW+NjPI65e3yWfmd5KiRvrV75ljU+VgSyPrikZK9B25NjddX5a/q9933aA=="}} Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp7VTY/YVkVkxL7Fhw9OzHcs3xPtBTModxTc1yIQ94+bmcWNuQ0GxmMi3HidmKKucdcNJl7BW+NjPI65e3yWfmd5KiRvrV75ljU+VgSyPrikZK9B25NjddX5a/q9933aA=='}}} Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 13 16:47:21.711213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07774f99-b5b3-42cb-95d3-520cbdd52d63 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-07774f99-b5b3-42cb-95d3-520cbdd52d63 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.251397 Sep 13 16:47:21.717852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1967/3974] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:47:21 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:47:21.729154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:21.729931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:21.750415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:21.750939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:21.751402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:21.752201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:21.755998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:21.756481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.195264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-466e8533-c43a-4c1e-a258-1cbb08e8ec43 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/e4367a58-f3d2-4d90-a9ff-61a172238009" status: 200 len: 184 microversion: 2.1 time: 0.721721 Sep 13 16:47:22.196026 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2008/3975] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:47:21 2022] GET /compute/v2.1/os-floating-ips/e4367a58-f3d2-4d90-a9ff-61a172238009 => generated 184 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:47:22.202052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb97a2b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2060471293", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:22.223210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:22.229332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for user 685ed786c6a14c75b462d4dd975e40af and project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:22.249895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 2167 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2060471293", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:47:22.269703 n-d-857467-1 devstack@n-api.service[122328]: exception: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2060471293', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:22.272660 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-72c14c63-c2e4-4368-ad5b-33c04090d56a tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.074732 Sep 13 16:47:22.275605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2009/3976] 10.222.0.61 () {60 vars in 1160 bytes} [Tue Sep 13 16:47:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:47:22.284864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b216f226-7274-4740-97dd-bf5bc4297323 req-e7ca1ee6-34f0-4cec-a780-c63c537cb717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:22.295265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b216f226-7274-4740-97dd-bf5bc4297323 req-e7ca1ee6-34f0-4cec-a780-c63c537cb717 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.295762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b216f226-7274-4740-97dd-bf5bc4297323 req-e7ca1ee6-34f0-4cec-a780-c63c537cb717 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.296200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b216f226-7274-4740-97dd-bf5bc4297323 req-e7ca1ee6-34f0-4cec-a780-c63c537cb717 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.310077 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b216f226-7274-4740-97dd-bf5bc4297323 req-e7ca1ee6-34f0-4cec-a780-c63c537cb717 service nova] Creating event network-changed:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:47:22.316887 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b216f226-7274-4740-97dd-bf5bc4297323 req-e7ca1ee6-34f0-4cec-a780-c63c537cb717 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041929 Sep 13 16:47:22.318373 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2010/3977] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:22.324342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.221"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:22.554969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:22.563394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.564289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.564976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.567426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.568169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.568944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.603632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:22.612355 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c20cecb-696e-470d-bf91-e138beb98a68 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 200 len: 1504 microversion: 2.1 time: 0.897741 Sep 13 16:47:22.622571 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1968/3978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:21 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 1504 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:22.630559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76cc2e08-7fe9-496e-bab6-41ace5d534a5 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb4ba8820>, body: {"keypair": {"name": "tempest-keypair-861734113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnOsXhCOosmthvfnGnNVf1fQmR8M4eVypzRyKASHUpD8bB6vvLb0ZpG62a/fkbyNg8BI9kh4/q1bWYoX9OUdRPMbCQFT7TZokYKBkZwLsrtZ8/lsUzgPmfqPByYYbFJPg=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:22.647771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-76cc2e08-7fe9-496e-bab6-41ace5d534a5 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:22.652972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-76cc2e08-7fe9-496e-bab6-41ace5d534a5 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for user 685ed786c6a14c75b462d4dd975e40af and project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:22.678703 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76cc2e08-7fe9-496e-bab6-41ace5d534a5 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054789 Sep 13 16:47:22.680219 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1969/3979] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:47:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:22.699855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:22.701366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:22.715433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.716194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.716872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.717719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.718632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.719247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.924416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:22.934164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75442055-cc7c-4d5a-9f05-220f071de51e tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1647 microversion: 2.1 time: 0.252592 Sep 13 16:47:22.950538 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1970/3980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:22 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1647 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:22.957564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:22.958497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:22.964807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.965740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.966215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.967109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:22.967879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:22.968320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:22.975891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:47:22.976418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquired lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:47:23.616750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:23.627357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e066b76-4a8a-433a-a2c9-a2b537654ae6 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096" status: 200 len: 1505 microversion: 2.1 time: 0.675301 Sep 13 16:47:23.629510 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1971/3981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:22 2022] GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 => generated 1505 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:23.635767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb54b01f0>, body: {"keypair": {"name": "tempest-keypair-861734113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysKGF+AVmSNRFgK/+NIJEUj0WDAr6w4Kza+5idCoX/VHNWHvmN1fFKEO+rGDsR57ky8clNQPFQDfdlnZIxsHvqYbr3WepiXI56ApoArZyGnTd5T+ZxS9CsIX6sqaJO+Q=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:23.680490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:23.690573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for user 685ed786c6a14c75b462d4dd975e40af and project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:23.723261 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] HTTP exception thrown: Key pair 'tempest-keypair-861734113' already exists. Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 272 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: {"keypair": {"name": "tempest-keypair-861734113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysKGF+AVmSNRFgK/+NIJEUj0WDAr6w4Kza+5idCoX/VHNWHvmN1fFKEO+rGDsR57ky8clNQPFQDfdlnZIxsHvqYbr3WepiXI56ApoArZyGnTd5T+ZxS9CsIX6sqaJO+Q=="}} Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: exception: Key pair 'tempest-keypair-861734113' already exists. Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-861734113', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysKGF+AVmSNRFgK/+NIJEUj0WDAr6w4Kza+5idCoX/VHNWHvmN1fFKEO+rGDsR57ky8clNQPFQDfdlnZIxsHvqYbr3WepiXI56ApoArZyGnTd5T+ZxS9CsIX6sqaJO+Q=='}}} Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result.read() Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '685ed786c6a14c75b462d4dd975e40af-tempest-keypair-861734113' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 13 16:47:23.734537 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi session.flush() Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result.read() Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 13 16:47:23.739415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '685ed786c6a14c75b462d4dd975e40af-tempest-keypair-861734113' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 13, 16, 47, 23, 715284), 'updated_at': None, 'name': 'tempest-keypair-861734113', 'user_id': '685ed786c6a14c75b462d4dd975e40af', 'fingerprint': '67:1e:08:eb:d0:5e:ae:c4:f6:0d:46:98:73:fd:75:60', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHysKGF+AVmSNRFgK/+NIJEUj0WDAr6w4Kza+5idCoX/VHNWHvmN1fFKEO+rGDsR57ky8clNQPFQDfdlnZIxsHvqYbr3WepiXI56ApoArZyGnTd5T+ZxS9CsIX6sqaJO+Q==', 'type': 'ssh'}] Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi keypair.create() Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._create() Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-861734113' already exists. Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 13 16:47:23.743800 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-861734113' already exists. Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-861734113' already exists. Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 409 to user: Key pair 'tempest-keypair-861734113' already exists. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a8dc641-c0a1-45ab-b0e5-9cb7f13d8824 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.105572 Sep 13 16:47:23.750711 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1972/3982] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:47:23 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:47:23.755766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:23.756353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:23.766058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:23.766672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:23.767192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:23.768699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:23.770876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:23.771401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:23.812236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:47:23.982519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c02f77f-19fe-447b-90da-798c4aa8a702 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "DELETE /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096" status: 204 len: 0 microversion: 2.1 time: 0.235296 Sep 13 16:47:23.991948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1973/3983] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:47:23 2022] DELETE /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:24.004178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74b13897-6232-4be3-9e17-ecbd8b721f0d tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Calling method '.version_select at 0x7fbeb47811f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:24.077008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74b13897-6232-4be3-9e17-ecbd8b721f0d tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861734113" status: 202 len: 0 microversion: 2.1 time: 0.081767 Sep 13 16:47:24.078045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1974/3984] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861734113 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:47:24.095383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c4dace17-9383-472d-8b79-0cf0fa36754d req-72188861-7ac8-4007-8060-ca8b1ebeb53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec311cf7-6f46-495d-80d1-20502b938058", "name": "network-vif-deleted", "tag": "11069db3-4dff-4247-9982-c890ada7e407"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:24.111962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c4dace17-9383-472d-8b79-0cf0fa36754d req-72188861-7ac8-4007-8060-ca8b1ebeb53b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.112467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c4dace17-9383-472d-8b79-0cf0fa36754d req-72188861-7ac8-4007-8060-ca8b1ebeb53b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.113005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c4dace17-9383-472d-8b79-0cf0fa36754d req-72188861-7ac8-4007-8060-ca8b1ebeb53b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.146340 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c4dace17-9383-472d-8b79-0cf0fa36754d req-72188861-7ac8-4007-8060-ca8b1ebeb53b service nova] Creating event network-vif-deleted:11069db3-4dff-4247-9982-c890ada7e407 for instance ec311cf7-6f46-495d-80d1-20502b938058 on n-h2-857467-1 Sep 13 16:47:24.174152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c4dace17-9383-472d-8b79-0cf0fa36754d req-72188861-7ac8-4007-8060-ca8b1ebeb53b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080843 Sep 13 16:47:24.174952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1975/3985] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:24.180658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:24.181364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:24.201680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.202221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.202663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.203375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.204648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.204648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.272080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.272718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.273014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.273473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lazy-loading 'fault' on Instance uuid ec311cf7-6f46-495d-80d1-20502b938058 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:24.383171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fc33e81e6d4f52875b369833ff7b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63e62adef134ca181d1d5c4c5b09880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:24.392758 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-16a188b5-9df5-4db5-8be6-9e2e3b400a53 tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 200 len: 1366 microversion: 2.1 time: 0.216288 Sep 13 16:47:24.413856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1976/3986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:24 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:24.413856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:24.413856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:24.424961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.426478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.427047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.427777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.428411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.433897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.507553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:47:24.683710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:24.696183 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3fca9d6-7f30-40b1-b2e2-3a4ce1e70031 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "DELETE /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 204 len: 0 microversion: 2.1 time: 0.294351 Sep 13 16:47:24.696788 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1977/3987] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:47:24 2022] DELETE /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:24.707825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb0ca655-0f5e-40ab-9b79-182b81c7a5fb tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb4df1430>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjM4jI9pEs+G6BpSBN1lPwcsDOEXAPXWdHILdPBV56QD99BhCpgmDRP/B3zY/iPbW9NcTte1cqf6/hirPXAMC9lWvQMkecVxINVpz/XzAt3vbwrk2Azx3+395Xs2BWeUw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb0ca655-0f5e-40ab-9b79-182b81c7a5fb tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 247 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjM4jI9pEs+G6BpSBN1lPwcsDOEXAPXWdHILdPBV56QD99BhCpgmDRP/B3zY/iPbW9NcTte1cqf6/hirPXAMC9lWvQMkecVxINVpz/XzAt3vbwrk2Azx3+395Xs2BWeUw=="}} Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjM4jI9pEs+G6BpSBN1lPwcsDOEXAPXWdHILdPBV56QD99BhCpgmDRP/B3zY/iPbW9NcTte1cqf6/hirPXAMC9lWvQMkecVxINVpz/XzAt3vbwrk2Azx3+395Xs2BWeUw=='}}} Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '' Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:24.711909 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb0ca655-0f5e-40ab-9b79-182b81c7a5fb tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:24.716505 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb0ca655-0f5e-40ab-9b79-182b81c7a5fb tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011027 Sep 13 16:47:24.729933 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1978/3988] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:47:24 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:47:24.737222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:24.738140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:24.757725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Building network info cache for instance {{(pid=122328) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:47:24.762401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.762914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.763353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:24.764217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:24.774095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:24.774688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:25.561357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:26.007342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:26.015995 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6dd272ef-f663-4b8a-82cb-6ccd458d0d0a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096" status: 200 len: 1511 microversion: 2.1 time: 1.284349 Sep 13 16:47:26.019861 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1979/3989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:24 2022] GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 => generated 1511 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:26.028663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbb4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1325726115", "public_key": " "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:26.083902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Updating instance_info_cache with network_info: [{"id": "12f6ea71-466c-48bf-8c97-03a1d13a26d3", "address": "fa:16:3e:c8:48:45", "network": {"id": "de36c228-169a-4e26-92cd-cb49c35f2833", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1319757258-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "67831491241246a5961d8b9c417662ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap12f6ea71-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122328) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:47:26.102692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:26.103306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Releasing lock "refresh_cache-900d3791-ef2c-42dd-9229-15cd3c67bbcd" {{(pid=122328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:47:26.104567 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e14f096-81fd-4c7b-9cae-202f85393bb2 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action" status: 202 len: 0 microversion: 2.1 time: 3.784204 Sep 13 16:47:26.110024 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2011/3990] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:47:22 2022] POST /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd/action => generated 0 bytes in 3791 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 13 16:47:26.119101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a5904afa-379b-417c-af87-502f2dd49b49 req-151b72e2-f420-4074-87cd-b84c2b6f9efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:26.127855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for user 685ed786c6a14c75b462d4dd975e40af and project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:26.162911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 95 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1325726115", "public_key": " "}} Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: exception: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1325726115', 'public_key': ' '}}} Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.170671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.176181 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.180044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:26.181129 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aa91711-f833-4408-88ea-820ea610cef6 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.159201 Sep 13 16:47:26.181793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a5904afa-379b-417c-af87-502f2dd49b49 req-151b72e2-f420-4074-87cd-b84c2b6f9efa service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.182171 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1980/3991] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Sep 13 16:47:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:47:26.191384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a5904afa-379b-417c-af87-502f2dd49b49 req-151b72e2-f420-4074-87cd-b84c2b6f9efa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.191384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a5904afa-379b-417c-af87-502f2dd49b49 req-151b72e2-f420-4074-87cd-b84c2b6f9efa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.227158 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a5904afa-379b-417c-af87-502f2dd49b49 req-151b72e2-f420-4074-87cd-b84c2b6f9efa service nova] Creating event network-changed:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:47:26.233646 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a5904afa-379b-417c-af87-502f2dd49b49 req-151b72e2-f420-4074-87cd-b84c2b6f9efa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117820 Sep 13 16:47:26.234862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2012/3992] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:26.240823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:26.244220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] [instance: ec311cf7-6f46-495d-80d1-20502b938058] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:26.253551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.254466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.255141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.256128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.256826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.257490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.290808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] HTTP exception thrown: Instance ec311cf7-6f46-495d-80d1-20502b938058 could not be found. Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Request method failure captured: Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 HTTP/1.1 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILOnt0fUFGlnaj64QJcnIvtPCb4FYYCOFT5HQDc3TT9Kp7dRObyDQF0NmZjQ3Fmn1CVynsm3mpAAjD1-TsNkEaCC2Qp-13MExCnFSBpig3Xs7iG81Vc_h65VmDKTq1dLt7keFoBczDo3uOlH1OkIP0txa3qxG17Qr9TbBbqu41FRroU Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f63e62adef134ca181d1d5c4c5b09880 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestManualDisk-305677669 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f63e62adef134ca181d1d5c4c5b09880"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f63e62adef134ca181d1d5c4c5b09880"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f63e62adef134ca181d1d5c4c5b09880"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f63e62adef134ca181d1d5c4c5b09880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestManualDisk-305677669 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f63e62adef134ca181d1d5c4c5b09880 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestManualDisk-305677669 Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestManualDisk-305677669-project Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 31fc33e81e6d4f52875b369833ff7b5b Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestManualDisk-305677669-project Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ec311cf7-6f46-495d-80d1-20502b938058 could not be found. Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ec311cf7-6f46-495d-80d1-20502b938058'} Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec311cf7-6f46-495d-80d1-20502b938058 could not be found. Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec311cf7-6f46-495d-80d1-20502b938058 could not be found. Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.294154 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec311cf7-6f46-495d-80d1-20502b938058 could not be found. Sep 13 16:47:26.298889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.301606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Returning 404 to user: Instance ec311cf7-6f46-495d-80d1-20502b938058 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:26.302430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-93223453", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "26065d38-a1e3-45c3-b153-7d2e919a353b"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:26.303129 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3908b7dc-95c8-44ae-a19c-9ee2bbf9cf0c tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058" status: 404 len: 111 microversion: 2.1 time: 0.066652 Sep 13 16:47:26.303961 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2013/3993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:26 2022] GET /compute/v2.1/servers/ec311cf7-6f46-495d-80d1-20502b938058 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:26.309123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:26.310616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:26.320177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.321351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.322103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.323082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.326270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.328688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.386677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] HTTP exception thrown: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Request method failure captured: Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 HTTP/1.1 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILO4fcJL_ktWI9nTGPGZIyol6w-I08PsZaOnje6H491j_ZzMw-YzSLKEMv37iBKP8tVuee39LrdHfBYnppMtrRB7VuAzEyr4LBgEtiEP99gyy_se5gn9tEHGAe0BqfTp7CYREqJqblnnD21cy7nR_nizqXzELEsp5tXkw0ir4S4YRHc Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67831491241246a5961d8b9c417662ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 20ecc8b135b34ef89a828f600a534e2c Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1e228a7f-5ea1-4292-a25f-0a1731fe5183'} Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:47:26.398526 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Returning 404 to user: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:26.403745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc1de738-7ec0-4a46-8a96-134eecc8b73e tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 404 len: 111 microversion: 2.1 time: 0.098491 Sep 13 16:47:26.405093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2014/3994] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:47:26 2022] DELETE /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:26.419647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2acf8757-03ed-4a94-9a35-343199dc65af tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb4715310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLzVlIVbj/zkFC3LfhVoqZScFNLNA/mh71I7JooU58jJuZxvXGKEEMwOs64/dmkmv2K/CBlg1bzBiWtf+s4XpyUA7KlE0hc+2iI92TR4QdigfXCeNJRE/ckD3CzGGsHGg=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2acf8757-03ed-4a94-9a35-343199dc65af tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 507 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLzVlIVbj/zkFC3LfhVoqZScFNLNA/mh71I7JooU58jJuZxvXGKEEMwOs64/dmkmv2K/CBlg1bzBiWtf+s4XpyUA7KlE0hc+2iI92TR4QdigfXCeNJRE/ckD3CzGGsHGg=="}} Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLzVlIVbj/zkFC3LfhVoqZScFNLNA/mh71I7JooU58jJuZxvXGKEEMwOs64/dmkmv2K/CBlg1bzBiWtf+s4XpyUA7KlE0hc+2iI92TR4QdigfXCeNJRE/ckD3CzGGsHGg=='}}} Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 13 16:47:26.432929 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 13 16:47:26.437736 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.445821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2acf8757-03ed-4a94-9a35-343199dc65af tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:26.445821 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2acf8757-03ed-4a94-9a35-343199dc65af tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.036079 Sep 13 16:47:26.450168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2015/3995] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:47:26 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:47:26.469767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee5f90e4-cbaa-4ad8-bf59-32a705133fed tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] Calling method '.version_select at 0x7fbeb97a2f70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:26.477432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] validate_networks() for [('26065d38-a1e3-45c3-b153-7d2e919a353b', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:47:26.539324 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee5f90e4-cbaa-4ad8-bf59-32a705133fed tempest-ServersTestManualDisk-305677669 tempest-ServersTestManualDisk-305677669-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349807728" status: 202 len: 0 microversion: 2.1 time: 0.087624 Sep 13 16:47:26.539953 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2016/3996] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349807728 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:47:26.547478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:26.548116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 1e228a7f-5ea1-4292-a25f-0a1731fe5183] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:26.569345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.570157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.570618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.571774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:26.572563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:26.573323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:26.612500 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] HTTP exception thrown: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Request method failure captured: Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 HTTP/1.1 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILO4fcJL_ktWI9nTGPGZIyol6w-I08PsZaOnje6H491j_ZzMw-YzSLKEMv37iBKP8tVuee39LrdHfBYnppMtrRB7VuAzEyr4LBgEtiEP99gyy_se5gn9tEHGAe0BqfTp7CYREqJqblnnD21cy7nR_nizqXzELEsp5tXkw0ir4S4YRHc Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67831491241246a5961d8b9c417662ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 20ecc8b135b34ef89a828f600a534e2c Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1e228a7f-5ea1-4292-a25f-0a1731fe5183'} Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.617480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Returning 404 to user: Instance 1e228a7f-5ea1-4292-a25f-0a1731fe5183 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:26.622527 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3315492b-356f-4882-a8c1-bb48f46bed55 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183" status: 404 len: 111 microversion: 2.1 time: 0.078628 Sep 13 16:47:26.624948 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2017/3997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:26 2022] GET /compute/v2.1/servers/1e228a7f-5ea1-4292-a25f-0a1731fe5183 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:26.633886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Action: 'create', calling method: .version_select at 0x7fbeb95d1f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-81086566", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:26.685818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:26.698653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Getting quotas for user 685ed786c6a14c75b462d4dd975e40af and project eb535ea68d9943de9057adfc4e5086c5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:26.748906 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 116 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-81086566", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: exception: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-81086566', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 13 16:47:26.750900 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 13 16:47:26.757174 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:47:26.760870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:26.766086 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4fc1f460-680e-48c4-b547-3413930a8142 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.139047 Sep 13 16:47:26.774665 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2018/3998] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:47:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:47:26.795576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fdc8684e-a3ae-4876-b833-2d50d0b76d83 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '.version_select at 0x7fbeb4b0d5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:28.155157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:47:28.155805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:47:28.156176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:47:28.156599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:47:28.157557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:47:28.188395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:28.188898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:28.191348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:28.197321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:28.199262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:28.199918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:28.252191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Getting quotas for project 1708f00107fd4d42a266f81485b13a79. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:28.267596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Getting quotas for user 0c9a7eaf31b645ddaf2f6184c4722111 and project 1708f00107fd4d42a266f81485b13a79. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:28.287409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:47:28.296744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:47:28.372050 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51bebf57-5977-4e73-b11a-f6cfd8dbab8f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.178173 Sep 13 16:47:28.373520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1981/3999] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:47:28.379261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e9cdb17-98db-4c32-a999-8aa5581856f1 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Calling method '.version_select at 0x7fbeb4a1d670>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:28.397522 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4e9cdb17-98db-4c32-a999-8aa5581856f1 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1313210428 not found for user 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e9cdb17-98db-4c32-a999-8aa5581856f1 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Request method failure captured: Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1313210428 HTTP/1.1 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQYHCbLq9NmLs6sAqq0wFSbn-CaQXjx-7z_JMTCvhhnIlRNsKTTnNP24sgypp6uiPaoELn9ymngpv_pNSYEY25Topvt1RyryZxVBM592NPapRz6NpOVrQMKrcLnAzb6VLmcyVj6baY6L2pMU4AU2O-cwmqHWWTZBxmOPszBL7IkEKk Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb535ea68d9943de9057adfc4e5086c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: eb535ea68d9943de9057adfc4e5086c5 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-562710180 Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-KeyPairsNegativeTestJSON-562710180-project Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: exception: Keypair tempest-keypair-non-existent-1313210428 not found for user 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'tempest-keypair-non-existent-1313210428'} Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1313210428 not found for user 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:28.408261 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1313210428 not found for user 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1313210428 not found for user 685ed786c6a14c75b462d4dd975e40af Sep 13 16:47:28.416208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:28.421272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e9cdb17-98db-4c32-a999-8aa5581856f1 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1313210428 not found for user 685ed786c6a14c75b462d4dd975e40af {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:28.422723 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e9cdb17-98db-4c32-a999-8aa5581856f1 tempest-KeyPairsNegativeTestJSON-562710180 tempest-KeyPairsNegativeTestJSON-562710180-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1313210428" status: 404 len: 145 microversion: 2.1 time: 0.047897 Sep 13 16:47:28.423530 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1982/4000] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1313210428 => generated 145 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:28.432883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:28.433782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:28.442939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:28.443928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:28.445238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:28.446327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:28.447033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:28.447719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:28.562614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:28.569436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:28.572049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:28.573460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lazy-loading 'fault' on Instance uuid 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:28.862143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71087bb4bd804ee8af20a8249aeadc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d126690fdf34b20b071a80a25893169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:28.872642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d1ede86-724b-4eae-8412-b69122fde729 tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096" status: 200 len: 1307 microversion: 2.1 time: 0.447709 Sep 13 16:47:28.877565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1983/4001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:28 2022] GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 => generated 1307 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:28.904305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f773fdfa-1642-4d78-a95a-65b9d973e2c0 req-f54e979e-94d4-40c6-a7ba-c6b361a64506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e4dd8f-7e7d-4a04-9132-76e3ba1f7096", "name": "network-vif-deleted", "tag": "229fe924-4f86-4dfe-8c07-6dc7339d54bc"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:28.925626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f773fdfa-1642-4d78-a95a-65b9d973e2c0 req-f54e979e-94d4-40c6-a7ba-c6b361a64506 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:28.926719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f773fdfa-1642-4d78-a95a-65b9d973e2c0 req-f54e979e-94d4-40c6-a7ba-c6b361a64506 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:28.927333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f773fdfa-1642-4d78-a95a-65b9d973e2c0 req-f54e979e-94d4-40c6-a7ba-c6b361a64506 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:28.959745 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f773fdfa-1642-4d78-a95a-65b9d973e2c0 req-f54e979e-94d4-40c6-a7ba-c6b361a64506 service nova] Creating event network-vif-deleted:229fe924-4f86-4dfe-8c07-6dc7339d54bc for instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 on n-h1-857467-1 Sep 13 16:47:28.974823 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f773fdfa-1642-4d78-a95a-65b9d973e2c0 req-f54e979e-94d4-40c6-a7ba-c6b361a64506 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095086 Sep 13 16:47:28.975451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1984/4002] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:28.994573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac73702a-4551-4f14-902f-4ef25eb02ce5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:28.996754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac73702a-4551-4f14-902f-4ef25eb02ce5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:29.433334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac73702a-4551-4f14-902f-4ef25eb02ce5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:29.452859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac73702a-4551-4f14-902f-4ef25eb02ce5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:29.457723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac73702a-4551-4f14-902f-4ef25eb02ce5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:29.461245 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac73702a-4551-4f14-902f-4ef25eb02ce5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1260 microversion: 2.26 time: 0.482668 Sep 13 16:47:29.477665 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1985/4003] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:28 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1260 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:29.906087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:29.907230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:29.929163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:29.942035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:29.942933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:29.944593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:29.947308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:29.948087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:29.995463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] HTTP exception thrown: Instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 could not be found. Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Request method failure captured: Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 HTTP/1.1 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILPXUZQG7Xzbrhr8n0mbzBnrUCN1aMOpDAc3lU_rNBqrnhzSaymYEgT_KdPMwQksEQfG9dsDTjvTPRqiU1CLEzLJgaldSI2T5ys0YfWvQcXkKc-AbzxTT0wTB0HOZXpuvRcFI5Av2cDPC9vDkk1pFobk_1a7oxVIzM1rwJeA02q131s Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1d126690fdf34b20b071a80a25893169 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateTestJSON-491754944 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d126690fdf34b20b071a80a25893169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d126690fdf34b20b071a80a25893169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d126690fdf34b20b071a80a25893169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d126690fdf34b20b071a80a25893169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateTestJSON-491754944 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1d126690fdf34b20b071a80a25893169 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateTestJSON-491754944 Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateTestJSON-491754944-project Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 71087bb4bd804ee8af20a8249aeadc1e Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateTestJSON-491754944-project Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 could not be found. Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '63e4dd8f-7e7d-4a04-9132-76e3ba1f7096'} Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 could not be found. Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 could not be found. Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:30.013755 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 could not be found. Sep 13 16:47:30.020254 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.023422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Returning 404 to user: Instance 63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:30.025361 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58c03d42-0594-4725-aab8-ea1f6897488a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096" status: 404 len: 111 microversion: 2.1 time: 0.126013 Sep 13 16:47:30.026718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1986/4004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:29 2022] GET /compute/v2.1/servers/63e4dd8f-7e7d-4a04-9132-76e3ba1f7096 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:47:30.049502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:30.053705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] [instance: 62bf0988-cfc9-487e-928e-b545ad9f33d1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:30.099454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:30.100031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:30.101495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:30.110163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:30.119218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:30.119794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:30.194395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] HTTP exception thrown: Instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 could not be found. Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Request method failure captured: Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 HTTP/1.1 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILPXUZQG7Xzbrhr8n0mbzBnrUCN1aMOpDAc3lU_rNBqrnhzSaymYEgT_KdPMwQksEQfG9dsDTjvTPRqiU1CLEzLJgaldSI2T5ys0YfWvQcXkKc-AbzxTT0wTB0HOZXpuvRcFI5Av2cDPC9vDkk1pFobk_1a7oxVIzM1rwJeA02q131s Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1d126690fdf34b20b071a80a25893169 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateTestJSON-491754944 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d126690fdf34b20b071a80a25893169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d126690fdf34b20b071a80a25893169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d126690fdf34b20b071a80a25893169"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d126690fdf34b20b071a80a25893169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateTestJSON-491754944 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1d126690fdf34b20b071a80a25893169 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateTestJSON-491754944 Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateTestJSON-491754944-project Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 71087bb4bd804ee8af20a8249aeadc1e Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateTestJSON-491754944-project Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 could not be found. Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '62bf0988-cfc9-487e-928e-b545ad9f33d1'} Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 could not be found. Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 could not be found. Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:30.196511 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 could not be found. Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] Returning 404 to user: Instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-167b68b1-4458-4df9-91cd-67c4b6c7c37a tempest-MultipleCreateTestJSON-491754944 tempest-MultipleCreateTestJSON-491754944-project] 10.222.0.61 "GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1" status: 404 len: 111 microversion: 2.1 time: 0.163570 Sep 13 16:47:30.201314 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1987/4005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:30 2022] GET /compute/v2.1/servers/62bf0988-cfc9-487e-928e-b545ad9f33d1 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:30.360328 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fdc8684e-a3ae-4876-b833-2d50d0b76d83 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/e4367a58-f3d2-4d90-a9ff-61a172238009" status: 202 len: 0 microversion: 2.1 time: 3.583051 Sep 13 16:47:30.361243 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2019/4006] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:47:26 2022] DELETE /compute/v2.1/os-floating-ips/e4367a58-f3d2-4d90-a9ff-61a172238009 => generated 0 bytes in 3585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:47:30.370200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:30.372995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:30.384633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:30.385436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:30.386107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:30.387303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:30.388185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:30.388820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:30.502027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:30.502845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:30.532178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:30.541266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:30.541961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:30.545079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:30.554270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:30.554991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:30.855408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:47:30.864325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:31.022526 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-175cec6c-3059-488a-b055-7e6cd2cdcc8d tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "DELETE /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 204 len: 0 microversion: 2.1 time: 0.656821 Sep 13 16:47:31.023697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1988/4007] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:47:30 2022] DELETE /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:47:31.037068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:31.039558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:31.046891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:31.047633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:31.048307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:31.049334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:31.050140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:31.066895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:31.695346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:31.714549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:31.718538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:31.723438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c777852d-54f6-48f0-990d-4b9f8a0eac65 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1312 microversion: 2.26 time: 1.226477 Sep 13 16:47:31.726536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2020/4008] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:30 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1312 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:31.741414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-571222be-0af2-4de1-8d9d-94769e1d506c req-f22dd5e9-77a2-413d-b2a1-86fcef5f2807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62bf0988-cfc9-487e-928e-b545ad9f33d1", "name": "network-vif-deleted", "tag": "06b6e3b9-fdb1-448e-b59b-9d2c74ae9576"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:31.761543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-571222be-0af2-4de1-8d9d-94769e1d506c req-f22dd5e9-77a2-413d-b2a1-86fcef5f2807 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:31.762172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-571222be-0af2-4de1-8d9d-94769e1d506c req-f22dd5e9-77a2-413d-b2a1-86fcef5f2807 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:31.762611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-571222be-0af2-4de1-8d9d-94769e1d506c req-f22dd5e9-77a2-413d-b2a1-86fcef5f2807 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:31.788790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-571222be-0af2-4de1-8d9d-94769e1d506c req-f22dd5e9-77a2-413d-b2a1-86fcef5f2807 service nova] Creating event network-vif-deleted:06b6e3b9-fdb1-448e-b59b-9d2c74ae9576 for instance 62bf0988-cfc9-487e-928e-b545ad9f33d1 on n-h2-857467-1 Sep 13 16:47:31.794583 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-571222be-0af2-4de1-8d9d-94769e1d506c req-f22dd5e9-77a2-413d-b2a1-86fcef5f2807 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065301 Sep 13 16:47:31.795801 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2021/4009] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:31.819893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:31.836011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-222aa503-3007-467e-99ac-e55c1e573708 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1525 microversion: 2.1 time: 0.806657 Sep 13 16:47:31.838089 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1989/4010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:31 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1525 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:47:32.156017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1be35538-df34-4be6-b349-3898d03d6dd4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb970e310>, body: {"keypair": {"name": "tempest-keypair-1557405534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXIDWfy9vL9qektn/M+Q/brQ7yd+XTlOaSuDzg/f7c6BSPzz0SF2nYJKON4VSIj76AUGSpBBwHymqzirrb932gzVCXKAwon3ZLUFfq8KjLSHDxzMNQEg49fVEUCgsGLxw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:32.184133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1be35538-df34-4be6-b349-3898d03d6dd4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:32.195617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1be35538-df34-4be6-b349-3898d03d6dd4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:32.227041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1be35538-df34-4be6-b349-3898d03d6dd4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.257679 Sep 13 16:47:32.227973 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2022/4011] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:32.244379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6be4654-53cc-493a-99ba-50749f4b9656 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4726790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.255339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6be4654-53cc-493a-99ba-50749f4b9656 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1557405534" status: 200 len: 513 microversion: 2.2 time: 0.020517 Sep 13 16:47:32.256737 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1990/4012] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Sep 13 16:47:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1557405534 => generated 513 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:32.269662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-54822db8-3099-4828-b55a-4dfd46910ab7 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4683d30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.295455 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-54822db8-3099-4828-b55a-4dfd46910ab7 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557405534" status: 204 len: 0 microversion: 2.2 time: 0.030316 Sep 13 16:47:32.305539 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2023/4013] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Sep 13 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557405534 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:32.309574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bf21672-bf7d-403d-b44d-11d99b6e033f tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb4cbda60>, body: {"keypair": {"name": "tempest-keypair-930079088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU4GqN7baTc0nGN0IytG+mU33gW0MjONhSrJ5msaqj/iVzMadp2V7HIVCzk6DngEgqYM5cG/xs0Yhl0K0YsbAWRWzwyxHpCRFIiL9i5pAgCZrcca0rsS1gHDcNuWhjE+A=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:32.337382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6bf21672-bf7d-403d-b44d-11d99b6e033f tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:32.342674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6bf21672-bf7d-403d-b44d-11d99b6e033f tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:32.381002 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bf21672-bf7d-403d-b44d-11d99b6e033f tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.075750 Sep 13 16:47:32.382042 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1991/4014] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:32.394639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc32952d-0cd7-4cfe-8d28-2ca18b6e18fc tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb96c01f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.430275 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc32952d-0cd7-4cfe-8d28-2ca18b6e18fc tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-930079088" status: 204 len: 0 microversion: 2.2 time: 0.028790 Sep 13 16:47:32.431702 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2024/4015] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Sep 13 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-930079088 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:47:32.443575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b49172fb-0ff2-42d2-bf9e-33c6c50325a6 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb4cbdf70>, body: {"keypair": {"name": "tempest-keypair-79669666", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:32.460084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b49172fb-0ff2-42d2-bf9e-33c6c50325a6 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:32.465223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b49172fb-0ff2-42d2-bf9e-33c6c50325a6 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:32.491998 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b49172fb-0ff2-42d2-bf9e-33c6c50325a6 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.053239 Sep 13 16:47:32.492994 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1992/4016] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:32.506799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6479aa0-cc38-4bc8-a06a-ab9db52da4b0 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb46d2dc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.528703 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6479aa0-cc38-4bc8-a06a-ab9db52da4b0 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-79669666" status: 204 len: 0 microversion: 2.2 time: 0.028593 Sep 13 16:47:32.529299 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2025/4017] 10.222.0.61 () {60 vars in 1255 bytes} [Tue Sep 13 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-79669666 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:32.543980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef3e31e4-1aef-4d3a-81de-8349b94c3423 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb4773040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2133995879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfvAhfC2u5jNFOymnuE5zwIfSU7pBiMx4Zl8mLEaQZgjLF0KYlr/4QRWmXcJZvpsjW8ThE2aGqWGNx4IsjFqavxE9lkB4pSAXh2zwKRSrLGI0OrErrPgksRP20oZMoi8w=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:32.561798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ef3e31e4-1aef-4d3a-81de-8349b94c3423 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:32.567952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ef3e31e4-1aef-4d3a-81de-8349b94c3423 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:32.596464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef3e31e4-1aef-4d3a-81de-8349b94c3423 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.056324 Sep 13 16:47:32.605397 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1993/4018] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:32.612671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f36165e-5203-401b-a48d-88c77d21b733 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb97a2b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1455486479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCDSnlgv8kBnvppVGaJMd/wacOtBAQ6cJplRsjaB0iuv1dxN1sE7OCrqBSCSj63Z5pReacB4JFHQIULmzRoJiak1FrCIodW4z5xQXUlgqiZR9kSFZ6ziqNuaoGZ4Z/2kA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:32.631123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8f36165e-5203-401b-a48d-88c77d21b733 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:32.636608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8f36165e-5203-401b-a48d-88c77d21b733 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:32.665492 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f36165e-5203-401b-a48d-88c77d21b733 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.057409 Sep 13 16:47:32.666533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2026/4019] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:32.682134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b24afc4-8d78-4a0c-b5a3-90df80c3bff4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb4773550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1962506895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH1MPOWmMQWHGBLPy0NuNhG8nqYwnDHMayrlK/q9yos91FFjHwf+d1cLeISdzjW+CcKDoD62KZY2hRQc2a32IyDzCvyegHu3GVVO7am/RJCLC5lbeHKHjU/kJ8W3lE5Nw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:32.700793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8b24afc4-8d78-4a0c-b5a3-90df80c3bff4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:32.708301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8b24afc4-8d78-4a0c-b5a3-90df80c3bff4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:32.711869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:32.743735 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b24afc4-8d78-4a0c-b5a3-90df80c3bff4 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.067375 Sep 13 16:47:32.744745 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1994/4020] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:32.754029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.755465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-291eb96a-08bc-4f00-a9bd-8693b622af23 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4da98b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.755764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:32.760152 n-d-857467-1 devstack@n-api.service[122327]: WARNING oslo_db.sqlalchemy.utils [None req-291eb96a-08bc-4f00-a9bd-8693b622af23 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 13 16:47:32.766079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:32.767461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:32.767461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:32.767698 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-291eb96a-08bc-4f00-a9bd-8693b622af23 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.016527 Sep 13 16:47:32.769392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:32.769653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1995/4021] 10.222.0.61 () {60 vars in 1177 bytes} [Tue Sep 13 16:47:32 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:32.770387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:32.771293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:32.783011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56eedac2-5939-409a-828c-02b3b0e228eb tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4c1adc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.814722 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-56eedac2-5939-409a-828c-02b3b0e228eb tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1962506895" status: 204 len: 0 microversion: 2.2 time: 0.034733 Sep 13 16:47:32.816542 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1996/4022] 10.222.0.61 () {60 vars in 1321 bytes} [Tue Sep 13 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1962506895 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:32.825662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c09f5a1-5ca1-442d-908a-890cf8b62b5c tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4ba84c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.851424 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c09f5a1-5ca1-442d-908a-890cf8b62b5c tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1455486479" status: 204 len: 0 microversion: 2.2 time: 0.030641 Sep 13 16:47:32.852714 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1997/4023] 10.222.0.61 () {60 vars in 1321 bytes} [Tue Sep 13 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1455486479 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:47:32.861576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b208ace8-b35b-4d09-87f4-dbf9a5f3ad0b tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4c1a040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.885713 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b208ace8-b35b-4d09-87f4-dbf9a5f3ad0b tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2133995879" status: 204 len: 0 microversion: 2.2 time: 0.028642 Sep 13 16:47:32.886744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1998/4024] 10.222.0.61 () {60 vars in 1321 bytes} [Tue Sep 13 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2133995879 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:47:32.892318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:32.893078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:32.901056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:32.901699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:32.902497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:32.903652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:32.904358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:32.905053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:32.922380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:32.948026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:32.951505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:32.953137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3ac42ea-cb92-4964-bb94-7e9afdce999c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1318 microversion: 2.26 time: 0.204844 Sep 13 16:47:32.954384 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2027/4025] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:32 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:32.970003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13da3bb1-1db9-46f2-a863-c0fd1dba62c3 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb970ea60>, body: {"keypair": {"name": "tempest-keypair-1363101748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6B6LXkt5LkS5bXaB/VlUNzayIHjvOYiuL4WCaFZFfUZd9vGVAGN5lXkvI+Cw6srISWryY2KsYUPU0xebWvPsYK6Qci3Sczd/hnj0/CshX66adArhIvAuPc6ROaEpIBQA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:33.028454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-13da3bb1-1db9-46f2-a863-c0fd1dba62c3 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:33.036153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-13da3bb1-1db9-46f2-a863-c0fd1dba62c3 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:33.086861 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13da3bb1-1db9-46f2-a863-c0fd1dba62c3 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.130454 Sep 13 16:47:33.087849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2028/4026] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Sep 13 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 13 16:47:33.101168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc55ec78-7429-4831-b538-bdf224a1b6b9 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4b0d5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:33.112872 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc55ec78-7429-4831-b538-bdf224a1b6b9 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1363101748" status: 200 len: 513 microversion: 2.2 time: 0.018014 Sep 13 16:47:33.114472 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2029/4027] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Sep 13 16:47:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1363101748 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:47:33.129304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45a0eb06-90a6-4327-905e-bc1a4237ecc2 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb96c01f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:33.144366 n-d-857467-1 devstack@n-api.service[122328]: WARNING oslo_db.sqlalchemy.utils [None req-45a0eb06-90a6-4327-905e-bc1a4237ecc2 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 13 16:47:33.161672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45a0eb06-90a6-4327-905e-bc1a4237ecc2 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.039065 Sep 13 16:47:33.163771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2030/4028] 10.222.0.61 () {60 vars in 1177 bytes} [Tue Sep 13 16:47:33 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:47:33.180802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:33.181615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c5eed35-1037-4093-8c18-774a08e5bf40 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4afcc10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:33.188901 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d7b1809-4d12-4166-be88-5dca0ada6277 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1525 microversion: 2.1 time: 0.300739 Sep 13 16:47:33.211436 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 1999/4029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:32 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1525 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:33.261627 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c5eed35-1037-4093-8c18-774a08e5bf40 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363101748" status: 204 len: 0 microversion: 2.2 time: 0.086914 Sep 13 16:47:33.267212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2031/4030] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Sep 13 16:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363101748 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:33.281140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Action: 'create', calling method: .version_select at 0x7fbeb4773d30>, body: {"keypair": {"name": "tempest-keypair-560760620", "type": "x509"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:33.334129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:33.358172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:33.406919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.processutils [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpqhkemosn/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqhkemosn/temp.key -subj /CN=cb6418c38cd64a6c822c2256799fbe10 -extensions v3_req_client {{(pid=122327) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 13 16:47:33.812185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.processutils [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpqhkemosn/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqhkemosn/temp.key -subj /CN=cb6418c38cd64a6c822c2256799fbe10 -extensions v3_req_client" returned: 0 in 0.405s {{(pid=122327) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 13 16:47:33.815329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.processutils [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpqhkemosn/temp.key -password pass: {{(pid=122327) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 13 16:47:33.836552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-78680cad-f41a-4cff-9e79-ece9f38d13f4 req-60eaa9ce-0a03-4d77-ad00-6a377544f854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900d3791-ef2c-42dd-9229-15cd3c67bbcd", "name": "network-vif-deleted", "tag": "12f6ea71-466c-48bf-8c97-03a1d13a26d3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:33.859058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:33.867749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-78680cad-f41a-4cff-9e79-ece9f38d13f4 req-60eaa9ce-0a03-4d77-ad00-6a377544f854 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:33.868258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-78680cad-f41a-4cff-9e79-ece9f38d13f4 req-60eaa9ce-0a03-4d77-ad00-6a377544f854 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:33.868706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-78680cad-f41a-4cff-9e79-ece9f38d13f4 req-60eaa9ce-0a03-4d77-ad00-6a377544f854 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:33.871385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.processutils [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpqhkemosn/temp.key -password pass:" returned: 0 in 0.055s {{(pid=122327) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 13 16:47:33.909014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-78680cad-f41a-4cff-9e79-ece9f38d13f4 req-60eaa9ce-0a03-4d77-ad00-6a377544f854 service nova] Creating event network-vif-deleted:12f6ea71-466c-48bf-8c97-03a1d13a26d3 for instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd on n-h1-857467-1 Sep 13 16:47:33.939061 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-78680cad-f41a-4cff-9e79-ece9f38d13f4 req-60eaa9ce-0a03-4d77-ad00-6a377544f854 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107416 Sep 13 16:47:33.957791 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2032/4031] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:47:33.991999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:33.993382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:34.013878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:47:34.023623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:34.027951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:34.029713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:34.034239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:34.037306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:34.039257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:34.044904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Getting quotas for user cb6418c38cd64a6c822c2256799fbe10 and project 8a20dfcdc1514f76ba88f904931c32f1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:47:34.124309 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae5505c4-3ac9-4da9-a661-cb52b9dc7c33 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.847631 Sep 13 16:47:34.131554 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2000/4032] 10.222.0.61 () {62 vars in 1198 bytes} [Tue Sep 13 16:47:33 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 852 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:34.145919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac50cd3e-0dd1-4efa-9289-f23cd9ef2e3c tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4cbd700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:34.165596 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac50cd3e-0dd1-4efa-9289-f23cd9ef2e3c tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-560760620" status: 200 len: 1533 microversion: 2.2 time: 0.032528 Sep 13 16:47:34.166507 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2001/4033] 10.222.0.61 () {60 vars in 1255 bytes} [Tue Sep 13 16:47:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-560760620 => generated 1533 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:34.187740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb5def3e-20da-439f-91be-d6c8f2ceafb0 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb54b0b80>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:34.196611 n-d-857467-1 devstack@n-api.service[122327]: WARNING oslo_db.sqlalchemy.utils [None req-bb5def3e-20da-439f-91be-d6c8f2ceafb0 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 13 16:47:34.206766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb5def3e-20da-439f-91be-d6c8f2ceafb0 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.032095 Sep 13 16:47:34.220448 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2002/4034] 10.222.0.61 () {60 vars in 1177 bytes} [Tue Sep 13 16:47:34 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:34.227005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:34.227758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:34.239402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:34.240119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:34.240603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:34.241595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:34.242149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:34.242600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:34.310609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:34.314890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:34.315958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:34.322264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lazy-loading 'fault' on Instance uuid 900d3791-ef2c-42dd-9229-15cd3c67bbcd {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:34.410707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ecc8b135b34ef89a828f600a534e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67831491241246a5961d8b9c417662ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:34.425308 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-999a5a74-d65f-42e0-88cf-169a4c43ed2f tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 200 len: 1313 microversion: 2.1 time: 0.203529 Sep 13 16:47:34.428440 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2003/4035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:34 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:34.450581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c46080e3-16ac-4e4d-89b4-db7ede42f728 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] Calling method '.version_select at 0x7fbeb4c1a670>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:34.496880 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c46080e3-16ac-4e4d-89b4-db7ede42f728 tempest-KeyPairsV22TestJSON-1417966678 tempest-KeyPairsV22TestJSON-1417966678-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-560760620" status: 204 len: 0 microversion: 2.2 time: 0.052530 Sep 13 16:47:34.520070 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2004/4036] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Sep 13 16:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-560760620 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:47:34.886556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:34.911682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:34.921565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:34.926913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cefef5c0-d777-412e-9f97-211490af8c2f tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.949337 Sep 13 16:47:34.928835 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2033/4037] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:33 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:35.461054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:35.461054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] [instance: 900d3791-ef2c-42dd-9229-15cd3c67bbcd] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:35.468335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:35.469111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:35.470041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:35.471072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:35.471900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:35.472553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:35.488673 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] HTTP exception thrown: Instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd could not be found. Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Request method failure captured: Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd HTTP/1.1 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILO4fcJL_ktWI9nTGPGZIyol6w-I08PsZaOnje6H491j_ZzMw-YzSLKEMv37iBKP8tVuee39LrdHfBYnppMtrRB7VuAzEyr4LBgEtiEP99gyy_se5gn9tEHGAe0BqfTp7CYREqJqblnnD21cy7nR_nizqXzELEsp5tXkw0ir4S4YRHc Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67831491241246a5961d8b9c417662ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67831491241246a5961d8b9c417662ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 67831491241246a5961d8b9c417662ed Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1302807848 Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 20ecc8b135b34ef89a828f600a534e2c Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1302807848-project Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd could not be found. Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '900d3791-ef2c-42dd-9229-15cd3c67bbcd'} Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd could not be found. Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd could not be found. Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:35.490713 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd could not be found. Sep 13 16:47:35.498096 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:35.500221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] Returning 404 to user: Instance 900d3791-ef2c-42dd-9229-15cd3c67bbcd could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:35.501358 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-feedac64-fa4c-40b8-9672-64a18707d484 tempest-FloatingIPsAssociationTestJSON-1302807848 tempest-FloatingIPsAssociationTestJSON-1302807848-project] 10.222.0.61 "GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd" status: 404 len: 111 microversion: 2.1 time: 0.051386 Sep 13 16:47:35.502183 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2005/4038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:47:35 2022] GET /compute/v2.1/servers/900d3791-ef2c-42dd-9229-15cd3c67bbcd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:47:35.954954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:35.955688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:35.968620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:35.970266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:35.970724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:35.971461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:35.985235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:35.985968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:36.233580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce0e94ae-ff19-4d5e-801f-4a8124a28e0f tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1871134414", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:36.237228 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-ce0e94ae-ff19-4d5e-801f-4a8124a28e0f tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] HTTP exception thrown: min_count must be <= max_count Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce0e94ae-ff19-4d5e-801f-4a8124a28e0f tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Request method failure captured: Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 184 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQnC1HCrEl5T3tRIR7bPb9SaAItlLgSjOhBr2sS_SAFDtzdPkWfk6n8Qpg0nZAh7YJQ-dJlx5FSYeja6CLXyFP1QUtedyvM5P4GH_qihFEsvehBeo0YwLJ-avWwLWqLPppRGmEXOzzG1gILVoobwrFM85QeTEvVSuQsCMaUoL_SWs4 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 89ce6753716044c38e706062ede875b4 Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1871134414", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: exception: min_count must be <= max_count Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1871134414', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 13 16:47:36.239067 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.245304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce0e94ae-ff19-4d5e-801f-4a8124a28e0f tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Returning 400 to user: min_count must be <= max_count {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:36.246668 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce0e94ae-ff19-4d5e-801f-4a8124a28e0f tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.236977 Sep 13 16:47:36.247127 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2006/4039] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:47:36 2022] POST /compute/v2.1/servers => generated 74 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:47:36.321919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6d87c3c-b5a7-4a76-aef4-3fc9045087e6 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1388850253", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "max_count": 0}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6d87c3c-b5a7-4a76-aef4-3fc9045087e6 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Request method failure captured: Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 168 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQnC1HCrEl5T3tRIR7bPb9SaAItlLgSjOhBr2sS_SAFDtzdPkWfk6n8Qpg0nZAh7YJQ-dJlx5FSYeja6CLXyFP1QUtedyvM5P4GH_qihFEsvehBeo0YwLJ-avWwLWqLPppRGmEXOzzG1gILVoobwrFM85QeTEvVSuQsCMaUoL_SWs4 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 89ce6753716044c38e706062ede875b4 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1388850253", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "max_count": 0}} Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1388850253', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'max_count': 0}}} Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 0 Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:36.326648 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.333433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6d87c3c-b5a7-4a76-aef4-3fc9045087e6 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:36.336442 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6d87c3c-b5a7-4a76-aef4-3fc9045087e6 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021623 Sep 13 16:47:36.337233 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2007/4040] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:47:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:47:36.437693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9f2343b-95fd-4fe2-af1d-3bcfa97ee423 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1221656990", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "max_count": 2.5}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9f2343b-95fd-4fe2-af1d-3bcfa97ee423 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Request method failure captured: Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 170 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQnC1HCrEl5T3tRIR7bPb9SaAItlLgSjOhBr2sS_SAFDtzdPkWfk6n8Qpg0nZAh7YJQ-dJlx5FSYeja6CLXyFP1QUtedyvM5P4GH_qihFEsvehBeo0YwLJ-avWwLWqLPppRGmEXOzzG1gILVoobwrFM85QeTEvVSuQsCMaUoL_SWs4 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 89ce6753716044c38e706062ede875b4 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1221656990", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "max_count": 2.5}} Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1221656990', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'max_count': 2.5}}} Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 2.5 Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:36.442914 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9f2343b-95fd-4fe2-af1d-3bcfa97ee423 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:36.447671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9f2343b-95fd-4fe2-af1d-3bcfa97ee423 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011077 Sep 13 16:47:36.454826 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2008/4041] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:47:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:47:36.502189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0b08ab9-54a3-4fa9-9561-4a7205c23226 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-657239249", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 0}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0b08ab9-54a3-4fa9-9561-4a7205c23226 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Request method failure captured: Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 167 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQnC1HCrEl5T3tRIR7bPb9SaAItlLgSjOhBr2sS_SAFDtzdPkWfk6n8Qpg0nZAh7YJQ-dJlx5FSYeja6CLXyFP1QUtedyvM5P4GH_qihFEsvehBeo0YwLJ-avWwLWqLPppRGmEXOzzG1gILVoobwrFM85QeTEvVSuQsCMaUoL_SWs4 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 89ce6753716044c38e706062ede875b4 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-657239249", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 0}} Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-657239249', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'min_count': 0}}} Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 0 Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:36.516534 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0b08ab9-54a3-4fa9-9561-4a7205c23226 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e0b08ab9-54a3-4fa9-9561-4a7205c23226 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020816 Sep 13 16:47:36.523302 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2009/4042] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:47:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:47:36.671708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30e4d73c-8832-433f-a625-81de2977fb76 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1134693855", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 2.5}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30e4d73c-8832-433f-a625-81de2977fb76 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Request method failure captured: Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 170 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQnC1HCrEl5T3tRIR7bPb9SaAItlLgSjOhBr2sS_SAFDtzdPkWfk6n8Qpg0nZAh7YJQ-dJlx5FSYeja6CLXyFP1QUtedyvM5P4GH_qihFEsvehBeo0YwLJ-avWwLWqLPppRGmEXOzzG1gILVoobwrFM85QeTEvVSuQsCMaUoL_SWs4 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f1cbb36a1a0a44b88f8ac05956e92267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f1cbb36a1a0a44b88f8ac05956e92267 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1419019185 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 89ce6753716044c38e706062ede875b4 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1419019185-project Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1134693855", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "min_count": 2.5}} Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1134693855', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'min_count': 2.5}}} Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 2.5 Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:47:36.676895 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 13 16:47:36.681483 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:47:36.684267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30e4d73c-8832-433f-a625-81de2977fb76 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:47:36.685370 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-30e4d73c-8832-433f-a625-81de2977fb76 tempest-MultipleCreateNegativeTestJSON-1419019185 tempest-MultipleCreateNegativeTestJSON-1419019185-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018036 Sep 13 16:47:36.692350 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2010/4043] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:47:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:47:36.800992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:36.818545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:36.820589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:36.824700 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-812e300a-abc1-488d-9866-bc3cb5a0b065 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.874173 Sep 13 16:47:36.825577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2034/4044] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:35 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:37.853088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:37.853795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:37.870834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:37.871353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:37.871803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:37.872522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:37.872991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:37.873442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:38.224025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:38.330732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:38.352621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:38.355325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:38.358521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fdd6dd89-6726-4085-85c1-8ce9dc5b783d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.511664 Sep 13 16:47:38.380427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2011/4045] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:37 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:38.395043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-efae9566-86fb-4e48-83c3-c4ebf94676bf req-b7492348-0d30-46c2-87a5-4fa8af4ca388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac1ae83-2629-43cb-8277-51e52488f4f4", "tag": "28f406da-d1a4-4778-bf84-41ab2edb9733"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:38.444905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-efae9566-86fb-4e48-83c3-c4ebf94676bf req-b7492348-0d30-46c2-87a5-4fa8af4ca388 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:38.448251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-efae9566-86fb-4e48-83c3-c4ebf94676bf req-b7492348-0d30-46c2-87a5-4fa8af4ca388 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:38.450162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-efae9566-86fb-4e48-83c3-c4ebf94676bf req-b7492348-0d30-46c2-87a5-4fa8af4ca388 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:38.493272 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-efae9566-86fb-4e48-83c3-c4ebf94676bf req-b7492348-0d30-46c2-87a5-4fa8af4ca388 service nova] Creating event network-changed:28f406da-d1a4-4778-bf84-41ab2edb9733 for instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 on n-h1-857467-1 Sep 13 16:47:38.507996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-efae9566-86fb-4e48-83c3-c4ebf94676bf req-b7492348-0d30-46c2-87a5-4fa8af4ca388 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124154 Sep 13 16:47:38.511919 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2012/4046] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:38.557796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:38.561355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:38.562322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:38.567103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:38.570174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:38.573057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:38.575996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:38.621529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:38.665995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ce09b08-825d-4548-8686-77839a476422 tempest-AZV2TestJSON-1499530649 tempest-AZV2TestJSON-1499530649-project] 10.222.0.61 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.698946 Sep 13 16:47:38.674302 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2035/4047] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Sep 13 16:47:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:47:39.388549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:39.389899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:39.401779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:39.402980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:39.403915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:39.404694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:39.417750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:39.421863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:39.994358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:40.012999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:40.031079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:40.036343 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a00febc9-dd8c-4ba5-8eb9-f822f7c8006c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.652236 Sep 13 16:47:40.055818 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2013/4048] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:39 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:47:41.068636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:41.069579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:41.094205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:41.094725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:41.095175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:41.095907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:41.096373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:41.096932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:42.008029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:42.022192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:42.029251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:42.033873 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40908dfd-55e2-41b7-8f4f-20d08b8b4448 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.971036 Sep 13 16:47:42.060522 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2036/4049] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:41 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:43.066011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:43.066761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:43.077550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:43.085278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:43.086033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:43.086825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:43.087325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:43.087767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:43.516442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:43.529544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:43.532642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:43.534319 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89e4e098-706d-416d-98a4-10683571808e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.473779 Sep 13 16:47:43.553929 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2014/4050] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:43 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:44.564435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:44.565125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:44.572152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:44.581789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:44.582989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:44.584520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:44.585462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:44.589389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:44.591160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:45.780889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:45.796624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:45.804006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:45.806379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d53080d5-1d0a-4916-9dd2-9348707ddf6d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 1.246746 Sep 13 16:47:45.810899 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2037/4051] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:44 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:46.833393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:46.834076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:46.837154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=46 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:46.861860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:46.863192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:46.865286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:46.867494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:46.871474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:46.873445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:47.549560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:47.560574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:47.568319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:47.570184 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f72a3039-a1a3-4361-ba7c-a3416c614c56 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.741503 Sep 13 16:47:47.574230 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2015/4052] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:46 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:48.029217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-aa6177b6-5f00-43db-8be5-27e0154545b1 req-76df1daa-053f-4f80-ac66-3a4922c9fff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac1ae83-2629-43cb-8277-51e52488f4f4", "name": "network-vif-plugged", "status": "completed", "tag": "28f406da-d1a4-4778-bf84-41ab2edb9733"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:48.056889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-aa6177b6-5f00-43db-8be5-27e0154545b1 req-76df1daa-053f-4f80-ac66-3a4922c9fff7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:48.057399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-aa6177b6-5f00-43db-8be5-27e0154545b1 req-76df1daa-053f-4f80-ac66-3a4922c9fff7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:48.057862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-aa6177b6-5f00-43db-8be5-27e0154545b1 req-76df1daa-053f-4f80-ac66-3a4922c9fff7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:48.104413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-aa6177b6-5f00-43db-8be5-27e0154545b1 req-76df1daa-053f-4f80-ac66-3a4922c9fff7 service nova] Creating event network-vif-plugged:28f406da-d1a4-4778-bf84-41ab2edb9733 for instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 on n-h1-857467-1 Sep 13 16:47:48.127363 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-aa6177b6-5f00-43db-8be5-27e0154545b1 req-76df1daa-053f-4f80-ac66-3a4922c9fff7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102157 Sep 13 16:47:48.129292 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2038/4053] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:47:48.600153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:48.600939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:48.612891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:48.624125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:48.624751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:48.625576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:48.626352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:48.627012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:48.994446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:49.005096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:49.006653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:49.007840 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb133e38-265c-4e33-ad93-d2fd2ea51d2c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.412288 Sep 13 16:47:49.024671 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2016/4054] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:48 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:50.054500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:50.055235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:50.068324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:50.082355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:50.082900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:50.083331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:50.084062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:50.091628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:50.092352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:50.905152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:50.920525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:50.924390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:50.931677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-069301c4-8291-478c-bb26-0a913fe3bee2 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1360 microversion: 2.26 time: 0.882631 Sep 13 16:47:50.946098 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2039/4055] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:50 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1360 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:51.961554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:51.962304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:51.962801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:51.963542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:51.974836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:51.975344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:51.975997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:51.979326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:51.980008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:51.982079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:51.989689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:51.991342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:51.991825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:51.992585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:51.993056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:51.993490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:52.174522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lazy-loading 'services' on Instance uuid 76cec120-ddf3-4621-8ccc-88bd968deba0 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:52.316357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7b4c274-01fb-4413-b555-53d8e60173a6 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-volume_attachments/4e5cab3e-5eab-4a2e-a2c3-1d563a69036e" status: 202 len: 0 microversion: 2.1 time: 0.357135 Sep 13 16:47:52.317592 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2017/4056] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:47:51 2022] DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-volume_attachments/4e5cab3e-5eab-4a2e-a2c3-1d563a69036e => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:47:52.970219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:52.985498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:52.989788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:52.994396 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0184cbc3-b6b2-4853-bd2f-dd0679cefce0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1545 microversion: 2.26 time: 1.037672 Sep 13 16:47:52.999945 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2040/4057] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:51 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1545 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:53.034659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4c0e310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:53.055654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.059276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.059907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.061918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:53.076236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.079427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.079989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.084629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.085417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.086170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.171745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.172764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.177208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.232971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.234413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.235552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.317138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:53.363806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89fd412d-7678-42a3-be10-7921432a055c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-854276415" status: 201 len: 0 microversion: 2.26 time: 0.327173 Sep 13 16:47:53.370211 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2018/4058] 10.222.0.61 () {62 vars in 1377 bytes} [Tue Sep 13 16:47:53 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-854276415 => generated 0 bytes in 343 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 13 16:47:53.375562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e0b149e-9e69-4817-8d37-43aa5cbbea9e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb5843670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:53.402646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e0b149e-9e69-4817-8d37-43aa5cbbea9e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.403722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e0b149e-9e69-4817-8d37-43aa5cbbea9e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.404359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e0b149e-9e69-4817-8d37-43aa5cbbea9e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.472874 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e0b149e-9e69-4817-8d37-43aa5cbbea9e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-854276415" status: 204 len: 0 microversion: 2.26 time: 0.101367 Sep 13 16:47:53.481719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2041/4059] 10.222.0.61 () {60 vars in 1358 bytes} [Tue Sep 13 16:47:53 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-854276415 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:53.499451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4c0e280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:53.529592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.532976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.533479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.533964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:53.558147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.558703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.559160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.559905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.562073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.562539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.653213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.654102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.654776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.701820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:53.720603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:53.729752 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73a5e1ee-d332-46b4-a0a1-6963091b11b0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 204 len: 0 microversion: 2.26 time: 0.242063 Sep 13 16:47:53.735815 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2019/4060] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Sep 13 16:47:53 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:53.743728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb1af4e9-fdc5-4325-9604-11bb1758a6d7 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb5843280>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:53.767680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb1af4e9-fdc5-4325-9604-11bb1758a6d7 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.770652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb1af4e9-fdc5-4325-9604-11bb1758a6d7 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.771624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb1af4e9-fdc5-4325-9604-11bb1758a6d7 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.784530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb1af4e9-fdc5-4325-9604-11bb1758a6d7 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 200 len: 12 microversion: 2.26 time: 0.045182 Sep 13 16:47:53.786925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2042/4061] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:47:53 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:53.798204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4773700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:53.818257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.820275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.821912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.823667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:53.830388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.840335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.843070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.844078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.848438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.849228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.912886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.913384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.913935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.931384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:53.931868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:53.932310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:53.990110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:54.037367 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b3656a0-61e6-4066-9638-0f89fda1f0ef tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-1726360687" status: 201 len: 0 microversion: 2.26 time: 0.235905 Sep 13 16:47:54.040952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2020/4062] 10.222.0.61 () {62 vars in 1380 bytes} [Tue Sep 13 16:47:53 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-1726360687 => generated 0 bytes in 247 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 13 16:47:54.063867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-910ee7e2-ec69-44f5-82df-1865fd492d07 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb980a310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.095639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910ee7e2-ec69-44f5-82df-1865fd492d07 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.096225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910ee7e2-ec69-44f5-82df-1865fd492d07 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.097367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-910ee7e2-ec69-44f5-82df-1865fd492d07 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.124552 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-910ee7e2-ec69-44f5-82df-1865fd492d07 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 200 len: 36 microversion: 2.26 time: 0.077948 Sep 13 16:47:54.125275 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2043/4063] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:47:54 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 36 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:54.136735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4db7160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.160956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.170846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.175589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.176290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:54.197426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.198286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.198886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.199767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.200397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.200991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.257703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.258484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.259104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.299060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:54.343632 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-819480d8-c083-4d6e-bbf9-44496d5608df tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-1726360687" status: 204 len: 0 microversion: 2.26 time: 0.211782 Sep 13 16:47:54.344567 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2021/4064] 10.222.0.61 () {60 vars in 1364 bytes} [Tue Sep 13 16:47:54 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-1726360687 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:54.355254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0018b16-3197-4c4f-ad0b-49297e04a7e5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4715040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.370255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0018b16-3197-4c4f-ad0b-49297e04a7e5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.382446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0018b16-3197-4c4f-ad0b-49297e04a7e5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.383298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0018b16-3197-4c4f-ad0b-49297e04a7e5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.397711 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0018b16-3197-4c4f-ad0b-49297e04a7e5 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 200 len: 12 microversion: 2.26 time: 0.048074 Sep 13 16:47:54.411094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4db7b80>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.419470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.419862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2044/4065] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:47:54 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 12 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:54.420591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.421262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.422016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:54.429500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.430274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.430942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.431890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.432578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.433236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.458809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.459552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.460225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.477245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:54.497252 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-865b7678-0133-4c98-aa81-1338e4b930d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 204 len: 0 microversion: 2.26 time: 0.091724 Sep 13 16:47:54.511427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb5843280>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.517001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2022/4066] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Sep 13 16:47:54 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:54.522882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.523734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.524420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.525159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:54.531557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.532393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.533063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.534629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.543384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.544997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.581955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.582743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.583392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.593580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.594388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.595027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.632604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:54.678350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8e4793d-ef81-4adf-8dcf-0717501e79da tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-354336914" status: 201 len: 0 microversion: 2.26 time: 0.171112 Sep 13 16:47:54.689277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb47261f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.697760 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2045/4067] 10.222.0.61 () {62 vars in 1377 bytes} [Tue Sep 13 16:47:54 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-354336914 => generated 0 bytes in 191 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 13 16:47:54.711532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.712032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.712478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.712965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:54.727500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.743711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.744672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.745659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.746371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.747039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.796100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.810813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.811494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.823682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.830568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.832128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.901928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:54.934844 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e688f2d-93fe-4f16-9d04-f02f372303b8 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-151291625" status: 201 len: 0 microversion: 2.26 time: 0.249511 Sep 13 16:47:54.946672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb9759430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:54.950513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2023/4068] 10.222.0.61 () {62 vars in 1377 bytes} [Tue Sep 13 16:47:54 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-151291625 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 13 16:47:54.958883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.961507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.962324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.963884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:54.977759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.980587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.983019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:54.984084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:54.986615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:54.989365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.041634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.042583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.044226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.086943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:55.129860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8d837bf-3bb5-48bb-bc60-e1af0803ceba tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 204 len: 0 microversion: 2.26 time: 0.187392 Sep 13 16:47:55.135926 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2046/4069] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Sep 13 16:47:54 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:55.142593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71217fd6-7337-4b2e-b839-66d71d80efe4 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4cbddc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:55.155131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71217fd6-7337-4b2e-b839-66d71d80efe4 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.155893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71217fd6-7337-4b2e-b839-66d71d80efe4 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.156703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71217fd6-7337-4b2e-b839-66d71d80efe4 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.169672 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71217fd6-7337-4b2e-b839-66d71d80efe4 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 200 len: 12 microversion: 2.26 time: 0.032143 Sep 13 16:47:55.182789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb584f280>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:55.188899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2024/4070] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:47:55 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 12 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:55.200560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.203030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.203863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.206066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:55.220015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.222752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.223512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.224381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.226839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.227467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.288403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.289115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.289805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.316051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:55.360943 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a44c3421-bbf9-4c51-8e70-78d8ef571b5c tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 204 len: 0 microversion: 2.26 time: 0.181980 Sep 13 16:47:55.361699 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2047/4071] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Sep 13 16:47:55 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:55.373105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb54b05e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:55.397312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.398452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.400285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.401176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:55.411607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:55.423324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.423914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.424554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.426862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.427354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.427802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.500264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.504592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.506699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.532566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.533443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.535141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.594284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:55.627920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aba1507d-5717-4184-adba-ac9f2c4dc5f0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-560351409" status: 201 len: 0 microversion: 2.26 time: 0.259466 Sep 13 16:47:55.632903 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2025/4072] 10.222.0.61 () {62 vars in 1377 bytes} [Tue Sep 13 16:47:55 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-560351409 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 13 16:47:55.643159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb582d670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:55.673148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.676211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.684356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.684879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:55.701341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.701807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.702299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.703016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.703479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.703920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.762480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.763177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.764299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.776331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.777472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.778159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.817331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:55.839983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0b31fb9-30c8-4534-8195-1f0fc30e7189 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-304032106" status: 201 len: 0 microversion: 2.26 time: 0.200880 Sep 13 16:47:55.841483 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2048/4073] 10.222.0.61 () {62 vars in 1377 bytes} [Tue Sep 13 16:47:55 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags/tempest-tag-304032106 => generated 0 bytes in 203 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 13 16:47:55.854035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Action: 'update_all', calling method: .version_select at 0x7fbeb4cbd670>, body: {"tags": ["tempest-tag-1283268734", "tempest-tag-1777028897"]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:47:55.882523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.883937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.886584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.889097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:55.900859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.901727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.902611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.903567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.904246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.904917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.936742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:55.937545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:55.938778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:55.974929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:56.008525 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e4eaef0-2bdb-4ef2-99a0-1878a9352f1e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 200 len: 62 microversion: 2.26 time: 0.161628 Sep 13 16:47:56.016278 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2026/4074] 10.222.0.61 () {62 vars in 1312 bytes} [Tue Sep 13 16:47:55 2022] PUT /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 62 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:56.023357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9517ac83-e7f0-49be-a509-78de82c6cb60 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4717e50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:56.041356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9517ac83-e7f0-49be-a509-78de82c6cb60 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.042379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9517ac83-e7f0-49be-a509-78de82c6cb60 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.042902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9517ac83-e7f0-49be-a509-78de82c6cb60 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.055374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9517ac83-e7f0-49be-a509-78de82c6cb60 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 200 len: 62 microversion: 2.26 time: 0.038049 Sep 13 16:47:56.056678 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2049/4075] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Sep 13 16:47:56 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 62 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:47:56.068049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '.version_select at 0x7fbeb4c1a430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:56.083677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.085821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.086950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.087955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:56.104210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.106133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.106695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.108451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.110269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.110828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.164698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.165353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.165353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.199716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'flavor' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:47:56.232286 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8be8d35f-4967-4f9e-8000-6a8357605ca0 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags" status: 204 len: 0 microversion: 2.26 time: 0.169236 Sep 13 16:47:56.239717 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2027/4076] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Sep 13 16:47:56 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:56.247043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:56.247721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:56.262124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.262632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.266011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.271844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.272579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.273502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.354984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:47:56.372024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:56.591750 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-edaecb75-fd7e-40b7-9610-5b205267239d tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 204 len: 0 microversion: 2.26 time: 0.350643 Sep 13 16:47:56.593134 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2050/4077] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:47:56 2022] DELETE /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:47:56.602641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:56.604318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:56.614896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.618496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.620812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.621884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:56.634106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:56.635000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:56.669359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:47:57.731884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:57.757052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:57.763141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:47:57.770380 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e0f5b3f1-08a3-4448-8ba7-a5f7ee6c9485 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1551 microversion: 2.26 time: 1.171974 Sep 13 16:47:57.778254 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2028/4078] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:56 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1551 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:47:58.803316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:47:58.804819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:47:58.835123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:58.837862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:58.838558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:47:58.839822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:47:58.842108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:47:58.844906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:00.160600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:00.177629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:00.179389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:00.192343 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7af49d07-3e10-4d0b-8d8a-3ab12c939513 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1551 microversion: 2.26 time: 1.394448 Sep 13 16:48:00.192889 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2051/4079] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:47:58 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1551 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:01.152662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-32563455", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "4e4adf1c-c9a5-4b95-a46d-565d18a7470d"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:01.226441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:01.227706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:01.240651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:01.241392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:01.244123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:01.245060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:01.246311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:01.250561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:01.260411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] validate_networks() for [('4e4adf1c-c9a5-4b95-a46d-565d18a7470d', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:48:01.904809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:01.919715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:01.926125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:01.928009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90559ce8-2b9b-4e15-89b5-b22f58aecc68 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1551 microversion: 2.26 time: 0.707229 Sep 13 16:48:01.938149 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2052/4080] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:01 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1551 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:02.707468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0a348a9b-9feb-4a22-b3c1-ff3f5eb3cf09 req-7dffe2ad-fb58-4fdc-94a1-f7b67e745089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac1ae83-2629-43cb-8277-51e52488f4f4", "name": "network-vif-deleted", "tag": "28f406da-d1a4-4778-bf84-41ab2edb9733"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:02.750040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0a348a9b-9feb-4a22-b3c1-ff3f5eb3cf09 req-7dffe2ad-fb58-4fdc-94a1-f7b67e745089 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:02.750992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0a348a9b-9feb-4a22-b3c1-ff3f5eb3cf09 req-7dffe2ad-fb58-4fdc-94a1-f7b67e745089 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:02.751665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0a348a9b-9feb-4a22-b3c1-ff3f5eb3cf09 req-7dffe2ad-fb58-4fdc-94a1-f7b67e745089 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:02.797775 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0a348a9b-9feb-4a22-b3c1-ff3f5eb3cf09 req-7dffe2ad-fb58-4fdc-94a1-f7b67e745089 service nova] Creating event network-vif-deleted:28f406da-d1a4-4778-bf84-41ab2edb9733 for instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 on n-h1-857467-1 Sep 13 16:48:02.817116 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0a348a9b-9feb-4a22-b3c1-ff3f5eb3cf09 req-7dffe2ad-fb58-4fdc-94a1-f7b67e745089 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113709 Sep 13 16:48:02.821539 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2053/4081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:48:02.994594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:02.995719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:03.009640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:03.012740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:03.013368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:03.018031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:03.019225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:03.024866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:03.134758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:03.136946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:03.138280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:03.140328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lazy-loading 'fault' on Instance uuid 8ac1ae83-2629-43cb-8277-51e52488f4f4 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:48:03.286163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:03.308489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:03.310948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c9a7eaf31b645ddaf2f6184c4722111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1708f00107fd4d42a266f81485b13a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:03.319693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39686377-32fc-4b3c-ae47-e416f550b2d3 tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 200 len: 1350 microversion: 2.26 time: 0.364768 Sep 13 16:48:03.339607 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2054/4082] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:02 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 1350 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:04.054857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1806103840", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "b7ca2186-347f-4ab4-b184-db43d513353b"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:04.133972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] validate_networks() for [('b7ca2186-347f-4ab4-b184-db43d513353b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:48:04.766838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:48:04.769290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:48:04.770721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:48:04.771799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:48:04.773910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:48:04.793122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:04.795375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:04.796088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:04.797212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:04.797957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:04.799008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:04.849380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Getting quotas for project 8d8f932ee66b4c908a7e4df1656ecef9. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:04.861339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Getting quotas for user d0a337390b984f57b27481ee1cdce278 and project 8d8f932ee66b4c908a7e4df1656ecef9. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:04.887041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:48:04.934448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:48:05.064065 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a69b02b-d233-46de-bf3e-0b59bc2f651c tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.186344 Sep 13 16:48:05.064725 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2029/4083] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4188 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:48:05.075384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96088669-2bd4-426c-bf76-793f1e752ce3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:05.088731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96088669-2bd4-426c-bf76-793f1e752ce3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.090229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96088669-2bd4-426c-bf76-793f1e752ce3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.092612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96088669-2bd4-426c-bf76-793f1e752ce3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:05.166217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96088669-2bd4-426c-bf76-793f1e752ce3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Going to try to stop instance {{(pid=122327) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:48:05.266489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96088669-2bd4-426c-bf76-793f1e752ce3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action" status: 202 len: 0 microversion: 2.1 time: 0.199515 Sep 13 16:48:05.267176 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2030/4084] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:48:05 2022] POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:48:05.291072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:05.297025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] [instance: 8ac1ae83-2629-43cb-8277-51e52488f4f4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:05.312354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.315947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.316656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:05.331713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.335233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.336013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:05.372331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] HTTP exception thrown: Instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 could not be found. Sep 13 16:48:05.373027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:48:05.373560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:48:05.374393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:48:05.375183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:48:05.377305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Request method failure captured: Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 HTTP/1.1 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILQcY5VzBzXh2Kdga0rY1Qb-HO-cGfAZSlHZAW2mDykvTkcbY_l4SrBpJIFyocCuPNDnz2gjRlBfL9o3iDSVNRG7ONML4HDCNVzxvNWIv5HLmtmk7OH5chWzQjROVtdUSjJE_vqVJsUAlTfjx_lz-dyZWtMOP_Ep7tJ8qnoMthMrAX8 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.26 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1708f00107fd4d42a266f81485b13a79 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerTagsTestJSON-1110761742 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1708f00107fd4d42a266f81485b13a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1708f00107fd4d42a266f81485b13a79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1708f00107fd4d42a266f81485b13a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1708f00107fd4d42a266f81485b13a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerTagsTestJSON-1110761742 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1708f00107fd4d42a266f81485b13a79 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerTagsTestJSON-1110761742 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerTagsTestJSON-1110761742-project Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 0c9a7eaf31b645ddaf2f6184c4722111 Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerTagsTestJSON-1110761742-project Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 could not be found. Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8ac1ae83-2629-43cb-8277-51e52488f4f4'} Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 could not be found. Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 could not be found. Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:05.384591 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 could not be found. Sep 13 16:48:05.389720 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:05.394122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:05.412748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.413286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.416454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:05.419675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] Returning 404 to user: Instance 8ac1ae83-2629-43cb-8277-51e52488f4f4 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:05.419888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.420655 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce231776-28d9-482a-9237-db3393b94b2e tempest-ServerTagsTestJSON-1110761742 tempest-ServerTagsTestJSON-1110761742-project] 10.222.0.61 "GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4" status: 404 len: 111 microversion: 2.26 time: 0.152360 Sep 13 16:48:05.421353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.422091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:05.427043 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2031/4085] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:05 2022] GET /compute/v2.1/servers/8ac1ae83-2629-43cb-8277-51e52488f4f4 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:48:05.432739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e40cdc6a-a10c-4715-80d1-d69d676d7340 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:05.433756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e40cdc6a-a10c-4715-80d1-d69d676d7340 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:05.473321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Getting quotas for project dba35f085a934e7386f11b3992532b63. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:05.510642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Getting quotas for user 2befbb1ed5bc4c54b2c4ae0a036ade34 and project dba35f085a934e7386f11b3992532b63. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:05.537874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:48:05.551126 n-d-857467-1 devstack@n-api.service[122328]: WARNING nova.utils [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1806103840 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-180610384 Sep 13 16:48:05.555726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:48:05.722380 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d7227be6-33ba-4f53-bf66-01523f374953 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225503 Sep 13 16:48:05.728871 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2055/4086] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:48:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:48:05.765818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e40cdc6a-a10c-4715-80d1-d69d676d7340 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:05.787325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e40cdc6a-a10c-4715-80d1-d69d676d7340 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:05.789291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e40cdc6a-a10c-4715-80d1-d69d676d7340 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:05.794996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e40cdc6a-a10c-4715-80d1-d69d676d7340 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1257 microversion: 2.21 time: 0.366246 Sep 13 16:48:05.796011 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2032/4087] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:05 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1257 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:05.814059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:05.815875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:05.833080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.835242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.835852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:05.836743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:05.838946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:05.839586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:06.445614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27578a7b-63b0-4330-9046-fd38821a15a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'create', calling method: .version_select at 0x7fbeb5bc0c10>, body: {"keypair": {"name": "tempest-keypair-454730044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTOXiMQ12HhI4SQ1m6K/mxFJZkLdabsj6uVqdH+fUUxHgcM+wuz2OFfs3h2LbLGzHphO8kzSFENJpxLqDRo1VvalUTmpdx8PtYi+cdgByKOYWaQoE5FWxpduXyLd/yaoA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:06.501899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-27578a7b-63b0-4330-9046-fd38821a15a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for project 080f8140d40642d9b47f0689e294887b. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:06.525281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-27578a7b-63b0-4330-9046-fd38821a15a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for user c2c12edf9f8d4b23bd1074facb2fad9d and project 080f8140d40642d9b47f0689e294887b. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:06.623127 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27578a7b-63b0-4330-9046-fd38821a15a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.892747 Sep 13 16:48:06.625873 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2056/4088] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:48:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:06.648760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a246b3f3-66c6-4189-8fa4-4f2bfd35f946 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:06.678795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a246b3f3-66c6-4189-8fa4-4f2bfd35f946 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:06.926962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a246b3f3-66c6-4189-8fa4-4f2bfd35f946 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:06.943335 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a246b3f3-66c6-4189-8fa4-4f2bfd35f946 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1232 microversion: 2.1 time: 0.315870 Sep 13 16:48:06.944089 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2057/4089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:06 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1232 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:07.041606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:07.044834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:07.112825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:07.123998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:07.128156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:07.129518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:07.130514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:07.131321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:07.243424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:07.258690 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0d66f14-3a2d-450b-b343-9767eb96aab4 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1677 microversion: 2.1 time: 1.460684 Sep 13 16:48:07.261203 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2033/4090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:05 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1677 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:07.593232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:07.608203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:07.609759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:07.624698 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-496722b0-3c0e-4024-aa2e-fc3dcfb3b622 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1309 microversion: 2.21 time: 0.675266 Sep 13 16:48:07.636985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2058/4091] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:06 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1309 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:07.974569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:07.975685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:08.004015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:08.004609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:08.005078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:08.005870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:08.006341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:08.006780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:08.290065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:08.290704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:08.300971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:08.301484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:08.301966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:08.302716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:08.303371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:08.304266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:08.323290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:08.334886 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51dccb3f-2c97-4d97-9615-f6bccc055793 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1284 microversion: 2.1 time: 0.367496 Sep 13 16:48:08.339784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2034/4092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:07 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1284 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:08.662434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:08.663608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:08.677267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:08.678281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:08.679281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:08.680517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:08.681315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:08.681817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:08.818332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:08.840350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a9f588f-8853-44e2-a160-5690c90204d9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1677 microversion: 2.1 time: 0.554528 Sep 13 16:48:08.851268 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2059/4093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:08 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1677 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:08.946686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:08.959072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:08.964044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:08.966762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2baf3a2-062a-488f-8f13-25337845ca45 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1315 microversion: 2.21 time: 0.307716 Sep 13 16:48:08.972583 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2035/4094] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:08 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:48:09.368426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:09.369384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:09.383583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:09.388317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:09.389184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:09.390400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:09.391947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:09.393206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:09.603610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:09.618439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe791d76-74c6-4803-81da-146bbe1b0fca tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1290 microversion: 2.1 time: 0.256156 Sep 13 16:48:09.631382 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2060/4095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:09 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1290 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:09.877213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:09.878626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:09.902382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:09.902883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:09.903339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:09.904074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:09.904549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:09.905172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:09.999085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:09.999654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:10.008858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:10.011745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:10.012283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:10.014256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:10.014832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:10.015927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:10.405704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:10.420390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:10.423973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:10.428648 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a206458c-59ee-4898-83a0-7501e0ba1494 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1315 microversion: 2.21 time: 0.432363 Sep 13 16:48:10.430652 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2061/4096] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:09 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:10.658284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:10.660470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:10.672250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:10.673647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:10.674465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:10.677149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:10.678151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:10.678869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:10.865448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:10.875585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab45ea35-bf7c-4ec3-86af-c0e9518ae92b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1290 microversion: 2.1 time: 0.231905 Sep 13 16:48:10.879138 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2062/4097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:10 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:10.944471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:10.955716 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a02ab2e-a482-4daf-a161-5f33b8d00d08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1677 microversion: 2.1 time: 1.082978 Sep 13 16:48:10.961768 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2036/4098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:09 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1677 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:11.467954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:11.473344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:11.487903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:11.500609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:11.501412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:11.502425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:11.503780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:11.504480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:11.713686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:11.735852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:11.744058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:11.748421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e84061fb-574d-41c3-9986-0d1b2f5c3388 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1315 microversion: 2.21 time: 0.290282 Sep 13 16:48:11.749211 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2063/4099] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:11 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:11.905651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:11.906671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:11.928819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:11.929324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:11.936665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:11.937736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:11.938528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:11.939203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:11.988937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:11.989797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:12.010866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:12.012760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:12.013466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:12.015365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:12.017783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:12.019006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:12.209030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:12.223497 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58ebf2a3-23a9-4129-a9ae-005e9715b4ac tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1290 microversion: 2.1 time: 0.319655 Sep 13 16:48:12.224848 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2037/4100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:11 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1290 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:12.570786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:12.587146 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5af5f911-f6f6-43eb-8220-b93c1973d4e8 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1677 microversion: 2.1 time: 0.598085 Sep 13 16:48:12.599250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2064/4101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:11 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1677 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:12.775210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:12.776671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:12.812478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:12.813378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:12.814172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:12.815501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:12.816344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:12.817031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:13.047478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:13.057733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:13.066301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:13.076862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40873b3e-8774-4970-8c51-a172dcc676e9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1315 microversion: 2.21 time: 0.305809 Sep 13 16:48:13.077571 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2038/4102] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:12 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:13.251544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:13.252183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:13.263652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:13.264162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:13.266409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:13.267184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:13.267788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:13.268135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:13.445723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:13.462336 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-546e375f-1353-4bb6-be63-cab4e710cd62 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1290 microversion: 2.1 time: 0.214754 Sep 13 16:48:13.463213 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2065/4103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:13 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1290 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:13.624983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:13.626335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:13.648044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:13.648850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:13.649492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:13.650580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:13.651214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:13.653357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:14.105713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:14.108176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:14.116815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:14.118259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:14.119061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:14.120260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:14.120916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:14.121646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:14.830949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:15.253233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:15.263294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4607f40-c9ba-4913-803b-43eb5f1adad7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1677 microversion: 2.1 time: 1.642011 Sep 13 16:48:15.272296 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2039/4104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:13 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1677 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:15.288784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2092322971", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebb6466b-9a22-4490-b956-78da5a25f8b5"}], "security_groups": [{"name": "tempest-securitygroup--1783770477"}], "key_name": "tempest-keypair-454730044", "user_data": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:15.453233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:15.474360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:15.492515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:15.496759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:15.511758 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97706460-224a-49a1-8997-2cb8876334b7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 1.411154 Sep 13 16:48:15.514242 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2066/4105] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:14 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:15.519307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:15.532232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:15.547477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:15.550497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:15.552110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:15.555517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:15.556324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:15.557031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:15.772066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:15.923873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:15.940814 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f99146d-f425-4f65-9eaf-a480fdb77036 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.424965 Sep 13 16:48:15.948614 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2067/4106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:15 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:16.083389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] validate_networks() for [('ebb6466b-9a22-4490-b956-78da5a25f8b5', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:48:16.380095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-705623073", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:16.529343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:48:16.931995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:18.375504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:48:18.375964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:48:18.376253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:48:18.376674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:48:18.377082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:48:18.411498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:18.412017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:18.412469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:18.413224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:18.415642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:18.418119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:18.466883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:18.483533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for user c2c12edf9f8d4b23bd1074facb2fad9d and project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:18.524336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:48:18.536181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:48:18.655863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-345ab2b9-86af-4957-be6b-e05deef61bb5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.380495 Sep 13 16:48:18.657457 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2040/4107] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:48:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 3384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:48:18.678276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:18.682500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:18.712279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:18.714885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:18.715374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:18.729769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:18.730355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:18.730821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:18.900488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:48:18.900994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:48:18.901887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:48:18.902543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:48:18.903325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:48:18.938920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:18.940005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:18.944623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:18.947351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:18.947885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:18.948339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:19.033128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:19.044965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:19.087349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:48:19.095975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:48:19.232131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d417a0e-fffc-4b90-9fce-666924c75029 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.263076 Sep 13 16:48:19.234265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2068/4108] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:48:19.246102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:19.247123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:19.286198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:19.288048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:19.288692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:19.290310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:19.293424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:19.295572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:19.397410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:19.817392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:19.838037 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a62ec25-255f-4713-9b77-5d1161fbd128 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1654 microversion: 2.1 time: 1.179151 Sep 13 16:48:19.839085 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2041/4109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:18 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1654 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:19.855862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:19.865810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:19.883151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:19.888933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:19.890693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:19.898978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:19.899760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:19.904567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.076766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.102604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.107539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.108743 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-192d22d8-52e0-481a-8519-937c48b501f2 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 1.869700 Sep 13 16:48:21.122171 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2069/4110] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:19 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:21.154294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:21.159781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:21.186070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.218756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.220282 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e777add-64b9-4978-ae8f-290ecb5fd63d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 1.374322 Sep 13 16:48:21.227079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.230159 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2042/4111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:19 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:21.234980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.242718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.244409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.254618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.268760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:21.269802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:21.290534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.291422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.292165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.293069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.293718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.294436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.412499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.431986 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-77d4e64d-e626-43d8-b4cc-241649a19250 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1308 microversion: 2.1 time: 0.303077 Sep 13 16:48:21.433615 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2070/4112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:21 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:21.453986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fe802bba-56c1-4beb-9139-95eb98f6890b req-12fe52db-9618-4597-8121-8ba04fa15a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4826ea2a-9af4-492c-aa60-a0b7f70517f2", "tag": "dadb3ee6-40cc-4468-9393-7a26d7b24203"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:21.491156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fe802bba-56c1-4beb-9139-95eb98f6890b req-12fe52db-9618-4597-8121-8ba04fa15a6b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.491675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fe802bba-56c1-4beb-9139-95eb98f6890b req-12fe52db-9618-4597-8121-8ba04fa15a6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.494189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fe802bba-56c1-4beb-9139-95eb98f6890b req-12fe52db-9618-4597-8121-8ba04fa15a6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.527121 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fe802bba-56c1-4beb-9139-95eb98f6890b req-12fe52db-9618-4597-8121-8ba04fa15a6b service nova] Creating event network-changed:dadb3ee6-40cc-4468-9393-7a26d7b24203 for instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 on n-h2-857467-1 Sep 13 16:48:21.544415 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fe802bba-56c1-4beb-9139-95eb98f6890b req-12fe52db-9618-4597-8121-8ba04fa15a6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106763 Sep 13 16:48:21.547987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.553551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2071/4113] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:21.563827 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a62fedf6-a36d-4bfa-8f4d-5e8a07247144 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1244 microversion: 2.1 time: 0.323954 Sep 13 16:48:21.564452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2043/4114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:21 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1244 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:21.566011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06d3a547-1286-40ee-a823-0f398f758157 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:21.576284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06d3a547-1286-40ee-a823-0f398f758157 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.576784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06d3a547-1286-40ee-a823-0f398f758157 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.577294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06d3a547-1286-40ee-a823-0f398f758157 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.607828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06d3a547-1286-40ee-a823-0f398f758157 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Going to try to start instance {{(pid=122328) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 16:48:21.675090 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06d3a547-1286-40ee-a823-0f398f758157 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action" status: 202 len: 0 microversion: 2.1 time: 0.116523 Sep 13 16:48:21.678209 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2072/4115] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:48:21 2022] POST /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:48:21.685333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:21.686196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:21.693213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.693984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.694636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.695933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:21.696699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:21.697132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:21.922346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:21.933332 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-031162d4-da76-4fe5-a83d-eb7d04e8d231 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1663 microversion: 2.1 time: 0.249864 Sep 13 16:48:21.949307 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2044/4116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:21 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1663 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:22.156489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:22.157208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:22.169631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.171419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.176431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.179068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.179768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.180615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.259413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:22.260062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:22.278516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.279024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.279475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.280213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.280686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.281125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.685677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:22.703454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:22.704935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:22.707011 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f97419b-a025-4b39-9970-8e3c3a8741f5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 0.555479 Sep 13 16:48:22.707612 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2073/4117] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:22 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:22.716553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:22.720058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:22.728954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.729475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.729956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.730688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.731159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.731600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.795739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:22.807319 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-120ae59c-172b-42bc-acb9-cdecc548514d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.551497 Sep 13 16:48:22.810427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2045/4118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:22 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:22.824274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:22.840378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:22.841027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:22.846289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a4347f5-2352-4dc5-9c12-0791d997e836 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1296 microversion: 2.1 time: 0.134606 Sep 13 16:48:22.847471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2074/4119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:22 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:22.852161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.853105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.853711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.855542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.856395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.857010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.958217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:22.959272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:22.970536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.971477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.972163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:22.979342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:22.979699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:22.980154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:23.044482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:23.056024 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-caa7ffce-483f-4183-9787-ab70703a6b50 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1250 microversion: 2.1 time: 0.243106 Sep 13 16:48:23.057277 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2046/4120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:22 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1250 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:23.746148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:23.748687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:23.815040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:23.815841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:23.818668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:23.851360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:23.854994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:23.855595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:23.912653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:23.929304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-134ad008-c61d-43ec-ae5d-17c60b1a1950 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1663 microversion: 2.1 time: 1.007133 Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2075/4121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:22 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1663 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:24.043378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:24.048468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:24.048468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:24.874353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:24.891312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:24.894834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:24.906053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-629b52cd-daf2-4fad-b0f1-b25b2b5f7896 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 1.171817 Sep 13 16:48:24.909521 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2047/4122] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:23 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:24.915121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:24.926771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:24.939570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:24.942535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:24.944139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:24.945044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:24.959616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:24.960102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.037066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:25.050815 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80fc89c8-d3c0-400b-bb9f-e0a0480bff66 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 1.072939 Sep 13 16:48:25.069519 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2076/4123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:23 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:25.074199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1765f5e3-9450-4a70-a5f5-119d41b5a3de req-09f375ac-ba8b-4139-b9e6-edf051534e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e19df5-5597-4976-a9a5-0e8058647e0e", "tag": "d9ef8458-aa19-4ce1-ac64-a17eebd38293"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:25.093872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1765f5e3-9450-4a70-a5f5-119d41b5a3de req-09f375ac-ba8b-4139-b9e6-edf051534e86 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.094367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1765f5e3-9450-4a70-a5f5-119d41b5a3de req-09f375ac-ba8b-4139-b9e6-edf051534e86 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.094804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1765f5e3-9450-4a70-a5f5-119d41b5a3de req-09f375ac-ba8b-4139-b9e6-edf051534e86 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.126558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1765f5e3-9450-4a70-a5f5-119d41b5a3de req-09f375ac-ba8b-4139-b9e6-edf051534e86 service nova] Creating event network-changed:d9ef8458-aa19-4ce1-ac64-a17eebd38293 for instance a5e19df5-5597-4976-a9a5-0e8058647e0e on n-h2-857467-1 Sep 13 16:48:25.134286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1765f5e3-9450-4a70-a5f5-119d41b5a3de req-09f375ac-ba8b-4139-b9e6-edf051534e86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076656 Sep 13 16:48:25.140397 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2077/4124] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:25.154043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:25.157606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:25.167878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.168742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.169634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.170551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.171151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.171812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.220351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:25.235754 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff616053-ee7f-427f-b13a-41f72b5d014b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1296 microversion: 2.1 time: 0.319089 Sep 13 16:48:25.249947 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2048/4125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:24 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1296 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:25.255170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:25.256550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:25.278715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.281007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.282436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.285982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.288569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.291031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.617629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:25.626391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f3f7bdd-ac17-4539-9544-96b0410fb3c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1250 microversion: 2.1 time: 0.484587 Sep 13 16:48:25.646243 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2078/4126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:25 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1250 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:25.743987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:25.755235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da0db0fa-a959-4cf4-9cc9-a8c8a3992abd tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1663 microversion: 2.1 time: 0.514345 Sep 13 16:48:25.757917 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2049/4127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:25 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1663 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:25.936599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:25.937218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:25.946985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.947492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.947936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:25.948666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:25.949132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:25.949565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:26.082951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:26.083751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:26.095837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:26.102031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:26.102783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:26.103603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:26.104571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:26.105199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:26.105854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:26.467037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:26.480178 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee81e677-2584-4118-bec8-0c51483ad55f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.402135 Sep 13 16:48:26.481489 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2050/4128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:26 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:26.498376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:26.505542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:26.522193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:26.522945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:26.523535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:26.527000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:26.527906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:26.529818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:26.664281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:26.673985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:26.682912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:26.686044 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-118fbd74-1f4c-45b0-8947-c071a6c559b9 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 0.753821 Sep 13 16:48:26.688664 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2079/4129] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:25 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:26.703215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:26.707296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:26.722596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:26.723099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:26.723539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:26.724445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:26.724958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:26.725328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:27.636895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:27.646069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0acc9a89-80a3-4b70-a23b-0d6e1724b407 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 1.163145 Sep 13 16:48:27.652120 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2051/4130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:26 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:27.665398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:27.666097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:27.677563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:27.684036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:27.684621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:27.685401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:27.685920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:27.686370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:27.755406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:27.766853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0fc6086-2d48-4322-b1ed-a54b05293064 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 1.073249 Sep 13 16:48:27.768484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2080/4131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:26 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:27.775907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:27.776823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:27.786562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:27.788597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:27.790026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:27.791410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:27.792143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:27.792898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.327824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:28.342361 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-acbcf844-0cde-4e37-81e2-3bbbd1ec7aa0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.572048 Sep 13 16:48:28.343017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2081/4132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:27 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:28.363589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:28.364145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:28.392605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.410159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.413213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.417174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.418436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.422242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.438532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:28.516657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:28.522943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:28.535794 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a73b20ce-001a-422c-b707-58a7a3e28793 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1667 microversion: 2.1 time: 0.882355 Sep 13 16:48:28.537955 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2052/4133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:27 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1667 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:28.677872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:28.679416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:28.710229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.710893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.712241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.716862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.717848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.718653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.792689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:28.807081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:28.813253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:28.814881 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19cc1fd0-fa3e-44b0-9cef-07b4eb2fe1a7 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 0.470397 Sep 13 16:48:28.841509 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2082/4134] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:28 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:28.853843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-45117683-6ece-4a97-8953-6a7e3623440f req-316090ba-0753-4e36-b647-49fbb1ec9247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:28.890724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-45117683-6ece-4a97-8953-6a7e3623440f req-316090ba-0753-4e36-b647-49fbb1ec9247 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.891143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-45117683-6ece-4a97-8953-6a7e3623440f req-316090ba-0753-4e36-b647-49fbb1ec9247 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.891593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-45117683-6ece-4a97-8953-6a7e3623440f req-316090ba-0753-4e36-b647-49fbb1ec9247 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.919032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-45117683-6ece-4a97-8953-6a7e3623440f req-316090ba-0753-4e36-b647-49fbb1ec9247 service nova] Creating event network-changed:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:48:28.925658 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-45117683-6ece-4a97-8953-6a7e3623440f req-316090ba-0753-4e36-b647-49fbb1ec9247 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082536 Sep 13 16:48:28.926835 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2083/4135] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:28.933349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:28.934099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:28.965985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.967903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.968497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:28.969976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:28.970753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:28.972424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:29.001413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:29.071746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:29.184200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:29.198194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9882bdfe-5a39-4564-85e5-cef0ec612a95 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.268846 Sep 13 16:48:29.198825 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2084/4136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:28 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:29.314041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d732e29e-9596-4a74-bc58-f3c6d4d61422 req-1bb6327b-2494-41fb-9eb0-e56b2d0996ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a41c4e-8fa2-4ce1-807a-284c34db7b92", "tag": "9776e2c8-1929-4e1b-a8e3-5a5b6797bd03"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:29.345092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d732e29e-9596-4a74-bc58-f3c6d4d61422 req-1bb6327b-2494-41fb-9eb0-e56b2d0996ac service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:29.345610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d732e29e-9596-4a74-bc58-f3c6d4d61422 req-1bb6327b-2494-41fb-9eb0-e56b2d0996ac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:29.348354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d732e29e-9596-4a74-bc58-f3c6d4d61422 req-1bb6327b-2494-41fb-9eb0-e56b2d0996ac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:29.383457 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d732e29e-9596-4a74-bc58-f3c6d4d61422 req-1bb6327b-2494-41fb-9eb0-e56b2d0996ac service nova] Creating event network-changed:9776e2c8-1929-4e1b-a8e3-5a5b6797bd03 for instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 on n-h1-857467-1 Sep 13 16:48:29.397295 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d732e29e-9596-4a74-bc58-f3c6d4d61422 req-1bb6327b-2494-41fb-9eb0-e56b2d0996ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088122 Sep 13 16:48:29.401227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2085/4137] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:29.413325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:29.416752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:29.434189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:29.436773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:29.437545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:29.439260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:29.442518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:29.443242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:29.443934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:29.560023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:29.580368 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-25dca3ab-b84b-4211-9d48-577bd05bdc34 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.908354 Sep 13 16:48:29.599656 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2053/4138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:28 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:29.848054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:29.853195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:29.853866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:29.859179 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c742808-bde1-48ba-9ccf-b4d68569ce4e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.456239 Sep 13 16:48:29.870351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:29.870860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:29.873747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:29.874456 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2086/4139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:29 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:29.875746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:29.876244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:29.879370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.165461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:30.182351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:30.203775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:30.208455 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff51104a-18f8-4ab4-b225-d779b5fec058 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 0.360836 Sep 13 16:48:30.209072 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2054/4140] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:29 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:48:30.226784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:30.227546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:30.236749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.238099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.239184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.240154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.240800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.241457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.241778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ee7240f1-f400-4a8b-90de-eb366c42cda1 req-2ff9a66e-71e4-4802-a04f-c3313e06a69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4826ea2a-9af4-492c-aa60-a0b7f70517f2", "name": "network-vif-plugged", "status": "completed", "tag": "dadb3ee6-40cc-4468-9393-7a26d7b24203"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:30.294454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ee7240f1-f400-4a8b-90de-eb366c42cda1 req-2ff9a66e-71e4-4802-a04f-c3313e06a69e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.295006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ee7240f1-f400-4a8b-90de-eb366c42cda1 req-2ff9a66e-71e4-4802-a04f-c3313e06a69e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.295459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ee7240f1-f400-4a8b-90de-eb366c42cda1 req-2ff9a66e-71e4-4802-a04f-c3313e06a69e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.380471 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ee7240f1-f400-4a8b-90de-eb366c42cda1 req-2ff9a66e-71e4-4802-a04f-c3313e06a69e service nova] Creating event network-vif-plugged:dadb3ee6-40cc-4468-9393-7a26d7b24203 for instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 on n-h2-857467-1 Sep 13 16:48:30.398867 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ee7240f1-f400-4a8b-90de-eb366c42cda1 req-2ff9a66e-71e4-4802-a04f-c3313e06a69e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158041 Sep 13 16:48:30.400292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2055/4141] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:30.554809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:30.559269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:30.569292 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3748bd3c-2ff5-48f2-8687-19815dab07aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.343488 Sep 13 16:48:30.569993 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2087/4142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:30 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:30.605497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:30.606237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:30.618039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.618654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.619129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.620592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.621444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.622108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.821683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:30.830877 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71e4df43-dbfc-40f9-ba1b-44f469564599 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.229434 Sep 13 16:48:30.848133 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2056/4143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:30 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:30.887502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:30.888135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:30.897239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.897747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.898223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:30.898954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:30.899424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:30.899867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.176971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:31.187959 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4f8dc8f-502d-4669-9020-ae044445d3d7 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.304312 Sep 13 16:48:31.189298 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2088/4144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:30 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:31.241751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:31.242484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:31.255689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:31.256194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:31.256653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.257400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:31.257894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:31.258506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.459484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:31.472223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:31.474462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:31.475925 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ae1f22d-3677-43e5-864c-78b85990233e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1357 microversion: 2.21 time: 0.241297 Sep 13 16:48:31.477052 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2057/4145] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:31 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:31.601239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:31.603449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:31.610618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:31.616025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:31.616710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.617912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:31.618555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:31.619564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.854440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:31.854946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:31.865244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:31.866010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:31.866607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.871570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:31.872266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:31.872870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:31.969490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:31.981561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c23aa08c-e50e-44a1-ba15-dbc7ad654ed7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.389248 Sep 13 16:48:31.988057 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2089/4146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:31 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:32.212510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:32.213620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:32.222428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:32.223846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:32.224522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:32.225538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:32.226268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:32.227441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:32.327187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:32.340844 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e04a5e38-6f9c-4353-ad4f-0fdcd331739c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.490480 Sep 13 16:48:32.341582 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2058/4147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:31 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:32.500863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:32.501666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:32.517317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:32.518713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:32.519309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:32.520184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:32.520769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:32.521338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:33.112435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:33.129274 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd3650af-1100-411c-96d5-6a8ab3327486 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.919960 Sep 13 16:48:33.131032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2090/4148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:32 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:33.168534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:33.169919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:33.179159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:33.180527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:33.182189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:33.183417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:33.184377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:33.185212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:33.719154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:33.743010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:33.747216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:33.751454 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a854b36-1eec-423c-baea-d2ca57cefcbd tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1550 microversion: 2.21 time: 1.254659 Sep 13 16:48:33.753745 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2059/4149] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:32 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1550 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:48:33.777376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:33.781209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:33.795960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:33.796680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:33.797388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:33.798316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:33.798984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:33.800119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.122520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:34.134824 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4c1fadd-5baf-405e-a1a0-3c9d7e52ce9e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.974027 Sep 13 16:48:34.139265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2091/4150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:33 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:34.150766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:34.151496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:34.170384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.175413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.176074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.189023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.192300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.194747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.218270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:34.239077 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06dc3beb-1d9a-4b06-ba4b-39e60c25c329 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.484016 Sep 13 16:48:34.241545 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2060/4151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:33 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:34.268532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-75952685-c155-4877-840e-8f2b229ac6d5 req-89431b21-2d0a-45d4-b042-db56935e1f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e19df5-5597-4976-a9a5-0e8058647e0e", "name": "network-vif-plugged", "status": "completed", "tag": "d9ef8458-aa19-4ce1-ac64-a17eebd38293"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:34.302995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-75952685-c155-4877-840e-8f2b229ac6d5 req-89431b21-2d0a-45d4-b042-db56935e1f1a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.303715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-75952685-c155-4877-840e-8f2b229ac6d5 req-89431b21-2d0a-45d4-b042-db56935e1f1a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.304338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-75952685-c155-4877-840e-8f2b229ac6d5 req-89431b21-2d0a-45d4-b042-db56935e1f1a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.316819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:48:34.333173 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-75952685-c155-4877-840e-8f2b229ac6d5 req-89431b21-2d0a-45d4-b042-db56935e1f1a service nova] Creating event network-vif-plugged:d9ef8458-aa19-4ce1-ac64-a17eebd38293 for instance a5e19df5-5597-4976-a9a5-0e8058647e0e on n-h2-857467-1 Sep 13 16:48:34.348838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-75952685-c155-4877-840e-8f2b229ac6d5 req-89431b21-2d0a-45d4-b042-db56935e1f1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089858 Sep 13 16:48:34.350442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2061/4152] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:34.360170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:34.361110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:34.372377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.373143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.374022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.375245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.375902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.379093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.505125 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ec4c944-799a-4f14-9a7b-9a11704e211d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 204 len: 0 microversion: 2.21 time: 0.364055 Sep 13 16:48:34.506172 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2092/4153] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:48:34 2022] DELETE /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:48:34.520242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:34.521018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:34.542163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.542820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.543226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.543992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:34.544469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:34.544905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:34.670576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:34.689218 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c115aec-345d-4c2f-94ef-18d12c0fe3c0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.334930 Sep 13 16:48:34.691448 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2062/4154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:34 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:35.045952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:35.062734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:35.064511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:35.067080 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abe95248-8c13-45ad-b942-79d3e0e60d66 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1556 microversion: 2.21 time: 0.556425 Sep 13 16:48:35.078625 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2093/4155] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:34 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1556 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:48:35.165355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:35.166263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:35.185562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:35.186702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:35.188478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:35.190618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:35.193189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:35.196121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:35.269096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:35.270436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:35.290750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:35.292979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:35.294779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:35.295863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:35.300878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:35.301846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:35.757269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:35.783555 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a9d6aeb-ddc8-4ab4-8586-ef00fcbf70a4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.620645 Sep 13 16:48:35.794241 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2063/4156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:35 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:35.800109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:35.817888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:35.846488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:35.847183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:35.847742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:35.848498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:35.848973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:35.849413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:36.182584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:36.198843 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4327c657-b179-49e8-ae87-b4dcb1509efa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.934114 Sep 13 16:48:36.200227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2094/4157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:35 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:36.224969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:36.250874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:36.267643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:36.270440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:36.270955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:36.271785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:36.273940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:36.275838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:36.551424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:36.568513 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d759619-63f0-4c22-beb9-82bc7e02395b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.770993 Sep 13 16:48:36.573683 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2064/4158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:35 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:36.809867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:36.810608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:36.821542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:36.826712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:36.828638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:36.831320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:36.836163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:36.836805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:36.962265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:37.561777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:37.584003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:37.597687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:37.605085 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-37d79876-0722-4556-9db5-7982b88c99a5 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1556 microversion: 2.21 time: 1.403563 Sep 13 16:48:37.610967 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2095/4159] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:36 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1556 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:37.650376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:37.652959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:37.666863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:37.672773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:37.676147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:37.677017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:37.678081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:37.679026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:37.679687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:37.685883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aad6213-2341-48b7-b48b-c7da48de0559 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.878830 Sep 13 16:48:37.686713 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2065/4160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:36 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:37.712632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:37.713265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:37.743503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:37.744016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:37.744468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:37.745195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:37.745665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:37.746192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:37.948950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:37.967401 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1670f709-35a8-4ad5-b267-ae0ceead3f66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.339413 Sep 13 16:48:37.969478 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2096/4161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:37 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:38.364999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:38.381704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0495ac01-6763-4d41-8aaa-793cd9307df9 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1332 microversion: 2.1 time: 0.694051 Sep 13 16:48:38.384342 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2066/4162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:37 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1332 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:38.640387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:38.642169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:38.654424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.655429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.656134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.657659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.660616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.661313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.715725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:38.716874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:38.754552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.755506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.757926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:38.765412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:38.769397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:38.770942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.028325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:39.047617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:39.057009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:39.063810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a163594e-7bb3-4fab-8fec-a8559301d86e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1514 microversion: 2.21 time: 0.430750 Sep 13 16:48:39.066467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2097/4163] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:38 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1514 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:48:39.091966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:39.096982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:39.120956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.128398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.132538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.133655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.136327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.140304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.489227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:39.502961 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a093dcbd-bdac-45d4-98b0-0f8dbf8f4feb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.795449 Sep 13 16:48:39.505183 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2067/4164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:38 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:39.518376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6360615e-2186-477b-9e0c-dde96d1ace6f req-1431f0b0-9dc8-40b7-8915-45043e178d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4826ea2a-9af4-492c-aa60-a0b7f70517f2", "name": "network-vif-deleted", "tag": "dadb3ee6-40cc-4468-9393-7a26d7b24203"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:39.547688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6360615e-2186-477b-9e0c-dde96d1ace6f req-1431f0b0-9dc8-40b7-8915-45043e178d11 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.548391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6360615e-2186-477b-9e0c-dde96d1ace6f req-1431f0b0-9dc8-40b7-8915-45043e178d11 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.549006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6360615e-2186-477b-9e0c-dde96d1ace6f req-1431f0b0-9dc8-40b7-8915-45043e178d11 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.582160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6360615e-2186-477b-9e0c-dde96d1ace6f req-1431f0b0-9dc8-40b7-8915-45043e178d11 service nova] Creating event network-vif-deleted:dadb3ee6-40cc-4468-9393-7a26d7b24203 for instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 on n-h2-857467-1 Sep 13 16:48:39.601936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6360615e-2186-477b-9e0c-dde96d1ace6f req-1431f0b0-9dc8-40b7-8915-45043e178d11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095169 Sep 13 16:48:39.608538 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2068/4165] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:39.617941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:39.618658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:39.644297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.645257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.645906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.647077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.652714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.653346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.789109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:39.798734 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-83368344-b236-4373-8e1d-ac450b36be31 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.730234 Sep 13 16:48:39.808073 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2098/4166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:39 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:39.843486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3b8f229e-8d30-4409-8f7b-8ac5ba0f08c6 req-df23bd12-1fe7-4dc7-a530-bda83f78d49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-plugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:39.855353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3b8f229e-8d30-4409-8f7b-8ac5ba0f08c6 req-df23bd12-1fe7-4dc7-a530-bda83f78d49e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:39.860618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3b8f229e-8d30-4409-8f7b-8ac5ba0f08c6 req-df23bd12-1fe7-4dc7-a530-bda83f78d49e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:39.861272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3b8f229e-8d30-4409-8f7b-8ac5ba0f08c6 req-df23bd12-1fe7-4dc7-a530-bda83f78d49e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:39.909081 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3b8f229e-8d30-4409-8f7b-8ac5ba0f08c6 req-df23bd12-1fe7-4dc7-a530-bda83f78d49e service nova] Creating event network-vif-plugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:48:39.922712 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3b8f229e-8d30-4409-8f7b-8ac5ba0f08c6 req-df23bd12-1fe7-4dc7-a530-bda83f78d49e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098398 Sep 13 16:48:39.923673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2099/4167] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:40.093796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:40.094794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:40.103157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:40.107680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:40.110712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:40.114421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:40.115431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:40.116119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:40.116765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:40.121737 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e386092-b2ef-4217-b606-1c5c1068692f tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1535 microversion: 2.1 time: 0.511342 Sep 13 16:48:40.126563 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2069/4168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:39 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1535 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:40.154756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8adf0331-f5f5-43ea-86e8-276413a01749 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'create', calling method: .version_select at 0x7fbeb95b9b80>, body: {"pool": "6128d85e-277c-4324-80a2-b0bf61ced0e7"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:40.190689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:40.191269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:40.191720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:40.200213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lazy-loading 'fault' on Instance uuid 4826ea2a-9af4-492c-aa60-a0b7f70517f2 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:48:40.349360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:40.367227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:40.368703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0a337390b984f57b27481ee1cdce278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8f932ee66b4c908a7e4df1656ecef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:40.369973 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3a81eaf-774d-4e51-a485-e9ab05fd5f9d tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 200 len: 1347 microversion: 2.21 time: 0.281182 Sep 13 16:48:40.370894 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2100/4169] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:40 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 1347 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:48:40.527296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:40.528199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:40.538980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:40.540957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:40.541907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:40.543275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:40.545073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:40.547135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.089122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:41.109417 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d64d9034-a0ef-44fb-b9f8-febd6e46b292 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.585800 Sep 13 16:48:41.112451 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2101/4170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:40 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:41.124122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:41.125052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:41.142130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.146376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.147420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.151292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.151958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.152561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.487143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:41.502894 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ee48e71-290c-4af9-ac40-3e40389269a2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1364 microversion: 2.1 time: 0.385488 Sep 13 16:48:41.504297 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2102/4171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:41 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1364 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:41.511118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:41.519575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:41.557476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.558114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.558573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.559619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.560082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.575560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.641474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:41.650024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] HTTP exception thrown: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Request method failure captured: Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 HTTP/1.1 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRAOpEh8usIECEJ2xUwXbyGEarGE8ZyM9KEfy9_WGKyagqzZoiigT8-FCuCJY1tq8izA2uAXAaDdKUN8NrxvgRd_ET55n2g2yGvAM9dErmDzCaBRZh04q8BVUTREyyKZQZWJAf7SqAJjPLuULoPpBZOwx32XZMv_j6qiaL8ZI6V6M8 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.21 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 8d8f932ee66b4c908a7e4df1656ecef9 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 8d8f932ee66b4c908a7e4df1656ecef9 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-InstanceActionsV221TestJSON-301146606-project Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d0a337390b984f57b27481ee1cdce278 Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-InstanceActionsV221TestJSON-301146606-project Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4826ea2a-9af4-492c-aa60-a0b7f70517f2'} Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:41.650822 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:41.654613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Returning 404 to user: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:41.675466 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2809a108-1119-497b-a759-4259a2455328 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 404 len: 111 microversion: 2.21 time: 0.145238 Sep 13 16:48:41.680883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2103/4172] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:41 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:48:41.714954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '.version_select at 0x7fbeb582d310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:41.715495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:41.744088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.745928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.747504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.748540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.751839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.757357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:41.953736 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d840146b-1460-49cf-9d9f-c7105ab6f78e tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.271187 Sep 13 16:48:41.955022 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2104/4173] 10.222.0.61 () {60 vars in 1337 bytes} [Tue Sep 13 16:48:41 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2/os-instance-actions => generated 611 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:48:41.983627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:41.984154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:41.997184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:41.997962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:41.999565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.002830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.003712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.005730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.040661 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] HTTP exception thrown: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Request method failure captured: Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 HTTP/1.1 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRAOpEh8usIECEJ2xUwXbyGEarGE8ZyM9KEfy9_WGKyagqzZoiigT8-FCuCJY1tq8izA2uAXAaDdKUN8NrxvgRd_ET55n2g2yGvAM9dErmDzCaBRZh04q8BVUTREyyKZQZWJAf7SqAJjPLuULoPpBZOwx32XZMv_j6qiaL8ZI6V6M8 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.21 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 8d8f932ee66b4c908a7e4df1656ecef9 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 8d8f932ee66b4c908a7e4df1656ecef9 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-InstanceActionsV221TestJSON-301146606-project Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d0a337390b984f57b27481ee1cdce278 Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-InstanceActionsV221TestJSON-301146606-project Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4826ea2a-9af4-492c-aa60-a0b7f70517f2'} Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:42.044218 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.047421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.052499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Returning 404 to user: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:42.053860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-498423f5-bd5c-4e01-85fa-acebd42f6c95 tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 404 len: 111 microversion: 2.21 time: 0.080846 Sep 13 16:48:42.055054 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2105/4174] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:48:41 2022] DELETE /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:48:42.078574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:42.080879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] [instance: 4826ea2a-9af4-492c-aa60-a0b7f70517f2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:42.103707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.105960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.110808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.113140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.114347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.116396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.180070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] HTTP exception thrown: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Request method failure captured: Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 HTTP/1.1 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRAOpEh8usIECEJ2xUwXbyGEarGE8ZyM9KEfy9_WGKyagqzZoiigT8-FCuCJY1tq8izA2uAXAaDdKUN8NrxvgRd_ET55n2g2yGvAM9dErmDzCaBRZh04q8BVUTREyyKZQZWJAf7SqAJjPLuULoPpBZOwx32XZMv_j6qiaL8ZI6V6M8 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.21 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 8d8f932ee66b4c908a7e4df1656ecef9 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8d8f932ee66b4c908a7e4df1656ecef9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 8d8f932ee66b4c908a7e4df1656ecef9 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-301146606 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-InstanceActionsV221TestJSON-301146606-project Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d0a337390b984f57b27481ee1cdce278 Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-InstanceActionsV221TestJSON-301146606-project Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4826ea2a-9af4-492c-aa60-a0b7f70517f2'} Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.183835 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. Sep 13 16:48:42.188215 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:42.191045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] Returning 404 to user: Instance 4826ea2a-9af4-492c-aa60-a0b7f70517f2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:42.194699 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-328a1652-c4c1-4854-90c1-797f28c47dde tempest-InstanceActionsV221TestJSON-301146606 tempest-InstanceActionsV221TestJSON-301146606-project] 10.222.0.61 "GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2" status: 404 len: 111 microversion: 2.21 time: 0.129274 Sep 13 16:48:42.196713 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2106/4175] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:48:42 2022] GET /compute/v2.1/servers/4826ea2a-9af4-492c-aa60-a0b7f70517f2 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:48:42.205799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:42.209021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:42.223188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.226274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.230216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.233358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.235802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.237570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.731926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:42.741881 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a031cf70-a064-4208-993e-bd9552c5517b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.543209 Sep 13 16:48:42.758376 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2107/4176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:42 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:42.770747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:42.771390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:42.787384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.787842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.791401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:42.791401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:42.791869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:42.793142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:43.384156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:43.401591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce84be0b-a79a-485c-9592-d46397e293b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1550 microversion: 2.1 time: 0.638758 Sep 13 16:48:43.406669 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2108/4177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:42 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1550 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:43.435797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-908808c3-854a-4009-8380-8b8f30b8a41f req-8133dacd-8874-498a-b60b-5b08881cc6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a41c4e-8fa2-4ce1-807a-284c34db7b92", "name": "network-vif-plugged", "status": "completed", "tag": "9776e2c8-1929-4e1b-a8e3-5a5b6797bd03"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:43.486891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-908808c3-854a-4009-8380-8b8f30b8a41f req-8133dacd-8874-498a-b60b-5b08881cc6e5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:43.490384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-908808c3-854a-4009-8380-8b8f30b8a41f req-8133dacd-8874-498a-b60b-5b08881cc6e5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:43.491118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-908808c3-854a-4009-8380-8b8f30b8a41f req-8133dacd-8874-498a-b60b-5b08881cc6e5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:43.512075 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-908808c3-854a-4009-8380-8b8f30b8a41f req-8133dacd-8874-498a-b60b-5b08881cc6e5 service nova] Creating event network-vif-plugged:9776e2c8-1929-4e1b-a8e3-5a5b6797bd03 for instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 on n-h1-857467-1 Sep 13 16:48:43.519451 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-908808c3-854a-4009-8380-8b8f30b8a41f req-8133dacd-8874-498a-b60b-5b08881cc6e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097496 Sep 13 16:48:43.521471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2109/4178] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:43.529345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:43.530257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:43.539441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:43.540563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:43.541227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:43.542343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:43.543103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:43.543752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:43.828056 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f7cf4cb-a4dd-4159-ad2e-caa9d73e13f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.304801 Sep 13 16:48:43.828680 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2110/4179] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:48:43 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/os-interface => generated 284 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:43.833664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:43.834318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:43.851524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:43.852048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:43.852505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:43.853241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:43.853790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:43.854404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:44.393429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:44.408917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-401f62df-a56b-41f8-ad0e-719b4c01cd2d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 0.578524 Sep 13 16:48:44.416620 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2111/4180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:43 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:45.442858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:45.444593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:45.462492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.464310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.468065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.469194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.472396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.473903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.896164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8adf0331-f5f5-43ea-86e8-276413a01749 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.748687 Sep 13 16:48:45.897300 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2070/4181] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:48:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:48:45.911470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.187"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:45.914563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:45.934794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.944282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.945757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:45.946823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:45.951464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:45.956443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:46.031929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:48:46.032348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquired lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:48:46.661208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:46.687002 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a48c98e7-0ea1-4375-9420-91fbb5108a6d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1292 microversion: 2.1 time: 1.246732 Sep 13 16:48:46.693665 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2112/4182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:45 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1292 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:47.717684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:47.718591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:47.754584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:47.755207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:47.755801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:47.757544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:47.758944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:47.760328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:48.907217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:48.929219 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef183a94-58e2-43ec-9728-2c4a114667f6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1473 microversion: 2.1 time: 1.212944 Sep 13 16:48:48.934438 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2113/4183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:47 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1473 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:48.946255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-85c4983e-8b61-4aa2-8a02-39336590669c req-686674d2-7cc7-4086-88b8-2970f89f270c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:48.993021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85c4983e-8b61-4aa2-8a02-39336590669c req-686674d2-7cc7-4086-88b8-2970f89f270c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:48.996334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85c4983e-8b61-4aa2-8a02-39336590669c req-686674d2-7cc7-4086-88b8-2970f89f270c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:48.997917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85c4983e-8b61-4aa2-8a02-39336590669c req-686674d2-7cc7-4086-88b8-2970f89f270c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:49.031101 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-85c4983e-8b61-4aa2-8a02-39336590669c req-686674d2-7cc7-4086-88b8-2970f89f270c service nova] Creating event network-changed:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:48:49.048419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-85c4983e-8b61-4aa2-8a02-39336590669c req-686674d2-7cc7-4086-88b8-2970f89f270c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111643 Sep 13 16:48:49.053742 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2114/4184] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:49.219970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-519375549", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:49.292698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Building network info cache for instance {{(pid=122327) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:48:49.336749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:48:50.897153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Updating instance_info_cache with network_info: [{"id": "d9ef8458-aa19-4ce1-ac64-a17eebd38293", "address": "fa:16:3e:ff:5c:d5", "network": {"id": "b7ca2186-347f-4ab4-b184-db43d513353b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-841209092-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dba35f085a934e7386f11b3992532b63", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd9ef8458-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:48:50.917294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Releasing lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:48:50.918644 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-befd5f64-a961-4457-815a-146d95e437fe tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action" status: 202 len: 0 microversion: 2.1 time: 5.012523 Sep 13 16:48:50.919530 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2071/4185] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:48:45 2022] POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action => generated 0 bytes in 5014 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 13 16:48:50.934747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3541ac9b-1877-4144-a811-d65a09646b0e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'create', calling method: .version_select at 0x7fbeb4e5c0d0>, body: {"pool": "6128d85e-277c-4324-80a2-b0bf61ced0e7"} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:51.797423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:48:51.797925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:48:51.798385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:48:51.800094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:48:51.800882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:48:51.848462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:51.849245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:51.852244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:51.853329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:51.855402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:51.856803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:51.917639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:51.944549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:51.976452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:48:51.983722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d1bd3c14-869d-4148-943d-c89278158f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:48:52.152992 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d3c2916-3659-4427-a958-58f19f320abc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.938464 Sep 13 16:48:52.155681 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2115/4186] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:48:52.167844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6144883f-1d13-422c-ab63-9d85cd2d279f req-f0395418-929c-4a8b-8b5a-7bb1ac9f4f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e19df5-5597-4976-a9a5-0e8058647e0e", "tag": "d9ef8458-aa19-4ce1-ac64-a17eebd38293"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:52.200850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6144883f-1d13-422c-ab63-9d85cd2d279f req-f0395418-929c-4a8b-8b5a-7bb1ac9f4f3d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:52.201997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6144883f-1d13-422c-ab63-9d85cd2d279f req-f0395418-929c-4a8b-8b5a-7bb1ac9f4f3d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:52.202620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6144883f-1d13-422c-ab63-9d85cd2d279f req-f0395418-929c-4a8b-8b5a-7bb1ac9f4f3d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:52.233260 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6144883f-1d13-422c-ab63-9d85cd2d279f req-f0395418-929c-4a8b-8b5a-7bb1ac9f4f3d service nova] Creating event network-changed:d9ef8458-aa19-4ce1-ac64-a17eebd38293 for instance a5e19df5-5597-4976-a9a5-0e8058647e0e on n-h2-857467-1 Sep 13 16:48:52.248612 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6144883f-1d13-422c-ab63-9d85cd2d279f req-f0395418-929c-4a8b-8b5a-7bb1ac9f4f3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089042 Sep 13 16:48:52.254230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2116/4187] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:52.260070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d7c20a3c-1871-44e9-b4b7-97ee6882c7fe tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:52.260854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d7c20a3c-1871-44e9-b4b7-97ee6882c7fe tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d1bd3c14-869d-4148-943d-c89278158f15] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:52.291176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d7c20a3c-1871-44e9-b4b7-97ee6882c7fe tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d1bd3c14-869d-4148-943d-c89278158f15] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:48:52.880179 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d7c20a3c-1871-44e9-b4b7-97ee6882c7fe tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15" status: 204 len: 0 microversion: 2.1 time: 0.624177 Sep 13 16:48:52.882864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2117/4188] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:48:52 2022] DELETE /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:48:52.902957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d601ee1f-93c0-41b2-addf-e77f24f3dadd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:52.903613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d601ee1f-93c0-41b2-addf-e77f24f3dadd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d1bd3c14-869d-4148-943d-c89278158f15] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:52.919123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:52.976343 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d601ee1f-93c0-41b2-addf-e77f24f3dadd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d601ee1f-93c0-41b2-addf-e77f24f3dadd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 HTTP/1.1 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd1bd3c14-869d-4148-943d-c89278158f15'} Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance d1bd3c14-869d-4148-943d-c89278158f15 Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:52.993249 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:48:52.997991 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:48:53.001647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d601ee1f-93c0-41b2-addf-e77f24f3dadd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:53.003267 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d601ee1f-93c0-41b2-addf-e77f24f3dadd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15" status: 404 len: 111 microversion: 2.1 time: 0.116119 Sep 13 16:48:53.020807 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2118/4189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:52 2022] GET /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:48:53.238688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1668497038", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:53.355537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:48:54.683184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:48:54.683689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:48:54.684059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:48:54.685091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:48:54.686138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:48:54.709996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:54.710709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:54.711384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:54.712396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:54.713074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:54.715360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:54.748706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:48:54.757085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:48:54.775889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3541ac9b-1877-4144-a811-d65a09646b0e tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.849231 Sep 13 16:48:54.776515 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2072/4190] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Sep 13 16:48:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:48:54.791285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.45"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:54.794526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:54.797648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:48:54.800785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:48:54.803813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:54.804651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:54.805338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:54.806980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:54.811602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:54.812351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:54.875077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:48:54.875220 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9dfb7bea-1b3b-4b71-9531-1e789e3cc1d9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640304 Sep 13 16:48:54.875942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquired lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:48:54.878708 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2119/4191] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:48:54.889387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0471532d-5ea1-40bd-93e0-24f63ea7790e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:54.889965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0471532d-5ea1-40bd-93e0-24f63ea7790e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:55.014590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0471532d-5ea1-40bd-93e0-24f63ea7790e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:55.024721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0471532d-5ea1-40bd-93e0-24f63ea7790e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1221 microversion: 2.1 time: 0.139333 Sep 13 16:48:55.030356 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2120/4192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:54 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:55.857118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7.", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:48:55.857808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Releasing lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:48:55.858426 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.858426 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Request method failure captured: Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action HTTP/1.1 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 45 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILRDVYgKWqTjr_GVhqs5O_bHiTkpq0ca_E6M9Od2pqQcVGgpmRGjh7IK9DGRNMMTlfGgqnfMPGZrUxKvzGJD1lxrLa43gtewklUOuyUj1Huf3MFeDlUQnsJUaIzFriBcnpqRt73dyQnuqGo-7z9Wb-_TMLwtHgOXp-KwcJ73w67AUTA Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dba35f085a934e7386f11b3992532b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2befbb1ed5bc4c54b2c4ae0a036ade34 Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: {"addFloatingIp": {"address": "172.25.7.45"}} Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: exception: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'a5e19df5-5597-4976-a9a5-0e8058647e0e', 'body': {'addFloatingIp': {'address': '172.25.7.45'}}} Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:48:55.860788 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] Sep 13 16:48:55.864795 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:48:55.867858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Returning 400 to user: Cannot associate floating IP 172.25.7.45 (e1799495-6865-49bc-93fb-a98c140ffc8e) with port d9ef8458-aa19-4ce1-ac64-a17eebd38293 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 6128d85e-277c-4324-80a2-b0bf61ced0e7. Sep 13 16:48:55.867858 n-d-857467-1 devstack@n-api.service[122327]: Neutron server returns request_ids: ['req-53cb3a28-a265-472e-a670-0e969af800a1'] {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:48:55.867858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-810195ff-3913-40d3-82d1-ba533b46aba2 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action" status: 400 len: 380 microversion: 2.1 time: 1.076754 Sep 13 16:48:55.867858 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2073/4193] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:48:54 2022] POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action => generated 380 bytes in 1078 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:48:55.873003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47944322-b80b-4a29-b8a8-95fca22dd1da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '.version_select at 0x7fbeb5100670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:56.065061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:56.073309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:56.091512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:56.093299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:56.094383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:56.095150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:56.096323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:56.096756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:56.256038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:56.266206 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55c6a893-acf7-4db2-bf58-567fae9daf3e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1217 microversion: 2.1 time: 0.213754 Sep 13 16:48:56.273900 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2074/4194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:56 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:57.299852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:57.301182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:57.305730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=46 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:48:57.331513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:57.332008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:57.332450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:57.333448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:57.334516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:57.335114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:57.598466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:57.609062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d720ebb-cc4b-491f-b221-77b0282f2586 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1279 microversion: 2.1 time: 0.313276 Sep 13 16:48:57.614070 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2075/4195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:57 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1279 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:48:58.636514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:48:58.637908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:58.660169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:58.660991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:58.661642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:58.662582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:58.663233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:58.663897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:59.128825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:48:59.149110 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62a73111-8589-476b-81ba-88c8610f9dce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.516308 Sep 13 16:48:59.149722 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2076/4196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:48:58 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:48:59.216529 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47944322-b80b-4a29-b8a8-95fca22dd1da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/e1799495-6865-49bc-93fb-a98c140ffc8e" status: 202 len: 0 microversion: 2.1 time: 3.347583 Sep 13 16:48:59.223210 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2121/4197] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:48:55 2022] DELETE /compute/v2.1/os-floating-ips/e1799495-6865-49bc-93fb-a98c140ffc8e => generated 0 bytes in 3355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:48:59.226316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'action', calling method: .version_select at 0x7fbeb7179b80>, body: {"removeFloatingIp": {"address": "172.25.7.187"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:48:59.543526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:48:59.550280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:59.551000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:59.551602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:48:59.552524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:48:59.566226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:48:59.566882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:00.116374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:49:00.116922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquired lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:49:00.507200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1491207008", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "69f04308-bf79-4bb3-bd9e-2d6e53a22d60"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:00.603358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] validate_networks() for [('69f04308-bf79-4bb3-bd9e-2d6e53a22d60', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:49:02.133728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:49:02.134576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:49:02.134980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:49:02.135640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:49:02.136171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:49:02.157006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.158723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.159517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:02.161192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.174919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.175890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:02.246713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Getting quotas for project 95d129eb5a6141d491058f0a9b50970f. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:02.255518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Getting quotas for user 649f9202b3374720a6fb8c6cbb6d5dab and project 95d129eb5a6141d491058f0a9b50970f. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:02.272207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:49:02.274833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:49:02.350717 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5dcbde7d-8219-44b9-8b77-b8478d01bf22 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.355049 Sep 13 16:49:02.352626 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2122/4198] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:49:02.379904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:02.380918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:02.404645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.407288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.409076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:02.414507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.415677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.417689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:02.620804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Building network info cache for instance {{(pid=122327) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 13 16:49:02.895562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:02.905506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80623740-0de2-4ee7-9010-ceb15f8808ad tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.551380 Sep 13 16:49:02.911205 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2123/4199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:02 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:02.923032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e98787be-adb6-4d55-8327-b04a28068b09 req-b9750648-6f97-490b-a6a4-b05589b91c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40537668-bb72-45b7-954c-b3d62cc22a38", "tag": "7cb1870f-b2b0-4315-a5d3-1b695626bd95"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:02.977051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e98787be-adb6-4d55-8327-b04a28068b09 req-b9750648-6f97-490b-a6a4-b05589b91c13 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:02.986339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e98787be-adb6-4d55-8327-b04a28068b09 req-b9750648-6f97-490b-a6a4-b05589b91c13 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:02.989386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e98787be-adb6-4d55-8327-b04a28068b09 req-b9750648-6f97-490b-a6a4-b05589b91c13 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:03.015901 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e98787be-adb6-4d55-8327-b04a28068b09 req-b9750648-6f97-490b-a6a4-b05589b91c13 service nova] Creating event network-changed:7cb1870f-b2b0-4315-a5d3-1b695626bd95 for instance 40537668-bb72-45b7-954c-b3d62cc22a38 on n-h2-857467-1 Sep 13 16:49:03.043406 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e98787be-adb6-4d55-8327-b04a28068b09 req-b9750648-6f97-490b-a6a4-b05589b91c13 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130747 Sep 13 16:49:03.044418 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2124/4200] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:03.062427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a458fc92-b8e5-4697-8064-a03ce45d4ec8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:03.063494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a458fc92-b8e5-4697-8064-a03ce45d4ec8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:03.241942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a458fc92-b8e5-4697-8064-a03ce45d4ec8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:03.252438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a458fc92-b8e5-4697-8064-a03ce45d4ec8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1228 microversion: 2.1 time: 0.203802 Sep 13 16:49:03.253401 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2125/4201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:03 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1228 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:03.600011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Updating instance_info_cache with network_info: [{"id": "d9ef8458-aa19-4ce1-ac64-a17eebd38293", "address": "fa:16:3e:ff:5c:d5", "network": {"id": "b7ca2186-347f-4ab4-b184-db43d513353b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-841209092-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dba35f085a934e7386f11b3992532b63", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd9ef8458-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:49:03.620089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Releasing lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:49:03.621283 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1a568db9-1180-45f2-bc35-0bc1e6476dcc tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action" status: 202 len: 0 microversion: 2.1 time: 4.399022 Sep 13 16:49:03.622534 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2077/4202] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:48:59 2022] POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action => generated 0 bytes in 4402 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 13 16:49:03.630863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8c04aaa-bee8-47b5-b90a-df90358aa7d4 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '.version_select at 0x7fbeb50ceca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:03.944149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:03.949782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:03.958882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:03.963573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:03.966546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:03.968218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:03.968936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:03.972674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:04.273800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:04.288834 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5cd20d66-33c9-4da6-a475-c399e886bd5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.348506 Sep 13 16:49:04.289697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2078/4203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:03 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:04.301612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:04.302717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:04.318255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:04.318777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:04.319235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:04.320733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:04.322674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:04.323128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:04.445918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:04.459219 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c296586d-7185-4f53-ad7b-cedf37a95007 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1232 microversion: 2.1 time: 0.168269 Sep 13 16:49:04.462140 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2079/4204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:04 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1232 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:05.123338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-939332d0-da60-44f8-a680-9e8962ab95c7 req-943e7940-df7d-4806-ac24-6fa6bd5a5d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e19df5-5597-4976-a9a5-0e8058647e0e", "tag": "d9ef8458-aa19-4ce1-ac64-a17eebd38293"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:05.148953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-939332d0-da60-44f8-a680-9e8962ab95c7 req-943e7940-df7d-4806-ac24-6fa6bd5a5d2c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:05.149453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-939332d0-da60-44f8-a680-9e8962ab95c7 req-943e7940-df7d-4806-ac24-6fa6bd5a5d2c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:05.149908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-939332d0-da60-44f8-a680-9e8962ab95c7 req-943e7940-df7d-4806-ac24-6fa6bd5a5d2c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:05.182872 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-939332d0-da60-44f8-a680-9e8962ab95c7 req-943e7940-df7d-4806-ac24-6fa6bd5a5d2c service nova] Creating event network-changed:d9ef8458-aa19-4ce1-ac64-a17eebd38293 for instance a5e19df5-5597-4976-a9a5-0e8058647e0e on n-h2-857467-1 Sep 13 16:49:05.192269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-939332d0-da60-44f8-a680-9e8962ab95c7 req-943e7940-df7d-4806-ac24-6fa6bd5a5d2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072538 Sep 13 16:49:05.195384 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2080/4205] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:49:05.317991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:05.319017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:05.338137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:05.338982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:05.339618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:05.340530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:05.341172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:05.342226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:06.204685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:06.244247 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-11183bf3-ac23-409f-8abc-a3ecd760fb7c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.926894 Sep 13 16:49:06.245286 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2081/4206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:05 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:06.269700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:06.270275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:06.288732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:06.289567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:06.289743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:06.291985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:06.292491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:06.293644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:06.443182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:06.455801 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a7d9e11-0489-4f1e-a52c-8ebf507ab517 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1286 microversion: 2.1 time: 0.208348 Sep 13 16:49:06.462116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2082/4207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:06 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:07.244693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8c04aaa-bee8-47b5-b90a-df90358aa7d4 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/9f81943f-ba9a-4490-8239-fce4447a8ff2" status: 202 len: 0 microversion: 2.1 time: 3.614458 Sep 13 16:49:07.245335 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2126/4208] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:49:03 2022] DELETE /compute/v2.1/os-floating-ips/9f81943f-ba9a-4490-8239-fce4447a8ff2 => generated 0 bytes in 3619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:49:07.267646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-442347ef-142f-4a28-a8e2-e7dbe00fc29a tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:07.268229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:07.268858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-442347ef-142f-4a28-a8e2-e7dbe00fc29a tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Request method failure captured: Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action HTTP/1.1 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 34 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILRDVYgKWqTjr_GVhqs5O_bHiTkpq0ca_E6M9Od2pqQcVGgpmRGjh7IK9DGRNMMTlfGgqnfMPGZrUxKvzGJD1lxrLa43gtewklUOuyUj1Huf3MFeDlUQnsJUaIzFriBcnpqRt73dyQnuqGo-7z9Wb-_TMLwtHgOXp-KwcJ73w67AUTA Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dba35f085a934e7386f11b3992532b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2befbb1ed5bc4c54b2c4ae0a036ade34 Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: {"addFloatingIp": {"address": ""}} Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'a5e19df5-5597-4976-a9a5-0e8058647e0e', 'body': {'addFloatingIp': {'address': ''}}} Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '' Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:49:07.280630 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 13 16:49:07.285921 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.290515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-442347ef-142f-4a28-a8e2-e7dbe00fc29a tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:07.293305 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-442347ef-142f-4a28-a8e2-e7dbe00fc29a tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action" status: 400 len: 142 microversion: 2.1 time: 0.038984 Sep 13 16:49:07.294916 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2083/4209] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:49:07 2022] POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action => generated 142 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:49:07.303555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.304009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.304456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.305178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.305644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.306123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.311220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:07.316094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:07.354031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.357229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.360772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.362045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.364792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.365449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.381317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:07.437685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 16:49:07.438076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquired lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 16:49:07.692051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Releasing lock "refresh_cache-a5e19df5-5597-4976-a9a5-0e8058647e0e" {{(pid=122327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 16:49:07.692802 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] HTTP exception thrown: floating IP not found Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Request method failure captured: Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action HTTP/1.1 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 41 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILRDVYgKWqTjr_GVhqs5O_bHiTkpq0ca_E6M9Od2pqQcVGgpmRGjh7IK9DGRNMMTlfGgqnfMPGZrUxKvzGJD1lxrLa43gtewklUOuyUj1Huf3MFeDlUQnsJUaIzFriBcnpqRt73dyQnuqGo-7z9Wb-_TMLwtHgOXp-KwcJ73w67AUTA Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dba35f085a934e7386f11b3992532b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2befbb1ed5bc4c54b2c4ae0a036ade34 Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: exception: floating IP not found Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'a5e19df5-5597-4976-a9a5-0e8058647e0e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 13 16:49:07.695146 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Returning 404 to user: floating IP not found {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:07.699021 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-609e01d8-47fe-44ff-9c60-2c1cf0230464 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action" status: 404 len: 67 microversion: 2.1 time: 0.390283 Sep 13 16:49:07.702982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2084/4210] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:49:07 2022] POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action => generated 67 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:49:07.713476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:07.714142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:07.728316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.728826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.729279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.730043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.732959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.733919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.783619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:07.793472 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7464002-1fc3-4de9-9c0d-bb2f20a21a81 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.529293 Sep 13 16:49:07.806955 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2127/4211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:07 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:07.816903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c040eda9-bb9a-4a33-9701-ec00a739bc4b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:07.881299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:07.905568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f3746e7-c2e9-461e-8606-f80560b49899 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1286 microversion: 2.1 time: 0.201372 Sep 13 16:49:07.918174 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2085/4212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:07 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1286 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:07.947937 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c040eda9-bb9a-4a33-9701-ec00a739bc4b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c040eda9-bb9a-4a33-9701-ec00a739bc4b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Request method failure captured: Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action HTTP/1.1 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 44 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRDVYgKWqTjr_GVhqs5O_bHiTkpq0ca_E6M9Od2pqQcVGgpmRGjh7IK9DGRNMMTlfGgqnfMPGZrUxKvzGJD1lxrLa43gtewklUOuyUj1Huf3MFeDlUQnsJUaIzFriBcnpqRt73dyQnuqGo-7z9Wb-_TMLwtHgOXp-KwcJ73w67AUTA Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dba35f085a934e7386f11b3992532b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2befbb1ed5bc4c54b2c4ae0a036ade34 Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: exception: Floating IP not found for address 0.0.0.0. Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'a5e19df5-5597-4976-a9a5-0e8058647e0e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 13 16:49:07.949537 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c040eda9-bb9a-4a33-9701-ec00a739bc4b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c040eda9-bb9a-4a33-9701-ec00a739bc4b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action" status: 404 len: 88 microversion: 2.1 time: 0.142959 Sep 13 16:49:07.962604 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2128/4213] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:49:07 2022] POST /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e/action => generated 88 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:49:07.966641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:07.967231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:07.987359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.993677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:07.994196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:07.997259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:07.997890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.000662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.100591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:49:08.308389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a9e69ee-6f5a-44e5-bdb7-b6a2a4746828 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 204 len: 0 microversion: 2.1 time: 0.346788 Sep 13 16:49:08.314386 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2086/4214] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:49:07 2022] DELETE /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:49:08.323345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:08.324873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:08.343423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.344117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.345258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.346265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.346856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.347402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.748766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:08.761125 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1a142cc-b76e-4dcf-8f43-7211a7e7b6dd tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1541 microversion: 2.1 time: 0.442199 Sep 13 16:49:08.765357 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2129/4215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:08 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1541 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:08.824015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:08.825475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:08.835788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.836408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.837232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.838450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.839209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.839898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.931217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:08.932003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:08.948644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.951514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.953974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:08.955735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:08.958065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:08.961111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:09.229314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:09.239567 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b35bd3b6-09a8-4ead-be54-a64351d86a1c tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.314313 Sep 13 16:49:09.243111 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2130/4216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:08 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:09.313415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:09.330444 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-989a3ac8-a4fe-42d5-b942-a8f8bceaa237 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.510874 Sep 13 16:49:09.332906 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2087/4217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:08 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:09.790220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:09.791467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:09.804875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:09.807750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:09.808420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:09.809351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:09.811183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:09.811787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.263705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:10.264877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:10.277523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:10.278878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:10.280041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.282501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:10.283692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:10.285275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.375118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:10.396573 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc522417-5af3-4aae-b7ac-539f2f59f1f0 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1541 microversion: 2.1 time: 0.606361 Sep 13 16:49:10.397474 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2131/4218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:09 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1541 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:10.418735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:10.419357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:10.446493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:10.446997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:10.447438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.448160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:10.448622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:10.449053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:10.848518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:10.861638 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a79f8bc-9ccf-4554-a59c-2ec4d8e1c018 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.459051 Sep 13 16:49:10.873854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2132/4219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:10 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:10.874299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:10.920619 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b5d84d3-836c-445e-a4b5-4d8da842430f tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.660797 Sep 13 16:49:10.926890 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2088/4220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:10 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:11.272535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1e20658a-84da-4b1b-b1f0-d9660c52c45e req-a2943b89-33c3-478b-a16a-3485fec53e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beb2376-1006-46f0-9467-2afb7c5f46c4", "tag": "d41eb67d-600b-4896-b863-3267b56b3d69"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:11.304464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1e20658a-84da-4b1b-b1f0-d9660c52c45e req-a2943b89-33c3-478b-a16a-3485fec53e60 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.305304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1e20658a-84da-4b1b-b1f0-d9660c52c45e req-a2943b89-33c3-478b-a16a-3485fec53e60 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.306302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1e20658a-84da-4b1b-b1f0-d9660c52c45e req-a2943b89-33c3-478b-a16a-3485fec53e60 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:11.340028 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1e20658a-84da-4b1b-b1f0-d9660c52c45e req-a2943b89-33c3-478b-a16a-3485fec53e60 service nova] Creating event network-changed:d41eb67d-600b-4896-b863-3267b56b3d69 for instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 on n-h2-857467-1 Sep 13 16:49:11.357413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1e20658a-84da-4b1b-b1f0-d9660c52c45e req-a2943b89-33c3-478b-a16a-3485fec53e60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088422 Sep 13 16:49:11.361982 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2133/4221] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:11.422146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:11.423494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:11.434928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.436118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.437758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:11.438827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.440172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.441105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:11.790726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:11.805676 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aef8caae-f091-4cbc-8dfa-fdcec2412f3d tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1499 microversion: 2.1 time: 0.388567 Sep 13 16:49:11.821863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2089/4222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:11 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1499 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:11.896354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:11.898627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:11.922927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.924901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.926202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:11.927867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.928704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.929363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:11.954148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:11.956528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:11.984495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.987020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.990332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:11.991688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:11.992438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:11.994227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:12.008735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:12.207922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:12.349533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:12.378976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea27682b-a581-4045-9451-619466248596 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.431031 Sep 13 16:49:12.415090 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2090/4223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:11 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:12.428172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-432d4469-5d34-4c97-b9af-99207413cc58 req-9131f016-3a0e-4e21-82f0-e6a35e13c357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e19df5-5597-4976-a9a5-0e8058647e0e", "name": "network-vif-deleted", "tag": "d9ef8458-aa19-4ce1-ac64-a17eebd38293"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:12.445704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-432d4469-5d34-4c97-b9af-99207413cc58 req-9131f016-3a0e-4e21-82f0-e6a35e13c357 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:12.446516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-432d4469-5d34-4c97-b9af-99207413cc58 req-9131f016-3a0e-4e21-82f0-e6a35e13c357 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:12.447391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-432d4469-5d34-4c97-b9af-99207413cc58 req-9131f016-3a0e-4e21-82f0-e6a35e13c357 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:12.468561 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-432d4469-5d34-4c97-b9af-99207413cc58 req-9131f016-3a0e-4e21-82f0-e6a35e13c357 service nova] Creating event network-vif-deleted:d9ef8458-aa19-4ce1-ac64-a17eebd38293 for instance a5e19df5-5597-4976-a9a5-0e8058647e0e on n-h2-857467-1 Sep 13 16:49:12.507975 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-432d4469-5d34-4c97-b9af-99207413cc58 req-9131f016-3a0e-4e21-82f0-e6a35e13c357 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085903 Sep 13 16:49:12.513318 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2091/4224] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:12.525009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5ea6b567-e200-48aa-abb7-ad7a3fc54c26 req-6ddd92a9-c55a-4c26-90bc-9727ac0d6f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40537668-bb72-45b7-954c-b3d62cc22a38", "name": "network-vif-plugged", "status": "completed", "tag": "7cb1870f-b2b0-4315-a5d3-1b695626bd95"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:12.552620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5ea6b567-e200-48aa-abb7-ad7a3fc54c26 req-6ddd92a9-c55a-4c26-90bc-9727ac0d6f10 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:12.553419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5ea6b567-e200-48aa-abb7-ad7a3fc54c26 req-6ddd92a9-c55a-4c26-90bc-9727ac0d6f10 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:12.555390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5ea6b567-e200-48aa-abb7-ad7a3fc54c26 req-6ddd92a9-c55a-4c26-90bc-9727ac0d6f10 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:12.574797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5ea6b567-e200-48aa-abb7-ad7a3fc54c26 req-6ddd92a9-c55a-4c26-90bc-9727ac0d6f10 service nova] Creating event network-vif-plugged:7cb1870f-b2b0-4315-a5d3-1b695626bd95 for instance 40537668-bb72-45b7-954c-b3d62cc22a38 on n-h2-857467-1 Sep 13 16:49:12.581987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5ea6b567-e200-48aa-abb7-ad7a3fc54c26 req-6ddd92a9-c55a-4c26-90bc-9727ac0d6f10 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065925 Sep 13 16:49:12.583835 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2092/4225] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:12.628309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:12.653430 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-24abc1d7-4926-4290-acd5-156fa5598a1d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.763848 Sep 13 16:49:12.658483 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2134/4226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:11 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:12.836032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:12.836851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:12.859410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:12.859978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:12.860461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:12.861281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:12.869010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:12.869496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.018365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.019578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.020183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.020835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lazy-loading 'fault' on Instance uuid a5e19df5-5597-4976-a9a5-0e8058647e0e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:49:13.129467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:13.139696 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06eb61e7-d689-4b88-981c-3b51215cf8da tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1322 microversion: 2.1 time: 0.311214 Sep 13 16:49:13.141496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2093/4227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:12 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:13.259700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=24 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:13.414796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:13.415698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:13.430028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.432256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.434259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.437821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.438797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.440441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.550500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca9a195c-958b-4aa7-ac31-50307fb7c6bf tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Action: 'create', calling method: .version_select at 0x7fbeb9733430>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:13.572479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ca9a195c-958b-4aa7-ac31-50307fb7c6bf tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Getting quotas for project dcf458bed83f4a77ba098a3e43e25be9. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:13.581402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ca9a195c-958b-4aa7-ac31-50307fb7c6bf tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Getting quotas for user 1949ad9fc2f347e6bf37c7686fc4cd36 and project dcf458bed83f4a77ba098a3e43e25be9. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:13.669054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ca9a195c-958b-4aa7-ac31-50307fb7c6bf tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Getting quotas for project dcf458bed83f4a77ba098a3e43e25be9. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:13.680782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ca9a195c-958b-4aa7-ac31-50307fb7c6bf tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Getting quotas for user 1949ad9fc2f347e6bf37c7686fc4cd36 and project dcf458bed83f4a77ba098a3e43e25be9. Resources: {'server_groups'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:13.704684 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca9a195c-958b-4aa7-ac31-50307fb7c6bf tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.450879 Sep 13 16:49:13.712675 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2135/4228] 10.222.0.61 () {62 vars in 1214 bytes} [Tue Sep 13 16:49:13 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:49:13.723941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:13.724604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:13.735402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.737033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.737887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.738565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:13.739035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:13.739494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:13.873255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:13.891660 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-10f7e384-8b1c-4c6c-8ab0-b82ff2770f38 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.480340 Sep 13 16:49:13.918854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2094/4229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:13 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:13.929960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32f21412-209b-40c4-b1dd-e113c3ce2b16 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:13.957672 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32f21412-209b-40c4-b1dd-e113c3ce2b16 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.034608 Sep 13 16:49:13.959077 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2095/4230] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Sep 13 16:49:13 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:49:13.980245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a965d93-cca1-4e84-8a9a-b8cc0fe8cc4b tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:13.996620 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a965d93-cca1-4e84-8a9a-b8cc0fe8cc4b tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49" status: 200 len: 235 microversion: 2.64 time: 0.026618 Sep 13 16:49:13.997782 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2096/4231] 10.222.0.61 () {60 vars in 1304 bytes} [Tue Sep 13 16:49:13 2022] GET /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49 => generated 235 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 16:49:14.010211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b20beef-acd8-4a0f-98dd-bc6819984d12 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:14.040413 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b20beef-acd8-4a0f-98dd-bc6819984d12 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49" status: 204 len: 0 microversion: 2.64 time: 0.034914 Sep 13 16:49:14.041226 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2097/4232] 10.222.0.61 () {60 vars in 1307 bytes} [Tue Sep 13 16:49:14 2022] DELETE /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 16:49:14.053864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b142f62d-9dbd-4aef-9939-2cf0c74375e9 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:14.065403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b142f62d-9dbd-4aef-9939-2cf0c74375e9 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] HTTP exception thrown: Instance group a4f9d919-a530-43b6-9877-2ee18bfe9a49 could not be found. Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b142f62d-9dbd-4aef-9939-2cf0c74375e9 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Request method failure captured: Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49 HTTP/1.1 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILSJHSICt3DkCkGVvo1ktSKfGVtT0nGqFgt0FjrCB5yEmswMg-JS1cnMlvBZ7X0nfN43BogrZj_H2-2rHyJobBuq8-zPeQ9DF6fI-JTgBCFVIEFhNDxvo9rLm73mV-P5VFpH7m7Muaw1ufzojqMt_5tEifwTP-VY2Hm3hzNRQF1cLvg Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.64 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dcf458bed83f4a77ba098a3e43e25be9 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerGroup264TestJSON-897399234 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dcf458bed83f4a77ba098a3e43e25be9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dcf458bed83f4a77ba098a3e43e25be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dcf458bed83f4a77ba098a3e43e25be9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dcf458bed83f4a77ba098a3e43e25be9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerGroup264TestJSON-897399234 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dcf458bed83f4a77ba098a3e43e25be9 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerGroup264TestJSON-897399234 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerGroup264TestJSON-897399234-project Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 1949ad9fc2f347e6bf37c7686fc4cd36 Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerGroup264TestJSON-897399234-project Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance group a4f9d919-a530-43b6-9877-2ee18bfe9a49 could not be found. Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'a4f9d919-a530-43b6-9877-2ee18bfe9a49'} Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a4f9d919-a530-43b6-9877-2ee18bfe9a49 could not be found. Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a4f9d919-a530-43b6-9877-2ee18bfe9a49 could not be found. Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:14.068574 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:14.072922 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:14.072922 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:14.072922 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:14.072922 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:14.072922 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a4f9d919-a530-43b6-9877-2ee18bfe9a49 could not be found. Sep 13 16:49:14.072922 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:14.076223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b142f62d-9dbd-4aef-9939-2cf0c74375e9 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] Returning 404 to user: Instance group a4f9d919-a530-43b6-9877-2ee18bfe9a49 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:14.078352 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b142f62d-9dbd-4aef-9939-2cf0c74375e9 tempest-ServerGroup264TestJSON-897399234 tempest-ServerGroup264TestJSON-897399234-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49" status: 404 len: 117 microversion: 2.64 time: 0.028210 Sep 13 16:49:14.085427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2098/4233] 10.222.0.61 () {60 vars in 1307 bytes} [Tue Sep 13 16:49:14 2022] DELETE /compute/v2.1/os-server-groups/a4f9d919-a530-43b6-9877-2ee18bfe9a49 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:49:14.194028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:14.196623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:14.213760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.214599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.215250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:14.216339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.217372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.218092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:14.241988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:14.269234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.270190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.270894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:14.275589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lazy-loading 'fault' on Instance uuid a5e19df5-5597-4976-a9a5-0e8058647e0e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:49:14.285988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67a947b6-e020-4cf6-93b7-f327b22f0209 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.572922 Sep 13 16:49:14.286923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2136/4234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:13 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:14.342903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2befbb1ed5bc4c54b2c4ae0a036ade34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba35f085a934e7386f11b3992532b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:14.352823 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69c862a4-632f-4b41-bed6-d4655dee805b tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 200 len: 1322 microversion: 2.1 time: 0.191531 Sep 13 16:49:14.353431 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2099/4235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:14 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:14.931090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:14.933976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:14.949699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.952199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.953879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:14.956792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:14.958292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:14.960279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:15.309598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:15.310501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:15.323349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:15.325744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:15.328033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:15.328948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:15.329942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:15.332869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:15.507052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:15.515866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9c014187-87b7-40e8-a307-07f804f823e7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.592549 Sep 13 16:49:15.526972 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2137/4236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:14 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:15.534650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:15.535508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] [instance: a5e19df5-5597-4976-a9a5-0e8058647e0e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:15.550906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:15.553926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:15.554404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:15.555152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:15.566881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:15.567575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:15.588523 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] HTTP exception thrown: Instance a5e19df5-5597-4976-a9a5-0e8058647e0e could not be found. Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Request method failure captured: Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e HTTP/1.1 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRDVYgKWqTjr_GVhqs5O_bHiTkpq0ca_E6M9Od2pqQcVGgpmRGjh7IK9DGRNMMTlfGgqnfMPGZrUxKvzGJD1lxrLa43gtewklUOuyUj1Huf3MFeDlUQnsJUaIzFriBcnpqRt73dyQnuqGo-7z9Wb-_TMLwtHgOXp-KwcJ73w67AUTA Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dba35f085a934e7386f11b3992532b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dba35f085a934e7386f11b3992532b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: dba35f085a934e7386f11b3992532b63 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2befbb1ed5bc4c54b2c4ae0a036ade34 Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance a5e19df5-5597-4976-a9a5-0e8058647e0e could not be found. Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'a5e19df5-5597-4976-a9a5-0e8058647e0e'} Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e19df5-5597-4976-a9a5-0e8058647e0e could not be found. Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e19df5-5597-4976-a9a5-0e8058647e0e could not be found. Sep 13 16:49:15.590330 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e19df5-5597-4976-a9a5-0e8058647e0e could not be found. Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] Returning 404 to user: Instance a5e19df5-5597-4976-a9a5-0e8058647e0e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:15.594204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4bc1c1cc-aa5b-4900-8dc6-c51ba75ad255 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831 tempest-FloatingIPsAssociationNegativeTestJSON-1842563831-project] 10.222.0.61 "GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e" status: 404 len: 111 microversion: 2.1 time: 0.063129 Sep 13 16:49:15.597279 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2138/4237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:15 2022] GET /compute/v2.1/servers/a5e19df5-5597-4976-a9a5-0e8058647e0e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:15.905196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:15.918627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-975f6131-b622-40fa-8a7e-ac56bef98249 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1321 microversion: 2.1 time: 0.613692 Sep 13 16:49:15.919552 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2100/4238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:15 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:16.544328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:16.548297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:16.570105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.576037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.578211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:16.597247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.598664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.599401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:16.959817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:16.961101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:16.977239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.987278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.988139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:16.989399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:16.990894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:16.991617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:17.045027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:17.071528 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f2e60d5-264c-48a7-9f97-fbc3a289b022 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.535676 Sep 13 16:49:17.072223 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2139/4239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:16 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:17.800224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:17.812964 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fc37e7a-1a5e-44a9-a502-54c4fd280c63 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1503 microversion: 2.1 time: 0.870831 Sep 13 16:49:17.815646 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2101/4240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:16 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1503 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:17.843170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:17.844077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:17.860995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:17.863048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:17.864008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:17.864753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:17.869686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:17.870181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.098480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:18.099693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:18.110564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.117404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.118088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.119013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.119652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.122428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.150716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:18.163021 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9899da9-37d3-4a14-98e5-2fc4ae96e82d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1503 microversion: 2.1 time: 0.325926 Sep 13 16:49:18.163613 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2140/4241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:17 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:18.191172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:18.191914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:18.195569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:18.207230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.208941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.209774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.215268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.215991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.217485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.293727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:49:18.520915 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d0f4f41-b5ca-4b79-ae55-11e8f31a329d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 204 len: 0 microversion: 2.1 time: 0.334181 Sep 13 16:49:18.522585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2141/4242] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:49:18 2022] DELETE /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:49:18.531919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:18.534339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:18.541906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.542824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.543515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.544989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:18.545679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:18.546341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:18.680508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:18.694985 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef72e727-586a-4835-8ede-f248463f3e65 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.602457 Sep 13 16:49:18.695969 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2102/4243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:18 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:18.718008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b1b5039c-382d-473b-b58c-ea3a6114acf3 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Action: 'create', calling method: .version_select at 0x7fbeb56fbe50>, body: {"keypair": {"name": "tempest-keypair-1696033212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQrD7OfmFHj+Cw4Rrzd+pAMcAFlcQWHv+yf3atp57bzOZ4qSPzUwIt6yopLUTc3JvW9G3QuAG7sE0RrfKPgWcag6CifHUDiRuju9orcNfcl1xY2Iugl3vnm53mZizNtLw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:18.759241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b1b5039c-382d-473b-b58c-ea3a6114acf3 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Getting quotas for project 66d9c9874b7c41f082ad52a82e7faf1e. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:18.768918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b1b5039c-382d-473b-b58c-ea3a6114acf3 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Getting quotas for user ed6d4ab471514a30b56943e5a4335600 and project 66d9c9874b7c41f082ad52a82e7faf1e. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:18.829045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b1b5039c-382d-473b-b58c-ea3a6114acf3 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.131845 Sep 13 16:49:18.830531 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2103/4244] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 16:49:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:49:18.968995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:18.983251 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8d1bb086-4549-4e6e-be80-fcefc56394d4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1509 microversion: 2.1 time: 0.454747 Sep 13 16:49:18.985895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2142/4245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:18 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:19.722555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:19.724589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:19.747854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:19.749552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:19.750344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:19.751302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:19.752298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:19.754579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:20.009137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:20.010419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:20.024523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:20.025261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:20.027449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:20.028427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:20.029054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:20.031822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:20.590138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:20.606377 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9a3990e-4265-44a7-8f71-62ae3ed393aa tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.889997 Sep 13 16:49:20.625250 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2104/4246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:19 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:20.641025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4dc05923-b276-4e08-bce5-621f7ce83d66 req-6b6deb30-b789-44d9-af8a-2d31486946b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beb2376-1006-46f0-9467-2afb7c5f46c4", "name": "network-vif-plugged", "status": "completed", "tag": "d41eb67d-600b-4896-b863-3267b56b3d69"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:20.654918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:20.662917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4dc05923-b276-4e08-bce5-621f7ce83d66 req-6b6deb30-b789-44d9-af8a-2d31486946b0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:20.663887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4dc05923-b276-4e08-bce5-621f7ce83d66 req-6b6deb30-b789-44d9-af8a-2d31486946b0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:20.664395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4dc05923-b276-4e08-bce5-621f7ce83d66 req-6b6deb30-b789-44d9-af8a-2d31486946b0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:20.665781 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35248c13-c863-4f2d-92f4-7e56239eb3a5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1509 microversion: 2.1 time: 0.660727 Sep 13 16:49:20.671017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2143/4247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:20 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:20.677767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:20.709659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4dc05923-b276-4e08-bce5-621f7ce83d66 req-6b6deb30-b789-44d9-af8a-2d31486946b0 service nova] Creating event network-vif-plugged:d41eb67d-600b-4896-b863-3267b56b3d69 for instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 on n-h2-857467-1 Sep 13 16:49:20.716424 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4dc05923-b276-4e08-bce5-621f7ce83d66 req-6b6deb30-b789-44d9-af8a-2d31486946b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089433 Sep 13 16:49:20.717392 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2105/4248] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:21.645165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:21.646886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:21.675270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:21.684606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:21.685088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:21.692779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:21.693117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:21.696252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:21.722415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:21.723799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:21.753215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:21.754224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:21.773024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:21.778312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:21.783276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:21.790129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:22.104139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:22.120045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9bfb40e2-39c3-42d9-9acd-0bbf48196083 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1328 microversion: 2.1 time: 0.479774 Sep 13 16:49:22.138101 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2144/4249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:21 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1328 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:22.145055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-580bf10d-4aa9-449c-bfb4-66ac0e6bc21e req-20a65715-ea8f-49ad-96b3-01b61247700f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40537668-bb72-45b7-954c-b3d62cc22a38", "name": "network-vif-deleted", "tag": "7cb1870f-b2b0-4315-a5d3-1b695626bd95"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:22.148850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:22.157153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-580bf10d-4aa9-449c-bfb4-66ac0e6bc21e req-20a65715-ea8f-49ad-96b3-01b61247700f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:22.158885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-580bf10d-4aa9-449c-bfb4-66ac0e6bc21e req-20a65715-ea8f-49ad-96b3-01b61247700f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:22.159678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-580bf10d-4aa9-449c-bfb4-66ac0e6bc21e req-20a65715-ea8f-49ad-96b3-01b61247700f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:22.167047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec1a702f-d6c3-42f4-82fe-ebc0340b4af0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 200 len: 1467 microversion: 2.1 time: 0.468546 Sep 13 16:49:22.167728 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2106/4250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:21 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 1467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:22.182092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-580bf10d-4aa9-449c-bfb4-66ac0e6bc21e req-20a65715-ea8f-49ad-96b3-01b61247700f service nova] Creating event network-vif-deleted:7cb1870f-b2b0-4315-a5d3-1b695626bd95 for instance 40537668-bb72-45b7-954c-b3d62cc22a38 on n-h2-857467-1 Sep 13 16:49:22.182092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-580bf10d-4aa9-449c-bfb4-66ac0e6bc21e req-20a65715-ea8f-49ad-96b3-01b61247700f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040468 Sep 13 16:49:22.182092 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2145/4251] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:23.147070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:23.148037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:23.157245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.158817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.159619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.161139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.161809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.162458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.199296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:23.199922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:23.213569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.214461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.215305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.216851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.217531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.218235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.242825 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 HTTP/1.1 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '40537668-bb72-45b7-954c-b3d62cc22a38'} Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:23.244775 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:23.248596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:23.248596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:23.248596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:23.248596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:23.248596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:49:23.248596 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:23.251003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:23.253210 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e900752-6d38-45cc-8e51-72397abd4b29 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 404 len: 111 microversion: 2.1 time: 0.057628 Sep 13 16:49:23.254923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2107/4252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:23 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:49:23.268864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1598528584", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a37f7bad-5035-486c-ac8c-f20d761f863e"}, {"port": "4ac32004-bfe2-4308-811c-e0444fad86fb", "tag": "port-1"}, {"port": "7d95abb3-3a18-4ca4-bb23-b36dd169b8ca", "tag": "port-2"}, {"uuid": "b50200d3-58eb-4f04-91ce-fdea8397c01f", "tag": "net-1"}, {"uuid": "b50200d3-58eb-4f04-91ce-fdea8397c01f"}, {"uuid": "cfb715bb-2b65-4676-a56f-3ed405b90cc9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cfb715bb-2b65-4676-a56f-3ed405b90cc9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "11f16b05-aefb-41cb-8553-9cd9cf6b35cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "db08ae87-9ebe-4405-9f89-a6b2c3418f81", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fc7f6078-87f7-434d-9007-275ff1a22f59", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--249749134"}], "key_name": "tempest-keypair-1696033212", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:23.388887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:23.398749 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c87b8046-242d-4a1e-8d02-e429f84b306b tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1529 microversion: 2.1 time: 0.257842 Sep 13 16:49:23.416434 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2146/4253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:23 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1529 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:23.425593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c70233ec-8a1e-4f85-8793-1d169e8046eb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: .version_select at 0x7fbeb582dca0>, body: {"keypair": {"name": "tempest-key-1924389335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLtJrh4KmN4fvymtJowRd8zKnGmquTk5v+8FQg+CXkYwVU5WvN4zxXDJtCPy+INlMEXUzUQjg+RCY34BJRCiV8PNdU2opa2nrNAsiT4CM5KelI98y/a4R8UNZdL8sAOnQ=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:23.442947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-c70233ec-8a1e-4f85-8793-1d169e8046eb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:23.451092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-c70233ec-8a1e-4f85-8793-1d169e8046eb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:23.451227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] validate_networks() for [('a37f7bad-5035-486c-ac8c-f20d761f863e', None, None, None, None, None), (None, None, '4ac32004-bfe2-4308-811c-e0444fad86fb', None, None, None), (None, None, '7d95abb3-3a18-4ca4-bb23-b36dd169b8ca', None, None, None), ('b50200d3-58eb-4f04-91ce-fdea8397c01f', None, None, None, None, None), ('b50200d3-58eb-4f04-91ce-fdea8397c01f', None, None, None, None, None), ('cfb715bb-2b65-4676-a56f-3ed405b90cc9', '10.2.2.100', None, None, None, None), ('cfb715bb-2b65-4676-a56f-3ed405b90cc9', '10.2.2.200', None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:49:23.492556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c70233ec-8a1e-4f85-8793-1d169e8046eb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.074639 Sep 13 16:49:23.493649 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2147/4254] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:49:23 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:23.500710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:23.501484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:23.509463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.510358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.510925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.511745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:23.512272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:23.512984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:23.692679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:23.706418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2313a8c-67d9-4637-9779-3a04eb2ef752 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1529 microversion: 2.1 time: 0.209771 Sep 13 16:49:23.707121 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2148/4255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:23 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1529 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:23.731147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79084bcb-0b38-4fb2-a259-995338a351ba tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '.version_select at 0x7fbeb51580d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:23.737573 n-d-857467-1 devstack@n-api.service[122328]: WARNING oslo_db.sqlalchemy.utils [None req-79084bcb-0b38-4fb2-a259-995338a351ba tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 13 16:49:23.744725 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79084bcb-0b38-4fb2-a259-995338a351ba tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.017305 Sep 13 16:49:23.745986 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2149/4256] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:49:23 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:24.071094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:24.071632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:24.090387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:24.091808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:24.093168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:24.095006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:24.096902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:24.097458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:24.125848 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] HTTP exception thrown: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Request method failure captured: Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 HTTP/1.1 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILR75hT2W1Ok4rAwXLXapb1sQs5Umd7XcJwuPQMoJdctIotPJ3RltnqEmGdlwr_-LB1MlcBIkdftstGx38Fqr6M8Cn_fgqrlTjseugwi7rLO0pgjwPNJ5yxHq5JWJOJkvxo1FeyumkkVvOUao6HE8D_HbxV9yeRrONuLfA9Pme_w31g Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a60fa8a5e4646b882d215922649b530 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1203473218 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a60fa8a5e4646b882d215922649b530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a60fa8a5e4646b882d215922649b530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a60fa8a5e4646b882d215922649b530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a60fa8a5e4646b882d215922649b530"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1203473218 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a60fa8a5e4646b882d215922649b530 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1203473218 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1203473218-project Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 767466c479314a3f8132cb2335ca68a9 Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1203473218-project Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1beb2376-1006-46f0-9467-2afb7c5f46c4'} Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:24.128134 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:24.131465 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:24.133588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Returning 404 to user: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:24.134713 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-56bddfea-d725-4c58-bc4f-da5d4312682e tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 404 len: 111 microversion: 2.1 time: 0.387632 Sep 13 16:49:24.139661 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2150/4257] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:49:23 2022] DELETE /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 111 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:24.146234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-852770657", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-key-1924389335", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:24.212472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:49:24.795092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:49:24.795524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:49:24.795998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:49:24.796580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:49:24.797355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:49:24.813607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:24.817798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:24.818495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:24.819674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:24.826431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:24.827391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:24.860386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:24.870338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:24.908294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:49:24.911815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:49:24.988634 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fba955b6-8378-436e-9534-a7feff179b5d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844638 Sep 13 16:49:24.997298 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2151/4258] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:49:25.020447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:25.021107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:25.034488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.034488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.034935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.036691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.037350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.037981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.240364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:25.253679 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0aa691f8-6ec0-4c18-9fad-ef478c91bdb8 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1529 microversion: 2.1 time: 0.251358 Sep 13 16:49:25.255640 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2152/4259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:24 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1529 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:25.276112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:25.285159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:25.312161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.316980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.318906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.323441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.324457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.338694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.416140 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e745321-6425-4223-98df-f3f870e4da69 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.156700 Sep 13 16:49:25.417156 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2153/4260] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:49:25 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:49:25.429651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99dce16b-ed15-4735-ba33-155d2c74027b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:25.430508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99dce16b-ed15-4735-ba33-155d2c74027b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:25.525436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99dce16b-ed15-4735-ba33-155d2c74027b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:25.535043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99dce16b-ed15-4735-ba33-155d2c74027b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1228 microversion: 2.1 time: 0.116680 Sep 13 16:49:25.536617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2154/4261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:25 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:25.541563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Action: 'update', calling method: >, body: {"server": {"name": "1beb2376-1006-46f0-9467-2afb7c5f46c4_new"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:25.544289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:25.553285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.554107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.554843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.555805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.556867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.557534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.574437 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] HTTP exception thrown: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Request method failure captured: Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: request: PUT /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 HTTP/1.1 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 64 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILR75hT2W1Ok4rAwXLXapb1sQs5Umd7XcJwuPQMoJdctIotPJ3RltnqEmGdlwr_-LB1MlcBIkdftstGx38Fqr6M8Cn_fgqrlTjseugwi7rLO0pgjwPNJ5yxHq5JWJOJkvxo1FeyumkkVvOUao6HE8D_HbxV9yeRrONuLfA9Pme_w31g Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a60fa8a5e4646b882d215922649b530 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1203473218 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a60fa8a5e4646b882d215922649b530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a60fa8a5e4646b882d215922649b530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a60fa8a5e4646b882d215922649b530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a60fa8a5e4646b882d215922649b530"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1203473218 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a60fa8a5e4646b882d215922649b530 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1203473218 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1203473218-project Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 767466c479314a3f8132cb2335ca68a9 Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1203473218-project Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "1beb2376-1006-46f0-9467-2afb7c5f46c4_new"}} Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1beb2376-1006-46f0-9467-2afb7c5f46c4', 'body': {'server': {'name': '1beb2376-1006-46f0-9467-2afb7c5f46c4_new'}}} Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:49:25.577296 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:25.581116 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:25.586016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] Returning 404 to user: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:25.587901 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1499775c-5f05-4367-b554-5908c8236818 tempest-ServersNegativeTestMultiTenantJSON-1203473218 tempest-ServersNegativeTestMultiTenantJSON-1203473218-project] 10.222.0.61 "PUT /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 404 len: 111 microversion: 2.1 time: 0.049644 Sep 13 16:49:25.588750 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2155/4262] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:49:25 2022] PUT /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:25.593996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:25.594897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:25.602426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.606126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.606126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.606126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.606126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.606126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.624253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:25.640195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:49:25.806834 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9519e6b1-7307-4fe1-a1c9-dc7c5955c84e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 204 len: 0 microversion: 2.1 time: 0.215393 Sep 13 16:49:25.808152 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2156/4263] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:49:25 2022] DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:49:25.816048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:25.817592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:25.825320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.826256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.827605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.828711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:25.830755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:25.831778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:25.872961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:49:26.065172 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4364f814-86d9-45d8-a2e7-7c38517b941d tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 204 len: 0 microversion: 2.1 time: 0.254284 Sep 13 16:49:26.070374 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2157/4264] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:49:25 2022] DELETE /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:49:26.089747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:26.090327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:26.106666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.107194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.107658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.108398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.109019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.112583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.366005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:26.377336 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cdfd9155-dc38-4200-867f-13c057a2cb47 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1673 microversion: 2.1 time: 0.301935 Sep 13 16:49:26.378464 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2158/4265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:26 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:26.395731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:26.396960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:26.407459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.408824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.409556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.410499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.411183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.411817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.576720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:26.588635 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff8b6243-eb86-4adf-a06e-6210f0a89f8e tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1535 microversion: 2.1 time: 0.206001 Sep 13 16:49:26.590666 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2159/4266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:26 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1535 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:26.851821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41f4ea27-b247-4278-9e65-3214d6f46a26 tempest-ExtensionsTest-2095765816 tempest-ExtensionsTest-2095765816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:26.854417 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41f4ea27-b247-4278-9e65-3214d6f46a26 tempest-ExtensionsTest-2095765816 tempest-ExtensionsTest-2095765816-project] 10.222.0.61 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.262583 Sep 13 16:49:26.855633 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2160/4267] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 16:49:26 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:26.863687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:26.864685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:26.872571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.873535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.874366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.875305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:26.875913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:26.876588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:26.979704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:26.993656 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-72a9bfa3-82c9-4784-ae6e-772387333a71 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1224 microversion: 2.1 time: 0.136349 Sep 13 16:49:26.994511 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2161/4268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:26 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:27.014018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:49:27.014558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:49:27.014960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:49:27.015376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:49:27.015790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:49:27.024002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3ff7198-67c4-442a-8687-468c3382daf2 tempest-ExtensionsTest-2095765816 tempest-ExtensionsTest-2095765816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:27.028246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:27.028936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:27.029178 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3ff7198-67c4-442a-8687-468c3382daf2 tempest-ExtensionsTest-2095765816 tempest-ExtensionsTest-2095765816-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009213 Sep 13 16:49:27.029697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:27.030611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:27.031123 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2162/4269] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Sep 13 16:49:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:49:27.031233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:27.031608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:27.054765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Getting quotas for project 66d9c9874b7c41f082ad52a82e7faf1e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:27.061588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Getting quotas for user ed6d4ab471514a30b56943e5a4335600 and project 66d9c9874b7c41f082ad52a82e7faf1e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:27.073907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:27.398794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:49:27.401608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='11f16b05-aefb-41cb-8553-9cd9cf6b35cf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='db08ae87-9ebe-4405-9f89-a6b2c3418f81',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc7f6078-87f7-434d-9007-275ff1a22f59',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:49:27.406252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:27.416226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:27.426748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:27.427272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:27.427715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:27.429229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:27.434414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:27.435058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:27.749378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:27.760602 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bfe574da-a501-47c2-ad1a-0743a2400fe3 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1673 microversion: 2.1 time: 0.361653 Sep 13 16:49:27.761143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2163/4270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:27 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1673 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:27.779243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:27.779868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:27.795288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:27.795769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:27.796228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:27.799518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:27.800021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:27.801692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:27.930569 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7a42d8f-4684-4b7a-8588-44bb9e2619ab tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.674100 Sep 13 16:49:27.940170 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2108/4271] 10.222.0.61 () {62 vars in 1189 bytes} [Tue Sep 13 16:49:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 4684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:49:27.949561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9a65169-1ea8-4545-95c4-d115428397e1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:27.950563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9a65169-1ea8-4545-95c4-d115428397e1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:28.068318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9a65169-1ea8-4545-95c4-d115428397e1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:28.078795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9a65169-1ea8-4545-95c4-d115428397e1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:28.083738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9a65169-1ea8-4545-95c4-d115428397e1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:28.091874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9a65169-1ea8-4545-95c4-d115428397e1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1286 microversion: 2.42 time: 0.148976 Sep 13 16:49:28.092583 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2109/4272] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:27 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:28.097699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:28.111158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:28.118649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:28.130801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:28.131591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:28.132369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:28.132845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:28.133290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:28.393495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:28.405797 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce7d2b77-3536-4c62-8b21-bf3489faf3a7 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1535 microversion: 2.1 time: 0.643486 Sep 13 16:49:28.406850 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2164/4273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:27 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1535 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:28.568008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:28.576654 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3fe7fea7-7e90-4856-b759-63be26a3e1b6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1288 microversion: 2.1 time: 0.482817 Sep 13 16:49:28.579261 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2110/4274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:28 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1288 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:28.786736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:28.787596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:28.810223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:28.816527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:28.816994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:28.828971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:28.829789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:28.830747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:29.120179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85ddb221-9fad-4ba6-8cee-3c4c461c968b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:29.120972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-85ddb221-9fad-4ba6-8cee-3c4c461c968b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:29.442363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-85ddb221-9fad-4ba6-8cee-3c4c461c968b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:29.464132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-85ddb221-9fad-4ba6-8cee-3c4c461c968b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:29.466296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-85ddb221-9fad-4ba6-8cee-3c4c461c968b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:29.468970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-85ddb221-9fad-4ba6-8cee-3c4c461c968b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1286 microversion: 2.42 time: 0.354440 Sep 13 16:49:29.493136 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2111/4275] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:29 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1286 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:29.498759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:29.503136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:29.513655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:29.514555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:29.515276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:29.516709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:29.518898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:29.519642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:30.284083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:30.298634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dcd38353-d0cb-4514-b049-c7e7455023d1 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1493 microversion: 2.1 time: 0.803788 Sep 13 16:49:30.313571 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2112/4276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:29 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1493 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:30.323529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:30.324485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:30.345541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:30.346586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:30.348825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:30.350629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:30.355208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:30.355890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:30.428165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:30.439509 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa6679d7-fef6-4359-9ae5-034be6ae4d9b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1673 microversion: 2.1 time: 1.658500 Sep 13 16:49:30.450230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2165/4277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:28 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1673 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:30.479379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3349efbe-8f42-49b2-bb9e-6f02d2042fe5 req-39abe69b-5cd7-4309-8af9-24247a160e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beb2376-1006-46f0-9467-2afb7c5f46c4", "name": "network-vif-deleted", "tag": "d41eb67d-600b-4896-b863-3267b56b3d69"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:30.521094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3349efbe-8f42-49b2-bb9e-6f02d2042fe5 req-39abe69b-5cd7-4309-8af9-24247a160e01 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:30.521587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3349efbe-8f42-49b2-bb9e-6f02d2042fe5 req-39abe69b-5cd7-4309-8af9-24247a160e01 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:30.535697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3349efbe-8f42-49b2-bb9e-6f02d2042fe5 req-39abe69b-5cd7-4309-8af9-24247a160e01 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:30.587803 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3349efbe-8f42-49b2-bb9e-6f02d2042fe5 req-39abe69b-5cd7-4309-8af9-24247a160e01 service nova] Creating event network-vif-deleted:d41eb67d-600b-4896-b863-3267b56b3d69 for instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 on n-h2-857467-1 Sep 13 16:49:30.597464 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3349efbe-8f42-49b2-bb9e-6f02d2042fe5 req-39abe69b-5cd7-4309-8af9-24247a160e01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121718 Sep 13 16:49:30.600984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2166/4278] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:49:30.615989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:30.616964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:30.626490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:30.627325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:30.627921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:30.628800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:30.631105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:30.635617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:30.697047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:30.721032 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5191e27a-dce9-4358-bded-489f237b0ad9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1286 microversion: 2.1 time: 0.390625 Sep 13 16:49:30.721927 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2113/4279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:30 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1286 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:30.912733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:30.955295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:30.956807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:30.958064 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-84703c9d-66c3-4a3d-bf7f-ca64b9173577 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1576 microversion: 2.42 time: 0.355692 Sep 13 16:49:30.958656 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2167/4280] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:30 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1576 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:31.337196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:31.337961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:31.356707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.359459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.360108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.361893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.364340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.364979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.450996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.452922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.454136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.457127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lazy-loading 'fault' on Instance uuid 1beb2376-1006-46f0-9467-2afb7c5f46c4 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:49:31.469164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:31.469780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:31.484591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.485342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.487675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.489915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.490655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.491274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.596092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649f9202b3374720a6fb8c6cbb6d5dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d129eb5a6141d491058f0a9b50970f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:31.614910 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27b7f9cc-a3b3-4f9e-880d-64b057d9b3fe tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 200 len: 1318 microversion: 2.1 time: 0.279696 Sep 13 16:49:31.617019 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2114/4281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:31 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:31.745810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:31.748183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:31.773787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.780458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.781259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.787063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:31.787908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:31.788595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:31.963096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:31.978272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e809b94-169e-43fd-a8df-355c1c7d2801 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1606 microversion: 2.1 time: 0.513342 Sep 13 16:49:31.979725 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2168/4282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:31 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1606 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:32.013666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:32.014577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:32.026774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:32.027704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:32.028297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:32.029160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:32.033482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:32.034167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:32.429464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:32.455709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:32.457688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:32.458958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b9add8c7-cbb8-4303-b467-6a15adcc827d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1594 microversion: 2.42 time: 0.457058 Sep 13 16:49:32.485202 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2169/4283] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:32 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1594 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:49:32.540524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:32.556204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79f0806f-2ae9-4cb2-85bf-a67d46e60e39 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 0.815043 Sep 13 16:49:32.560503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2115/4284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:31 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:32.643655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:32.644321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] [instance: 1beb2376-1006-46f0-9467-2afb7c5f46c4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:32.647550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:32.672185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:32.676621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:32.677438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:32.679484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:32.683885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:32.685752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:32.762759 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] HTTP exception thrown: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Request method failure captured: Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 HTTP/1.1 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRpmkrcjbW9ElD8N0gNIfiJ01UajqluYMEgNsFz4sfTHpMFzFApK-RYwhnukxgpzskieiTUB2OPo01J4VA1D6vxyiHHtnQMpJgGL6dRD5CCqvSDw_TKWieXqZ8fyKe3ZO4xQlTVMfmUUhvdRwOGFEbtBYX9qtifGcfurVUCrMWIij8 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 95d129eb5a6141d491058f0a9b50970f Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1378724321 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95d129eb5a6141d491058f0a9b50970f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_95d129eb5a6141d491058f0a9b50970f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95d129eb5a6141d491058f0a9b50970f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/95d129eb5a6141d491058f0a9b50970f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1378724321 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 95d129eb5a6141d491058f0a9b50970f Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1378724321 Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1378724321-project Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 649f9202b3374720a6fb8c6cbb6d5dab Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1378724321-project Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1beb2376-1006-46f0-9467-2afb7c5f46c4'} Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:32.777546 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. Sep 13 16:49:32.782036 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:32.786453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] Returning 404 to user: Instance 1beb2376-1006-46f0-9467-2afb7c5f46c4 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:32.788111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dda23f44-42ce-496a-bd5c-e7c400ec4839 tempest-ServersNegativeTestMultiTenantJSON-1378724321 tempest-ServersNegativeTestMultiTenantJSON-1378724321-project] 10.222.0.61 "GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4" status: 404 len: 111 microversion: 2.1 time: 0.149382 Sep 13 16:49:32.816075 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2170/4285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:32 2022] GET /compute/v2.1/servers/1beb2376-1006-46f0-9467-2afb7c5f46c4 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:33.009030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:33.010172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:33.027472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.028268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.028964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.029568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.030075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.030520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.330797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d6442825-a634-4e12-bebc-184997b7f57b req-1d481083-4e90-4bfc-92f8-34a777b95ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cec120-ddf3-4621-8ccc-88bd968deba0", "name": "network-vif-deleted", "tag": "c5388a65-7a5a-4e42-a528-6f7a4104a680"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:33.339933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:33.362973 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6974b44c-a9fc-4cdc-85ab-b0cc457aee08 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1606 microversion: 2.1 time: 0.351875 Sep 13 16:49:33.364118 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2116/4286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:33 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1606 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:33.375097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6442825-a634-4e12-bebc-184997b7f57b req-1d481083-4e90-4bfc-92f8-34a777b95ced service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.377277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6442825-a634-4e12-bebc-184997b7f57b req-1d481083-4e90-4bfc-92f8-34a777b95ced service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.381200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6442825-a634-4e12-bebc-184997b7f57b req-1d481083-4e90-4bfc-92f8-34a777b95ced service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.405277 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d6442825-a634-4e12-bebc-184997b7f57b req-1d481083-4e90-4bfc-92f8-34a777b95ced service nova] Creating event network-vif-deleted:c5388a65-7a5a-4e42-a528-6f7a4104a680 for instance 76cec120-ddf3-4621-8ccc-88bd968deba0 on n-h1-857467-1 Sep 13 16:49:33.414337 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d6442825-a634-4e12-bebc-184997b7f57b req-1d481083-4e90-4bfc-92f8-34a777b95ced service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091139 Sep 13 16:49:33.417121 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2171/4287] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:49:33.490425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:33.491294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:33.510409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.511260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.511933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.512945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.513609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.514307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.589169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:33.589913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:33.600994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.601606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.604878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.605868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:33.606598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:33.607204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:33.655975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:33.676867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:33.684419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:33.685662 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4c85b66-217a-4f7e-8bf1-c2f21ac37d53 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1594 microversion: 2.42 time: 0.200857 Sep 13 16:49:33.686296 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2117/4288] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:33 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1594 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:34.267505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:34.276010 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b21ea6e0-3e93-4d0a-a821-765da95091aa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 0.691182 Sep 13 16:49:34.299209 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2172/4289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:33 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:34.396380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:34.398834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:34.441961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:34.443281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:34.445336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:34.447107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:34.449023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:34.449978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:34.562046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:34.563616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:34.567476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:34.572319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lazy-loading 'fault' on Instance uuid 76cec120-ddf3-4621-8ccc-88bd968deba0 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:49:34.721289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:34.722093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:34.732401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:34.739333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:34.740083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:34.740974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:34.741599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:34.760584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:34.860474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:35.045302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:35.066928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58c95e60-99b7-4589-9c78-a12b7a156445 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 200 len: 1327 microversion: 2.1 time: 0.681123 Sep 13 16:49:35.067792 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2118/4290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:34 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 1327 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:35.310718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:35.311567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:35.322468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:35.329819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:35.331616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:35.334495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:35.335205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:35.336357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:35.534360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:36.229433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:36.231805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:36.246845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:36.248236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:36.259379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4cd4dda9-aeef-4068-8aee-d3ff6f256dde tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1661 microversion: 2.42 time: 1.542352 Sep 13 16:49:36.264951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2173/4291] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:34 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1661 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:36.292525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:36.295461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:36.310107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:36.311006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:36.311844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:36.313137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:36.315747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:36.316870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:36.346131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] HTTP exception thrown: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Request method failure captured: Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 HTTP/1.1 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILNgbAMBbrpTNiJvgmPrLmfeTQjCs6eVT6ZYXzKtX33Um_U9keB1U9wrDPkVnsmE8xxqgG8yGuQ2igaMOG1OJRXU_DhVucSnFZr-Y57ASNy7kI7ox_wTes-AkHmzCx34gTeOT_CXMgwTxu9iuKxfgiUFUIeA70IUyaVu2Zyl_QjLmCk Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: e2620846244d4943925ca47225a9eb36 Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '76cec120-ddf3-4621-8ccc-88bd968deba0'} Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:36.348518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:49:36.352607 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:36.354726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Returning 404 to user: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:36.356274 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f82683b-7206-4d92-97d9-67a69d3f8b61 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 404 len: 111 microversion: 2.1 time: 0.089489 Sep 13 16:49:36.357646 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2174/4292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:36 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:36.383309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a1553c57-01e6-4973-afd4-a79a8b1f0add req-bf834c5f-5263-4129-af08-967a7cfd0581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37", "tag": "40377182-e052-4d6d-b30c-a2c03a59d0ee"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:36.399823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a1553c57-01e6-4973-afd4-a79a8b1f0add req-bf834c5f-5263-4129-af08-967a7cfd0581 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:36.400702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a1553c57-01e6-4973-afd4-a79a8b1f0add req-bf834c5f-5263-4129-af08-967a7cfd0581 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:36.401962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a1553c57-01e6-4973-afd4-a79a8b1f0add req-bf834c5f-5263-4129-af08-967a7cfd0581 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:36.424117 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a1553c57-01e6-4973-afd4-a79a8b1f0add req-bf834c5f-5263-4129-af08-967a7cfd0581 service nova] Creating event network-changed:40377182-e052-4d6d-b30c-a2c03a59d0ee for instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 on n-h2-857467-1 Sep 13 16:49:36.434197 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a1553c57-01e6-4973-afd4-a79a8b1f0add req-bf834c5f-5263-4129-af08-967a7cfd0581 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072600 Sep 13 16:49:36.435806 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2175/4293] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:36.446248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0361abda-18a6-4465-9dce-9ee6acafd0fe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '.version_select at 0x7fbeb50ee9d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:36.483284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0361abda-18a6-4465-9dce-9ee6acafd0fe tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730285479" status: 202 len: 0 microversion: 2.1 time: 0.043618 Sep 13 16:49:36.484131 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2176/4294] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:49:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730285479 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:49:36.626999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:36.642403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d422c73b-e2f1-4df3-84e3-0f115a8e1694 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 1.335347 Sep 13 16:49:36.643845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2119/4295] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:35 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:37.296055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:37.299843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:37.315141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:37.315940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:37.316854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:37.318091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:37.325882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:37.330595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:37.669690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:37.670412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:37.683385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:37.694789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:37.696191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:37.699024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:37.701331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:37.702168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:37.704617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:37.889815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:37.938344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:37.958931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:37.971983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52d7a5b3-0ecb-427d-b070-b8b1eaebf063 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1661 microversion: 2.42 time: 0.681097 Sep 13 16:49:37.976299 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2177/4296] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:37 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1661 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:39.000638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:39.003200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:39.018303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:39.018807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:39.019258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:39.034004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:39.034821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:39.035484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:39.287914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:39.303068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b00af6be-c649-418b-8732-b9908d190ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 1.638147 Sep 13 16:49:39.303921 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2120/4297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:37 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:39.919852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:39.937241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:39.955886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:39.957114 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b5efb16-b947-4936-91fe-96fba82c9950 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1707 microversion: 2.42 time: 0.960696 Sep 13 16:49:39.957687 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2178/4298] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:38 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1707 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:49:40.327484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:40.329948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:40.340544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:40.344131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:40.349700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:40.352575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:40.354101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:40.354101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:40.362804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:40.709323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b6a11b9-4d10-4845-9886-d379fff40fe9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: .version_select at 0x7fbeb97f5040>, body: {"keypair": {"name": "tempest-keypair-51701182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHENdLQaBdW9fmhNfqebu1Z46zt/Go0S09nLsmexE/u8iCc3I0BedF3vyBlsKfiDC8iMV1e66Pq3syiyz86dSkJr3xmH8pJqP0uZJvXQ8VuRpOQZWY+Jf9VceZx9wsdOFw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:40.786713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0b6a11b9-4d10-4845-9886-d379fff40fe9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:40.810555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0b6a11b9-4d10-4845-9886-d379fff40fe9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for user e2620846244d4943925ca47225a9eb36 and project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:40.903512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b6a11b9-4d10-4845-9886-d379fff40fe9 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.201400 Sep 13 16:49:40.905467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2179/4299] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:49:40 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:40.987703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:40.988480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:41.000633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:41.001625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:41.005743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:41.010734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:41.011552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:41.012958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:41.284429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:41.296984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a128c315-75ce-4b16-8b06-a60e9b4fc1ce tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 0.973159 Sep 13 16:49:41.298997 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2121/4300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:40 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:41.638341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:41.659044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:41.666803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:41.669459 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3308ea2c-9335-4d36-8c69-bd794c09806d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1707 microversion: 2.42 time: 0.687741 Sep 13 16:49:41.671790 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2180/4301] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:40 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1707 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:49:42.321108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:42.321741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:42.337460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:42.338082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:42.338694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:42.339451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:42.339920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:42.340813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:42.703808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:42.706278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:42.726484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:42.739908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:42.750916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-763acf7b-e5ee-48d0-aed5-1127a772fb58 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 0.434451 Sep 13 16:49:42.751700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:42.752372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:42.755375 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2122/4302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:42 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:42.757766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:42.758506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:42.761992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:42.814619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-661c89e4-357e-4314-9689-1316bf8601ea req-23695f7e-00c2-45d9-9ad6-adef782b3d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37", "name": "network-vif-plugged", "status": "completed", "tag": "40377182-e052-4d6d-b30c-a2c03a59d0ee"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:42.850785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-661c89e4-357e-4314-9689-1316bf8601ea req-23695f7e-00c2-45d9-9ad6-adef782b3d1a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:42.853942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-661c89e4-357e-4314-9689-1316bf8601ea req-23695f7e-00c2-45d9-9ad6-adef782b3d1a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:42.857423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-661c89e4-357e-4314-9689-1316bf8601ea req-23695f7e-00c2-45d9-9ad6-adef782b3d1a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:42.898235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-661c89e4-357e-4314-9689-1316bf8601ea req-23695f7e-00c2-45d9-9ad6-adef782b3d1a service nova] Creating event network-vif-plugged:40377182-e052-4d6d-b30c-a2c03a59d0ee for instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 on n-h2-857467-1 Sep 13 16:49:42.907231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-661c89e4-357e-4314-9689-1316bf8601ea req-23695f7e-00c2-45d9-9ad6-adef782b3d1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097749 Sep 13 16:49:42.909225 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2123/4303] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:49:43.341812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:43.358834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:43.363911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:43.368580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d68d16f8-3b46-4237-8108-87b6979f642b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1707 microversion: 2.42 time: 0.671340 Sep 13 16:49:43.369990 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2181/4304] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:42 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1707 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:49:43.786245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:43.787252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:43.817534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:43.820780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:43.822350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:43.827428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:43.829662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:43.831011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:44.400664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:44.401731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:44.415932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:44.419495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:44.420247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:44.423045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:44.426420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:44.427060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:44.755406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:44.774018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6c584cc-e4f8-4a6f-96de-168106469452 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1328 microversion: 2.1 time: 0.994482 Sep 13 16:49:44.776778 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2124/4305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:43 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1328 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:45.103286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbe491cc-005b-4ca0-bf14-786548648b4f tempest-FloatingIPDetailsNegativeTestJSON-2057700635 tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project] Calling method '.version_select at 0x7fbeb9760f70>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:45.290162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG neutronclient.v2_0.client [None req-cbe491cc-005b-4ca0-bf14-786548648b4f tempest-FloatingIPDetailsNegativeTestJSON-2057700635 tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 14ab76cf-19f7-4231-987d-66405ff52567 could not be found", "detail": ""}} {{(pid=122327) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 16:49:45.291109 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-cbe491cc-005b-4ca0-bf14-786548648b4f tempest-FloatingIPDetailsNegativeTestJSON-2057700635 tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project] HTTP exception thrown: Floating IP not found for ID 14ab76cf-19f7-4231-987d-66405ff52567 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbe491cc-005b-4ca0-bf14-786548648b4f tempest-FloatingIPDetailsNegativeTestJSON-2057700635 tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project] Request method failure captured: Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-floating-ips/14ab76cf-19f7-4231-987d-66405ff52567 HTTP/1.1 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILSo24TTDVRnOg3Y5_gdVLE3_FNZA7jFcgD7jcX4dg8u6JFGeOhvJ2LS0rzsSwbVwNUeu9dkXeFoY72CrDFlQm6YKbMj-ldepj6fi7DlUSgAca-CagEPrTLxvZCV32y7SZWwEKbV5-QwWWs6afsqwIoOuL3_VrQj0s4iX3PJ_nd4KhQ Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c4eca8654df448a7b18ae33c840171c7 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2057700635 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4eca8654df448a7b18ae33c840171c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c4eca8654df448a7b18ae33c840171c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4eca8654df448a7b18ae33c840171c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c4eca8654df448a7b18ae33c840171c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2057700635 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c4eca8654df448a7b18ae33c840171c7 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2057700635 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2fd92cf2bd634cccbfbb0cc47b0f67a8 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: exception: Floating IP not found for ID 14ab76cf-19f7-4231-987d-66405ff52567 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '14ab76cf-19f7-4231-987d-66405ff52567'} Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 13 16:49:45.293293 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 14ab76cf-19f7-4231-987d-66405ff52567 could not be found Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-858b4106-84d5-4bca-9ae9-ede5d3ffe22b'] Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 14ab76cf-19f7-4231-987d-66405ff52567. Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 14ab76cf-19f7-4231-987d-66405ff52567 Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 14ab76cf-19f7-4231-987d-66405ff52567 Sep 13 16:49:45.297341 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:49:45.300626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbe491cc-005b-4ca0-bf14-786548648b4f tempest-FloatingIPDetailsNegativeTestJSON-2057700635 tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project] Returning 404 to user: Floating IP not found for ID 14ab76cf-19f7-4231-987d-66405ff52567 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:45.302406 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbe491cc-005b-4ca0-bf14-786548648b4f tempest-FloatingIPDetailsNegativeTestJSON-2057700635 tempest-FloatingIPDetailsNegativeTestJSON-2057700635-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/14ab76cf-19f7-4231-987d-66405ff52567" status: 404 len: 111 microversion: 2.1 time: 0.522920 Sep 13 16:49:45.303065 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2125/4306] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:49:44 2022] GET /compute/v2.1/os-floating-ips/14ab76cf-19f7-4231-987d-66405ff52567 => generated 111 bytes in 525 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:45.316171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-217296765", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01fb7c7f-f3fb-4070-839d-66b52fab6029"}], "security_groups": [{"name": "tempest-securitygroup--1875866178"}], "key_name": "tempest-keypair-51701182", "user_data": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:45.460157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:45.480829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:45.483089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:45.492285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0d36abf-35b0-427f-8670-d9c9fa169a0a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1753 microversion: 2.42 time: 1.096639 Sep 13 16:49:45.505888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2182/4307] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:44 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1753 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:45.539490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] validate_networks() for [('01fb7c7f-f3fb-4070-839d-66b52fab6029', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:49:45.805759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:45.808982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:45.826291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:45.827045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:45.827637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:45.828504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:45.829441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:45.830226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:46.405398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:46.421667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b611de6-41f0-46b9-90e2-7b2f008d680f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1510 microversion: 2.1 time: 0.625767 Sep 13 16:49:46.427956 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2183/4308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:45 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:46.448702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:46.449699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:46.462055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:46.462620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:46.463935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:46.464802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:46.466108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:46.468082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:46.945908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:49:46.946685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:49:46.948065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:49:46.948750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:49:46.950311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:49:46.979388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:46.980517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:46.981523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:46.982757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:46.983449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:46.984129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:47.020646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:47.030333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Getting quotas for user e2620846244d4943925ca47225a9eb36 and project 266bcfc04bec48c897f828ed06a1e7fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:47.070561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:49:47.073994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:49:47.165782 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f3cc949-6220-469a-86a9-b906437b8966 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.858042 Sep 13 16:49:47.172674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2126/4309] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:49:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:49:47.181487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:47.190496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:47.214945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:47.222219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:47.225950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:47.227086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:47.227844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:47.228506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:47.300257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:47.615931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:47.638326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1da84fcd-71be-438e-bf7c-516df2c981a7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1510 microversion: 2.1 time: 1.194657 Sep 13 16:49:47.657151 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2184/4310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:46 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1510 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:47.663785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7abbfc79-739c-4a1b-993d-4b53852c8579 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:47.666240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7abbfc79-739c-4a1b-993d-4b53852c8579 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:47.728422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:47.744246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:47.750293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:47.752474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af1ec4b1-a759-495d-b7ea-f59668f5725f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1753 microversion: 2.42 time: 0.584078 Sep 13 16:49:47.760121 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2127/4311] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:47 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1753 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:47.765228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:47.765739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:47.785558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:47.789734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:47.797285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:47.798991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:47.799754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:47.800827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:47.884032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:49:47.958701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7abbfc79-739c-4a1b-993d-4b53852c8579 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:47.973769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7abbfc79-739c-4a1b-993d-4b53852c8579 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1235 microversion: 2.1 time: 0.321445 Sep 13 16:49:47.980764 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2185/4312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:47 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1235 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:48.150818 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50731188-a13b-406c-a96b-c70d655e6ead tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 204 len: 0 microversion: 2.1 time: 0.387961 Sep 13 16:49:48.152226 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2128/4313] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:49:47 2022] DELETE /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:49:48.180397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:48.182319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:48.228643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:48.237125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:48.238903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:48.239770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:48.240663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:48.241317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:48.636526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:48.651245 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0be476b2-814c-4c63-9a4c-64d7b3bd53db tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1516 microversion: 2.1 time: 0.495080 Sep 13 16:49:48.651854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2186/4314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:48 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:48.785408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:48.786588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:48.803462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:48.807293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:48.808136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:48.810305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:48.810984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:48.818026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:49.006858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:49.007398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:49.020935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:49.021441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:49.021960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:49.022946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:49.023408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:49.023902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:49.286341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:49.309568 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-72771fea-d4d4-43e6-96c4-02f244f07331 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1287 microversion: 2.1 time: 0.305985 Sep 13 16:49:49.312721 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2187/4315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:48 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1287 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:49.678524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:49.680838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:49.717531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:49.724115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:49.724912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:49.725917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:49.726555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:49.727863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:50.024965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:50.043356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:50.046584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:50.051403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c45a7286-dc8b-4c0c-b2d2-7bcf8b2fb436 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1799 microversion: 2.42 time: 1.273237 Sep 13 16:49:50.053242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2129/4316] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:48 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1799 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:50.230362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:50.243882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b801143a-7237-4bd1-a3d5-bc1e5058691f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1516 microversion: 2.1 time: 0.568336 Sep 13 16:49:50.245484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2188/4317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:49 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1516 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:50.340922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:50.341563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:50.355817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:50.358695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:50.359505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:50.361236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:50.368960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:50.369790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:50.856806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:50.892672 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4391b16c-a119-4d84-9444-98daebbe74aa tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1293 microversion: 2.1 time: 0.556942 Sep 13 16:49:50.906673 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2130/4318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:50 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1293 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:51.081804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:51.082853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:51.098002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:51.100234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:51.100992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:51.105790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:51.107240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:51.107700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:51.272285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:51.273173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:51.283216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:51.283721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:51.289784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:51.290628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:51.291122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:51.291572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:51.613763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:51.633905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:51.637440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:51.642522 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23ad0f58-f62b-4928-a681-eab4fca23e80 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1845 microversion: 2.42 time: 0.565803 Sep 13 16:49:51.643192 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2189/4319] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:51 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1845 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:51.920865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:51.921722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:51.932387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:51.934273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:51.936464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:51.937362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:51.941216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:51.941848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:52.132378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:52.143424 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b765e046-1cfc-4d48-9321-d74be74d23ec tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1293 microversion: 2.1 time: 0.226540 Sep 13 16:49:52.146118 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2190/4320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:51 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:52.454872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:52.489335 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-533f1335-7146-42a8-a4ea-fd41e4c8e680 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1516 microversion: 2.1 time: 1.209337 Sep 13 16:49:52.489548 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2131/4321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:51 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1516 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:52.668813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:52.669432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:52.680382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:52.680880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:52.683835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:52.686524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:52.687633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:52.688817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:53.168621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:53.169249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:53.186012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:53.187407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:53.187918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:53.190224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:53.192682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:53.193277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:53.396282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:53.422176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:53.424778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:53.427548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff1074a9-283a-4dc5-adf4-4ec8862c2385 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1845 microversion: 2.42 time: 0.762800 Sep 13 16:49:53.443641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2191/4322] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:52 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1845 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:53.513445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:53.514441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:53.529525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:53.530431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:53.531175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:53.540492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:53.541216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:53.541811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:53.761914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:53.771491 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bb9e0fc3-4ec2-447f-b641-c96c42bd231e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1474 microversion: 2.1 time: 0.262595 Sep 13 16:49:53.790271 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2192/4323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:53 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:54.270913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:54.286005 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e4dfe41-1531-4072-b1e9-8720a1d9e518 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 1.119432 Sep 13 16:49:54.287045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2132/4324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:53 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:54.461484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:54.462139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:54.479994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:54.492015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:54.492373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:54.493299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:54.493992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:54.494657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:54.797202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:54.799370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:54.818762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:54.820480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:54.822993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:54.825622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:54.826323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:54.830809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:55.095485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:55.140201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:55.146922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:55.162220 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d137ce6-5e20-4a1b-a77c-5f5e58e03fce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1845 microversion: 2.42 time: 0.704265 Sep 13 16:49:55.172120 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2193/4325] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:54 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1845 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:55.188935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b60b630d-283b-4412-8dda-f973f5cec835 req-80bdfa3b-4a6c-4d05-8409-42ab7cbb804c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37", "name": "network-vif-deleted", "tag": "40377182-e052-4d6d-b30c-a2c03a59d0ee"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:55.230927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b60b630d-283b-4412-8dda-f973f5cec835 req-80bdfa3b-4a6c-4d05-8409-42ab7cbb804c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:55.231426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b60b630d-283b-4412-8dda-f973f5cec835 req-80bdfa3b-4a6c-4d05-8409-42ab7cbb804c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:55.231872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b60b630d-283b-4412-8dda-f973f5cec835 req-80bdfa3b-4a6c-4d05-8409-42ab7cbb804c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:55.264698 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b60b630d-283b-4412-8dda-f973f5cec835 req-80bdfa3b-4a6c-4d05-8409-42ab7cbb804c service nova] Creating event network-vif-deleted:40377182-e052-4d6d-b30c-a2c03a59d0ee for instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 on n-h2-857467-1 Sep 13 16:49:55.279745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b60b630d-283b-4412-8dda-f973f5cec835 req-80bdfa3b-4a6c-4d05-8409-42ab7cbb804c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099732 Sep 13 16:49:55.283381 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2194/4326] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:55.313930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:55.314691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:55.326738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:55.328450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:55.329449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:55.331741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:55.332230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:55.349520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:55.391246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:55.497404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:55.513884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cef609e4-fbac-4179-83fe-4fd282c773c2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 200 len: 1313 microversion: 2.1 time: 0.721140 Sep 13 16:49:55.518716 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2133/4327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:54 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:55.530781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1fa9b455-3c6d-4d34-8c5b-0b389eb7d738 req-e0a38c79-b496-4fec-91e2-278b0546a85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "c4de8a56-a7f1-4bc6-96b5-e4f932d9448c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:55.563260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1fa9b455-3c6d-4d34-8c5b-0b389eb7d738 req-e0a38c79-b496-4fec-91e2-278b0546a85b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:55.565241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1fa9b455-3c6d-4d34-8c5b-0b389eb7d738 req-e0a38c79-b496-4fec-91e2-278b0546a85b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:55.572172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1fa9b455-3c6d-4d34-8c5b-0b389eb7d738 req-e0a38c79-b496-4fec-91e2-278b0546a85b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:55.597352 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1fa9b455-3c6d-4d34-8c5b-0b389eb7d738 req-e0a38c79-b496-4fec-91e2-278b0546a85b service nova] Creating event network-changed:c4de8a56-a7f1-4bc6-96b5-e4f932d9448c for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:49:55.614132 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1fa9b455-3c6d-4d34-8c5b-0b389eb7d738 req-e0a38c79-b496-4fec-91e2-278b0546a85b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084980 Sep 13 16:49:55.615150 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2134/4328] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:56.213625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:56.214392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:56.218577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:56.230299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:56.231244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:56.231857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:56.232850 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b60c93f6-686c-4bd1-ab66-cebd06395121 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.923480 Sep 13 16:49:56.232991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:56.233626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:56.234790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:56.246081 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2195/4329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:55 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:49:56.543901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:56.546248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:56.555099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:56.556715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:56.558539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:56.561939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:56.563116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:56.564713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:56.596850 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 HTTP/1.1 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37'} Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:56.600411 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:49:56.605064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:49:56.605064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:49:56.605064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:49:56.605064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:49:56.605064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:49:56.605064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:49:56.610496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:49:56.612154 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6f299f2-36e4-431a-88bc-7bda019a971e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 404 len: 111 microversion: 2.1 time: 0.078202 Sep 13 16:49:56.613311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2196/4330] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:56 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:49:56.643725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68e0ecd1-bee8-41a9-a874-3d9ebabb1bac tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '.version_select at 0x7fbeb97f59d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:56.695439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68e0ecd1-bee8-41a9-a874-3d9ebabb1bac tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-key-1924389335" status: 202 len: 0 microversion: 2.1 time: 0.061984 Sep 13 16:49:56.696539 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2197/4331] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Sep 13 16:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1924389335 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:49:56.805046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:56.822275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:56.824098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:56.828662 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20cb7ab7-5b3e-4dc7-ae24-047c6b9e63ad tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1845 microversion: 2.42 time: 0.621992 Sep 13 16:49:56.833146 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2135/4332] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:56 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1845 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:57.008321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1593006313", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:57.104884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:49:57.258561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:57.259259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:57.267606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:57.275283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:57.277255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:57.279223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:57.279910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:57.284633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:57.285935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:57.286588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:57.287319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:57.968670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:49:58.165723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:58.186510 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-831f086d-95b2-4944-b4be-802ecfc86a6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.932148 Sep 13 16:49:58.192384 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2136/4333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:57 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:58.197502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:58.215636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:58.230463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:58.240411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:58.241129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:58.245231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:58.245974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:58.246669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:58.752971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:58.786504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:58.799930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:58.802936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f66fab80-b704-4c13-8c91-f2a40d6ecdf2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1866 microversion: 2.42 time: 0.608018 Sep 13 16:49:58.803854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2137/4334] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:58 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1866 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:49:59.038218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a0776e35-1589-48f6-b921-a138d7a453f4 req-8f646bc3-6a0b-4a1f-bed6-7126cedcf19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b977f7c-ae5d-4018-b738-a59455646029", "tag": "ffca52ed-fa81-47b9-ad26-30fee6da8c36"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:59.071489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a0776e35-1589-48f6-b921-a138d7a453f4 req-8f646bc3-6a0b-4a1f-bed6-7126cedcf19f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.072170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a0776e35-1589-48f6-b921-a138d7a453f4 req-8f646bc3-6a0b-4a1f-bed6-7126cedcf19f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.072768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a0776e35-1589-48f6-b921-a138d7a453f4 req-8f646bc3-6a0b-4a1f-bed6-7126cedcf19f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.089216 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a0776e35-1589-48f6-b921-a138d7a453f4 req-8f646bc3-6a0b-4a1f-bed6-7126cedcf19f service nova] Creating event network-changed:ffca52ed-fa81-47b9-ad26-30fee6da8c36 for instance 7b977f7c-ae5d-4018-b738-a59455646029 on n-h1-857467-1 Sep 13 16:49:59.100666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a0776e35-1589-48f6-b921-a138d7a453f4 req-8f646bc3-6a0b-4a1f-bed6-7126cedcf19f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066575 Sep 13 16:49:59.101529 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2138/4335] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:49:59.215113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:59.215852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:59.232061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.234856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.236059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.239878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.240500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.242177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.602464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:49:59.614749 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8044b679-fe0b-4b64-82a6-9eb8c3592289 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.405699 Sep 13 16:49:59.618150 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2139/4336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:59 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:49:59.631794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-89d02d6a-23c7-4c55-beba-4224015c98ea req-0f4383bc-077b-4e57-b2d4-b32f75ec234d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "4ac32004-bfe2-4308-811c-e0444fad86fb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:49:59.662759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89d02d6a-23c7-4c55-beba-4224015c98ea req-0f4383bc-077b-4e57-b2d4-b32f75ec234d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.663360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:49:59.664379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:49:59.664846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89d02d6a-23c7-4c55-beba-4224015c98ea req-0f4383bc-077b-4e57-b2d4-b32f75ec234d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.665224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:49:59.665411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89d02d6a-23c7-4c55-beba-4224015c98ea req-0f4383bc-077b-4e57-b2d4-b32f75ec234d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.666013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:49:59.666604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:49:59.691948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.692691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.693349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.694302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.694945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.695553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.704804 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-89d02d6a-23c7-4c55-beba-4224015c98ea req-0f4383bc-077b-4e57-b2d4-b32f75ec234d service nova] Creating event network-changed:4ac32004-bfe2-4308-811c-e0444fad86fb for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:49:59.716648 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-89d02d6a-23c7-4c55-beba-4224015c98ea req-0f4383bc-077b-4e57-b2d4-b32f75ec234d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096063 Sep 13 16:49:59.720442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2140/4337] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:49:59.737499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:49:59.750038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:49:59.771430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:49:59.774335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:49:59.835359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:59.844917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:49:59.862682 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f5cd009-caee-4361-91fa-c4e40b4c8ddd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.851109 Sep 13 16:49:59.867639 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2198/4338] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:49:59.874235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.878729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.884631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1e56672-1208-4266-81b6-82f584096fc9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:49:59.886977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.891529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:49:59.901369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:49:59.901923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:49:59.906716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1e56672-1208-4266-81b6-82f584096fc9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:00.179038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1e56672-1208-4266-81b6-82f584096fc9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:00.187063 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1e56672-1208-4266-81b6-82f584096fc9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1209 microversion: 2.1 time: 0.315871 Sep 13 16:50:00.187654 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2199/4339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:49:59 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1209 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:00.199566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:00.203020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:00.216988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:00.225327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:00.225996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:00.227079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:00.227715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:00.228310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:00.756274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:00.774419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:00.776066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:00.778640 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-189cc7d7-7a00-4c07-8a84-a066f626ea5c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1866 microversion: 2.42 time: 0.948615 Sep 13 16:50:00.781688 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2141/4340] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:49:59 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1866 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:00.793323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:00.797934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:00.814017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:00.819115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:00.819814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:00.820760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:00.821405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:00.823246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.261266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:01.271036 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46e2053d-4958-4b9e-94da-742a57fa6942 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 1.079176 Sep 13 16:50:01.278117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2200/4341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:00 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:01.283772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:01.289569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:01.311930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.312500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.313069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.314325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.314790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.315220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.411387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:01.420447 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-623cffe0-f335-4056-99f7-bb3f1eb5b523 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1205 microversion: 2.1 time: 0.140926 Sep 13 16:50:01.425623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2201/4342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:01 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1205 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:01.436650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:01.438892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:01.455619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.456815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.458468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.464806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.465749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.466498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.660516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:01.677726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc9f1953-3fa4-46ea-a8ed-ad7e4b521814 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.892383 Sep 13 16:50:01.689860 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2142/4343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:00 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:01.797127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:01.806831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebb222fa-723e-4995-b584-77fcc718de27 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.379281 Sep 13 16:50:01.810774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2202/4344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:01 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:01.826964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:01.827513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:01.831423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:01.832113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:01.844547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.845919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.846365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.847716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.847854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.848316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.848846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.849330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.850251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:01.850878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:01.851466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:01.857296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:02.727857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:02.738670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:02.746959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:02.748402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa5f4d71-6b4a-4467-8fc0-8a7a0c8d90f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1887 microversion: 2.42 time: 0.943887 Sep 13 16:50:02.749452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2143/4345] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:01 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1887 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:02.755155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ee5e8840-c92a-41bf-9479-79e303b60c9c req-e9097214-9cf8-4794-b822-82b2fc028bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "7d95abb3-3a18-4ca4-bb23-b36dd169b8ca"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:02.764573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ee5e8840-c92a-41bf-9479-79e303b60c9c req-e9097214-9cf8-4794-b822-82b2fc028bc4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:02.765296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ee5e8840-c92a-41bf-9479-79e303b60c9c req-e9097214-9cf8-4794-b822-82b2fc028bc4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:02.765986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ee5e8840-c92a-41bf-9479-79e303b60c9c req-e9097214-9cf8-4794-b822-82b2fc028bc4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:02.779933 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ee5e8840-c92a-41bf-9479-79e303b60c9c req-e9097214-9cf8-4794-b822-82b2fc028bc4 service nova] Creating event network-changed:7d95abb3-3a18-4ca4-bb23-b36dd169b8ca for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:02.786469 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ee5e8840-c92a-41bf-9479-79e303b60c9c req-e9097214-9cf8-4794-b822-82b2fc028bc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035550 Sep 13 16:50:02.787603 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2144/4346] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:02.795261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:02.796166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:02.805027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:02.805914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:02.806511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:02.807373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:02.807984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:02.808595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:02.814427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:02.919964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:02.933088 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c58c79a2-ddb7-4709-9f5a-d51985bce7c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 1.106654 Sep 13 16:50:02.934317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2203/4347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:01 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:02.945569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:02.946615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:02.954085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:02.956693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:02.957566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:02.958297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:02.959592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:02.960230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:02.960905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:03.104289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:03.122619 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-26cf1a1f-cf82-402e-bb86-2ddd613e1048 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1267 microversion: 2.1 time: 0.332955 Sep 13 16:50:03.124394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2145/4348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:02 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:03.158742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1052234173"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:03.164978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:03.187516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:03.187516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:03.187516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:03.187516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:03.188079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:03.189243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:03.630025 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0633dd1-44f1-46ac-9812-97e2cd443854 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.484169 Sep 13 16:50:03.631235 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2146/4349] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:50:03 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 13 16:50:03.783714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:03.787810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:03.800175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:03.801101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:03.801101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:03.806443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:03.807049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:03.808826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:03.840473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:03.852240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b9e02c2-edfd-4952-b3c9-1d7fa695896e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.916320 Sep 13 16:50:03.858197 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2204/4350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:02 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:04.156053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:04.160215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:04.175835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:04.176350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:04.176794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:04.177519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:04.178017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:04.178449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:04.350074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:04.365918 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99534790-f9f7-40cb-8c1d-4015cce0ed18 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1267 microversion: 2.1 time: 0.215797 Sep 13 16:50:04.383096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2205/4351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:04 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:04.572359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:04.608437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:04.615704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:04.617323 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f282e628-9a02-4ffe-9860-df6ba550cceb tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1887 microversion: 2.42 time: 0.842284 Sep 13 16:50:04.639335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2147/4352] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:03 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1887 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:04.883196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:04.884392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:04.906703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:04.907729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:04.908457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:04.909383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:04.912548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:04.913187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:04.927996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-07b2db01-646c-4a9f-9d5a-4c3e5f1bfe70 req-3c950c1c-8844-4a09-ac94-2110d1b551f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "9f8d4b2e-313f-409c-af69-875f37588cda"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:04.952820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-07b2db01-646c-4a9f-9d5a-4c3e5f1bfe70 req-3c950c1c-8844-4a09-ac94-2110d1b551f8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:04.958125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-07b2db01-646c-4a9f-9d5a-4c3e5f1bfe70 req-3c950c1c-8844-4a09-ac94-2110d1b551f8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:04.962108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-07b2db01-646c-4a9f-9d5a-4c3e5f1bfe70 req-3c950c1c-8844-4a09-ac94-2110d1b551f8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:05.019375 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-07b2db01-646c-4a9f-9d5a-4c3e5f1bfe70 req-3c950c1c-8844-4a09-ac94-2110d1b551f8 service nova] Creating event network-changed:9f8d4b2e-313f-409c-af69-875f37588cda for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:05.030890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-07b2db01-646c-4a9f-9d5a-4c3e5f1bfe70 req-3c950c1c-8844-4a09-ac94-2110d1b551f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107559 Sep 13 16:50:05.035813 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2148/4353] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:05.403032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:05.404222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:05.428620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:05.430642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:05.433267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:05.435640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:05.436294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:05.439422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:05.636535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:05.651380 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abe7e54a-a6e9-4400-9e35-d1c4cfc2e2f5 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.774078 Sep 13 16:50:05.662400 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2206/4354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:04 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:05.674249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:05.674886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:05.697080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:05.697592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:05.698073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:05.698798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:05.699278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:05.699697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:06.027935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:06.040483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0332490c-7971-4e03-a724-815519d61cb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1267 microversion: 2.1 time: 0.645199 Sep 13 16:50:06.040963 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2149/4355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:05 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1267 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:06.191366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:06.205001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:06.208590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:06.211823 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe1621f1-5d57-42d9-8fdb-576f9f127c08 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1887 microversion: 2.42 time: 0.548345 Sep 13 16:50:06.226636 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2207/4356] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:05 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1887 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:06.238247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-febc1c8c-93c3-418d-9ee2-6d733e727045 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb53f7040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:06.326579 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-febc1c8c-93c3-418d-9ee2-6d733e727045 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6" status: 200 len: 637 microversion: 2.1 time: 0.092672 Sep 13 16:50:06.346614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e6b4d34-cfc2-45d6-b8cf-b8ef212cffbc tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb50ce940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:06.349958 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2150/4357] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:06 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6 => generated 637 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:06.468666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6e6b4d34-cfc2-45d6-b8cf-b8ef212cffbc tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:06.494793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6e6b4d34-cfc2-45d6-b8cf-b8ef212cffbc tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:06.679547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:06.680269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:06.746056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:06.763824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:06.780866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:06.782451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:06.789027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:06.790929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:07.251899 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e6b4d34-cfc2-45d6-b8cf-b8ef212cffbc tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.909930 Sep 13 16:50:07.258654 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2208/4358] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:06 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:50:07.264780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:07.279812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:07.296895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:07.297521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:07.298663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:07.300017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:07.302325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:07.302834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:07.794444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:07.806650 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abfc0fac-d75e-4b3d-93d5-958c07a780ec tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 0.546629 Sep 13 16:50:07.830643 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2209/4359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:07 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:07.850294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0f7e1b62-d2c8-4683-a124-159b0ea8dc1d req-30c542e9-e7b2-4d6a-aa44-d62b27df86f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "8d963fa2-857f-48ba-9e30-6eb1f472d8e5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:07.894141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0f7e1b62-d2c8-4683-a124-159b0ea8dc1d req-30c542e9-e7b2-4d6a-aa44-d62b27df86f4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:07.894641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0f7e1b62-d2c8-4683-a124-159b0ea8dc1d req-30c542e9-e7b2-4d6a-aa44-d62b27df86f4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:07.895089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0f7e1b62-d2c8-4683-a124-159b0ea8dc1d req-30c542e9-e7b2-4d6a-aa44-d62b27df86f4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:07.931784 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0f7e1b62-d2c8-4683-a124-159b0ea8dc1d req-30c542e9-e7b2-4d6a-aa44-d62b27df86f4 service nova] Creating event network-changed:8d963fa2-857f-48ba-9e30-6eb1f472d8e5 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:07.970135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0f7e1b62-d2c8-4683-a124-159b0ea8dc1d req-30c542e9-e7b2-4d6a-aa44-d62b27df86f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136816 Sep 13 16:50:07.973652 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2210/4360] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:07.996548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:07.997387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:08.028828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:08.029341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:08.029785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:08.036983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:08.037493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:08.044924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:08.501628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:08.521119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:08.523879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:08.525510 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07c6a1cc-a11e-4567-a617-46f68fa8d1b6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1887 microversion: 2.42 time: 0.549304 Sep 13 16:50:08.544535 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2211/4361] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:07 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1887 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:08.553297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a58ce5fc-6742-4243-8a0b-5cf6cd723050 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb48e49d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:08.697285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:08.710759 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c9554a5-d59c-4077-84d0-090f6d6b819f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 2.035305 Sep 13 16:50:08.712000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2151/4362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:06 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:08.727375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b41c90ce-7e94-450a-886a-e809d8cf2062 req-229de5e2-69f6-4b47-a362-f54dde2ca4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b977f7c-ae5d-4018-b738-a59455646029", "name": "network-vif-plugged", "status": "completed", "tag": "ffca52ed-fa81-47b9-ad26-30fee6da8c36"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:08.770747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b41c90ce-7e94-450a-886a-e809d8cf2062 req-229de5e2-69f6-4b47-a362-f54dde2ca4cf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:08.776992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b41c90ce-7e94-450a-886a-e809d8cf2062 req-229de5e2-69f6-4b47-a362-f54dde2ca4cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:08.777687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b41c90ce-7e94-450a-886a-e809d8cf2062 req-229de5e2-69f6-4b47-a362-f54dde2ca4cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:08.801508 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b41c90ce-7e94-450a-886a-e809d8cf2062 req-229de5e2-69f6-4b47-a362-f54dde2ca4cf service nova] Creating event network-vif-plugged:ffca52ed-fa81-47b9-ad26-30fee6da8c36 for instance 7b977f7c-ae5d-4018-b738-a59455646029 on n-h1-857467-1 Sep 13 16:50:08.818987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b41c90ce-7e94-450a-886a-e809d8cf2062 req-229de5e2-69f6-4b47-a362-f54dde2ca4cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104563 Sep 13 16:50:08.820107 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2152/4363] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:09.003848 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a58ce5fc-6742-4243-8a0b-5cf6cd723050 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "DELETE /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.459853 Sep 13 16:50:09.004576 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2212/4364] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Sep 13 16:50:08 2022] DELETE /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata/os_version => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:50:09.012303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:09.013151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:09.027952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:09.031076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:09.031944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:09.034834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:09.035490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:09.036830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:09.214591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6897500f-4221-4bf3-b268-d5ac878b1d90 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] Calling method '.version_select at 0x7fbeb57874c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:09.348220 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6897500f-4221-4bf3-b268-d5ac878b1d90 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97/defaults" status: 200 len: 371 microversion: 2.1 time: 0.526650 Sep 13 16:50:09.350721 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2153/4365] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:50:08 2022] GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97/defaults => generated 371 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:09.357320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bae8c26a-6322-4d4b-9f53-18da6a2283ab tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb53c75e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:09.441197 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bae8c26a-6322-4d4b-9f53-18da6a2283ab tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 37 microversion: 2.1 time: 0.089116 Sep 13 16:50:09.446863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2154/4366] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:50:09 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 37 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:09.462635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0040c08c-b7a6-49be-8211-ae62fe496d08 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] Calling method '.version_select at 0x7fbeb4e56a60>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:09.479836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:09.499671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-89507a10-66e4-4049-86c5-a2d206e15411 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 0.490514 Sep 13 16:50:09.503686 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2213/4367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:09 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:09.518867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5da3ab5-9f85-4424-97d3-f954134f274d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb50ce4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:09.603719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b5da3ab5-9f85-4424-97d3-f954134f274d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:09.620836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b5da3ab5-9f85-4424-97d3-f954134f274d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:09.671540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0040c08c-b7a6-49be-8211-ae62fe496d08 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97" status: 200 len: 371 microversion: 2.1 time: 0.222625 Sep 13 16:50:09.682944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2155/4368] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:50:09 2022] GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97 => generated 371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:09.688665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:09.689802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:09.712757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:09.716232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:09.722376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:09.723001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:09.723784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:09.724267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:09.725690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.124499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5da3ab5-9f85-4424-97d3-f954134f274d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.618951 Sep 13 16:50:10.125323 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2214/4369] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:09 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:10.136134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-011c5289-fe62-4714-b371-fe1e6095b42a tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] Calling method '.version_select at 0x7fbeb4808160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:10.405260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:10.429945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:10.431812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:10.433047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c5fbab1-11b9-4d8b-9771-6d8a6f919cce tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.748562 Sep 13 16:50:10.433624 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2156/4370] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:09 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:10.438694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:10.439645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:10.450825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:10.451580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:10.452179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.453046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:10.454203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:10.455060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.570614 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-011c5289-fe62-4714-b371-fe1e6095b42a tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97/defaults" status: 200 len: 371 microversion: 2.1 time: 0.443024 Sep 13 16:50:10.571945 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2215/4371] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:50:10 2022] GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97/defaults => generated 371 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:10.584458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b32635c3-a0c8-4c45-8d08-cf94447a4a9b req-296d03bb-c519-4095-808f-34a41cb619e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "f8d74f64-19aa-442c-8831-3c7580891fc8"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:10.605371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b32635c3-a0c8-4c45-8d08-cf94447a4a9b req-296d03bb-c519-4095-808f-34a41cb619e8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:10.606306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b32635c3-a0c8-4c45-8d08-cf94447a4a9b req-296d03bb-c519-4095-808f-34a41cb619e8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:10.606919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b32635c3-a0c8-4c45-8d08-cf94447a4a9b req-296d03bb-c519-4095-808f-34a41cb619e8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.619551 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b32635c3-a0c8-4c45-8d08-cf94447a4a9b req-296d03bb-c519-4095-808f-34a41cb619e8 service nova] Creating event network-changed:f8d74f64-19aa-442c-8831-3c7580891fc8 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:10.625050 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b32635c3-a0c8-4c45-8d08-cf94447a4a9b req-296d03bb-c519-4095-808f-34a41cb619e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049868 Sep 13 16:50:10.626477 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2216/4372] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:10.632205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-43df03f1-509e-45cf-8e40-2a790b520d06 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb48081f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:10.690426 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-43df03f1-509e-45cf-8e40-2a790b520d06 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.062332 Sep 13 16:50:10.691429 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2217/4373] 10.222.0.61 () {58 vars in 1290 bytes} [Tue Sep 13 16:50:10 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata/os_distro => generated 33 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:10.699371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-8c2eeeb3-e6ec-40de-bb9c-1fe8cb244071 req-c8e3709b-8212-4c6a-a177-4e555fa35719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e7e51b-5938-4a24-83d0-38c5ea3d3641", "tag": "114bbd3a-f4a3-4278-93dc-299cfc57874b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:10.712310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8c2eeeb3-e6ec-40de-bb9c-1fe8cb244071 req-c8e3709b-8212-4c6a-a177-4e555fa35719 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:10.713078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8c2eeeb3-e6ec-40de-bb9c-1fe8cb244071 req-c8e3709b-8212-4c6a-a177-4e555fa35719 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:10.713666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8c2eeeb3-e6ec-40de-bb9c-1fe8cb244071 req-c8e3709b-8212-4c6a-a177-4e555fa35719 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.746289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8c2eeeb3-e6ec-40de-bb9c-1fe8cb244071 req-c8e3709b-8212-4c6a-a177-4e555fa35719 service nova] Creating event network-changed:114bbd3a-f4a3-4278-93dc-299cfc57874b for instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 on n-h2-857467-1 Sep 13 16:50:10.758121 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-8c2eeeb3-e6ec-40de-bb9c-1fe8cb244071 req-c8e3709b-8212-4c6a-a177-4e555fa35719 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065380 Sep 13 16:50:10.769771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2218/4374] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:10.776671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:10.777666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:10.794898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:10.795955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:10.796642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.800883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:10.801457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:10.802984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:10.885674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:10.896838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d16632e-ddb5-4e21-a8bf-4be3f39021bf tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1361 microversion: 2.1 time: 0.461951 Sep 13 16:50:10.898156 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2157/4375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:10 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:10.905632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14e8f219-2df1-4531-810e-0033b05199d7 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] Calling method '.version_select at 0x7fbeb53c70d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:11.367804 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14e8f219-2df1-4531-810e-0033b05199d7 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97" status: 200 len: 371 microversion: 2.1 time: 0.467610 Sep 13 16:50:11.368428 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2158/4376] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:50:10 2022] GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97 => generated 371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:11.378713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03c7970a-574f-418e-94be-a40c7f817287 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb4e56790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:11.450814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-03c7970a-574f-418e-94be-a40c7f817287 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:11.467851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-03c7970a-574f-418e-94be-a40c7f817287 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:11.529730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:11.541298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9edf9575-6664-447d-8c26-72177ce047f8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 0.769901 Sep 13 16:50:11.542749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2219/4377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:10 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:11.560147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e3d7e3c-f489-4abd-8577-ee7c6e261ad8 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] Calling method '.version_select at 0x7fbeb4808c10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:11.772046 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03c7970a-574f-418e-94be-a40c7f817287 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.402372 Sep 13 16:50:11.773525 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2159/4378] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:11 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:11.778541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:11.779753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:11.788211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:11.789327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:11.790260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:11.791192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:11.791855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:11.792947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:11.911473 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e3d7e3c-f489-4abd-8577-ee7c6e261ad8 tempest-QuotasTestJSON-273568640 tempest-QuotasTestJSON-273568640-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97?user_id=ca01f14e7f2b43d281b2713ec6d9622c" status: 200 len: 371 microversion: 2.1 time: 0.367379 Sep 13 16:50:11.912103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2220/4379] 10.222.0.61 () {58 vars in 1323 bytes} [Tue Sep 13 16:50:11 2022] GET /compute/v2.1/os-quota-sets/0fb59cbbc3f044558a9964ef2ed45a97?user_id=ca01f14e7f2b43d281b2713ec6d9622c => generated 371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:11.931866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-68b9418b-722f-471e-b07a-7e7fde752be8 req-70fa1be1-4e11-4134-8d40-adf70e1e27ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-plugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:11.948131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-68b9418b-722f-471e-b07a-7e7fde752be8 req-70fa1be1-4e11-4134-8d40-adf70e1e27ed service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:11.948904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-68b9418b-722f-471e-b07a-7e7fde752be8 req-70fa1be1-4e11-4134-8d40-adf70e1e27ed service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:11.949506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-68b9418b-722f-471e-b07a-7e7fde752be8 req-70fa1be1-4e11-4134-8d40-adf70e1e27ed service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:11.965384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-68b9418b-722f-471e-b07a-7e7fde752be8 req-70fa1be1-4e11-4134-8d40-adf70e1e27ed service nova] Creating event network-vif-plugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:50:11.972563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-68b9418b-722f-471e-b07a-7e7fde752be8 req-70fa1be1-4e11-4134-8d40-adf70e1e27ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049279 Sep 13 16:50:11.973386 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2221/4380] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:11.980546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7921a422-6d8c-44b5-bf0c-c0e4702bdb24 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb48aa9d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:12.051215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7921a422-6d8c-44b5-bf0c-c0e4702bdb24 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076315 Sep 13 16:50:12.052251 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2222/4381] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:50:11 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:12.065105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:12.066125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:12.073405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:12.074220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:12.075227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:12.076272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:12.076916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:12.077513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:12.150101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:12.163911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:12.165629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:12.167301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b5b0c9c-0ec1-403b-b37e-60dad926a19b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.392755 Sep 13 16:50:12.177986 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2160/4382] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:11 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:12.185972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-805b47d1-a5ea-444a-bb7f-eedcb4006d41 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb53d6b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:12.246498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-805b47d1-a5ea-444a-bb7f-eedcb4006d41 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:12.253783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-805b47d1-a5ea-444a-bb7f-eedcb4006d41 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:12.288142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:12.300329 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-01c40b60-0747-42f7-925d-dbac3f2eb870 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1547 microversion: 2.1 time: 0.239004 Sep 13 16:50:12.304490 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2223/4383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:12 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1547 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:12.330086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:12.330808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:12.338796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:12.339668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:12.340361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:12.341896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:12.342333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:12.342838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:12.507536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-805b47d1-a5ea-444a-bb7f-eedcb4006d41 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.330306 Sep 13 16:50:12.510840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ecf7d437-81df-4d90-bf99-8a9463ac5769 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186874 Sep 13 16:50:12.511611 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2224/4384] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:50:12 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:12.512346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2161/4385] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:12 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:12.527364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-88f3d74a-278e-476b-9dab-073f979b8eb2 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb536eaf0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:12.568675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:12.569415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:12.577129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:12.577893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:12.578503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:12.580192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:12.580829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:12.581427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:12.611300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-88f3d74a-278e-476b-9dab-073f979b8eb2 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:12.635478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-88f3d74a-278e-476b-9dab-073f979b8eb2 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:12.956125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:12.968121 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b13e5c45-0681-4109-9fcd-5ef0978565b4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 0.407492 Sep 13 16:50:12.970797 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2162/4386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:12 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:12.982567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5551cca4-ff38-4618-a84d-da4bd0e54e17 req-1cdc6d87-a452-463d-a215-178b2e2e0db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "4cc3d202-6c15-40ca-8e70-39399e2d00e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:13.012125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5551cca4-ff38-4618-a84d-da4bd0e54e17 req-1cdc6d87-a452-463d-a215-178b2e2e0db7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:13.013469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5551cca4-ff38-4618-a84d-da4bd0e54e17 req-1cdc6d87-a452-463d-a215-178b2e2e0db7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:13.014245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5551cca4-ff38-4618-a84d-da4bd0e54e17 req-1cdc6d87-a452-463d-a215-178b2e2e0db7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:13.046125 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5551cca4-ff38-4618-a84d-da4bd0e54e17 req-1cdc6d87-a452-463d-a215-178b2e2e0db7 service nova] Creating event network-changed:4cc3d202-6c15-40ca-8e70-39399e2d00e6 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:13.059950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5551cca4-ff38-4618-a84d-da4bd0e54e17 req-1cdc6d87-a452-463d-a215-178b2e2e0db7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085358 Sep 13 16:50:13.062909 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2163/4387] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:13.123780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-88f3d74a-278e-476b-9dab-073f979b8eb2 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.603447 Sep 13 16:50:13.125663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2225/4388] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:12 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 64 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:13.138608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b2eab453-d4b9-4262-868a-1e75e9bdc450 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb5a00430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:13.194803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:13.196115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:13.209191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:13.212739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:13.213385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:13.214485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:13.215682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:13.216373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:13.217818 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b2eab453-d4b9-4262-868a-1e75e9bdc450 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.085889 Sep 13 16:50:13.227724 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2164/4389] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:50:13 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 64 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:13.237486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-809c329f-0b95-46d0-a626-4bf62627ff8f tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb53f7ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:13.247635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:13.319811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-809c329f-0b95-46d0-a626-4bf62627ff8f tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:13.339630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-809c329f-0b95-46d0-a626-4bf62627ff8f tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:13.851908 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-809c329f-0b95-46d0-a626-4bf62627ff8f tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.622663 Sep 13 16:50:13.859026 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2165/4390] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:13 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:13.866309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-650a563f-33c9-483c-8809-bc3ed52eb8a7 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update', calling method: .version_select at 0x7fbeb53c7820>, body: {"meta": {"os_version": "alt"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:13.940684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-650a563f-33c9-483c-8809-bc3ed52eb8a7 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:13.948788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-650a563f-33c9-483c-8809-bc3ed52eb8a7 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:13.981557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:14.006868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:14.011160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:14.014895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb06a05b-0228-4ad6-bdd9-4dea6628525b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.825618 Sep 13 16:50:14.022194 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2226/4391] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:13 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:14.042390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:14.043300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:14.075893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:14.080426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:14.081228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:14.081629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:14.082134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:14.082577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:14.425192 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-650a563f-33c9-483c-8809-bc3ed52eb8a7 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.563700 Sep 13 16:50:14.430557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2166/4392] 10.222.0.61 () {60 vars in 1313 bytes} [Tue Sep 13 16:50:13 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata/os_version => generated 31 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:14.436669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75ade0a9-85d8-4c08-89c2-a60648c51a63 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb53f7c10>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:14.496931 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75ade0a9-85d8-4c08-89c2-a60648c51a63 tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 58 microversion: 2.1 time: 0.065177 Sep 13 16:50:14.498122 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2167/4393] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:50:14 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 58 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:14.510037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4e42923-dfae-4364-a0b6-14419375406d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'update_all', calling method: .version_select at 0x7fbeb5c0aee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:14.587015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d4e42923-dfae-4364-a0b6-14419375406d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:14.599360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d4e42923-dfae-4364-a0b6-14419375406d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:15.307240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:15.320344 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1459d7ae-e1db-45fc-971e-583eacb6dde9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 1.295840 Sep 13 16:50:15.330122 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4e42923-dfae-4364-a0b6-14419375406d tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.825548 Sep 13 16:50:15.331126 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2168/4394] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:50:14 2022] PUT /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 61 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:15.336632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:15.337199 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2227/4395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:14 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:15.339246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:15.356091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de48c27b-bddf-4f09-8514-511a8ba617aa tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Action: 'create', calling method: .version_select at 0x7fbeb4808e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:15.367313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:15.367891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:15.368340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:15.369071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:15.371890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:15.372360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:15.449942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-de48c27b-bddf-4f09-8514-511a8ba617aa tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:15.487213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-de48c27b-bddf-4f09-8514-511a8ba617aa tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Getting quotas for user 2dc09eefd2c142128b9add90d48e467c and project dfdd81c3ce614316b5fc2e1b92e9db0f. Resources: dict_keys(['metadata_items']) {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:15.992998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:16.018121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:16.022453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:16.031569 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8925a37e-646d-4173-80dd-87bc6401575c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.697667 Sep 13 16:50:16.043135 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2169/4396] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:15 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:16.199661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8e8c34b8-5f88-4baf-80b6-433091a13c62 req-d7fdef45-5ae0-4a74-be9e-29907a355178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b977f7c-ae5d-4018-b738-a59455646029", "tag": "ffca52ed-fa81-47b9-ad26-30fee6da8c36"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:16.223811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8e8c34b8-5f88-4baf-80b6-433091a13c62 req-d7fdef45-5ae0-4a74-be9e-29907a355178 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:16.233987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8e8c34b8-5f88-4baf-80b6-433091a13c62 req-d7fdef45-5ae0-4a74-be9e-29907a355178 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:16.236069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8e8c34b8-5f88-4baf-80b6-433091a13c62 req-d7fdef45-5ae0-4a74-be9e-29907a355178 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:16.242460 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de48c27b-bddf-4f09-8514-511a8ba617aa tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "POST /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.903743 Sep 13 16:50:16.243670 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2228/4397] 10.222.0.61 () {60 vars in 1281 bytes} [Tue Sep 13 16:50:15 2022] POST /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 85 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:50:16.257308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-003a6968-4160-43f3-84da-36356b57bfab tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] Calling method '.version_select at 0x7fbeb98013a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:16.280216 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8e8c34b8-5f88-4baf-80b6-433091a13c62 req-d7fdef45-5ae0-4a74-be9e-29907a355178 service nova] Creating event network-changed:ffca52ed-fa81-47b9-ad26-30fee6da8c36 for instance 7b977f7c-ae5d-4018-b738-a59455646029 on n-h1-857467-1 Sep 13 16:50:16.301477 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8e8c34b8-5f88-4baf-80b6-433091a13c62 req-d7fdef45-5ae0-4a74-be9e-29907a355178 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102846 Sep 13 16:50:16.302184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2170/4398] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:16.365765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:16.366546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:16.368528 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-003a6968-4160-43f3-84da-36356b57bfab tempest-ImagesMetadataTestJSON-837125377 tempest-ImagesMetadataTestJSON-837125377-project] 10.222.0.61 "GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.116799 Sep 13 16:50:16.370924 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2229/4399] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Sep 13 16:50:16 2022] GET /compute/v2.1/images/40cadc22-49f5-49d5-84e3-148d021f27f6/metadata => generated 85 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:50:16.380278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:16.381875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:16.381875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:16.382909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:16.383433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:16.383875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:16.880312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-bc7a434b-aa45-4704-93d7-7c4df82b320b req-821d1d92-21b4-4f26-a8e5-06e36cbb2382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e7e51b-5938-4a24-83d0-38c5ea3d3641", "name": "network-vif-plugged", "status": "completed", "tag": "114bbd3a-f4a3-4278-93dc-299cfc57874b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:16.901296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bc7a434b-aa45-4704-93d7-7c4df82b320b req-821d1d92-21b4-4f26-a8e5-06e36cbb2382 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:16.901819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bc7a434b-aa45-4704-93d7-7c4df82b320b req-821d1d92-21b4-4f26-a8e5-06e36cbb2382 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:16.915139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bc7a434b-aa45-4704-93d7-7c4df82b320b req-821d1d92-21b4-4f26-a8e5-06e36cbb2382 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:16.970802 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-bc7a434b-aa45-4704-93d7-7c4df82b320b req-821d1d92-21b4-4f26-a8e5-06e36cbb2382 service nova] Creating event network-vif-plugged:114bbd3a-f4a3-4278-93dc-299cfc57874b for instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 on n-h2-857467-1 Sep 13 16:50:16.993211 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-bc7a434b-aa45-4704-93d7-7c4df82b320b req-821d1d92-21b4-4f26-a8e5-06e36cbb2382 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117680 Sep 13 16:50:16.996301 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2230/4400] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:17.077940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:17.079382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:17.123375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:17.125480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:17.125985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:17.126739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:17.127213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:17.127653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:17.478130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:17.493550 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2fe20e66-3735-4825-9741-53bb9bffbcb6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 1.130422 Sep 13 16:50:17.496400 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2171/4401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:16 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:17.749606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:17.763545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:17.765459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:17.767752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76b351f3-a990-482e-9c95-d278d68d2c7e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.702039 Sep 13 16:50:17.785053 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2231/4402] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:17 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:18.526132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:18.527928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:18.547072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:18.551593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:18.554626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:18.562404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:18.564047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:18.564675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:18.802203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:18.805085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:18.827326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:18.830629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:18.831171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:18.837896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:18.846985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:18.847773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:19.312351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:19.328273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af8d289b-c78e-4b4b-a11e-73c3bcad132a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1309 microversion: 2.1 time: 0.807486 Sep 13 16:50:19.332145 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2172/4403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:18 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1309 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:19.580152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:19.590447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:19.600908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:19.602391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-982ad4b5-fe39-499e-88c4-20f283c7f375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.810061 Sep 13 16:50:19.603848 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2232/4404] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:18 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:20.353435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:20.354088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:20.356941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:20.386418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:20.386930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:20.387381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:20.388111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:20.388580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:20.389024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:20.632200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:20.633547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:20.661630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:20.667161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:20.670152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:20.675052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:20.675780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:20.678559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:20.940216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:20.948721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b61a2c4-3c85-4c1e-b890-74ade612d58f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1491 microversion: 2.1 time: 0.599075 Sep 13 16:50:20.959004 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2173/4405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:20 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1491 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:21.033650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:21.049978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:21.052401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:21.053940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b8e441e6-c4f5-490e-968a-c6741f3b9799 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.426436 Sep 13 16:50:21.073451 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2233/4406] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:20 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:21.347582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1593006313", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:21.475100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:50:22.085550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:22.086492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:22.100419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:22.101586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:22.102685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:22.105938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:22.108239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:22.109006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:22.499906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:50:22.501015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:50:22.501720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:50:22.502390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:50:22.503054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:50:22.516735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:22.571922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:22.572900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.050s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:22.574663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:22.575370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:22.576341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:22.617383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:22.623682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:22.635229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:22.637044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:22.638916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:22.647085 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea9e5cbb-c8ac-402b-bcbd-54f54e8aa1cd tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.562333 Sep 13 16:50:22.663794 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2234/4407] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:22 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:22.671846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:50:22.679276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:50:22.788994 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-064b0ff9-53ca-4fd1-9430-642e258b35c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451990 Sep 13 16:50:22.789843 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2174/4408] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:50:22.804647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b2cbde6-db71-4890-b381-48e867707f75 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:22.805286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b2cbde6-db71-4890-b381-48e867707f75 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:22.936396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b2cbde6-db71-4890-b381-48e867707f75 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:22.954870 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b2cbde6-db71-4890-b381-48e867707f75 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1209 microversion: 2.1 time: 0.150500 Sep 13 16:50:22.955674 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2235/4409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:22 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:23.729077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:23.729732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:23.755014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:23.755516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:23.755973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:23.756709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:23.757173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:23.757606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:23.980457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:23.981341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:23.994556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:23.995248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:23.995988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:23.998907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:24.000886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:24.001726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:24.207295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:24.217757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:24.230378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:24.233002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:24.235413 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e91d0bbb-3a6c-4ac6-b587-05988ce7613f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.510900 Sep 13 16:50:24.237091 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2175/4410] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:23 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:24.845577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:24.855309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a94527b-d88f-463f-863b-358b2e42cddf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1213 microversion: 2.1 time: 0.877908 Sep 13 16:50:24.856756 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2236/4411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:23 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1213 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:25.269050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:25.269947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:25.302717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:25.303475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:25.304552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:25.308662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:25.309458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:25.312381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:25.524202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b832c009-2328-4060-aa4c-331e3412da64 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb97ebdc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:25.649342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b832c009-2328-4060-aa4c-331e3412da64 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/f7e678d4-6ceb-4232-82f0-0784ce1d5fdf" status: 200 len: 662 microversion: 2.1 time: 0.132436 Sep 13 16:50:25.650892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2237/4412] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:25 2022] GET /compute/v2.1/images/f7e678d4-6ceb-4232-82f0-0784ce1d5fdf => generated 662 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:25.669971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c125cf02-a3c1-43d7-b0a7-311c5317754d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb97eb040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:25.727306 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c125cf02-a3c1-43d7-b0a7-311c5317754d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/f7e678d4-6ceb-4232-82f0-0784ce1d5fdf" status: 200 len: 662 microversion: 2.1 time: 0.061908 Sep 13 16:50:25.728643 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2238/4413] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:25 2022] GET /compute/v2.1/images/f7e678d4-6ceb-4232-82f0-0784ce1d5fdf => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:25.809744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:25.825077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:25.833905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:25.854322 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-23ebedef-22a4-4d52-a76f-35ec36d232a5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.574423 Sep 13 16:50:25.857082 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2176/4414] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:25 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:25.883560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:25.887163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:25.914851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:25.916142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:25.916608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:25.925066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:25.926883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:25.928695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:26.088698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:26.107290 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41a3b012-75ad-4489-b2d7-24f601bba02a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1267 microversion: 2.1 time: 0.223644 Sep 13 16:50:26.108563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2239/4415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:25 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:26.887528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:26.888959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:26.902680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:26.909807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:26.914580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:26.917811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:26.918449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:26.919990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:27.130893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:27.131509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:27.149379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:27.149979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:27.150429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:27.151153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:27.151607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:27.152043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:27.603460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:27.613737 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-02a5379f-eb18-499c-962f-6a6a6fd4e221 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.487028 Sep 13 16:50:27.623876 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2240/4416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:27 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:27.965761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:27.985310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:27.987255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:27.994390 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6e0d8a8-e722-4212-85ac-de8700f4e0fa tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 1.110916 Sep 13 16:50:27.998149 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2177/4417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:26 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:28.369698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-15f9ea09-f0f9-4d30-aace-47be8419f334 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4864310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:28.492419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-15f9ea09-f0f9-4d30-aace-47be8419f334 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/327eafbe-a6eb-4148-ad1e-a573ffc491bc" status: 200 len: 662 microversion: 2.1 time: 0.127086 Sep 13 16:50:28.493659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2241/4418] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:28 2022] GET /compute/v2.1/images/327eafbe-a6eb-4148-ad1e-a573ffc491bc => generated 662 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:28.509600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad546223-b342-477f-96c8-113b329dfb29 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb98139d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:28.604327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad546223-b342-477f-96c8-113b329dfb29 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/327eafbe-a6eb-4148-ad1e-a573ffc491bc" status: 200 len: 662 microversion: 2.1 time: 0.099720 Sep 13 16:50:28.612254 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2178/4419] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:28 2022] GET /compute/v2.1/images/327eafbe-a6eb-4148-ad1e-a573ffc491bc => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:28.638384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:28.639013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:28.658675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:28.659349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:28.659822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:28.660598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:28.661078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:28.661523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:28.717518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7f71f16e-96aa-44f2-9683-b89a5fecaad6 req-88b3a9ab-eccf-4635-a3fb-4229da643265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1371b7e5-8c8a-475f-881c-b28b6af6b1c2", "tag": "d999c545-01a2-40b6-bc17-5f9fa025cd6c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:28.754922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7f71f16e-96aa-44f2-9683-b89a5fecaad6 req-88b3a9ab-eccf-4635-a3fb-4229da643265 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:28.754922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7f71f16e-96aa-44f2-9683-b89a5fecaad6 req-88b3a9ab-eccf-4635-a3fb-4229da643265 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:28.754922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7f71f16e-96aa-44f2-9683-b89a5fecaad6 req-88b3a9ab-eccf-4635-a3fb-4229da643265 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:28.821792 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7f71f16e-96aa-44f2-9683-b89a5fecaad6 req-88b3a9ab-eccf-4635-a3fb-4229da643265 service nova] Creating event network-changed:d999c545-01a2-40b6-bc17-5f9fa025cd6c for instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 on n-h1-857467-1 Sep 13 16:50:28.847338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7f71f16e-96aa-44f2-9683-b89a5fecaad6 req-88b3a9ab-eccf-4635-a3fb-4229da643265 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133639 Sep 13 16:50:28.854434 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2179/4420] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:28.991119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:29.006111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebbbb5d9-dcbe-438f-a054-47f6841f37d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.371569 Sep 13 16:50:29.007249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2242/4421] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:28 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:29.035459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:29.036450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:29.049412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:29.062397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:29.063133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:29.064519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:29.066156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:29.066894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:29.826891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:29.896619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:29.896619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:29.896619 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2afd3977-4d91-4109-a013-22ddd98368da tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.848377 Sep 13 16:50:29.922429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2180/4422] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:29 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:30.030578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:30.031181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:30.041092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:30.041771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:30.042349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:30.043183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:30.043756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:30.044194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:30.261509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:30.272141 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9c2c2b81-ba1a-4977-8e7b-da4d218aa6fb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.245264 Sep 13 16:50:30.273311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2243/4423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:30 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:30.930297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:30.931978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:30.961880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:30.966193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:30.968787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:30.974239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:30.974965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:30.976492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:31.083420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-797f8c35-7c74-42ed-acb0-c5fbd200e903 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb48aa310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:31.249408 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-797f8c35-7c74-42ed-acb0-c5fbd200e903 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/f208e1b8-dd46-46e6-a331-9370ab878b3f" status: 200 len: 662 microversion: 2.1 time: 0.182157 Sep 13 16:50:31.250946 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2244/4424] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:31 2022] GET /compute/v2.1/images/f208e1b8-dd46-46e6-a331-9370ab878b3f => generated 662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:31.267510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc7c876f-13f4-497b-ad16-0904f5c7236b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4808790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:31.384581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc7c876f-13f4-497b-ad16-0904f5c7236b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/f208e1b8-dd46-46e6-a331-9370ab878b3f" status: 200 len: 662 microversion: 2.1 time: 0.123118 Sep 13 16:50:31.394811 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2245/4425] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:50:31 2022] GET /compute/v2.1/images/f208e1b8-dd46-46e6-a331-9370ab878b3f => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:31.394811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:31.394811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:31.399872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:31.400401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:31.400824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:31.402232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:31.402681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:31.403325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:31.512185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:31.546784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:31.548576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:31.555566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8bf2599f-83e5-47ca-a689-a359d3552e69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.633093 Sep 13 16:50:31.556569 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2181/4426] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:30 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:31.805851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:31.808226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-656008702", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:31.820627 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-817225d5-4cb1-44b6-aaa4-b19bbeca690f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.429821 Sep 13 16:50:31.822143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2246/4427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:31 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:31.981372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:50:32.317352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:50:32.317989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:50:32.318583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:50:32.319201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:50:32.321763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:50:32.334368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:32.334861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:32.335424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:32.336305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:32.336782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:32.337365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:32.365416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Getting quotas for project 62c97812df4c466b9cd8d4562a8cda38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:32.385188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Getting quotas for user d3318c456e444ce0bf528cc27f0b5046 and project 62c97812df4c466b9cd8d4562a8cda38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:32.401482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:50:32.415260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:50:32.514330 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0f18b23-7e93-4c88-a60b-9a7dde3f8220 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712380 Sep 13 16:50:32.515541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2182/4428] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:50:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:50:32.587676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:32.588299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:32.618769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:32.619279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:32.619726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:32.630890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:32.631692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:32.632159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:32.773699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1633392748", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:32.874597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:50:32.948366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=30 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:33.139024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:33.171106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:33.181084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:33.190023 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-875824a5-bbd7-47bd-b871-9ce9b6052375 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.599156 Sep 13 16:50:33.191576 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2247/4429] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:32 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:33.207128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:33.208200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:33.244879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:33.265278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:33.266914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:33.276042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:33.280983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:33.281671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:33.282390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:33.438712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:50:33.439266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:50:33.439547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:50:33.440129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:50:33.440560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:50:33.457887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:33.458455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:33.458913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:33.459679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:33.461436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:33.463468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:33.534096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Getting quotas for project 62c97812df4c466b9cd8d4562a8cda38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:33.565342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Getting quotas for user d3318c456e444ce0bf528cc27f0b5046 and project 62c97812df4c466b9cd8d4562a8cda38. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:33.628647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:50:33.635286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:50:33.649386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:33.663146 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a68c1fe-7211-45ee-a033-fca33d15aae3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.470192 Sep 13 16:50:33.673866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2248/4430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:33 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:33.776027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2dad705-19c2-45ea-8152-afbd6afed77d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008528 Sep 13 16:50:33.782254 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2183/4431] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:50:33.795268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec8c07a4-cd4f-485e-90e5-0523a2048f5d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:33.796344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec8c07a4-cd4f-485e-90e5-0523a2048f5d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:33.932940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ec8c07a4-cd4f-485e-90e5-0523a2048f5d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:33.942384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec8c07a4-cd4f-485e-90e5-0523a2048f5d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1218 microversion: 2.1 time: 0.154072 Sep 13 16:50:33.943530 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2249/4432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:33 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:34.225518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:34.227970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:34.242662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.243176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.243639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:34.249965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.250499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.250952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:34.699681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:34.701785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:34.727285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.731049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.731687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:34.734829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:34.739356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:34.740104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:35.065167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:35.090788 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c9745367-2de4-4ad2-9739-77e54af61288 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.396983 Sep 13 16:50:35.094966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2250/4433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:34 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:35.102221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:35.103485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:35.140543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:35.142488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:35.143629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:35.145270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:35.146572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:35.147888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:35.287433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:35.301921 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5dfa55d-a6bc-4713-a73b-1cb1f4a8af67 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1222 microversion: 2.1 time: 0.203655 Sep 13 16:50:35.303457 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2251/4434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:35 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:35.364114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:35.378491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:35.380234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:35.386934 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3bca970-96ff-43a2-b902-fbdc1588acb7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 1.169594 Sep 13 16:50:35.401863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2184/4435] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:34 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:36.124461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:36.126889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:36.140366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.147252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.150959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.159533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.161076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.164340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.327459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:36.328159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:36.338279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.341416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.346172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.350472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.355895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.356437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.590718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:36.608326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f515e57-e427-4184-b73e-1801e98f6de5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1214 microversion: 2.1 time: 0.285305 Sep 13 16:50:36.612982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2185/4436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:36 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:36.618039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:36.630604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:36.646662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.648660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.650182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.651809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:36.652520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:36.653170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:36.716804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:36.723637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:36.749979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b5558ec-e56d-4ab1-912c-dfd74558080a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.630342 Sep 13 16:50:36.756561 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2252/4437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:36 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:37.163642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:37.188300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:37.190374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:37.191999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65ba9639-efa5-4ee3-b5c9-9e87bfd93ad2 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.577496 Sep 13 16:50:37.192791 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2186/4438] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:36 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:37.641616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:37.643142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:37.655893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.659418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.660322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.662765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.666648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.669123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.781056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:37.782027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:37.793899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.797041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.797524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:37.798686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:37.799340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:37.802879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:38.033377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:38.049962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d007c54-adee-4f5c-8cb4-acd907a4a094 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1288 microversion: 2.1 time: 0.413906 Sep 13 16:50:38.081296 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2253/4439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:37 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1288 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:38.209020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-845febf6-0b94-4c5f-b31b-d659a6af9031 req-c318037a-a3ba-4110-9437-afd21e8d1e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1371b7e5-8c8a-475f-881c-b28b6af6b1c2", "name": "network-vif-plugged", "status": "completed", "tag": "d999c545-01a2-40b6-bc17-5f9fa025cd6c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:38.250768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-845febf6-0b94-4c5f-b31b-d659a6af9031 req-c318037a-a3ba-4110-9437-afd21e8d1e17 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:38.257570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-845febf6-0b94-4c5f-b31b-d659a6af9031 req-c318037a-a3ba-4110-9437-afd21e8d1e17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:38.258860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-845febf6-0b94-4c5f-b31b-d659a6af9031 req-c318037a-a3ba-4110-9437-afd21e8d1e17 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:38.331429 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-845febf6-0b94-4c5f-b31b-d659a6af9031 req-c318037a-a3ba-4110-9437-afd21e8d1e17 service nova] Creating event network-vif-plugged:d999c545-01a2-40b6-bc17-5f9fa025cd6c for instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 on n-h1-857467-1 Sep 13 16:50:38.349332 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-845febf6-0b94-4c5f-b31b-d659a6af9031 req-c318037a-a3ba-4110-9437-afd21e8d1e17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151711 Sep 13 16:50:38.355194 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2254/4440] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:38.369676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:38.372477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:38.383591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:38.384532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:38.402939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:38.405632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:38.407245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:38.408366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:38.660015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:38.679069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-278e7dab-84d9-4607-82d6-f15587345399 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.901436 Sep 13 16:50:38.679285 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2187/4441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:37 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:38.993019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:39.014296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:39.020063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:39.022333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0da603f9-ff51-4cc1-83a8-b17412682469 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.665459 Sep 13 16:50:39.025901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2255/4442] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:38 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:39.082302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:39.083034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:39.096514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:39.099457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:39.100096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:39.101033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:39.101687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:39.102940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:39.405776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:39.426291 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-59adc865-7b86-4c71-969c-052e43b666a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1276 microversion: 2.1 time: 0.347183 Sep 13 16:50:39.426945 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2188/4443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:39 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1276 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:39.712032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:39.712524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:39.731772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:39.732281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:39.735860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:39.736815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:39.739338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:39.740994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:40.074744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:40.075385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:40.084955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:40.085602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:40.085929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:40.086649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:40.101781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:40.101921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:40.240418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:40.256544 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66fdef39-b6f7-4bc9-a0b8-11c917412f77 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1309 microversion: 2.1 time: 0.546850 Sep 13 16:50:40.258391 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2256/4444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:39 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1309 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:40.455786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:40.456422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:40.471835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:40.472340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:40.472786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:40.474768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:40.475420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:40.477216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:40.954407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:40.962865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b31beb82-5dd8-4058-97ea-288ab11a88f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.512324 Sep 13 16:50:40.977358 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2257/4445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:40 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:40.987239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:40.988395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:40.997313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:40.998192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:40.998966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:41.000127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:41.001342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:41.002035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:41.216343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:41.237685 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61c69a44-f207-45ef-bba6-c38048fb709e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.254168 Sep 13 16:50:41.241301 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2258/4446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:40 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:41.283375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:41.285000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:41.299349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:41.299858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:41.300311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:41.301047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:41.301517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:41.306182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:41.504336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:41.524237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:41.526113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:41.545519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e5cb59e-f538-47bb-b23f-1b6fa74c7f2f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 1.491041 Sep 13 16:50:41.547513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2189/4447] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:40 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:41.664948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:41.674966 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ef23043-11b9-453a-98fc-5d4a366e458f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1490 microversion: 2.1 time: 0.396378 Sep 13 16:50:41.678186 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2259/4448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:41 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1490 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:41.709637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:41.711811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:41.731065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:41.731909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:41.732623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:41.733554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:41.734235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:41.735754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:41.991092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:41.992038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:42.005541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.011244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.015240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.017011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.017651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.018093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.182829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:42.192909 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-794665ea-dbd8-4de2-8e98-e858317a87da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1491 microversion: 2.1 time: 0.496097 Sep 13 16:50:42.196534 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2190/4449] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:41 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1491 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:42.221587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:42.223359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:42.231821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.232622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.233411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.234212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.235834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.236863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.453408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:42.470677 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4450aaf7-9a91-4d43-a8c0-db1fb2967d20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.484826 Sep 13 16:50:42.482736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2260/4450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:41 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:42.493529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:42.494515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:42.501726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.502264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.502734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.503437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.503894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.504443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.664199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:42.672844 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-86bb2551-7aa9-401d-ba65-68a83bf4c0e5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1490 microversion: 2.1 time: 0.457728 Sep 13 16:50:42.673441 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2191/4451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:42 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1490 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:42.692465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:42.698262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:42.724281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:42.726919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.727875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.729038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.730478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.731479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.733464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.736215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d944eb48-cd25-4e9e-839c-7f03bf83a28c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.251989 Sep 13 16:50:42.739925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2261/4452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:42 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:42.755722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ffc9322d-64f6-443a-9f41-4db24dc55b91 req-58a923ed-8fe2-40be-919c-ffc69a2e3561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:42.793065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ffc9322d-64f6-443a-9f41-4db24dc55b91 req-58a923ed-8fe2-40be-919c-ffc69a2e3561 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.793634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ffc9322d-64f6-443a-9f41-4db24dc55b91 req-58a923ed-8fe2-40be-919c-ffc69a2e3561 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.794140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ffc9322d-64f6-443a-9f41-4db24dc55b91 req-58a923ed-8fe2-40be-919c-ffc69a2e3561 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.819220 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ffc9322d-64f6-443a-9f41-4db24dc55b91 req-58a923ed-8fe2-40be-919c-ffc69a2e3561 service nova] Creating event network-changed:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:50:42.825672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ffc9322d-64f6-443a-9f41-4db24dc55b91 req-58a923ed-8fe2-40be-919c-ffc69a2e3561 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083043 Sep 13 16:50:42.826500 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2262/4453] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:42.835100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:42.835877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:42.853742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.854327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.854754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.856056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:42.856056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:42.866146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:42.943258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:50:43.133244 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1f568d0-31f2-4587-9fdf-bafd7fc244c0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 204 len: 0 microversion: 2.1 time: 0.305181 Sep 13 16:50:43.134680 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2263/4454] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:50:42 2022] DELETE /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:50:43.150653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1598806392"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:43.160436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:43.185853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.186810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.187035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.187713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.188519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.189032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.242660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:43.253357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:43.263764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:43.280449 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9141586d-5340-4d60-88c8-6598e4b675f5 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.592805 Sep 13 16:50:43.298352 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2192/4455] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:42 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:43.309313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-58165d53-b4f2-46e1-ad70-d8610bf86cc1 req-0badd537-13d8-4cf0-84bc-2e31cb1ae01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c2ae7a-83cc-4182-a6d3-020a00bc333e", "tag": "b57d7ddb-d6ef-4416-a6db-fda9170363ec"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:43.323116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-58165d53-b4f2-46e1-ad70-d8610bf86cc1 req-0badd537-13d8-4cf0-84bc-2e31cb1ae01f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.323896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-58165d53-b4f2-46e1-ad70-d8610bf86cc1 req-0badd537-13d8-4cf0-84bc-2e31cb1ae01f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.324501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-58165d53-b4f2-46e1-ad70-d8610bf86cc1 req-0badd537-13d8-4cf0-84bc-2e31cb1ae01f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.351062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-58165d53-b4f2-46e1-ad70-d8610bf86cc1 req-0badd537-13d8-4cf0-84bc-2e31cb1ae01f service nova] Creating event network-changed:b57d7ddb-d6ef-4416-a6db-fda9170363ec for instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e on n-h2-857467-1 Sep 13 16:50:43.365617 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-58165d53-b4f2-46e1-ad70-d8610bf86cc1 req-0badd537-13d8-4cf0-84bc-2e31cb1ae01f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065883 Sep 13 16:50:43.366782 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2193/4456] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:43.376731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:43.385341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:43.401729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.402478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.403835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.404760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.405422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.406092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.498610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:43.613372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=42 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:43.686162 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30ad0e9d-e224-4a47-b591-c776ab67a728 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.547347 Sep 13 16:50:43.688291 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2264/4457] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:50:43 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 13 16:50:43.713426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:43.714200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:43.735055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.735700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.736156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.738971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:43.739766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:43.742656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:43.888121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:43.903840 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40780662-9aa0-46b9-8698-20796ef7ac9a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1496 microversion: 2.1 time: 0.534936 Sep 13 16:50:43.905218 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2194/4458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:43 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1496 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:43.938026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:44.313164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:44.314118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:44.326496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:44.334956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:44.335564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:44.336672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:44.338764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:44.339435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:44.349139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:44.366102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7398a250-6796-49f0-8027-725588d1cc53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.669590 Sep 13 16:50:44.371370 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2265/4459] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:43 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:44.524939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6cd5739d-bef3-4016-ba5f-eba3eafa723c req-bbb7114c-c0f8-41b3-9502-b5a5c023220f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-unplugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:44.544041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6cd5739d-bef3-4016-ba5f-eba3eafa723c req-bbb7114c-c0f8-41b3-9502-b5a5c023220f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:44.545020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6cd5739d-bef3-4016-ba5f-eba3eafa723c req-bbb7114c-c0f8-41b3-9502-b5a5c023220f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:44.545882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6cd5739d-bef3-4016-ba5f-eba3eafa723c req-bbb7114c-c0f8-41b3-9502-b5a5c023220f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:44.563379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6cd5739d-bef3-4016-ba5f-eba3eafa723c req-bbb7114c-c0f8-41b3-9502-b5a5c023220f service nova] Creating event network-vif-unplugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:50:44.570415 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6cd5739d-bef3-4016-ba5f-eba3eafa723c req-bbb7114c-c0f8-41b3-9502-b5a5c023220f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049897 Sep 13 16:50:44.571734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2266/4460] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:44.661742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:44.673418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:44.675618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:44.677691 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76590e34-12ae-44d6-8fa6-19b07eab9ffc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.368107 Sep 13 16:50:44.678986 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2195/4461] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:44 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:44.932152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:44.933618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:44.950041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:44.950929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:44.953744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:44.954703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:44.955328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:44.956504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:45.249247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:45.262469 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d863fd5a-dbb4-44c9-abb2-a528eaecbd52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1496 microversion: 2.1 time: 0.336716 Sep 13 16:50:45.277021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2267/4462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:44 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1496 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:45.394145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:45.395674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:45.414531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:45.418188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:45.424966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:45.425803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:45.426339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:45.426795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:45.490193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:45.490579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a9fc1dfe-6060-4a0d-a7fc-29a480914f8b req-6e9251bf-33d6-4d22-90d5-5cc33fa04e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1371b7e5-8c8a-475f-881c-b28b6af6b1c2", "name": "network-vif-deleted", "tag": "d999c545-01a2-40b6-bc17-5f9fa025cd6c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:45.522329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a9fc1dfe-6060-4a0d-a7fc-29a480914f8b req-6e9251bf-33d6-4d22-90d5-5cc33fa04e56 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:45.523394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a9fc1dfe-6060-4a0d-a7fc-29a480914f8b req-6e9251bf-33d6-4d22-90d5-5cc33fa04e56 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:45.524708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a9fc1dfe-6060-4a0d-a7fc-29a480914f8b req-6e9251bf-33d6-4d22-90d5-5cc33fa04e56 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:45.559592 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a9fc1dfe-6060-4a0d-a7fc-29a480914f8b req-6e9251bf-33d6-4d22-90d5-5cc33fa04e56 service nova] Creating event network-vif-deleted:d999c545-01a2-40b6-bc17-5f9fa025cd6c for instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 on n-h1-857467-1 Sep 13 16:50:45.571000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a9fc1dfe-6060-4a0d-a7fc-29a480914f8b req-6e9251bf-33d6-4d22-90d5-5cc33fa04e56 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083317 Sep 13 16:50:45.584371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2268/4463] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:45.709175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:45.710822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:45.719421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:45.720321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:45.721040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:45.722053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:45.722808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:45.723927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:45.772015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:45.794578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:45.848437 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96166b41-040c-4b25-9c9b-ffac7d256607 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.456381 Sep 13 16:50:45.853863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2196/4464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:45 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:46.199623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:46.212685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:46.214570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:46.215932 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de4eaa82-8cd4-4bdc-bf02-3d6018c93938 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.512356 Sep 13 16:50:46.217617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2269/4465] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:45 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:46.307646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:46.309191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:46.322968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:46.324278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:46.324747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:46.326090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:46.327487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:46.329909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:46.368493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:46.369072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:46.369752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:46.370535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lazy-loading 'fault' on Instance uuid 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:50:46.454021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:46.470523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b62a5c4d-7dc4-48a5-882f-af2243c9c1e8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 200 len: 1299 microversion: 2.1 time: 0.184197 Sep 13 16:50:46.471768 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2197/4466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:46 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:46.883272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:46.883898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:46.891994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:46.892586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:46.893546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:46.894320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:46.896488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:46.897454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.054472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:47.065603 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e0b4d10-68c9-4668-aa87-9c938ea33e49 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.186193 Sep 13 16:50:47.066761 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2270/4467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:46 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:47.244552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:47.245182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:47.251788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.252287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.252743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.253464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.253962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.254402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.478400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:47.490699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:47.492399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:47.493920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce8e77fa-76af-48d5-95e0-5115ceb56b9f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.253272 Sep 13 16:50:47.494968 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2198/4468] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:47 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:47.495940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:47.496560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:47.522026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.522540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.523055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.524335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.524807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.525315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.541033 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 HTTP/1.1 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1371b7e5-8c8a-475f-881c-b28b6af6b1c2'} Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:47.542644 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:47.547701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:50:47.547701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:50:47.547701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:50:47.547701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:50:47.547701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:50:47.547701 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:47.549271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:50:47.550936 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0969bd4d-5d38-4c9d-a96b-559933c795c8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 404 len: 111 microversion: 2.1 time: 0.058957 Sep 13 16:50:47.564062 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2271/4469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:47 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:50:47.572078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:47.572586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:47.588240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.590661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.593600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.594379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.594849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.595313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.633484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:50:47.733302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:47.748240 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5eaca45f-6ca6-4cb6-aa65-1cecce33843a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 204 len: 0 microversion: 2.1 time: 0.180049 Sep 13 16:50:47.752403 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2199/4470] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:50:47 2022] DELETE /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:50:47.758884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:47.762804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:47.777209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.778444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.779569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:47.780943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:47.782767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:47.784482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:48.007157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:48.016927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-762bf04c-7011-4fe1-ba71-38cefcb198c3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1497 microversion: 2.1 time: 0.263158 Sep 13 16:50:48.018592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2272/4471] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:47 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:48.089613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:48.090176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:48.109795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:48.110798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:48.111310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:48.112040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:48.112512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:48.112951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:48.355688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:48.365580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-04b12013-c08b-40e1-b809-11da87daaa6b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.280551 Sep 13 16:50:48.366476 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2200/4472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:48 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:48.423185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ba79434a-1a76-4440-a489-9ce8be7b9a43 req-add4787e-d794-4ab6-8055-2892ba98576a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "4ac32004-bfe2-4308-811c-e0444fad86fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:48.447567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ba79434a-1a76-4440-a489-9ce8be7b9a43 req-add4787e-d794-4ab6-8055-2892ba98576a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:48.448217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ba79434a-1a76-4440-a489-9ce8be7b9a43 req-add4787e-d794-4ab6-8055-2892ba98576a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:48.448759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ba79434a-1a76-4440-a489-9ce8be7b9a43 req-add4787e-d794-4ab6-8055-2892ba98576a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:48.472096 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ba79434a-1a76-4440-a489-9ce8be7b9a43 req-add4787e-d794-4ab6-8055-2892ba98576a service nova] Creating event network-vif-plugged:4ac32004-bfe2-4308-811c-e0444fad86fb for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:48.485501 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ba79434a-1a76-4440-a489-9ce8be7b9a43 req-add4787e-d794-4ab6-8055-2892ba98576a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067323 Sep 13 16:50:48.489780 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2273/4473] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:48.522022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:48.522663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:48.536886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:48.537503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:48.539182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:48.540123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:48.540589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:48.542525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:48.894624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:48.928806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:48.943291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:48.950200 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da6d457b-63b8-48b3-94e6-c8cb77f778df tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.431631 Sep 13 16:50:48.952543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2201/4474] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:48 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:49.043945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:49.045548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:49.056510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:49.057259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:49.058292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:49.062922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:49.065448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:49.066121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:49.391369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:49.392127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:49.405263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:49.407311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:49.410907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:49.413050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:49.417064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:49.417778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:49.560117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:49.580653 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c79d5f4d-173d-4ba2-a022-faa9921ad12c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1497 microversion: 2.1 time: 0.541625 Sep 13 16:50:49.588997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2274/4475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:49 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1497 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:49.779960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:49.804835 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75a64a83-7ede-46e2-b8f3-73a07d01c591 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.418780 Sep 13 16:50:49.805862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2202/4476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:49 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:49.978925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:49.979557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:49.990902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:49.991512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:49.991937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:49.992696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:49.994571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:49.996748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:50.290747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:50.306839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:50.309247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:50.310797 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0131cdee-a0de-4c6b-9247-9b82ce179ae6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.335723 Sep 13 16:50:50.311759 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2275/4477] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:49 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:50.524616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "7d95abb3-3a18-4ca4-bb23-b36dd169b8ca"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "9f8d4b2e-313f-409c-af69-875f37588cda"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:50.539906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:50.540596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:50.541141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:50.566128 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] Creating event network-vif-plugged:7d95abb3-3a18-4ca4-bb23-b36dd169b8ca for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:50.567257 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] Creating event network-vif-plugged:9f8d4b2e-313f-409c-af69-875f37588cda for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:50.573682 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bb67db9e-547e-4ad0-8000-254843d2204a req-0071b4cc-f063-4710-ba0c-7c948f1e3c95 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053468 Sep 13 16:50:50.575254 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2203/4478] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:50.618830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:50.619937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:50.632789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:50.635761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:50.636312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:50.637239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:50.639955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:50.642382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:50.831227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:50.831946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:50.846621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:50.847667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:50.848304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:50.849343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:50.851682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:50.852930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:51.179691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:51.192950 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6713ce05-34cc-4fc5-9aea-8ed2fda65925 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1497 microversion: 2.1 time: 0.579639 Sep 13 16:50:51.194833 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2276/4479] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:50 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1497 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:51.337003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:51.338814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:51.351062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:51.351684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:51.352629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:51.353366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:51.353876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:51.354295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:51.692420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:51.702598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-26e8efeb-7bab-4d84-b5fc-871808a43657 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.877276 Sep 13 16:50:51.708367 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2204/4480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:50 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:51.804027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:51.815939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:51.823932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:51.829579 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd625624-1ed6-4c22-9e2b-6a4bd2539236 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.495227 Sep 13 16:50:51.831065 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2277/4481] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:51 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:52.207535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d19d147a-3218-4961-a868-9b748060a37e req-23b3e199-256e-481c-be78-b904234c37ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e7e51b-5938-4a24-83d0-38c5ea3d3641", "name": "network-vif-deleted", "tag": "114bbd3a-f4a3-4278-93dc-299cfc57874b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:52.226473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d19d147a-3218-4961-a868-9b748060a37e req-23b3e199-256e-481c-be78-b904234c37ac service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.228049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:52.230559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:52.231202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d19d147a-3218-4961-a868-9b748060a37e req-23b3e199-256e-481c-be78-b904234c37ac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.231880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d19d147a-3218-4961-a868-9b748060a37e req-23b3e199-256e-481c-be78-b904234c37ac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.242619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.243146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.243596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.244361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.244831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.245269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.266073 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d19d147a-3218-4961-a868-9b748060a37e req-23b3e199-256e-481c-be78-b904234c37ac service nova] Creating event network-vif-deleted:114bbd3a-f4a3-4278-93dc-299cfc57874b for instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 on n-h2-857467-1 Sep 13 16:50:52.279450 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d19d147a-3218-4961-a868-9b748060a37e req-23b3e199-256e-481c-be78-b904234c37ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076532 Sep 13 16:50:52.285277 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2205/4482] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:52.395695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:52.418329 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-318ac300-4379-4293-bb7a-ee4a93aae861 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 200 len: 1294 microversion: 2.1 time: 0.191400 Sep 13 16:50:52.419551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2278/4483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:52 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 1294 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:52.612575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-plugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "c4de8a56-a7f1-4bc6-96b5-e4f932d9448c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:52.635052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.642274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.643508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.663119 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] Creating event network-vif-plugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:50:52.663650 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] Creating event network-vif-plugged:c4de8a56-a7f1-4bc6-96b5-e4f932d9448c for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:52.674137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4b332ed6-b08d-43c5-8ba5-ec4b98830d9b req-75f90470-4010-4b6b-ab05-67c6e0a5c16e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067329 Sep 13 16:50:52.675090 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2206/4484] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:52.728580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:52.729290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:52.738782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.739731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.740231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.741300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.742174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.743255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.858656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:52.860024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:52.869663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.871439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.872986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.873916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:52.875328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:52.878570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:52.926432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:52.935680 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f03e19a-0361-4934-9e4f-7ff5f1fd86bd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.213456 Sep 13 16:50:52.940267 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2279/4485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:52 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:53.297619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:53.325560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:53.327500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:53.331039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f580b2bd-ea39-40a3-9ad7-e28bc2a8fbf9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.475226 Sep 13 16:50:53.332086 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2207/4486] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:52 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:53.445520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:53.446312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:53.465043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:53.466782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:53.468184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:53.472658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:53.473720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:53.479120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:53.519787 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 HTTP/1.1 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '02e7e51b-5938-4a24-83d0-38c5ea3d3641'} Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:53.522073 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:50:53.528561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41115746-e08a-49d9-8d12-20aef8fbcac0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 404 len: 111 microversion: 2.1 time: 0.082822 Sep 13 16:50:53.549680 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2280/4487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:53 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:50:53.828915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1470940119", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:53.928118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:50:53.962586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:53.963221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:53.980976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:53.981485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:53.981965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:53.982712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:53.983181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:53.983621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:54.270119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:54.292767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-219d6751-e7e8-4c77-a3e5-eb9b78136fc1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.335550 Sep 13 16:50:54.298391 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2281/4488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:53 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:54.367350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:54.367988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:54.382522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:54.383029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:54.383493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:54.384482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:54.384662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:54.385149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:54.645952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:50:54.646885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:50:54.647555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:50:54.648134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:50:54.648968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:50:54.664798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:54.672160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:54.672725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:54.673547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:54.674055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:54.674503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:54.716869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:50:54.729368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:50:54.764531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:50:54.768021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:50:54.788212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:54.800417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:54.802155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:54.803549 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d493067d-8e1a-40af-b14a-051940fc8bcc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.445060 Sep 13 16:50:54.804286 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2282/4489] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:54 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:54.809012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "4cc3d202-6c15-40ca-8e70-39399e2d00e6"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "f8d74f64-19aa-442c-8831-3c7580891fc8"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-plugged", "status": "completed", "tag": "8d963fa2-857f-48ba-9e30-6eb1f472d8e5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:54.838218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:54.839001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:54.839629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:54.876390 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Creating event network-vif-plugged:4cc3d202-6c15-40ca-8e70-39399e2d00e6 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:54.880655 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Creating event network-vif-plugged:f8d74f64-19aa-442c-8831-3c7580891fc8 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:54.881799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] Creating event network-vif-plugged:8d963fa2-857f-48ba-9e30-6eb1f472d8e5 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:50:54.899222 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-8e56d0da-7a37-4e02-aa20-99ee38b6a840 req-1c13244f-ee3e-478c-a771-3d0c502fef8b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.092774 Sep 13 16:50:54.900195 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2283/4490] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:54.911979 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d8747b71-ec64-4a0c-9b5a-16528f3943f0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087188 Sep 13 16:50:54.912765 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2208/4491] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:50:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:50:54.926024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-404ebdce-af38-4fad-8f30-3c4674b6d72b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:54.927470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-404ebdce-af38-4fad-8f30-3c4674b6d72b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:55.057298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-404ebdce-af38-4fad-8f30-3c4674b6d72b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:55.074533 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-404ebdce-af38-4fad-8f30-3c4674b6d72b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1209 microversion: 2.1 time: 0.152364 Sep 13 16:50:55.094436 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2284/4492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:54 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:55.316479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:55.317093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:55.338153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:55.338649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:55.339100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:55.339837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:55.340326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:55.344534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:55.660183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:55.672411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52b4018c-3fe3-4ed1-ab84-0e0f8cb15eb0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.359578 Sep 13 16:50:55.679848 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2209/4493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:55 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:55.837050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:55.837707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:55.851007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:55.851786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:55.852543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:55.853894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:55.859302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:55.860697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:56.104588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-249e2545-4baf-41a5-bfc7-689845094704 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:56.105858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-249e2545-4baf-41a5-bfc7-689845094704 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:56.185221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:56.197373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-249e2545-4baf-41a5-bfc7-689845094704 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:56.208267 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-249e2545-4baf-41a5-bfc7-689845094704 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1209 microversion: 2.1 time: 0.109154 Sep 13 16:50:56.209297 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2210/4494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:56 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:50:56.210407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:56.212876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:56.214927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b9f0659-1940-4c44-9683-3bb4585a6ca6 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1875 microversion: 2.42 time: 0.384537 Sep 13 16:50:56.215585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2285/4495] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:55 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1875 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:56.710665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:56.711938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:56.733211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:56.740272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:56.741189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:56.749364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:56.750453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:56.761821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:56.982791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-91d6f576-f4cb-4fc4-8bde-0ad9e149034b req-0f821dec-1db7-459e-86dc-b0921fa1ff60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "name": "network-vif-plugged", "status": "completed", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:57.006350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-91d6f576-f4cb-4fc4-8bde-0ad9e149034b req-0f821dec-1db7-459e-86dc-b0921fa1ff60 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:57.007015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-91d6f576-f4cb-4fc4-8bde-0ad9e149034b req-0f821dec-1db7-459e-86dc-b0921fa1ff60 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:57.008325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-91d6f576-f4cb-4fc4-8bde-0ad9e149034b req-0f821dec-1db7-459e-86dc-b0921fa1ff60 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:57.046433 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-91d6f576-f4cb-4fc4-8bde-0ad9e149034b req-0f821dec-1db7-459e-86dc-b0921fa1ff60 service nova] Creating event network-vif-plugged:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:50:57.081020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-91d6f576-f4cb-4fc4-8bde-0ad9e149034b req-0f821dec-1db7-459e-86dc-b0921fa1ff60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103217 Sep 13 16:50:57.082221 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2286/4496] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:50:57.153337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:57.170266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b476fbbd-9f1a-45af-a63a-70719437508e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.463705 Sep 13 16:50:57.173956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2211/4497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:56 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:57.243698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:57.244493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:57.245432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:57.248524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:57.259680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:57.260191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:57.264438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:57.273783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:57.276024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:57.276972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:57.277949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:57.278604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:57.279546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:57.280342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:57.281014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:57.281330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:57.453590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:57.467965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-309abef6-3a17-4478-bf99-da7b7e52f316 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1261 microversion: 2.1 time: 0.237322 Sep 13 16:50:57.478052 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2287/4498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:57 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:58.208826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:58.210992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:58.221592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:58.222400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:58.223061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:58.224078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:58.224744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:58.225520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:58.353106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:58.368379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:58.373751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:58.375408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83f16c21-7804-4095-9ae8-d3f8140b3e57 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2831 microversion: 2.42 time: 1.136791 Sep 13 16:50:58.378147 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2212/4499] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:50:57 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2831 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:50:58.405423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:58.406978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:58.419378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:58.428093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:58.428790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:58.429870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:58.430549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:58.431215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:58.641593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:58.651209 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69b492b3-ea37-4f17-b89f-7fd5af371896 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.450286 Sep 13 16:50:58.654635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a11fdc0-6bd1-4eed-9099-31388af918a1 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.253108 Sep 13 16:50:58.655879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2213/4500] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 16:50:58 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af/os-interface => generated 1830 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:50:58.667930 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2288/4501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:58 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:58.672798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:58.673501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:58.684456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:58.687590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:58.689971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:58.690978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:58.691639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:58.695141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:58.878727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:50:58.884146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:50:58.894485 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d841c4d-5e0b-46fe-a9ab-23252cac9747 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1267 microversion: 2.1 time: 0.236749 Sep 13 16:50:58.902177 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2214/4502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:58 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:50:59.305272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a015a239-77d3-41ac-8f38-68ee056d59c3 req-b29e85e5-4771-45d6-9944-854fca55dd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c2ae7a-83cc-4182-a6d3-020a00bc333e", "name": "network-vif-plugged", "status": "completed", "tag": "b57d7ddb-d6ef-4416-a6db-fda9170363ec"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:50:59.338128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a015a239-77d3-41ac-8f38-68ee056d59c3 req-b29e85e5-4771-45d6-9944-854fca55dd2f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:59.354735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a015a239-77d3-41ac-8f38-68ee056d59c3 req-b29e85e5-4771-45d6-9944-854fca55dd2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:59.361101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a015a239-77d3-41ac-8f38-68ee056d59c3 req-b29e85e5-4771-45d6-9944-854fca55dd2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:59.441438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a015a239-77d3-41ac-8f38-68ee056d59c3 req-b29e85e5-4771-45d6-9944-854fca55dd2f service nova] Creating event network-vif-plugged:b57d7ddb-d6ef-4416-a6db-fda9170363ec for instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e on n-h2-857467-1 Sep 13 16:50:59.462694 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a015a239-77d3-41ac-8f38-68ee056d59c3 req-b29e85e5-4771-45d6-9944-854fca55dd2f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160890 Sep 13 16:50:59.463265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2289/4503] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:50:59.687015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:59.687847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:59.698634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:59.701694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:59.702365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:59.707010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:59.707629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:59.708950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:59.927790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:50:59.928642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:50:59.946416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:59.946913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:59.961955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:50:59.962817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:50:59.967684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:50:59.968691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:00.259197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:00.279487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0954ab42-12d6-4cc3-b891-a5726041ac53 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.605616 Sep 13 16:51:00.282437 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2215/4504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:59 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:00.566577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:00.573596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:00.576012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52c60739-2188-41b8-aa8d-8644dfc9cdfd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.652777 Sep 13 16:51:00.597044 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2290/4505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:50:59 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:01.306047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:01.307078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:01.324025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:01.328449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:01.329950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:01.333188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:01.334123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:01.335010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:01.504260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-29efa8a5-1eaf-4819-b517-9c701c90cf95 req-7bcc6015-3f0a-44c2-a0c6-e2ae6d04bad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "tag": "c4de8a56-a7f1-4bc6-96b5-e4f932d9448c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:01.518148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-29efa8a5-1eaf-4819-b517-9c701c90cf95 req-7bcc6015-3f0a-44c2-a0c6-e2ae6d04bad1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:01.518656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-29efa8a5-1eaf-4819-b517-9c701c90cf95 req-7bcc6015-3f0a-44c2-a0c6-e2ae6d04bad1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:01.519105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-29efa8a5-1eaf-4819-b517-9c701c90cf95 req-7bcc6015-3f0a-44c2-a0c6-e2ae6d04bad1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:01.572984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-29efa8a5-1eaf-4819-b517-9c701c90cf95 req-7bcc6015-3f0a-44c2-a0c6-e2ae6d04bad1 service nova] Creating event network-changed:c4de8a56-a7f1-4bc6-96b5-e4f932d9448c for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:51:01.595892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-29efa8a5-1eaf-4819-b517-9c701c90cf95 req-7bcc6015-3f0a-44c2-a0c6-e2ae6d04bad1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394293 Sep 13 16:51:01.602044 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2216/4506] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:01.610691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:01.614089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:01.632118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:01.637383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:01.638144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:01.639069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:01.642097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:01.642791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:01.936456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:01.949509 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1a186d4c-7410-4483-bda5-8a3f57f0c590 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1318 microversion: 2.1 time: 0.648635 Sep 13 16:51:01.953981 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2291/4507] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:01 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:02.128395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:02.136277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9b2cd0a-d713-4c9f-bd47-0523e02836e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.532609 Sep 13 16:51:02.141036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2217/4508] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:01 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:02.907610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6e7d4318-fed2-4c11-85dd-618cf13c50e6 req-27b7b020-8a9c-402e-837a-945640617fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8a76f3-291d-45aa-8165-bdcac0c0d1a1", "tag": "ea925f33-3621-4a07-b67d-6717c3ebab76"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:02.946949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e7d4318-fed2-4c11-85dd-618cf13c50e6 req-27b7b020-8a9c-402e-837a-945640617fcd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:02.948722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e7d4318-fed2-4c11-85dd-618cf13c50e6 req-27b7b020-8a9c-402e-837a-945640617fcd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:02.949692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e7d4318-fed2-4c11-85dd-618cf13c50e6 req-27b7b020-8a9c-402e-837a-945640617fcd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:02.964971 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6e7d4318-fed2-4c11-85dd-618cf13c50e6 req-27b7b020-8a9c-402e-837a-945640617fcd service nova] Creating event network-changed:ea925f33-3621-4a07-b67d-6717c3ebab76 for instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 on n-h1-857467-1 Sep 13 16:51:02.978536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:02.980068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:02.993415 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6e7d4318-fed2-4c11-85dd-618cf13c50e6 req-27b7b020-8a9c-402e-837a-945640617fcd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090251 Sep 13 16:51:02.995109 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2292/4509] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:02.997581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:02.998562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:02.999182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:03.000477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:03.001252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:03.001892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:03.163477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:03.164463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:03.172859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:03.179298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:03.179802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:03.182570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:03.183340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:03.185174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:03.188985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:03.476740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:03.502125 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c43f862-b1fb-4c72-880b-212e323cae1a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.341759 Sep 13 16:51:03.505201 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2293/4510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:03 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:03.565677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:03.578273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-70a8b92a-b10c-4a2d-b65a-35b1b5cfcfb8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1467 microversion: 2.1 time: 0.605808 Sep 13 16:51:03.589744 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2218/4511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:02 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1467 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:03.616213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:03.617007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:03.628467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:03.629003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:03.629430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:03.630158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:03.644613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:03.646502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:04.089559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:04.100639 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a33ccb5b-4300-40a5-b30f-ced500a967f8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 1466 microversion: 2.1 time: 0.489833 Sep 13 16:51:04.101241 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2294/4512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:03 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 1466 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:04.131799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-317645780"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:04.135194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:04.173269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:04.174320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:04.174963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:04.176044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:04.176713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:04.177318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:04.529412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:04.530241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:04.552956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:04.556851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:04.559431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:04.561180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:04.561914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:04.565843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:04.634625 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef7290ae-483a-4893-9b10-4b24313094f1 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "POST /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8/action" status: 202 len: 0 microversion: 2.1 time: 0.501202 Sep 13 16:51:04.635624 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2219/4513] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:51:04 2022] POST /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 13 16:51:04.648313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f48597fc-9e7a-431d-82de-9fb2fdd5233d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb56fb160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:04.689625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:04.849343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:04.859092 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cb34abd-c8c8-4db7-939b-b700aef6bdb3 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.336260 Sep 13 16:51:04.861104 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2295/4514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:04 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:04.866390 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f48597fc-9e7a-431d-82de-9fb2fdd5233d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.222232 Sep 13 16:51:04.866982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2220/4515] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:04 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:05.884365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5adedb43-0b43-4335-a40e-586412d20809 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb97eba60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:05.891867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:05.892691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:05.894053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:05.916814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:05.917346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:05.918512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:05.921378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:05.922052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:05.922908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:05.958648 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5adedb43-0b43-4335-a40e-586412d20809 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.078561 Sep 13 16:51:05.970170 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2296/4516] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:05 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:06.207232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:06.230552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:06.240744 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4dec6873-92c4-47dd-96c0-b6bcb1fe6296 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.355796 Sep 13 16:51:06.241868 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2221/4517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:05 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:06.977636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d05f4564-4449-447a-a24a-cfb166eb60d8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb47c40d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:07.113585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d05f4564-4449-447a-a24a-cfb166eb60d8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.141406 Sep 13 16:51:07.114803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2297/4518] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:06 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:07.267763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:07.269801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:07.279204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:07.280349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:07.282111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:07.283075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:07.283752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:07.284410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:07.610001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:07.618933 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ddd60872-43ee-41f1-9d98-c1aded639143 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.356172 Sep 13 16:51:07.634440 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2222/4519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:07 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:08.130676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-676e552c-360c-4c41-bfc1-ba414ecc87a8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb48aa5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:08.220722 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-676e552c-360c-4c41-bfc1-ba414ecc87a8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.094677 Sep 13 16:51:08.227685 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2298/4520] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:08 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:08.644061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:08.645435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:08.663099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:08.664658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:08.665367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:08.669373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:08.670530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:08.670996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:08.944723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:08.960145 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8922d324-7af4-422f-a72d-f403fcb46afb tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.320087 Sep 13 16:51:08.970730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2223/4521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:08 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:09.243070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e9dd2a9e-397f-4263-bef3-96bc58984b20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb469e700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:09.313808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e9dd2a9e-397f-4263-bef3-96bc58984b20 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.076507 Sep 13 16:51:09.316648 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2299/4522] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:09 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:09.986860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:09.987587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:10.010902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:10.012331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:10.014403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:10.017917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:10.019033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:10.036940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:10.316291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:10.324786 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-31a88dca-5923-45ef-9550-ba1c1e97e07b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.342834 Sep 13 16:51:10.333070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3af18d39-3765-4086-8fc8-4ff3778e2f6a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb48aaca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:10.348012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2224/4523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:09 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:11.313034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-49dd5353-ec06-4584-8ab1-72e32d2f55a1 req-e57eb4be-92df-4b3e-916c-6fb62b84fcbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "name": "network-vif-plugged", "status": "completed", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:11.328816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-49dd5353-ec06-4584-8ab1-72e32d2f55a1 req-e57eb4be-92df-4b3e-916c-6fb62b84fcbd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:11.329682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-49dd5353-ec06-4584-8ab1-72e32d2f55a1 req-e57eb4be-92df-4b3e-916c-6fb62b84fcbd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:11.330346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-49dd5353-ec06-4584-8ab1-72e32d2f55a1 req-e57eb4be-92df-4b3e-916c-6fb62b84fcbd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:11.349196 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-49dd5353-ec06-4584-8ab1-72e32d2f55a1 req-e57eb4be-92df-4b3e-916c-6fb62b84fcbd service nova] Creating event network-vif-plugged:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:51:11.359930 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-49dd5353-ec06-4584-8ab1-72e32d2f55a1 req-e57eb4be-92df-4b3e-916c-6fb62b84fcbd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053975 Sep 13 16:51:11.361207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2225/4524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:11.370350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:11.371401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:11.384213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:11.385283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:11.386392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:11.387298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:11.387994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:11.388588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:11.559256 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3af18d39-3765-4086-8fc8-4ff3778e2f6a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 1.232683 Sep 13 16:51:11.560601 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2300/4525] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:10 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:11.654600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:11.664511 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e5d7d5d-b615-4ad9-9a98-ac7dcf16385f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.301867 Sep 13 16:51:11.665328 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2226/4526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:11 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:12.578186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ead95d09-215f-417e-b8da-28bebfffb29f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb46308b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:12.690720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:12.691370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:12.704542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:12.705092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:12.705539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:12.706292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:12.706756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:12.707188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:12.821642 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ead95d09-215f-417e-b8da-28bebfffb29f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.247559 Sep 13 16:51:12.824804 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2301/4527] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:12 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:12.910871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:12.912478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:12.920662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:12.922884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:12.923540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:12.924463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:12.925123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:12.925733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:12.955096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:12.964042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d73946b4-3bc8-464f-8b62-b55c1e03de84 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.279399 Sep 13 16:51:12.965120 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2227/4528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:12 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:13.133669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:13.149590 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f135aba6-d67c-4ce2-b9b6-8b4046640a10 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.248283 Sep 13 16:51:13.150229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2302/4529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:12 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:13.173785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1066952707"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:13.176276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:13.183019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:13.183815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:13.184454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:13.185338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:13.186714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:13.187397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:13.378082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-997db173-aa8f-4889-af8c-c66d939cc01a req-cb4eeb2b-bc83-46e6-9111-7d008891bb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8a76f3-291d-45aa-8165-bdcac0c0d1a1", "name": "network-vif-plugged", "status": "completed", "tag": "ea925f33-3621-4a07-b67d-6717c3ebab76"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:13.408524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-997db173-aa8f-4889-af8c-c66d939cc01a req-cb4eeb2b-bc83-46e6-9111-7d008891bb84 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:13.409024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-997db173-aa8f-4889-af8c-c66d939cc01a req-cb4eeb2b-bc83-46e6-9111-7d008891bb84 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:13.409888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-997db173-aa8f-4889-af8c-c66d939cc01a req-cb4eeb2b-bc83-46e6-9111-7d008891bb84 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:13.423082 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-997db173-aa8f-4889-af8c-c66d939cc01a req-cb4eeb2b-bc83-46e6-9111-7d008891bb84 service nova] Creating event network-vif-plugged:ea925f33-3621-4a07-b67d-6717c3ebab76 for instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 on n-h1-857467-1 Sep 13 16:51:13.429488 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-997db173-aa8f-4889-af8c-c66d939cc01a req-cb4eeb2b-bc83-46e6-9111-7d008891bb84 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054531 Sep 13 16:51:13.435563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2303/4530] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:13.824298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47fef970-fd38-4218-9d31-16ba8c05ff78 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.655243 Sep 13 16:51:13.828565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2228/4531] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:51:13 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 13 16:51:13.835291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:13.836878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:13.856859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3610e273-c6f9-426c-b4be-6c4544e5d19c tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb9723dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:13.858102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:13.859109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:13.859795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:13.860741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:13.862238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:13.862986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:14.133882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:14.143654 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2deb8f23-9ba7-47b0-a502-5e9aeb0670be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.312903 Sep 13 16:51:14.144875 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2304/4532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:13 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:14.150423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:14.151334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:14.159037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:14.159816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:14.160442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:14.161932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:14.162413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:14.163117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:14.387114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:14.399875 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-83534f8f-cd59-452f-a647-efdaf799ce2f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1309 microversion: 2.1 time: 0.253670 Sep 13 16:51:14.401119 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2305/4533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:14 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1309 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:14.477065 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3610e273-c6f9-426c-b4be-6c4544e5d19c tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.634266 Sep 13 16:51:14.477781 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2229/4534] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:13 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:15.176164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:15.177047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:15.185068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.194694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.196372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.198396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.200172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.201535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.430841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:15.432257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:15.469815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.470539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.471162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.472106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.472522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.473140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.483455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:15.495046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d6f756f-4e63-43e5-bc9a-00be0088bcf2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.322815 Sep 13 16:51:15.496559 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2306/4535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:15 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:15.501531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ec91804-b73b-472a-a5da-b3519d866eac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45ce5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:15.714065 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ec91804-b73b-472a-a5da-b3519d866eac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.215843 Sep 13 16:51:15.716608 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2307/4536] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:15 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:15.767054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:15.785736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08b3ae57-930e-4bf1-ba8d-3e7fbebd07cd tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1490 microversion: 2.1 time: 0.365477 Sep 13 16:51:15.787373 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2230/4537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:15 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1490 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:15.809945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:15.812750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:15.821641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.822187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.822638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.823357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.823822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.824459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.931076 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e04182d9-3e8f-47bb-81a0-bbe7bcaf2e87 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "PUT /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1085 microversion: 2.1 time: 0.125890 Sep 13 16:51:15.945799 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2308/4538] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:51:15 2022] PUT /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1085 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:15.951617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:15.953201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:15.961218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.961218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.961218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:15.961859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:15.962460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:15.962935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.144714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:16.154789 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f0d6a2d-6e05-4ca6-bdf9-916ce8e3aa42 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1511 microversion: 2.1 time: 0.207499 Sep 13 16:51:16.170983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2231/4539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:15 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:16.182316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:16.183720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:16.192615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.193499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.194163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.195062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.195702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.196297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.377057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8a94c2fc-3296-4b28-a6b0-53d937d4d8ec req-1efc1b14-5c75-49b1-9039-4c78ab7fb5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-unplugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:16.396873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8a94c2fc-3296-4b28-a6b0-53d937d4d8ec req-1efc1b14-5c75-49b1-9039-4c78ab7fb5f1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.398853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8a94c2fc-3296-4b28-a6b0-53d937d4d8ec req-1efc1b14-5c75-49b1-9039-4c78ab7fb5f1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.399475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8a94c2fc-3296-4b28-a6b0-53d937d4d8ec req-1efc1b14-5c75-49b1-9039-4c78ab7fb5f1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.411820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:16.414166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8a94c2fc-3296-4b28-a6b0-53d937d4d8ec req-1efc1b14-5c75-49b1-9039-4c78ab7fb5f1 service nova] Creating event network-vif-unplugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:51:16.422445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8a94c2fc-3296-4b28-a6b0-53d937d4d8ec req-1efc1b14-5c75-49b1-9039-4c78ab7fb5f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048461 Sep 13 16:51:16.432116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2232/4540] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:51:16.532328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:16.532495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:16.533096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:16.544897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2dad1a24-6a7c-4e1d-9e6e-1fa8a1c4398c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1511 microversion: 2.1 time: 0.366326 Sep 13 16:51:16.545786 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2309/4541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:16 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:16.570522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.570956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.571778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.572206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.572577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.573019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.574427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:16.574947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:16.585366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.586817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.587603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.589582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.590286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.590883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.667519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:51:16.874980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:16.880289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6c5edfd-2ac4-4dbf-b2ad-a5695fb09f00 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 204 len: 0 microversion: 2.1 time: 0.312821 Sep 13 16:51:16.888500 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47e77f9c-ff1a-4329-9e59-6a369e1387d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.365483 Sep 13 16:51:16.904761 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2233/4543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:16 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:16.912760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2cbdca52-b40d-40e7-9d6e-3a5abf26ce00 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb96d7040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:16.928321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2310/4543] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:51:16 2022] DELETE /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:51:16.934190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:16.935145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:16.947536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.948181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.949469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:16.973958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:16.974541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:16.977542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:17.058082 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2cbdca52-b40d-40e7-9d6e-3a5abf26ce00 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.151811 Sep 13 16:51:17.059233 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2234/4544] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:16 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:17.235164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:17.247774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06051361-6f94-4c69-81e9-49424bacec49 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1517 microversion: 2.1 time: 0.317971 Sep 13 16:51:17.249380 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2311/4545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:16 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1517 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:17.920400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:17.922333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:17.941071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:17.941588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:17.946648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:17.947422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:17.947936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:17.949026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:18.134017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e62f9e1-75a0-45b1-b1e8-614688c660f7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45c7ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:18.278731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:18.290743 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d996ed92-a0ce-4c95-9824-bd3b1336f99f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.376596 Sep 13 16:51:18.294175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2235/4546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:17 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:18.306114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:18.308708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:18.325080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:18.326854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:18.327526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:18.328266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:18.329245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:18.337975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:18.338851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:18.660750 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e62f9e1-75a0-45b1-b1e8-614688c660f7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.584348 Sep 13 16:51:18.667610 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2312/4547] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:18 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:18.751115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:18.763182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-376777eb-3579-450a-b5ca-40ae0460af5e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1517 microversion: 2.1 time: 0.467667 Sep 13 16:51:18.766581 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2236/4548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:18 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:19.322707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:19.323667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:19.335884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:19.335884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:19.335884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:19.336661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:19.337281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:19.337910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:19.378278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ef5ae9b1-6d5e-4219-869a-fe030983de75 req-5fafcbfa-746d-4f59-8a43-8071b908945e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8a76f3-291d-45aa-8165-bdcac0c0d1a1", "name": "network-vif-deleted", "tag": "ea925f33-3621-4a07-b67d-6717c3ebab76"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:19.404642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ef5ae9b1-6d5e-4219-869a-fe030983de75 req-5fafcbfa-746d-4f59-8a43-8071b908945e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:19.411034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ef5ae9b1-6d5e-4219-869a-fe030983de75 req-5fafcbfa-746d-4f59-8a43-8071b908945e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:19.411721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ef5ae9b1-6d5e-4219-869a-fe030983de75 req-5fafcbfa-746d-4f59-8a43-8071b908945e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:19.458396 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ef5ae9b1-6d5e-4219-869a-fe030983de75 req-5fafcbfa-746d-4f59-8a43-8071b908945e service nova] Creating event network-vif-deleted:ea925f33-3621-4a07-b67d-6717c3ebab76 for instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 on n-h1-857467-1 Sep 13 16:51:19.473862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ef5ae9b1-6d5e-4219-869a-fe030983de75 req-5fafcbfa-746d-4f59-8a43-8071b908945e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100707 Sep 13 16:51:19.477686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2237/4549] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:19.621029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:19.638623 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6aeea1cc-a77d-43e4-9db9-8bf3826a92dd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1686 microversion: 2.1 time: 0.319604 Sep 13 16:51:19.641537 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2313/4550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:19 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1686 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:19.681856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b42a66a5-e54c-47fd-88fb-a769e557f9a8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4e5c8b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:19.793812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:19.795919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:19.823718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:19.826801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:19.830381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:19.832078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:19.835277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:19.836238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:19.877338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b42a66a5-e54c-47fd-88fb-a769e557f9a8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.200400 Sep 13 16:51:19.877971 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2238/4551] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:19 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:19.949327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:19.969687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:19.970234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:19.970686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:19.971529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lazy-loading 'fault' on Instance uuid ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:51:20.087749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:20.096713 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-803e67ee-8c4b-41f6-b2a0-b0ff8b1ea76d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 200 len: 1320 microversion: 2.1 time: 0.307500 Sep 13 16:51:20.097377 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2314/4552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:19 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:20.569310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-50efcf7f-9949-4ef8-bc38-0ca76c53e71f req-72696dd6-21f8-4740-896f-06c80621bf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-plugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:20.600747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-50efcf7f-9949-4ef8-bc38-0ca76c53e71f req-72696dd6-21f8-4740-896f-06c80621bf76 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:20.601473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-50efcf7f-9949-4ef8-bc38-0ca76c53e71f req-72696dd6-21f8-4740-896f-06c80621bf76 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:20.603089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-50efcf7f-9949-4ef8-bc38-0ca76c53e71f req-72696dd6-21f8-4740-896f-06c80621bf76 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:20.625646 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-50efcf7f-9949-4ef8-bc38-0ca76c53e71f req-72696dd6-21f8-4740-896f-06c80621bf76 service nova] Creating event network-vif-plugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:51:20.643717 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-50efcf7f-9949-4ef8-bc38-0ca76c53e71f req-72696dd6-21f8-4740-896f-06c80621bf76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080262 Sep 13 16:51:20.644367 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2239/4553] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:20.668512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:20.669138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:20.698517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:20.700862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:20.702353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:20.704029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:20.705279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:20.706251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:20.901156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec491157-8299-4442-8894-7b9137ebb192 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb976c160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:20.937441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:20.956886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-334380e1-da10-41a9-bd07-7e43e42da5fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1686 microversion: 2.1 time: 0.291954 Sep 13 16:51:20.957297 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2315/4554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:20 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1686 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:20.997510 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec491157-8299-4442-8894-7b9137ebb192 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.108326 Sep 13 16:51:20.999123 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2240/4555] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:20 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:21.128287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:21.128910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:21.146155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:21.146666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:21.147112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:21.147828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:21.148289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:21.148998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:21.183638 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 HTTP/1.1 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ca8a76f3-291d-45aa-8165-bdcac0c0d1a1'} Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:51:21.185318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-958b9ee6-627a-4f6a-b1ab-f8b4b518a82c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 404 len: 111 microversion: 2.1 time: 0.064066 Sep 13 16:51:21.193904 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2316/4556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:21 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:51:21.352142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-933617005", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "daefc9e9-71e1-4a09-8dc8-a497da60db93"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:21.437274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] validate_networks() for [('daefc9e9-71e1-4a09-8dc8-a497da60db93', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:51:21.983009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:21.985845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:21.997750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:21.998553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:21.999466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:22.000846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:22.002219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:22.002882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:22.183348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:51:22.184300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:51:22.184939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:51:22.185507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:51:22.186183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:51:22.199270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:22.202060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:22.202965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:22.204485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:22.204989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:22.207537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:22.235385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:51:22.243878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Getting quotas for user 121bd2b9dfb8482da3a82d193a40261c and project 9b2706957b26482dbf1b961588ebb52c. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:51:22.275332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:51:22.281393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:51:22.315668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:22.328714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-517656e6-fae1-4812-9813-58607582e270 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1686 microversion: 2.1 time: 0.350319 Sep 13 16:51:22.329955 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2317/4557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:21 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1686 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:22.352187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cfe13ed0-c7f7-4096-90e3-4f50d0d9c9cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb50ee310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:22.360618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-487d9831-ff4f-47fd-887c-4f531956566d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013801 Sep 13 16:51:22.367917 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2241/4558] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:51:22.373320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-502f9c5b-c22d-4f74-acf8-e3d35f678ba9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:22.374372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-502f9c5b-c22d-4f74-acf8-e3d35f678ba9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:22.467712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-502f9c5b-c22d-4f74-acf8-e3d35f678ba9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:22.478032 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-502f9c5b-c22d-4f74-acf8-e3d35f678ba9 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1208 microversion: 2.1 time: 0.108614 Sep 13 16:51:22.478651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2242/4559] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:22 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1208 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:22.670319 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cfe13ed0-c7f7-4096-90e3-4f50d0d9c9cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.336228 Sep 13 16:51:22.676235 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2318/4560] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:22 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:23.358538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:23.359307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:23.372941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:23.373439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:23.373915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:23.381091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:23.383004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:23.383738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:23.507067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:23.507700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:23.534029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:23.534613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:23.534968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:23.535690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:23.536149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:23.536575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:23.670801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:23.684326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b568042a-bb36-414b-b590-2dfe793a226c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1204 microversion: 2.1 time: 0.185437 Sep 13 16:51:23.686550 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2319/4561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:23 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1204 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:23.712384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f05a2e7d-1f1e-4f8e-8447-ad737e4ffefe tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb46305e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:23.823041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f05a2e7d-1f1e-4f8e-8447-ad737e4ffefe tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.116122 Sep 13 16:51:23.825473 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2320/4562] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:23 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:23.999306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:24.012920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff1d6c55-343c-435e-91c6-73215aee48e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1686 microversion: 2.1 time: 0.658941 Sep 13 16:51:24.016241 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2243/4563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:23 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1686 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:24.712993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:24.714325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:24.733121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:24.736083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:24.737470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:24.739396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:24.740308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:24.743700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:24.850866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b96a5dc2-636a-4e93-9500-8f6f3c62cd81 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb56fba60>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:24.928085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:24.942694 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3ee7486-51f9-416a-a7e3-b30248998410 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1266 microversion: 2.1 time: 0.233955 Sep 13 16:51:24.948346 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2321/4564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:24 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:24.970520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b96a5dc2-636a-4e93-9500-8f6f3c62cd81 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 0.130259 Sep 13 16:51:24.976021 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2244/4565] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:24 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:25.044667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:25.045651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:25.058668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:25.063223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:25.065694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:25.067271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:25.069098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:25.071228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:25.433113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:25.460208 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a876a105-986c-45e1-8092-62ad8e868eb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1686 microversion: 2.1 time: 0.419355 Sep 13 16:51:25.483621 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2322/4566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:25 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1686 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:25.979253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:25.981084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:25.995608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-48444e4a-eeaa-4f62-b080-80f3071a0a61 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45f2b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:26.009140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:26.013181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:26.014502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:26.016075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:26.016712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:26.017159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:26.529574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:26.545378 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78745295-acc8-496d-b9da-3237d62257e0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.568770 Sep 13 16:51:26.548423 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2245/4567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:25 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:26.553619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:26.558873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:26.574469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:26.586612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:26.587349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:26.588273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:26.588891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:26.589602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:26.944256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:26.959517 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-763884f3-4d04-4a9d-9c2a-2a9489c48e39 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.409197 Sep 13 16:51:26.961811 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2246/4568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:26 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:27.574417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:27.575053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:27.592821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:27.593638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:27.607221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:27.609443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:27.610904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:27.611973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:28.350382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:28.373007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-43d0261d-cab4-4ff1-b143-4530b6bf1719 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.802819 Sep 13 16:51:28.387669 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2247/4569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:27 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:28.422890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:28.423885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:28.454399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:28.454916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:28.455371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:28.456127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:28.460042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:28.461897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:29.128596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:29.146343 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb3ed53a-bd1d-42cc-87c3-c66a6d4df73b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.742105 Sep 13 16:51:29.148821 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2248/4570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:28 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:29.166812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-78e209f4-8b85-4ea4-be46-a3144d8c0f63 req-3862ca32-a2eb-4a2f-bdde-5f74af65f62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44aeeee2-601c-4ebe-9d14-091430c94b72", "tag": "31102bb1-487b-4e62-b694-c4847a31c198"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:29.208536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-78e209f4-8b85-4ea4-be46-a3144d8c0f63 req-3862ca32-a2eb-4a2f-bdde-5f74af65f62a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:29.209176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-78e209f4-8b85-4ea4-be46-a3144d8c0f63 req-3862ca32-a2eb-4a2f-bdde-5f74af65f62a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:29.209639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-78e209f4-8b85-4ea4-be46-a3144d8c0f63 req-3862ca32-a2eb-4a2f-bdde-5f74af65f62a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:29.271962 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-78e209f4-8b85-4ea4-be46-a3144d8c0f63 req-3862ca32-a2eb-4a2f-bdde-5f74af65f62a service nova] Creating event network-changed:31102bb1-487b-4e62-b694-c4847a31c198 for instance 44aeeee2-601c-4ebe-9d14-091430c94b72 on n-h1-857467-1 Sep 13 16:51:29.299446 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-78e209f4-8b85-4ea4-be46-a3144d8c0f63 req-3862ca32-a2eb-4a2f-bdde-5f74af65f62a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148996 Sep 13 16:51:29.306705 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2249/4571] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:29.410359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:29.411820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:29.426532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:29.428042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:29.429415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:29.432076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:29.432820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:29.434527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:29.803915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:29.823418 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c2c1246-a52d-4fcf-9065-0e000b86d13b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.418229 Sep 13 16:51:29.846360 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2250/4572] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:29 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:30.177332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:30.178885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:30.191421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:30.193734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:30.194455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:30.195758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:30.196760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:30.198068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:30.499211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:30.508972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-122e90d9-d28c-4ecd-8834-41b5cc573391 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.338497 Sep 13 16:51:30.511344 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2251/4573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:30 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:30.523420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:30.524414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:30.550653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:30.553851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:30.554609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:30.556881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:30.562238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:30.563936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:30.586676 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-48444e4a-eeaa-4f62-b080-80f3071a0a61 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1452 microversion: 2.1 time: 4.593830 Sep 13 16:51:30.586676 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2323/4574] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:25 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1452 bytes in 4595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:30.631167 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd0ded7f-29ca-412a-8331-dbce90088451 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/ips" status: 200 len: 145 microversion: 2.1 time: 0.116276 Sep 13 16:51:30.632586 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2252/4575] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:51:30 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/ips => generated 145 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:30.857519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:30.858787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:30.871767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:30.875698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:30.877712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:30.882354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:30.883190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:30.883903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:31.309285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:31.337576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4dbe0edc-2ca7-403c-b18a-50c75f71ec89 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.485007 Sep 13 16:51:31.361574 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2324/4576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:30 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:31.543275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:31.545166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:31.566216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:31.568947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:31.571865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:31.574030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:31.575825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:31.577731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:31.602278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a49bfcbd-16aa-406a-9f48-16f6ed780f52 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4b2ba60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:32.127301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:32.143996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a430de1e-8e24-4474-ad1e-d0c0463313e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.605402 Sep 13 16:51:32.146164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a49bfcbd-16aa-406a-9f48-16f6ed780f52 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1461 microversion: 2.1 time: 0.549810 Sep 13 16:51:32.148465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2325/4577] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:31 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1461 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:32.163811 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2253/4578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:31 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:32.185476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ecc975c9-e878-48c7-87c3-fd3a86a4f611 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45d83a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:32.365433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:32.368623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:32.384629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:32.391935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:32.392781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:32.401781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:32.404317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:32.404859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:32.415242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:32.459791 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ecc975c9-e878-48c7-87c3-fd3a86a4f611 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 200 len: 1461 microversion: 2.1 time: 0.279171 Sep 13 16:51:32.462152 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2326/4579] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:32 2022] GET /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 1461 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:32.480716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:32.481362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:32.486483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:32.496617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:32.497127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:32.497582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:32.502918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:32.504563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:32.506226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:32.749995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:32.763344 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-56fbc0a6-1110-4791-acae-83f38ecf06a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.402008 Sep 13 16:51:32.789383 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2254/4580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:32 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:33.195329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:33.197328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:33.220134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:33.221286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:33.225634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:33.228672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:33.230485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:33.232920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:33.343211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:33.362638 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b3ab27a-c9f1-4d17-972b-4333d080722f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 1466 microversion: 2.1 time: 0.889431 Sep 13 16:51:33.366406 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2327/4581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:32 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 1466 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:33.396291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-690526696"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:33.400387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:33.410999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:33.436003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:33.436790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:33.437256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:33.440296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:33.443037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:33.443759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:34.207293 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ecc56ca-58f1-451a-a6fe-9344128234ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "POST /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e/action" status: 202 len: 0 microversion: 2.1 time: 0.810310 Sep 13 16:51:34.210323 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2328/4582] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:51:33 2022] POST /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 16:51:34.242026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:34.244740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:34.262237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:34.263927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:34.267718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:34.271166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:34.272603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:34.277017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:34.277349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:34.309067 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8dddc224-c875-4737-bf6d-19cccb86ba4c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 1.118452 Sep 13 16:51:34.337800 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2255/4583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:33 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:34.358030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4a8b058f-4ab8-4e80-ae2a-8d489f9ea890 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4da9820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:34.497008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4a8b058f-4ab8-4e80-ae2a-8d489f9ea890 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.154445 Sep 13 16:51:34.503395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2256/4584] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:34 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:34.721544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:34.735641 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-daddd39f-1877-44dd-aa56-5399f466f3e2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.513064 Sep 13 16:51:34.738535 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2329/4585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:34 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:34.895592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b84a945-6888-46e3-aeb2-280b73622547"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:34.904480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:34.937296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:34.937885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:34.941641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:34.943737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:34.944281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:34.944850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:35.346977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:35.347607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:35.371533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:35.372264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:35.373063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:35.375297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:35.376859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:35.377988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:35.568875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:35.928685 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b83023e-887d-402f-8679-aa4a42a0dd1e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.031235 Sep 13 16:51:35.932108 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2257/4586] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:51:34 2022] POST /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments => generated 194 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:51:35.978275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e89f7798-9a33-402f-8f96-78293e63e822 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a3c9d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:36.114776 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e89f7798-9a33-402f-8f96-78293e63e822 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.178066 Sep 13 16:51:36.116489 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2258/4587] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:35 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:36.129723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:36.130528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:36.148471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:36.149279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:36.149773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:36.153198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:36.153198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:36.153198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:36.407711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:36.420442 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-51f1e239-bf98-465d-92b0-54f01016102e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 1.078530 Sep 13 16:51:36.421772 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2330/4588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:35 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:36.536179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:36.549423 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c06fec5-d7ed-40d3-8c54-60ec0c442f28 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.429814 Sep 13 16:51:36.554144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2259/4589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:36 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:36.661625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a3e30dbb-5005-4217-bcb1-8c1c3ac670ba req-4d47d01e-b9b2-486b-894e-16605ff5e2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44aeeee2-601c-4ebe-9d14-091430c94b72", "name": "network-vif-plugged", "status": "completed", "tag": "31102bb1-487b-4e62-b694-c4847a31c198"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:36.688765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a3e30dbb-5005-4217-bcb1-8c1c3ac670ba req-4d47d01e-b9b2-486b-894e-16605ff5e2cb service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:36.691253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a3e30dbb-5005-4217-bcb1-8c1c3ac670ba req-4d47d01e-b9b2-486b-894e-16605ff5e2cb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:36.693491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a3e30dbb-5005-4217-bcb1-8c1c3ac670ba req-4d47d01e-b9b2-486b-894e-16605ff5e2cb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:36.737331 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a3e30dbb-5005-4217-bcb1-8c1c3ac670ba req-4d47d01e-b9b2-486b-894e-16605ff5e2cb service nova] Creating event network-vif-plugged:31102bb1-487b-4e62-b694-c4847a31c198 for instance 44aeeee2-601c-4ebe-9d14-091430c94b72 on n-h1-857467-1 Sep 13 16:51:36.769299 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a3e30dbb-5005-4217-bcb1-8c1c3ac670ba req-4d47d01e-b9b2-486b-894e-16605ff5e2cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114157 Sep 13 16:51:36.774077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2331/4590] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:37.135443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e508999-fdaf-4931-bfa4-5c85c1841d9c tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a3c9d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:37.253991 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e508999-fdaf-4931-bfa4-5c85c1841d9c tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.122303 Sep 13 16:51:37.257550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2260/4591] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:37 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:37.448466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:37.450126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:37.473924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:37.475177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:37.478461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:37.482210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:37.482781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:37.483796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:37.580048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:37.580687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:37.592443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:37.592986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:37.593534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:37.600894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:37.604151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:37.604728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:37.893376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:37.937816 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ab693796-1005-4c77-95b1-944a323ce4a0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1308 microversion: 2.1 time: 0.362079 Sep 13 16:51:37.940880 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2261/4592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:37 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:38.151375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:38.176019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f9750ce-3142-49ed-8cc6-e81db44a1142 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.731378 Sep 13 16:51:38.197396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2332/4593] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:37 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:38.276785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7eda49da-90dc-4ed7-a8f3-6b0c08a43568 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb97885e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:38.430035 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7eda49da-90dc-4ed7-a8f3-6b0c08a43568 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.150689 Sep 13 16:51:38.437426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2262/4594] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:38 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:38.969119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:38.970131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:39.006471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:39.009375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:39.011298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:39.013541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:39.018176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:39.020382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:39.250290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-81dceac8-0f32-4645-b7d0-85758ab7b52a req-c488cb60-fa5f-4c51-9318-426666ddda71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "name": "network-vif-unplugged", "status": "completed", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:39.286953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-81dceac8-0f32-4645-b7d0-85758ab7b52a req-c488cb60-fa5f-4c51-9318-426666ddda71 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:39.291010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-81dceac8-0f32-4645-b7d0-85758ab7b52a req-c488cb60-fa5f-4c51-9318-426666ddda71 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:39.299345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-81dceac8-0f32-4645-b7d0-85758ab7b52a req-c488cb60-fa5f-4c51-9318-426666ddda71 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:39.359495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-81dceac8-0f32-4645-b7d0-85758ab7b52a req-c488cb60-fa5f-4c51-9318-426666ddda71 service nova] Creating event network-vif-unplugged:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:51:39.381349 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-81dceac8-0f32-4645-b7d0-85758ab7b52a req-c488cb60-fa5f-4c51-9318-426666ddda71 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.587397 Sep 13 16:51:39.382001 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2333/4595] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:39.416296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:39.417357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:39.445598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:39.447848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:39.449206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:39.454209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:39.458057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:39.461658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:40.152979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:40.164929 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dbd3d9a0-1172-4faf-8599-d923b2e910d8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1489 microversion: 2.1 time: 1.202246 Sep 13 16:51:40.165529 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2263/4596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:38 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1489 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:40.175834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a0a682a-15c3-4924-b2c0-0ddb89d3668a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4b509d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:40.282101 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a0a682a-15c3-4924-b2c0-0ddb89d3668a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.114853 Sep 13 16:51:40.287138 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2264/4597] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:40 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:40.307886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-573098985"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:40.310632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:40.350182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:40.350726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:40.351117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:40.353681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:40.354198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:40.354647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:40.544670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:40.554449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b00c0583-f9fa-4e51-aea7-fcdf1674ba50 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 1.163594 Sep 13 16:51:40.567866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2334/4598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:39 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:40.609771 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6457ce50-4739-49a1-b693-a6f04fe02ab4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "PUT /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1074 microversion: 2.1 time: 0.318969 Sep 13 16:51:40.622920 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2265/4599] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:51:40 2022] PUT /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1074 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:40.634903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:40.635549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:40.642626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:40.643118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:40.643549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:40.657052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:40.658329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:40.659381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:41.169873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:41.191935 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3301727-1047-4af3-89c9-92b2c5be94a1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1500 microversion: 2.1 time: 0.561003 Sep 13 16:51:41.200783 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2335/4600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:40 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1500 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:41.224808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:41.225701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:41.250666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:41.251305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:41.251886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:41.252848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:41.253428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:41.254008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:41.298937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8e89023-3c6e-4c6b-8698-5d76b2cf65f7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb461b160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:41.391530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8e89023-3c6e-4c6b-8698-5d76b2cf65f7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.097193 Sep 13 16:51:41.399274 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2336/4601] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:41 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:41.587128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:41.589087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:41.605667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:41.610325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:41.616276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:41.626813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:41.627602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:41.628241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:41.694721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:41.805265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:41.832566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c15d9df-22fc-4af6-8a01-f1ab5595774b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1500 microversion: 2.1 time: 0.609445 Sep 13 16:51:41.833262 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2266/4602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:41 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1500 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:41.865920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0471a603-990a-4e6c-99cc-0d0f83bc0ca0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:41.877403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0471a603-990a-4e6c-99cc-0d0f83bc0ca0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:41.878241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0471a603-990a-4e6c-99cc-0d0f83bc0ca0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:41.882573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0471a603-990a-4e6c-99cc-0d0f83bc0ca0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:41.973874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0471a603-990a-4e6c-99cc-0d0f83bc0ca0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Going to try to stop instance {{(pid=122327) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:51:42.103440 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0471a603-990a-4e6c-99cc-0d0f83bc0ca0 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "POST /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72/action" status: 202 len: 0 microversion: 2.1 time: 0.242061 Sep 13 16:51:42.104925 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2267/4603] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:51:41 2022] POST /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:51:42.125814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-74d718e3-8ffe-49ec-ae31-4fe51d119f27 req-630be600-dbf1-49a6-be3a-4543b71d86fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c2ae7a-83cc-4182-a6d3-020a00bc333e", "name": "network-vif-plugged", "status": "completed", "tag": "b57d7ddb-d6ef-4416-a6db-fda9170363ec"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:42.146075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-74d718e3-8ffe-49ec-ae31-4fe51d119f27 req-630be600-dbf1-49a6-be3a-4543b71d86fa service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:42.147283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-74d718e3-8ffe-49ec-ae31-4fe51d119f27 req-630be600-dbf1-49a6-be3a-4543b71d86fa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:42.148165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-74d718e3-8ffe-49ec-ae31-4fe51d119f27 req-630be600-dbf1-49a6-be3a-4543b71d86fa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:42.193718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-74d718e3-8ffe-49ec-ae31-4fe51d119f27 req-630be600-dbf1-49a6-be3a-4543b71d86fa service nova] Creating event network-vif-plugged:b57d7ddb-d6ef-4416-a6db-fda9170363ec for instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e on n-h2-857467-1 Sep 13 16:51:42.214578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-74d718e3-8ffe-49ec-ae31-4fe51d119f27 req-630be600-dbf1-49a6-be3a-4543b71d86fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108268 Sep 13 16:51:42.215672 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2268/4604] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:42.227669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:42.229080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:42.275216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:42.280656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:42.281176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:42.285869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:42.290519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:42.293112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:42.513948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:42.546958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0c7d688-b74a-456e-b836-fee458e3b9a8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.963641 Sep 13 16:51:42.547600 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2337/4605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:41 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:42.568689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b578ab56-503a-4089-92c8-5320d192d053 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45db790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:42.647668 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b578ab56-503a-4089-92c8-5320d192d053 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.098518 Sep 13 16:51:42.650862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2338/4606] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:42 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:42.733385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:42.750321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b54b37a-9df4-4e36-b987-8ebc98f2c26b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 0.530298 Sep 13 16:51:42.752412 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2269/4607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:42 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:43.573367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:43.574768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:43.588545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:43.591328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:43.591968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:43.593104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:43.594337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:43.594952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:43.665696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60902ebe-3fa0-4262-a194-60b657da2717 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a551f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:43.744886 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60902ebe-3fa0-4262-a194-60b657da2717 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.083261 Sep 13 16:51:43.746121 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2270/4608] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:43 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:43.783875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:43.784820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:43.792949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:43.798653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:43.799484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:43.800456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:43.801169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:43.801857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:43.939434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:43.950052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f82581c5-f334-449d-ad31-cc99fb628ba7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.381494 Sep 13 16:51:43.950834 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2339/4609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:43 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:44.267428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:44.289944 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95c84a40-1ee9-48a7-a82a-9450022c046b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 0.510571 Sep 13 16:51:44.292417 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2271/4610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:43 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:44.763126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-792a53e0-8238-42cb-8e59-0c9aad33d9ea tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45f2940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:44.980888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:44.982438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:45.001380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:45.003359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:45.006437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:45.007490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:45.008190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:45.011268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:45.642958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:45.662438 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9bd39f88-3620-424f-9d81-af37793deae6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.687832 Sep 13 16:51:45.666134 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2272/4611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:44 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:45.675217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:45.677869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:45.699009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:45.704190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:45.706533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:45.711735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:45.712924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:45.714848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:46.293281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:46.310226 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa262ee6-b633-48c4-882a-084f1c4c02a6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 0.642547 Sep 13 16:51:46.338674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2273/4612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:45 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:46.693041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:46.694254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:46.715058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:46.718075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:46.718640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:46.719765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:46.721171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:46.721622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:47.637376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:47.659566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7de0e348-3a29-47d8-a64a-899816278d3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.969937 Sep 13 16:51:47.683872 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2274/4613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:46 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:47.706576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:47.707431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:47.722786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:47.735376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:47.736911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:47.739646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:47.740749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:47.745446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:48.696557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:48.710384 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e35d6db9-16bd-4fe8-98b0-c145704ad1e1 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.024973 Sep 13 16:51:48.717050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2275/4614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:47 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:48.735714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:48.737378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:48.744184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:48.761013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:48.761803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:48.762495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:48.763379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:48.764100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:48.765871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:49.332529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:49.344768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f3d7594-fb19-4ddb-b66e-23c5b6e1dcb7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.625910 Sep 13 16:51:49.345706 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2276/4615] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:48 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:49.747223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:49.747968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:49.765921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:49.796056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:49.798600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:49.800013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:49.803679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:49.806610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:51.032783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:51.035908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:51.051317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e52a44d4-521f-47de-964d-985d69733181 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.309213 Sep 13 16:51:51.074711 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2277/4616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:49 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:51.084310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:51.091840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:51.114033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:51.114826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:51.115533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:51.116485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:51.117128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:51.117725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:52.391817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:52.403032 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5110385-e42b-4a13-b234-dfbd6452107b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 1.326868 Sep 13 16:51:52.406483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2278/4617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:51 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:52.425425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:52.430868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:52.457343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:52.458196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:52.458822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:52.466894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:52.468442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:52.469216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:52.859133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:52.871275 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0608ce37-a063-4360-8ab5-c3b386ac86da tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 0.458542 Sep 13 16:51:52.877420 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2279/4618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:52 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:53.119732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-792a53e0-8238-42cb-8e59-0c9aad33d9ea tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 8.360771 Sep 13 16:51:53.123032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2340/4619] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:44 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 8365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:53.432903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:53.433550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:53.449388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:53.449962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:53.452755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:53.454076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:53.459396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:53.460128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:53.903540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:53.904427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:53.920739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=19 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:53.926638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:53.933744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:53.936547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:53.941890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:53.944094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:53.944388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:53.953139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=9 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:51:54.165312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:54.183694 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7fd96e0d-4d9e-420b-afc0-a094657c17c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1681 microversion: 2.1 time: 0.756572 Sep 13 16:51:54.192427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2280/4620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:53 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1681 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:54.211732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7192c53d-11a0-48ac-8652-4443b02846d0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a1d0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:55.310314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:55.331123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7a9b5a4d-7662-44f1-8f09-9445fa348f24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.432238 Sep 13 16:51:55.348951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2341/4621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:53 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:55.367843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:55.375106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:55.394105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:55.394883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:55.395485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:55.396376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:55.397046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:55.397634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:55.526661 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7192c53d-11a0-48ac-8652-4443b02846d0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 1.332731 Sep 13 16:51:55.537569 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2281/4622] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:54 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:55.790045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:55.804788 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5751016-9438-462f-bf0f-2839c73f02d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.452502 Sep 13 16:51:55.808203 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2342/4623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:55 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:55.939071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:55.939936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:55.957302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:55.957807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:55.958276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:55.961588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:55.962261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:55.962865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:56.359963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:56.368386 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54f2cb89-7955-4c01-a671-bbf47bcfc976 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.433262 Sep 13 16:51:56.369001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2282/4624] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:55 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:51:56.381636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:56.387148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:56.427373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:56.432322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:56.433036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:56.434046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:56.436957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:56.437582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:56.548218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b093a7d-5f82-4e9d-9679-039c0c5baea8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb966f280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:56.686624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:56.698058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e35819d6-afdb-4e6e-b9d9-fb5d13c0032f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 0.320612 Sep 13 16:51:56.705002 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2343/4625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:56 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:56.723166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4352b4fd-36c0-4024-8ee4-3901f3a86d43 req-1c14c70c-4d66-4888-9802-fa7ea10132ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-unplugged", "status": "completed", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:51:56.734963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4352b4fd-36c0-4024-8ee4-3901f3a86d43 req-1c14c70c-4d66-4888-9802-fa7ea10132ca service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:56.736083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4352b4fd-36c0-4024-8ee4-3901f3a86d43 req-1c14c70c-4d66-4888-9802-fa7ea10132ca service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:56.736763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4352b4fd-36c0-4024-8ee4-3901f3a86d43 req-1c14c70c-4d66-4888-9802-fa7ea10132ca service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:56.750281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4352b4fd-36c0-4024-8ee4-3901f3a86d43 req-1c14c70c-4d66-4888-9802-fa7ea10132ca service nova] Creating event network-vif-unplugged:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:51:56.758227 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4352b4fd-36c0-4024-8ee4-3901f3a86d43 req-1c14c70c-4d66-4888-9802-fa7ea10132ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051334 Sep 13 16:51:56.762706 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2344/4626] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:57.731563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:57.733541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:57.754061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:57.762302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:57.762678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:57.763587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:57.764100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:57.764598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:58.334912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:58.349234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70cb4fe0-db93-48e0-bb31-3dd571aef527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 0.623909 Sep 13 16:51:58.349917 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2345/4627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:57 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:58.355361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:58.369268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:58.377564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:58.385533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:58.386317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:58.387328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:58.389559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:58.390592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:58.481254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-220bcdd5-e43c-46a2-9a84-93f672d78216 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126795 Sep 13 16:51:58.482128 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2346/4628] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:51:58 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:51:58.495149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:58.495696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:58.505441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:58.506050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:58.506493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:58.508171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:58.508171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:58.508171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:58.555471 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81e18649-ad26-41e3-a3f4-9d4e081a72ba tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/9b84a945-6888-46e3-aeb2-280b73622547" status: 200 len: 194 microversion: 2.1 time: 0.064446 Sep 13 16:51:58.575182 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2347/4629] 10.222.0.61 () {58 vars in 1413 bytes} [Tue Sep 13 16:51:58 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/9b84a945-6888-46e3-aeb2-280b73622547 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:51:58.832313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:58.833687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:58.843708 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b093a7d-5f82-4e9d-9679-039c0c5baea8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 2.300809 Sep 13 16:51:58.844993 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2283/4630] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:51:56 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:58.860450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:58.860960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:58.861405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:58.862578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:58.863044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:58.865018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:59.388606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:59.389892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:59.411999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:59.418311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:59.421711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:59.434214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:59.435369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:59.439557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:59.580142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:51:59.596699 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0e70a31-6e63-4f59-ad2c-cb953dc3f3ce tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.771692 Sep 13 16:51:59.600878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2348/4631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:58 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:51:59.639553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:51:59.640218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:51:59.660137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:59.660655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:59.666211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:51:59.667055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:51:59.667562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:51:59.668017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:00.199481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:00.210281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cde5c7e4-0bee-4ef1-8f9e-6c00944963b8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.584820 Sep 13 16:52:00.210684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2349/4632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:59 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:00.230185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd9f2888-b304-459e-a153-6925810f6eef tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb9801940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:00.320991 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd9f2888-b304-459e-a153-6925810f6eef tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.108965 Sep 13 16:52:00.321785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2350/4633] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:00 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:00.353149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:00.353810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:00.414102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:00.414609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:00.424419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:00.427603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:00.431310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:00.433324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:00.698717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:00.748708 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2c57c95-efee-40bc-81d7-3e4dd6aca89a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.364168 Sep 13 16:52:00.750408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2284/4634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:51:59 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:01.168484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:01.180565 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99a8b2f6-e677-4d64-b8c1-03c20c01bf1f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.857819 Sep 13 16:52:01.181176 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2351/4635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:00 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:01.213914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:01.216620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:01.253027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:01.255688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:01.256191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:01.256976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:01.257467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:01.265016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:01.341516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32cae7f0-45fa-405c-ba73-0a5e3aff53a8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb458c940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:01.491043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32cae7f0-45fa-405c-ba73-0a5e3aff53a8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.153348 Sep 13 16:52:01.504102 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2352/4636] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:01 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:01.650468 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa82dd8d-28a6-4dc7-a490-a89a299f504c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.437180 Sep 13 16:52:01.656649 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2285/4637] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:52:01 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:52:01.663343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:01.663986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:01.672249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:01.672885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:01.673282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:01.696301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:01.696928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:01.701270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:01.773693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:01.775610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:01.794186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:01.796927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:01.806099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:01.810266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:01.813569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:01.817107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:02.180047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:02.200535 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3ad2718-f013-4738-bf93-b8c6ed214c87 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1670 microversion: 2.1 time: 0.537661 Sep 13 16:52:02.204975 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2353/4638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:01 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:02.515090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4febedd-6c18-42b4-a59f-6fd99842bbde tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45db3a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:02.650098 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4febedd-6c18-42b4-a59f-6fd99842bbde tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.143740 Sep 13 16:52:02.659145 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2354/4639] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:02 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:02.669511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:02.672561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:02.690369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:02.692500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:02.694175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:02.696443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:02.697127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:02.698761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:03.003452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:03.019484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6282721-cb2b-4aea-9362-cd90c419bae2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.248946 Sep 13 16:52:03.020763 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2286/4640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:01 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:03.040527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3b44374-8096-4244-a723-3fa5387010d7"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:03.047529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:03.073726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:03.076246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:03.077515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:03.080512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:03.081147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:03.083915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:03.329100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:03.339835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:03.349071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:03.350738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4f895a4-f262-4c3b-83e5-430c01490a9b tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2950 microversion: 2.42 time: 0.690325 Sep 13 16:52:03.376673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2355/4641] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:52:02 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2950 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:52:03.393155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:03.394404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:03.414817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:03.415565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:03.416194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:03.417102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:03.417756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:03.418438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:03.812895 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4906815b-8837-427b-9596-946d3bc2c913 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "POST /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785064 Sep 13 16:52:03.813961 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2287/4642] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:52:03 2022] POST /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:03.840425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:03.841428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:03.884826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:03.887261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:03.887864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:03.888719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:03.891141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:03.894017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:04.007114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:04.024998 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-440c0e17-6f4d-4838-b9e9-962cf6026899 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1670 microversion: 2.1 time: 0.635392 Sep 13 16:52:04.036080 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2356/4643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:03 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1670 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:04.085008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2ca6f641-f329-4e23-a04c-28eee9bd032a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45f2940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:04.253530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2ca6f641-f329-4e23-a04c-28eee9bd032a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.210976 Sep 13 16:52:04.264238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2357/4644] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:04 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:04.307142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:04.308184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:04.330497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:04.332342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:04.336331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:04.337382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:04.339639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:04.341647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:04.432642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-56b67fdc-34b0-4456-98bf-5686c44a255c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.615812 Sep 13 16:52:04.443054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2288/4645] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 16:52:03 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af/os-interface => generated 1830 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:52:05.072799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:05.074001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:05.087715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:05.096626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:05.098945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:05.102668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:05.105401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:05.106070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:05.865718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:05.893015 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb541dd2-c55f-434f-a8f3-05189bbd9b24 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.622492 Sep 13 16:52:05.894052 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2358/4646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:04 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:05.911302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46665c1f-e639-4d19-8407-9694526db44a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb50ce790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:06.033501 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46665c1f-e639-4d19-8407-9694526db44a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.138245 Sep 13 16:52:06.034484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2359/4647] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:05 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:06.923711 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:52:06.924637 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 16:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 (ip 10.222.0.61) !!! Sep 13 16:52:06.938276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:06.939618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:06.979104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:06.979996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:06.988770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:06.990463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:06.991368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:06.993268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:07.032297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:07.050169 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9341510-c782-4da4-b62e-34cccb018933 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1675 microversion: 2.1 time: 1.978992 Sep 13 16:52:07.051505 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2289/4648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:05 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1675 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:07.065221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98645faa-055c-4ad3-9ea0-689897939c93 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb9813820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:07.159604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98645faa-055c-4ad3-9ea0-689897939c93 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.104158 Sep 13 16:52:07.164156 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2290/4649] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:07 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:08.081937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:08.082712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:08.097432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:08.097964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:08.114044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:08.119191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:08.121108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:08.121749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:08.158822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:08.176877 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0840186-f12f-4ad1-a2a3-c94ded763527 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1510 microversion: 2.1 time: 1.258929 Sep 13 16:52:08.199569 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2360/4650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:06 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1510 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:08.205057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ba10281-4b6e-41d4-99e8-6b35fad8cf38 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45e1160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:08.302877 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ba10281-4b6e-41d4-99e8-6b35fad8cf38 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.102061 Sep 13 16:52:08.303874 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2361/4651] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:08 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:08.712127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:08.731402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc072a24-3b25-4964-99a3-7e17613c1c73 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.654305 Sep 13 16:52:08.733773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2291/4652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:08 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:08.775241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:08.777421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:08.801914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:08.802429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:08.802874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:08.803592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:08.804053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:08.804481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:08.909667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bfec5171-917b-416c-ac6a-9720e06e5297 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 200 len: 324 microversion: 2.1 time: 0.138385 Sep 13 16:52:08.911304 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2362/4653] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:52:08 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 324 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:08.921511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:08.922315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:08.943076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:08.943929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:08.947049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:08.950917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:08.955415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:08.958621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.206004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:09.207393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:09.224038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:09.224728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:09.225333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.226279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:09.226919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:09.227527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.595787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:09.604176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92e1790d-2b73-4533-88ed-6a83e862dc68 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.687434 Sep 13 16:52:09.620415 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2292/4654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:08 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:09.647625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f902ef2b-77f3-40fc-b724-deabc4106032 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb9745310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:09.749879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:09.780157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-86d1eec9-b4b4-4879-ad32-159a45ecc3d2 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1487 microversion: 2.1 time: 0.579665 Sep 13 16:52:09.792647 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f902ef2b-77f3-40fc-b724-deabc4106032 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.166250 Sep 13 16:52:09.793604 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2363/4655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:09 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1487 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:09.794388 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2293/4656] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:09 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:09.829703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-524870082"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:09.838320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:09.839287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:09.859942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:09.862574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:09.865296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.866622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:09.866965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:09.869792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:09.870490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.882801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:09.884115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:09.889684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.890808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:09.892221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:09.892824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:09.982316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:10.058722 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1fd74d71-87c1-4450-841a-48781b0efb15 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "PUT /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1060 microversion: 2.1 time: 0.238297 Sep 13 16:52:10.065715 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2294/4657] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:52:09 2022] PUT /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1060 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:10.087927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:10.089756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:10.114329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:10.123335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:10.125954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:10.126782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:10.127271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:10.132842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:10.430316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:10.432755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:10.446634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ba3ac0c1-a1c0-4ff3-b3ff-c9ba18434f52 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1487 microversion: 2.1 time: 0.361947 Sep 13 16:52:10.449148 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2295/4658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:10 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:10.478930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:10.481349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:10.498198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:10.499507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:10.500258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:10.501455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:10.502457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:10.503374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:10.547009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:10.574895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34161cf8-f550-4525-974f-dd011df171d8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.759051 Sep 13 16:52:10.583945 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2364/4659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:09 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:10.603114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:10.603742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:10.629929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:10.631006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:10.632379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:10.634585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:10.635551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:10.637426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:11.387850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:11.410120 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d61f044-92c0-4078-92c8-a86ecdfd2ce5 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1487 microversion: 2.1 time: 0.943106 Sep 13 16:52:11.411292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2296/4660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:10 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1487 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:11.422337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20fb69b2-dfac-44ed-bfe0-1db9da39a1d0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb98134c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:11.436418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:11.445471 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebdfefd2-4503-43f5-b1c0-2af1423f2492 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.846792 Sep 13 16:52:11.446091 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2365/4661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:10 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:11.468521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:11.469057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:11.486480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:11.486972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:11.490730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:11.493571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:11.494257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:11.496489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:11.517732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20fb69b2-dfac-44ed-bfe0-1db9da39a1d0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.103321 Sep 13 16:52:11.525951 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2297/4662] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:11 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:11.537897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:11.538534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:11.545645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:52:11.557239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:11.557753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:11.558280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:11.559015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:11.564962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:11.566655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:11.783327 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e73c5892-1731-44b4-a177-f085052428c7 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 204 len: 0 microversion: 2.1 time: 0.335879 Sep 13 16:52:11.783979 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2366/4663] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:11 2022] DELETE /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:52:11.793131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:11.793858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:11.806474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:11.808616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:11.812986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:11.813875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:11.816742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:11.817200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:12.158045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:12.174500 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-32932674-e243-4129-8ca5-3602d9e8d323 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.653987 Sep 13 16:52:12.175403 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2298/4664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:11 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:12.361237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:12.376820 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90125888-b211-4960-b0a2-1c188be636e6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1493 microversion: 2.1 time: 0.587822 Sep 13 16:52:12.379730 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2367/4665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:11 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1493 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:12.434370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-354916273", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "ebb6466b-9a22-4490-b956-78da5a25f8b5"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:12.542917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4473514-066b-4e98-8bb6-c6130b3bb576 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45c7ca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:12.566357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] validate_networks() for [('ebb6466b-9a22-4490-b956-78da5a25f8b5', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:52:12.649306 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4473514-066b-4e98-8bb6-c6130b3bb576 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1452 microversion: 2.1 time: 0.118547 Sep 13 16:52:12.649916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2368/4666] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:12 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:13.407266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:13.408467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:13.443470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:13.443987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:13.444435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:13.445172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:13.445637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:13.446099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:14.091190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:14.100226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-640a6de8-483d-472f-80f1-6ff6516f9d73 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1493 microversion: 2.1 time: 0.699922 Sep 13 16:52:14.116570 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2369/4667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:13 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1493 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:14.116570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e870383-fea4-4fcc-b7ff-8872bc5b006f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb582d5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:14.166809 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e870383-fea4-4fcc-b7ff-8872bc5b006f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1461 microversion: 2.1 time: 0.061638 Sep 13 16:52:14.167421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2370/4668] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:14 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1461 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:14.183317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f46134a4-9e78-4832-b1f5-32906f31d3dc tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb458cf70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:14.268207 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f46134a4-9e78-4832-b1f5-32906f31d3dc tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 200 len: 1461 microversion: 2.1 time: 0.089907 Sep 13 16:52:14.277921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2371/4669] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:14 2022] GET /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:14.293944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:14.299714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:14.308049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:14.308930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:14.309965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:14.312067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:14.312803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:14.313729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:14.390618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:52:14.392032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:52:14.392620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:52:14.393141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:52:14.393815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:52:14.410150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:14.410933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:14.411704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:14.412966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:14.413649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:14.414392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:14.442440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:52:14.450539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for user c2c12edf9f8d4b23bd1074facb2fad9d and project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:52:14.472939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:52:14.477066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:52:14.586529 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c47212ce-7749-46de-9c80-1896202e26ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.156769 Sep 13 16:52:14.588589 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2299/4670] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:52:14.607922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1af00158-c64c-454d-adc3-cee31e394e32 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:14.612945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1af00158-c64c-454d-adc3-cee31e394e32 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:14.785616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1af00158-c64c-454d-adc3-cee31e394e32 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:14.802559 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1af00158-c64c-454d-adc3-cee31e394e32 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1214 microversion: 2.1 time: 0.205242 Sep 13 16:52:14.813856 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2300/4671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:14 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:14.940923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:14.995039 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12dd5134-5acc-4e08-b17e-a5338c2ebb80 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1480 microversion: 2.1 time: 0.711646 Sep 13 16:52:15.013608 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2372/4672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:14 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1480 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:15.125253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:15.126544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:15.173635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:15.174491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:15.175994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:15.192461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:15.193099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:15.193574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:15.534370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:15.555684 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-30f8e7b9-7e46-49b3-a056-e21b7a24c46c tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 200 len: 1451 microversion: 2.1 time: 0.433875 Sep 13 16:52:15.574469 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2301/4673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:15 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 1451 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:15.775138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c3efb0e1-7fdb-4d78-8541-937de62ad287 req-20a67756-19aa-4fbb-9250-96828c07c3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44aeeee2-601c-4ebe-9d14-091430c94b72", "name": "network-vif-deleted", "tag": "31102bb1-487b-4e62-b694-c4847a31c198"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:15.817670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c3efb0e1-7fdb-4d78-8541-937de62ad287 req-20a67756-19aa-4fbb-9250-96828c07c3fd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:15.819298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c3efb0e1-7fdb-4d78-8541-937de62ad287 req-20a67756-19aa-4fbb-9250-96828c07c3fd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:15.820195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c3efb0e1-7fdb-4d78-8541-937de62ad287 req-20a67756-19aa-4fbb-9250-96828c07c3fd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:15.838916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:15.839623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:15.850939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:15.851491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:15.851964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:15.852792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:15.853458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:15.854288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:15.861052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c3efb0e1-7fdb-4d78-8541-937de62ad287 req-20a67756-19aa-4fbb-9250-96828c07c3fd service nova] Creating event network-vif-deleted:31102bb1-487b-4e62-b694-c4847a31c198 for instance 44aeeee2-601c-4ebe-9d14-091430c94b72 on n-h1-857467-1 Sep 13 16:52:15.877058 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c3efb0e1-7fdb-4d78-8541-937de62ad287 req-20a67756-19aa-4fbb-9250-96828c07c3fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367237 Sep 13 16:52:15.877684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2373/4674] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:52:15.989142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:16.000570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3794e9a5-592a-4519-80b2-22aca84cbe97 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1210 microversion: 2.1 time: 0.174203 Sep 13 16:52:16.019110 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2302/4675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:15 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:16.033041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:16.033884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:16.048087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.048587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.049030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.060691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.069440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.070120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.584201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:16.585127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:16.598333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.602436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.603008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.603876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.604641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.605170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.628775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 HTTP/1.1 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '44aeeee2-601c-4ebe-9d14-091430c94b72'} Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.630974 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.636253 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:16.636253 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:16.636253 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:16.636253 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:16.636253 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.636253 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.637948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:16.639980 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e41aaa00-a659-40a2-b2ab-da85659b2487 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 404 len: 111 microversion: 2.1 time: 0.060193 Sep 13 16:52:16.641094 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2303/4676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:16 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:16.664192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:16.677291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:16.695511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.704520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.705271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.712689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:16.722525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.723089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.723495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.729064 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57b67955-7538-4112-9e40-1312984a3161 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1467 microversion: 2.1 time: 0.702225 Sep 13 16:52:16.750413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2374/4677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:16 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1467 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:16.765886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-639856480"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:16.768689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:16.790472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.794404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.795215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.797390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.798202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.800905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.850116 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 HTTP/1.1 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '44aeeee2-601c-4ebe-9d14-091430c94b72'} Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:16.866950 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.871546 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.882857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:16.889729 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69298b52-f93d-4e71-a2de-b55a376d2a40 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 404 len: 111 microversion: 2.1 time: 0.234555 Sep 13 16:52:16.896838 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2304/4678] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:16 2022] DELETE /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:16.920825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:16.921466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 44aeeee2-601c-4ebe-9d14-091430c94b72] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:16.927751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.928502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.929803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.931064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.932405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.933012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.950685 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 HTTP/1.1 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '44aeeee2-601c-4ebe-9d14-091430c94b72'} Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.952907 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:16.957859 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:16.957859 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:16.957859 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:16.957859 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:16.957859 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. Sep 13 16:52:16.957859 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:16.959878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 44aeeee2-601c-4ebe-9d14-091430c94b72 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:16.960934 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-59888a4e-c4db-40ed-b79a-39f497477bf8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72" status: 404 len: 111 microversion: 2.1 time: 0.062253 Sep 13 16:52:16.961687 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2305/4679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:16 2022] GET /compute/v2.1/servers/44aeeee2-601c-4ebe-9d14-091430c94b72 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:16.970562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:16.971075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:16.977292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.978050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.978658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:16.980991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:16.981621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:16.982247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.015924 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 HTTP/1.1 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ca8a76f3-291d-45aa-8165-bdcac0c0d1a1'} Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.018233 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.022224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.034464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-333610cd-97e7-426b-a6a2-529a40ff8384 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 404 len: 111 microversion: 2.1 time: 0.055001 Sep 13 16:52:17.035137 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2306/4680] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:16 2022] DELETE /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.049384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.051411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.064658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.073249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.073685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.075900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.076965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.077417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.277567 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73779547-6e07-42ed-809e-32f96135f113 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "POST /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8/action" status: 202 len: 0 microversion: 2.1 time: 0.516957 Sep 13 16:52:17.281211 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2375/4681] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:52:16 2022] POST /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 13 16:52:17.306242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.311655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: ca8a76f3-291d-45aa-8165-bdcac0c0d1a1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.324571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.327159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.327876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.330395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.331704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.332299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.372043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 HTTP/1.1 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ca8a76f3-291d-45aa-8165-bdcac0c0d1a1'} Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.375766 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.380390 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.380390 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.380390 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.380390 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.380390 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. Sep 13 16:52:17.380390 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.381539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.382589 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-824e360f-bc44-4702-86dd-491ea177bbd8 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1" status: 404 len: 111 microversion: 2.1 time: 0.100201 Sep 13 16:52:17.383317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2376/4682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/servers/ca8a76f3-291d-45aa-8165-bdcac0c0d1a1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.391584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5a38dee-13fb-4d37-a7af-a9bd9135dbbe tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45e1550>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.463493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:17.491998 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5a38dee-13fb-4d37-a7af-a9bd9135dbbe tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.105018 Sep 13 16:52:17.492820 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2377/4683] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:17.493534 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b619867-7f84-47b3-8ff7-387472e6206a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1274 microversion: 2.1 time: 0.456725 Sep 13 16:52:17.498625 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2307/4684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1274 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:17.519624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.520454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.540441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.541256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.541874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.542767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.543383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.543967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.570615 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 HTTP/1.1 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1371b7e5-8c8a-475f-881c-b28b6af6b1c2'} Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.572876 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.578552 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.581228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.582579 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec393921-a340-49ee-8f1d-5b136446eed6 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 404 len: 111 microversion: 2.1 time: 0.085283 Sep 13 16:52:17.583321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2378/4685] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:17 2022] DELETE /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.594547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.599750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 1371b7e5-8c8a-475f-881c-b28b6af6b1c2] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.619105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.623927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.626084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.627678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.628407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.629067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.652130 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 HTTP/1.1 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '1371b7e5-8c8a-475f-881c-b28b6af6b1c2'} Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.654866 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.660223 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.660223 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.660223 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.660223 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.660223 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. Sep 13 16:52:17.660223 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.662595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 1371b7e5-8c8a-475f-881c-b28b6af6b1c2 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.663759 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9fc2d64e-6a71-42e0-8853-436bb8980b2a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2" status: 404 len: 111 microversion: 2.1 time: 0.073807 Sep 13 16:52:17.664923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2308/4686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/servers/1371b7e5-8c8a-475f-881c-b28b6af6b1c2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.674701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.675404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.686021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.689553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.690451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.692080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.692788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.693450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.712588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 HTTP/1.1 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '02e7e51b-5938-4a24-83d0-38c5ea3d3641'} Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.715708 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.723512 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.744491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.745523 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3564b3f6-2be1-483b-867f-1289f2267f8b tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 404 len: 111 microversion: 2.1 time: 0.076063 Sep 13 16:52:17.751003 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2379/4687] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:17 2022] DELETE /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.756419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.757257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 02e7e51b-5938-4a24-83d0-38c5ea3d3641] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.763424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.764538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.765666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.766417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.766886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.767482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.783739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 HTTP/1.1 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '02e7e51b-5938-4a24-83d0-38c5ea3d3641'} Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.785405 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 02e7e51b-5938-4a24-83d0-38c5ea3d3641 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e5dd5c04-1d5b-4616-998c-8cb0fdddb0fa tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641" status: 404 len: 111 microversion: 2.1 time: 0.034613 Sep 13 16:52:17.789493 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2309/4688] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/servers/02e7e51b-5938-4a24-83d0-38c5ea3d3641 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.796697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.797345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.803569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.804165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.804929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.805876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.806551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.807535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.839495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 HTTP/1.1 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37'} Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.841338 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.846553 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.848671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.849794 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-340082ce-43c7-4399-89d3-44e00f03eabc tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 404 len: 111 microversion: 2.1 time: 0.058086 Sep 13 16:52:17.850882 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2380/4689] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:17 2022] DELETE /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.861407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.862146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.880119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.881046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.882003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.883764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.884411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.885035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.903613 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 HTTP/1.1 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37'} Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.905544 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64788daa-dad4-4a06-8064-d909b7fc6634 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37" status: 404 len: 111 microversion: 2.1 time: 0.050265 Sep 13 16:52:17.915050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2310/4690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/servers/668c6d4f-e3ee-46e6-a2e0-cd72f3fb0e37 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:17.924986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:17.925774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:17.933034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.933956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.934619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.936842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:17.938199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:17.938855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:17.959414 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 HTTP/1.1 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '40537668-bb72-45b7-954c-b3d62cc22a38'} Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:17.962599 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:17.967572 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:17.971211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:17.972817 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba44c06a-780c-4090-bc37-0430781c22cf tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 404 len: 111 microversion: 2.1 time: 0.053142 Sep 13 16:52:17.990077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2381/4691] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:17 2022] DELETE /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:18.000315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.001011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: 40537668-bb72-45b7-954c-b3d62cc22a38] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:18.010108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.010877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.012614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.013679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.014704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.015839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.041410 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 HTTP/1.1 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '40537668-bb72-45b7-954c-b3d62cc22a38'} Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.043636 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.048579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:18.048579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:18.048579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:18.048579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:18.048579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. Sep 13 16:52:18.048579 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.051374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance 40537668-bb72-45b7-954c-b3d62cc22a38 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:18.052562 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0a6ef4e-e7dd-4c8d-a021-e341f6f1148d tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38" status: 404 len: 111 microversion: 2.1 time: 0.062446 Sep 13 16:52:18.053860 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2311/4692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:17 2022] GET /compute/v2.1/servers/40537668-bb72-45b7-954c-b3d62cc22a38 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:52:18.062334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7090be0c-9b5c-4802-a4fd-f600b713b10e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.062909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7090be0c-9b5c-4802-a4fd-f600b713b10e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d1bd3c14-869d-4148-943d-c89278158f15] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:18.072752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7090be0c-9b5c-4802-a4fd-f600b713b10e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7090be0c-9b5c-4802-a4fd-f600b713b10e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 HTTP/1.1 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd1bd3c14-869d-4148-943d-c89278158f15'} Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:18.074340 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7090be0c-9b5c-4802-a4fd-f600b713b10e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7090be0c-9b5c-4802-a4fd-f600b713b10e tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15" status: 404 len: 111 microversion: 2.1 time: 0.018025 Sep 13 16:52:18.079019 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2382/4693] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:18 2022] DELETE /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:18.085782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d7ba3a8-8e87-4039-81f5-27961b0f4cff tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.086653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d7ba3a8-8e87-4039-81f5-27961b0f4cff tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d1bd3c14-869d-4148-943d-c89278158f15] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:18.093476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8d7ba3a8-8e87-4039-81f5-27961b0f4cff tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d7ba3a8-8e87-4039-81f5-27961b0f4cff tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 HTTP/1.1 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd1bd3c14-869d-4148-943d-c89278158f15'} Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:18.095414 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d7ba3a8-8e87-4039-81f5-27961b0f4cff tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance d1bd3c14-869d-4148-943d-c89278158f15 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d7ba3a8-8e87-4039-81f5-27961b0f4cff tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15" status: 404 len: 111 microversion: 2.1 time: 0.015469 Sep 13 16:52:18.099307 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2312/4694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:18 2022] GET /compute/v2.1/servers/d1bd3c14-869d-4148-943d-c89278158f15 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:18.115437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.115950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:18.133492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.135470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.135993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.138357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.140873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.142727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.180031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:52:18.375121 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce85028e-c93f-49d6-9005-e0114fced057 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 204 len: 0 microversion: 2.1 time: 0.271791 Sep 13 16:52:18.384890 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2383/4695] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:18 2022] DELETE /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:52:18.385917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.386593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:18.406074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.406617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.407002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.407708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.408395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.408832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.523845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2ebcf94-6b7c-4357-8da3-d8bb9a180051 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb582d5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.615303 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2ebcf94-6b7c-4357-8da3-d8bb9a180051 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.097752 Sep 13 16:52:18.618788 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2384/4696] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:18 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:18.628455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:18.630192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:18.639174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.640089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.640784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.642134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:18.643663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:18.644471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:18.758886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:18.772079 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2795428f-502a-4e2c-b095-51135555e978 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1479 microversion: 2.1 time: 0.390110 Sep 13 16:52:18.782380 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2313/4697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:18 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1479 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:18.983148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:18.992167 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cbc42a5-0143-4957-9049-87d52821a913 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.371841 Sep 13 16:52:18.996053 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2385/4698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:18 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:19.638117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33568988-ca15-4bc2-a9e3-fbc104670c6e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a1d0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:19.681135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-bc2511da-391e-44d5-8aef-ea905d65acf7 req-fa57a9d9-9272-4ced-b4d3-de69eae5fa82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c2ae7a-83cc-4182-a6d3-020a00bc333e", "name": "network-vif-unplugged", "status": "completed", "tag": "b57d7ddb-d6ef-4416-a6db-fda9170363ec"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:19.699700 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33568988-ca15-4bc2-a9e3-fbc104670c6e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.069319 Sep 13 16:52:19.707804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bc2511da-391e-44d5-8aef-ea905d65acf7 req-fa57a9d9-9272-4ced-b4d3-de69eae5fa82 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:19.708822 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2314/4699] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:19 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:19.709196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bc2511da-391e-44d5-8aef-ea905d65acf7 req-fa57a9d9-9272-4ced-b4d3-de69eae5fa82 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:19.709816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bc2511da-391e-44d5-8aef-ea905d65acf7 req-fa57a9d9-9272-4ced-b4d3-de69eae5fa82 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:19.725812 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-bc2511da-391e-44d5-8aef-ea905d65acf7 req-fa57a9d9-9272-4ced-b4d3-de69eae5fa82 service nova] Creating event network-vif-unplugged:b57d7ddb-d6ef-4416-a6db-fda9170363ec for instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e on n-h2-857467-1 Sep 13 16:52:19.735452 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-bc2511da-391e-44d5-8aef-ea905d65acf7 req-fa57a9d9-9272-4ced-b4d3-de69eae5fa82 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062348 Sep 13 16:52:19.736520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2386/4700] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:19.804196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:19.805566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:19.819107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:19.821611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:19.823524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:19.823524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:19.825095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:19.825727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:19.827042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:20.025449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:20.026480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:20.048249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:20.049044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:20.049629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:20.050382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:20.050843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:20.068908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:20.073607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:20.350110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:20.366901 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca969190-f0e6-4934-88d7-ac5e4144af6f tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1479 microversion: 2.1 time: 0.568002 Sep 13 16:52:20.367509 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2315/4701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:19 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1479 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:20.538795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:20.558999 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a46d4bd-06f0-4245-bbc2-d3c1fd7f0c1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.538671 Sep 13 16:52:20.559984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2387/4702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:20 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:20.715611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fb535346-8234-4637-b05d-758a4685f24d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4e5c0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:20.777517 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fb535346-8234-4637-b05d-758a4685f24d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.065746 Sep 13 16:52:20.778718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2316/4703] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:20 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:21.390228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:21.391516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:21.408339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:21.412741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:21.413195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:21.413962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:21.414426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:21.414864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:21.585738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:21.587077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:21.599964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:21.600837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:21.601551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:21.603582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:21.605058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:21.607931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:21.617495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:21.627312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9eb7d9c-eb25-4813-9952-f0ad7fff95e4 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1437 microversion: 2.1 time: 0.241620 Sep 13 16:52:21.632759 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2388/4704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:21 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1437 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:21.724569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e2df3959-e4c9-47fc-97e2-cc8d15c2c398 req-77bf1916-9e57-4728-ad35-681ecf1ba8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a41c4e-8fa2-4ce1-807a-284c34db7b92", "name": "network-vif-deleted", "tag": "9776e2c8-1929-4e1b-a8e3-5a5b6797bd03"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:21.735861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e2df3959-e4c9-47fc-97e2-cc8d15c2c398 req-77bf1916-9e57-4728-ad35-681ecf1ba8b8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:21.736599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e2df3959-e4c9-47fc-97e2-cc8d15c2c398 req-77bf1916-9e57-4728-ad35-681ecf1ba8b8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:21.737435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e2df3959-e4c9-47fc-97e2-cc8d15c2c398 req-77bf1916-9e57-4728-ad35-681ecf1ba8b8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:21.762462 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e2df3959-e4c9-47fc-97e2-cc8d15c2c398 req-77bf1916-9e57-4728-ad35-681ecf1ba8b8 service nova] Creating event network-vif-deleted:9776e2c8-1929-4e1b-a8e3-5a5b6797bd03 for instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 on n-h1-857467-1 Sep 13 16:52:21.771633 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e2df3959-e4c9-47fc-97e2-cc8d15c2c398 req-77bf1916-9e57-4728-ad35-681ecf1ba8b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052909 Sep 13 16:52:21.772782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2389/4705] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:21.796986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c2d1ce6-57a7-4874-911f-83c83482af37 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a89d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:21.896720 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c2d1ce6-57a7-4874-911f-83c83482af37 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.106354 Sep 13 16:52:21.899785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2390/4706] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:21 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:22.514541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:22.525150 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f072381d-9688-47e1-ac09-b02a2a4614e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.945946 Sep 13 16:52:22.541093 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2317/4707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:21 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:22.659379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:22.660119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:22.682875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:22.683381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:22.683828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:22.684541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:22.685250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:22.686634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:22.816432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:22.817592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:22.818389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:22.819015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lazy-loading 'fault' on Instance uuid d2a41c4e-8fa2-4ce1-807a-284c34db7b92 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:52:22.916247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-448caf82-10c1-4a57-acbc-3e24290e01e9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a1dc10>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:22.994275 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-448caf82-10c1-4a57-acbc-3e24290e01e9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.082044 Sep 13 16:52:22.999404 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2318/4708] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:22 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:23.016903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:23.016903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:23.034547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.035050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.035502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.036226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.036688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.037119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.106773 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e45ba94-7ba3-47ad-9f2d-90e016c1e691 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.105889 Sep 13 16:52:23.107543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2319/4709] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:52:22 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:23.191310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121bd2b9dfb8482da3a82d193a40261c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2706957b26482dbf1b961588ebb52c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:23.232569 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f81d14d-183d-4b20-8342-7809ebc3fd6a tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 200 len: 1282 microversion: 2.1 time: 0.578476 Sep 13 16:52:23.240747 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2391/4710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:22 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 1282 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:23.262139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:23.262634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:23.275072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.278094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.278966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.282606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.283367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.284051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.362554 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-096286d5-bc96-49d1-951c-1bc2dd5c6b46 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/9b84a945-6888-46e3-aeb2-280b73622547" status: 200 len: 194 microversion: 2.1 time: 0.106095 Sep 13 16:52:23.365776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2320/4711] 10.222.0.61 () {58 vars in 1413 bytes} [Tue Sep 13 16:52:23 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/9b84a945-6888-46e3-aeb2-280b73622547 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:23.376723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:23.377238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:23.390795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.391537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.392144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.393182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.393847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.395773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.537305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lazy-loading 'services' on Instance uuid 7b977f7c-ae5d-4018-b738-a59455646029 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:52:23.552325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:23.555195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:23.571175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.576178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.577058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.578384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.579029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.579641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.677234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58ab094e-d6e5-43d3-b8d5-c8e3f0b01ef2 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/9b84a945-6888-46e3-aeb2-280b73622547" status: 202 len: 0 microversion: 2.1 time: 0.304805 Sep 13 16:52:23.681919 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2392/4712] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:52:23 2022] DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/9b84a945-6888-46e3-aeb2-280b73622547 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:52:23.819569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-49a0e68f-a9f4-4aea-a41a-4dc1f8569c12 req-91aaf77d-03bd-41e0-be7d-fea0946d98c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a59874a-c8d0-466a-9ad9-79571f19c221", "tag": "2916652f-3ae7-4192-b63a-b871a2c7bc5d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:23.838308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49a0e68f-a9f4-4aea-a41a-4dc1f8569c12 req-91aaf77d-03bd-41e0-be7d-fea0946d98c2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:23.838799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49a0e68f-a9f4-4aea-a41a-4dc1f8569c12 req-91aaf77d-03bd-41e0-be7d-fea0946d98c2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:23.839235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-49a0e68f-a9f4-4aea-a41a-4dc1f8569c12 req-91aaf77d-03bd-41e0-be7d-fea0946d98c2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:23.862757 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-49a0e68f-a9f4-4aea-a41a-4dc1f8569c12 req-91aaf77d-03bd-41e0-be7d-fea0946d98c2 service nova] Creating event network-changed:2916652f-3ae7-4192-b63a-b871a2c7bc5d for instance 6a59874a-c8d0-466a-9ad9-79571f19c221 on n-h2-857467-1 Sep 13 16:52:23.868318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-49a0e68f-a9f4-4aea-a41a-4dc1f8569c12 req-91aaf77d-03bd-41e0-be7d-fea0946d98c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052569 Sep 13 16:52:23.869612 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2393/4713] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:52:23.909478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:23.922569 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb8c5746-c82a-43f9-8d7f-d5db9a0c7565 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.374697 Sep 13 16:52:23.924002 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2321/4714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:23 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:24.031824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c6891c2-1629-41ff-83dd-e09df05d7dfe tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a89d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:24.143296 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c6891c2-1629-41ff-83dd-e09df05d7dfe tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.130525 Sep 13 16:52:24.143911 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2394/4715] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:24 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:24.269729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:24.270420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] [instance: d2a41c4e-8fa2-4ce1-807a-284c34db7b92] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:24.284435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:24.288254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:24.288651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:24.290195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:24.290690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:24.291108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:24.322557 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] HTTP exception thrown: Instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 could not be found. Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Request method failure captured: Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 HTTP/1.1 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILROLmgNwCalVSfxtQOH0qF_ucT4ojwiiil4nt6Pka8Hk-Ykewz8x2vVN7dlVapbrjvjleBabLHuWwJhtNfbfP_C9CpEhvaLOFatY-JxO2vaF5Fh7ejIXJccZzycnNpLd8-NsvzCKn1mvcxp2cywkc1bmblmskhAL74aG8Xwy7pausc Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2706957b26482dbf1b961588ebb52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersTestJSON-404299290 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 9b2706957b26482dbf1b961588ebb52c Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersTestJSON-404299290 Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersTestJSON-404299290-project Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 121bd2b9dfb8482da3a82d193a40261c Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersTestJSON-404299290-project Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 could not be found. Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd2a41c4e-8fa2-4ce1-807a-284c34db7b92'} Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 could not be found. Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 could not be found. Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:24.324054 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:24.329504 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:24.329504 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:24.329504 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:24.329504 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:24.329504 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 could not be found. Sep 13 16:52:24.329504 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:24.331291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] Returning 404 to user: Instance d2a41c4e-8fa2-4ce1-807a-284c34db7b92 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:24.332399 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c175507-abd0-423a-8036-f0f093243633 tempest-ServersTestJSON-404299290 tempest-ServersTestJSON-404299290-project] 10.222.0.61 "GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92" status: 404 len: 111 microversion: 2.1 time: 0.067558 Sep 13 16:52:24.333997 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2322/4716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:24 2022] GET /compute/v2.1/servers/d2a41c4e-8fa2-4ce1-807a-284c34db7b92 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:52:24.948402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:24.949070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:24.959253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:24.967482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:24.969670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:24.970162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:24.970928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:24.975098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:24.975640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:25.170937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f08244b9-5207-4456-a7e6-3d5750d2e3fd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4e5c8b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:25.185725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:25.203954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:25.247995 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f08244b9-5207-4456-a7e6-3d5750d2e3fd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.087400 Sep 13 16:52:25.250096 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2323/4717] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:25 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:25.342549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:25.359809 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1644d2c-fa2a-4c0f-904b-edc052f7bdaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.415989 Sep 13 16:52:25.361135 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2395/4718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:24 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:25.784846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-21a62a5a-b70f-4a35-a092-691f41b63177 req-308f8312-3466-4bed-b816-139160253b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "name": "network-vif-plugged", "status": "completed", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:25.809973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-21a62a5a-b70f-4a35-a092-691f41b63177 req-308f8312-3466-4bed-b816-139160253b02 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:25.810876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-21a62a5a-b70f-4a35-a092-691f41b63177 req-308f8312-3466-4bed-b816-139160253b02 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:25.812053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-21a62a5a-b70f-4a35-a092-691f41b63177 req-308f8312-3466-4bed-b816-139160253b02 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:25.826176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-21a62a5a-b70f-4a35-a092-691f41b63177 req-308f8312-3466-4bed-b816-139160253b02 service nova] Creating event network-vif-plugged:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:52:25.851653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-21a62a5a-b70f-4a35-a092-691f41b63177 req-308f8312-3466-4bed-b816-139160253b02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074571 Sep 13 16:52:25.854055 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2324/4719] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:26.275240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1647860-19b7-4f43-9445-139e3a23c83d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a5940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:26.348808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1647860-19b7-4f43-9445-139e3a23c83d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.083293 Sep 13 16:52:26.349422 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2396/4720] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:26 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:26.383365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:26.384749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:26.402952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:26.404618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:26.405576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:26.418958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:26.430077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:26.431014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:26.953307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:26.962083 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4fbdb497-08d1-467b-b24a-1c991c8c6c07 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.583255 Sep 13 16:52:26.967557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2325/4721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:26 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:27.366447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3fc4e18-80b7-49d4-bdef-5515dcc017ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a8040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:27.496989 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3fc4e18-80b7-49d4-bdef-5515dcc017ac tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.135182 Sep 13 16:52:27.499155 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2397/4722] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:27 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:27.991216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:27.991834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:28.001763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:28.007898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:28.009288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:28.016098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:28.017569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:28.018671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:28.523201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-129d9c7b-3a4f-4841-85bb-9373102db8c8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45dbdc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:28.623860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-129d9c7b-3a4f-4841-85bb-9373102db8c8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.114543 Sep 13 16:52:28.626895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2398/4723] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:28 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:28.908341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:28.915779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:28.918476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ab965a4-cce9-411e-a5a6-f133aa5950c9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.931446 Sep 13 16:52:28.923649 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2326/4724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:27 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:29.643146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-397e76c5-2123-4937-9c07-2b3617c9bed9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb95cdb80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:29.803533 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-397e76c5-2123-4937-9c07-2b3617c9bed9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.166800 Sep 13 16:52:29.812172 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2399/4725] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:29 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:29.947054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:29.947691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:29.969950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:29.970638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:29.971088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:29.982112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:29.982809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:29.983571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:30.644249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-20ab590f-0bf2-4b3e-ad19-262c9745056e req-f90dde24-f9a1-4dce-b57a-218e0c150b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a59874a-c8d0-466a-9ad9-79571f19c221", "name": "network-vif-plugged", "status": "completed", "tag": "2916652f-3ae7-4192-b63a-b871a2c7bc5d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:30.673204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-20ab590f-0bf2-4b3e-ad19-262c9745056e req-f90dde24-f9a1-4dce-b57a-218e0c150b4b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:30.675516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-20ab590f-0bf2-4b3e-ad19-262c9745056e req-f90dde24-f9a1-4dce-b57a-218e0c150b4b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:30.675980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-20ab590f-0bf2-4b3e-ad19-262c9745056e req-f90dde24-f9a1-4dce-b57a-218e0c150b4b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:30.732580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-20ab590f-0bf2-4b3e-ad19-262c9745056e req-f90dde24-f9a1-4dce-b57a-218e0c150b4b service nova] Creating event network-vif-plugged:2916652f-3ae7-4192-b63a-b871a2c7bc5d for instance 6a59874a-c8d0-466a-9ad9-79571f19c221 on n-h2-857467-1 Sep 13 16:52:30.746694 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-20ab590f-0bf2-4b3e-ad19-262c9745056e req-f90dde24-f9a1-4dce-b57a-218e0c150b4b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106706 Sep 13 16:52:30.753769 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2400/4726] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:52:30.846593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38a9ba35-0e70-4f7b-ac8d-b7c2d20a1df7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a5160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:30.955151 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38a9ba35-0e70-4f7b-ac8d-b7c2d20a1df7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.131761 Sep 13 16:52:30.956338 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2401/4727] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:30 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:31.160162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:31.187961 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4607241b-0062-4b24-9dfe-d9b98fb9f9f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 1.245284 Sep 13 16:52:31.188915 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2327/4728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:29 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:31.972565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08f2cb28-f5b3-4218-849f-351788476b91 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45c7b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:32.050867 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08f2cb28-f5b3-4218-849f-351788476b91 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.083699 Sep 13 16:52:32.051396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2402/4729] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:31 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:32.221354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:32.276764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:32.289181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:32.290222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:32.291333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:32.292252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:32.292933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:32.293535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:33.073996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be7ecaa1-6c1d-441e-83b7-8bd289c909d5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb461b790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:33.098424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:33.134415 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c63cd4f-2393-41df-b550-ffb0c5e59739 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1314 microversion: 2.1 time: 0.917608 Sep 13 16:52:33.144701 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2328/4730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:32 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:33.202854 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be7ecaa1-6c1d-441e-83b7-8bd289c909d5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.137935 Sep 13 16:52:33.204936 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2403/4731] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:33 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:33.886721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:33.887870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:33.897314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:33.898127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:33.899074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:33.900367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:33.901038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:33.901778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:33.958969 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7af92127-ef54-4b61-a634-2104dab8868a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/f3b44374-8096-4244-a723-3fa5387010d7" status: 200 len: 194 microversion: 2.1 time: 0.079875 Sep 13 16:52:33.972158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:33.973026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:33.976638 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2329/4732] 10.222.0.61 () {58 vars in 1413 bytes} [Tue Sep 13 16:52:33 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/f3b44374-8096-4244-a723-3fa5387010d7 => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:33.986541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:33.987264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:33.987861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:33.988762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:33.989378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:33.990029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:34.163832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:34.165073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:34.178629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:34.179430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:34.181307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:34.184126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:34.186009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:34.187190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:34.275048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lazy-loading 'services' on Instance uuid 7b977f7c-ae5d-4018-b738-a59455646029 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:52:34.433714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4cc3ca2e-9447-426c-9ee7-dc2eb0ca846b tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/f3b44374-8096-4244-a723-3fa5387010d7" status: 202 len: 0 microversion: 2.1 time: 0.466786 Sep 13 16:52:34.434805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2404/4733] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:52:33 2022] DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments/f3b44374-8096-4244-a723-3fa5387010d7 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:52:34.465010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3790252-1b4a-4893-a97e-8c9277618cc5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45c78b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:34.563730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3790252-1b4a-4893-a97e-8c9277618cc5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.127317 Sep 13 16:52:34.564345 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2405/4734] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:34 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:34.613148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:34.631362 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00b2c813-2800-4bd6-907f-9560ce426c18 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1500 microversion: 2.1 time: 0.472241 Sep 13 16:52:34.643112 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2330/4735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:34 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1500 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:34.662321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b8c77f5a-52ca-42b3-9bb8-7bbf7fd62f86 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:34.670750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c77f5a-52ca-42b3-9bb8-7bbf7fd62f86 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:34.671420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c77f5a-52ca-42b3-9bb8-7bbf7fd62f86 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:34.672057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c77f5a-52ca-42b3-9bb8-7bbf7fd62f86 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:34.721765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8c77f5a-52ca-42b3-9bb8-7bbf7fd62f86 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Going to try to stop instance {{(pid=122328) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:52:34.895459 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b8c77f5a-52ca-42b3-9bb8-7bbf7fd62f86 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221/action" status: 202 len: 0 microversion: 2.1 time: 0.236819 Sep 13 16:52:34.900476 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2406/4736] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:52:34 2022] POST /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:52:34.906291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:34.907506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:34.915212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:34.921622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:34.922580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:34.923549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:34.924299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:34.925063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:35.411566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:35.420671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36f9fbb4-a0ab-488a-8d21-1847c28609a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.518734 Sep 13 16:52:35.421270 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2331/4737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:34 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:35.588419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e8831f8-1d76-4be9-886e-818acc58e8f6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4556040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:35.700407 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e8831f8-1d76-4be9-886e-818acc58e8f6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.117533 Sep 13 16:52:35.707920 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2407/4738] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:35 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:36.447862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:36.449155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:36.457699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:36.458552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:36.459205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:36.460121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:36.460784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:36.461459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:36.717777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ac7951a-6a42-46f4-916c-5c36ed86c297 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45581f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:36.738666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:36.748389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe6e6b6e-eff4-4d1e-a516-d0cfa9b51da9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.303787 Sep 13 16:52:36.768580 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2332/4739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:36 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:36.824468 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ac7951a-6a42-46f4-916c-5c36ed86c297 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.111706 Sep 13 16:52:36.825640 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2408/4740] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:36 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:37.774994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:37.775623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:37.787889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:37.791771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:37.792284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:37.793110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:37.793538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:37.794013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:37.842731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10c6a3f1-c6cb-44a6-8d2a-15aedc8c68ec tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb456fca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:37.947856 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10c6a3f1-c6cb-44a6-8d2a-15aedc8c68ec tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.111141 Sep 13 16:52:37.949149 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2409/4741] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:37 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:38.199480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:38.211785 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f076badc-50ad-4731-a0fc-63f8b09b7bd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.441154 Sep 13 16:52:38.215921 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2333/4742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:37 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:39.019432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6fb0b72-beea-42a8-8ab0-803f6445f1b0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb461b160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:39.159369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6fb0b72-beea-42a8-8ab0-803f6445f1b0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.172561 Sep 13 16:52:39.165148 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2410/4743] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:38 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:39.243310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:39.244562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:39.259092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:39.259873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:39.260527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:39.264491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:39.265403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:39.268130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:40.181720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-02a97fc7-dd91-415e-9410-d22234de017f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb96fb670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:40.313595 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-02a97fc7-dd91-415e-9410-d22234de017f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.136697 Sep 13 16:52:40.315567 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2411/4744] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:40 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:40.515249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:40.530530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-82a7ad33-e22c-456a-ad37-cff788ec2396 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 1.291389 Sep 13 16:52:40.531009 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2334/4745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:39 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:41.331501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12a9e369-7d61-42ed-80da-bd4177e49d0e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4558670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:41.434159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12a9e369-7d61-42ed-80da-bd4177e49d0e tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.109133 Sep 13 16:52:41.435482 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2412/4746] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:41 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:41.558031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:41.558661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:41.583698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:41.584487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:41.585107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:41.586041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:41.586674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:41.592979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:42.461666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-483598a5-64d0-44d0-b971-e94a222d9ca8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb453e430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:42.545392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-483598a5-64d0-44d0-b971-e94a222d9ca8 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.098576 Sep 13 16:52:42.546328 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2413/4747] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:42 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:43.484972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:43.493736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2346838a-2d9d-4a18-b4aa-d2094d5cebb9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 1.939670 Sep 13 16:52:43.501174 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2335/4748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:41 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:43.562693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6464c5e-efee-4d71-ae26-7ed905ea03f6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb50ce430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:43.650029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6464c5e-efee-4d71-ae26-7ed905ea03f6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.087528 Sep 13 16:52:43.650964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2414/4749] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:43 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:44.536373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:44.544795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:44.582201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:44.582714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:44.583171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:44.583907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:44.584375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:44.584825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:44.666915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30bb16a5-be20-437d-b114-8f8ac4a60204 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb458c940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:44.683723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:44.791288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30bb16a5-be20-437d-b114-8f8ac4a60204 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.128149 Sep 13 16:52:44.791831 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2415/4750] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:44 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:45.203553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:45.205972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:45.221446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:45.223543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:45.224044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:45.224488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:45.225417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:45.226107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:45.227127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:45.313420 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12c51d51-7ffa-41de-a73f-45567fa64e33 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114018 Sep 13 16:52:45.319689 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2416/4751] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:52:45 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:52:45.351033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:45.399523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15139879-06ef-4e99-b96a-ba8b34a1bc70 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.875158 Sep 13 16:52:45.432459 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2336/4752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:44 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:45.606269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:45.608860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:45.638828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:45.639510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:45.640174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:45.641024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:45.646377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:45.647204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:45.744509 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99d93afd-b259-4424-aa6f-ae37f2ac6e6e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142148 Sep 13 16:52:45.751550 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2417/4753] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:52:45 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:52:45.808223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-22fdec81-ce67-4d7e-84bc-5bb50f94bca9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4cd7a60>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:45.874481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:45.875366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:45.893300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:45.893809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:45.894282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:45.895258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:45.895890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:45.896492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:45.939048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:52:45.961432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-22fdec81-ce67-4d7e-84bc-5bb50f94bca9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.157094 Sep 13 16:52:45.962601 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2337/4754] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:45 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:46.152642 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a03ca2d5-19ac-4f8c-b327-ec2a943af3c7 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 204 len: 0 microversion: 2.1 time: 0.290365 Sep 13 16:52:46.157880 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2418/4755] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:52:45 2022] DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:52:46.163728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:46.164448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:46.188724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:46.190004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:46.190768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:46.191771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:46.192658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:46.193591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:46.444326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:46.444326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:46.461300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:46.462388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:46.464450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:46.468119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:46.468702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:46.470439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:47.310747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:47.324223 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b864c33b-6489-45df-a469-7a3bdd1b77cb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1671 microversion: 2.1 time: 1.165733 Sep 13 16:52:47.327109 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2338/4756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:46 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1671 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:47.335908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92c0e5eb-afc4-47bd-a2de-00bc4d646170 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a3c9d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:47.446915 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92c0e5eb-afc4-47bd-a2de-00bc4d646170 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.114617 Sep 13 16:52:47.456035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2339/4757] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:47 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:47.498291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:47.509124 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f82b4240-64e6-4b15-99d6-82fbf789b22e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 1.070512 Sep 13 16:52:47.509716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2419/4758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:46 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:48.355942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:48.356634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:48.377448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:48.379878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:48.380591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:48.381499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:48.383983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:48.384632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:48.463755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67d51850-e4bb-405d-9bcf-6ee7b4ceb9f5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45581f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:48.552149 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67d51850-e4bb-405d-9bcf-6ee7b4ceb9f5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.092152 Sep 13 16:52:48.554270 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2420/4759] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:48 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:48.573714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:48.574949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:48.591920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:48.593043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:48.593759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:48.597954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:48.598892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:48.599575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:49.523537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:49.544949 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa763c81-9763-421f-b5b7-2127e76ca375 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1671 microversion: 2.1 time: 1.194788 Sep 13 16:52:49.546007 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2340/4760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:48 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1671 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:49.573505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-380ea0d8-e417-407b-bb72-0007930f8694 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4add670>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:49.650043 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-380ea0d8-e417-407b-bb72-0007930f8694 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.082897 Sep 13 16:52:49.653270 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2341/4761] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:49 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:49.754770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:49.775594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4807cc67-dedb-4440-b619-a8e5fe6737b0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 1.218062 Sep 13 16:52:49.778091 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2421/4762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:48 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:50.571817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:50.573425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:50.584085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=42 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:50.587460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:50.590005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:50.594355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:50.595768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:50.596458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:50.597074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:50.670121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b677e6b-7abd-4cd6-aa2c-3fed3c56478f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb48aa5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:50.780556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b677e6b-7abd-4cd6-aa2c-3fed3c56478f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.115845 Sep 13 16:52:50.790064 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2422/4763] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:50 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:50.802806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:50.803429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:50.820124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:50.821042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:50.821715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:50.823355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:50.827590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:50.828480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:51.054669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:51.064359 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-10f8ac8f-b9e1-4d62-b819-c4ea214cd5ea tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1671 microversion: 2.1 time: 0.497236 Sep 13 16:52:51.086683 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2342/4764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:50 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1671 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:51.472823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:51.485419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6593c7e7-b44e-4cdf-9d48-10861ebcbdeb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.684205 Sep 13 16:52:51.487461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2423/4765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:50 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:51.802593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d9196f2-4bf5-40ed-961b-f43a808aab84 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a73430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:51.929134 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d9196f2-4bf5-40ed-961b-f43a808aab84 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.136503 Sep 13 16:52:51.931513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2343/4766] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:51 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:52.096495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:52.097097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:52.117757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:52.118330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:52.118796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:52.119553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:52.120014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:52.120443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:52.363087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:52.382478 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90edea5a-8578-4e94-9dcf-9e6ba0a6d79c tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1603 microversion: 2.1 time: 0.288083 Sep 13 16:52:52.387368 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2424/4767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:52 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1603 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:52.517063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:52.517961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:52.536647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:52.539026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:52.541182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:52.543206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:52.546132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:52.546821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:52.951308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d6509b4-a8d9-42d9-a617-3fe84cbf809f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45949d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:53.098698 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d6509b4-a8d9-42d9-a617-3fe84cbf809f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.155175 Sep 13 16:52:53.103505 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2425/4768] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:52 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:53.416405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:53.417403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:53.447735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:53.455490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:53.456429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:53.459402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:53.460201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:53.461542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:53.725178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:53.798724 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99cc0e0d-b49a-4ccc-8f4e-76259d49cf55 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1603 microversion: 2.1 time: 0.388016 Sep 13 16:52:53.802939 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2426/4769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:53 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1603 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:53.942136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:53.963652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d547469f-c8ba-4663-9c68-9545b964a981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 1.449136 Sep 13 16:52:53.967719 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2344/4770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:52 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:54.118572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f311ace7-e3f2-4135-bea9-b48cb9f938c3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb458ce50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:54.180923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-67cbcf49-48fa-4ae6-a7de-b0cbc562f62b req-a67418d3-362c-4c16-9965-d22471daeb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b977f7c-ae5d-4018-b738-a59455646029", "name": "network-vif-deleted", "tag": "ffca52ed-fa81-47b9-ad26-30fee6da8c36"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:54.223135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-67cbcf49-48fa-4ae6-a7de-b0cbc562f62b req-a67418d3-362c-4c16-9965-d22471daeb57 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:54.226242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-67cbcf49-48fa-4ae6-a7de-b0cbc562f62b req-a67418d3-362c-4c16-9965-d22471daeb57 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:54.230218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-67cbcf49-48fa-4ae6-a7de-b0cbc562f62b req-a67418d3-362c-4c16-9965-d22471daeb57 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:54.279112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-67cbcf49-48fa-4ae6-a7de-b0cbc562f62b req-a67418d3-362c-4c16-9965-d22471daeb57 service nova] Creating event network-vif-deleted:ffca52ed-fa81-47b9-ad26-30fee6da8c36 for instance 7b977f7c-ae5d-4018-b738-a59455646029 on n-h1-857467-1 Sep 13 16:52:54.285910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f311ace7-e3f2-4135-bea9-b48cb9f938c3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.171461 Sep 13 16:52:54.287230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2427/4771] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:54 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:54.296882 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-67cbcf49-48fa-4ae6-a7de-b0cbc562f62b req-a67418d3-362c-4c16-9965-d22471daeb57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128730 Sep 13 16:52:54.304194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2345/4772] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:54.839260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:54.842796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:54.866718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:54.871132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:54.871591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:54.872919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:54.873396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:54.873861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:54.915287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-648090929", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:52:54.998497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:55.009657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:55.010241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:55.010933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lazy-loading 'fault' on Instance uuid 7b977f7c-ae5d-4018-b738-a59455646029 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:52:55.020531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] validate_networks() for [('52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:52:55.168331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2620846244d4943925ca47225a9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266bcfc04bec48c897f828ed06a1e7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:55.181518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cdc25349-cfec-473c-8daf-18686707d51d tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 200 len: 1325 microversion: 2.1 time: 0.358996 Sep 13 16:52:55.200375 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2346/4773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:54 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:55.229887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:55.234916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:55.279655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:55.280487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:55.282827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:55.283771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:55.285984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:55.288510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:55.636988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:55.640523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:52:55.655550 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f98bbd49-0183-488c-a928-3d66b6cf5c89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.451835 Sep 13 16:52:55.657056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2347/4774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:55 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:55.666163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06cfd70a-b0ed-4d76-9804-eeee9ff07783 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4ad9af0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:55.754333 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06cfd70a-b0ed-4d76-9804-eeee9ff07783 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1452 microversion: 2.1 time: 0.094654 Sep 13 16:52:55.755498 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2348/4775] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:55 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:56.228668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:56.234129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:56.266136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:56.267172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:56.270338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:56.271248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:56.272206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:56.274087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:56.306037 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] HTTP exception thrown: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Request method failure captured: Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 HTTP/1.1 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILNgbAMBbrpTNiJvgmPrLmfeTQjCs6eVT6ZYXzKtX33Um_U9keB1U9wrDPkVnsmE8xxqgG8yGuQ2igaMOG1OJRXU_DhVucSnFZr-Y57ASNy7kI7ox_wTes-AkHmzCx34gTeOT_CXMgwTxu9iuKxfgiUFUIeA70IUyaVu2Zyl_QjLmCk Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: e2620846244d4943925ca47225a9eb36 Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7b977f7c-ae5d-4018-b738-a59455646029'} Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:52:56.309445 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:52:56.315583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Returning 404 to user: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:52:56.317182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f93c03ee-1aee-41c3-9d0d-523d02cb5d4f tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 404 len: 111 microversion: 2.1 time: 0.102579 Sep 13 16:52:56.318913 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2349/4776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:56 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:52:56.329089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ba35bd89-f9d0-4929-a432-1a6aea8115eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '.version_select at 0x7fbeb4adddc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:56.368232 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ba35bd89-f9d0-4929-a432-1a6aea8115eb tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51701182" status: 202 len: 0 microversion: 2.1 time: 0.044975 Sep 13 16:52:56.369650 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2350/4777] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Sep 13 16:52:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51701182 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:52:56.401203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:52:56.402382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:52:56.403081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:52:56.404232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:52:56.404936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:52:56.426355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:56.428987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:56.429617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:56.431478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:56.434899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:56.438265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:56.515583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Getting quotas for project 74b38fb1b5ed4c3daa5ff12d3c2239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:52:56.527718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Getting quotas for user 156a39f4db5f465da2c19d927fc0b8f2 and project 74b38fb1b5ed4c3daa5ff12d3c2239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:52:56.586539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:52:56.591758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:52:56.680425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:56.681031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:56.693798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:56.694751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:56.695422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:56.696362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:56.697042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:56.697691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:56.758780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f03c34ec-6b79-4b2e-9b44-ba2114ea960b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223768 Sep 13 16:52:56.761130 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2428/4778] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:52:56.802450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-714f3006-c9fd-40df-8808-268bdb6e8e47 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a8c10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:56.910022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-714f3006-c9fd-40df-8808-268bdb6e8e47 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1461 microversion: 2.1 time: 0.139081 Sep 13 16:52:56.910731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2429/4779] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:56 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1461 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:56.937216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3066952e-eeb8-4131-9ae3-e6bb0ccaf9bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:56.937886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3066952e-eeb8-4131-9ae3-e6bb0ccaf9bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:57.182989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3066952e-eeb8-4131-9ae3-e6bb0ccaf9bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:57.193755 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3066952e-eeb8-4131-9ae3-e6bb0ccaf9bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1216 microversion: 2.1 time: 0.281157 Sep 13 16:52:57.217393 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2430/4780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:56 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1216 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:57.235842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9553a908-7ee4-423d-b3f4-64e39ba227c2 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45c7a60>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:57.307425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9553a908-7ee4-423d-b3f4-64e39ba227c2 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 200 len: 1461 microversion: 2.1 time: 0.087690 Sep 13 16:52:57.308019 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2431/4781] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:52:57 2022] GET /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:57.322591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:57.330348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:57.353114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:57.353750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:57.354407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:57.360731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:57.360731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:57.364486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:57.418517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:57.437653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0921011e-e3d3-421a-9513-2e0ea7191be7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.756169 Sep 13 16:52:57.438739 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2351/4782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:56 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:58.239181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:58.240036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:58.256684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:58.259767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:58.260441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:58.262650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:58.264122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:58.266550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:58.390359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:58.402073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-038bc4a1-1a86-4bde-a9a7-c4737df3c08a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 1466 microversion: 2.1 time: 1.083326 Sep 13 16:52:58.403190 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2432/4783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:57 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 1466 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:58.426834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab994570-c386-45fe-83d0-fad46af12714 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb50ce5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:58.483172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:58.496160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a4226444-bca2-4e4d-a4a4-730e0b0154d8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1268 microversion: 2.1 time: 0.262789 Sep 13 16:52:58.516894 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2352/4784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:58 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1268 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:58.522183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:58.523058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:58.530154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:58.530946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:58.532231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:58.533188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:58.534420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:58.535073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:58.593407 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab994570-c386-45fe-83d0-fad46af12714 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?changes-since=2022-09-13T16%3A50%3A29Z" status: 200 len: 1901 microversion: 2.1 time: 0.170440 Sep 13 16:52:58.594645 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2433/4785] 10.222.0.61 () {58 vars in 1199 bytes} [Tue Sep 13 16:52:58 2022] GET /compute/v2.1/images?changes-since=2022-09-13T16%3A50%3A29Z => generated 1901 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:52:58.613887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-180c3734-529f-4f39-ace7-133659fe300d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb96fb0d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:58.737252 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-180c3734-529f-4f39-ace7-133659fe300d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1975723374" status: 200 len: 485 microversion: 2.1 time: 0.126555 Sep 13 16:52:58.738105 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2434/4786] 10.222.0.61 () {58 vars in 1231 bytes} [Tue Sep 13 16:52:58 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1975723374 => generated 485 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:58.752275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-918c440d-7403-4d02-ba71-b5aced3db7cd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45a83a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:58.783344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:58.795975 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b1e08c1-de68-4abf-89bb-6063db6eab3f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.277558 Sep 13 16:52:58.797953 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2353/4787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:58 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:58.893512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-918c440d-7403-4d02-ba71-b5aced3db7cd tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?server=19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 956 microversion: 2.1 time: 0.146433 Sep 13 16:52:58.900058 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2435/4788] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Sep 13 16:52:58 2022] GET /compute/v2.1/images?server=19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 956 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:52:58.936863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-04acb7ef-ea83-4d78-b32a-2bc7f4420d30 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4ace0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.078290 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-04acb7ef-ea83-4d78-b32a-2bc7f4420d30 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 484 microversion: 2.1 time: 0.166065 Sep 13 16:52:59.081164 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2354/4789] 10.222.0.61 () {58 vars in 1317 bytes} [Tue Sep 13 16:52:58 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 484 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:59.093481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6941fbc8-bf2e-4b8c-bf83-8b38b2fbfb69 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4556d30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.162521 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6941fbc8-bf2e-4b8c-bf83-8b38b2fbfb69 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 484 microversion: 2.1 time: 0.073826 Sep 13 16:52:59.163749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2436/4790] 10.222.0.61 () {58 vars in 1303 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 484 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:59.179259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0d7b26e-1fdb-4b8f-849c-7761ee1a71f0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb53a9310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.441765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0d7b26e-1fdb-4b8f-849c-7761ee1a71f0 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.266752 Sep 13 16:52:59.443136 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2355/4791] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:59.458965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-452df48e-23b1-4a0d-9b53-c89f8d8a55a5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb50ce790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.521291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.521954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:59.535009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:59.535803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:59.536441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:59.542054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:59.543773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:59.549297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:59.605385 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-452df48e-23b1-4a0d-9b53-c89f8d8a55a5 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.149845 Sep 13 16:52:59.606895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2437/4792] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:59.630891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9c85da71-c85a-4c8d-ab97-9cd1d564118c tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb45c7dc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.685957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:52:59.713821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-05fe13e9-3277-4452-bbc4-29babedbe4d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1274 microversion: 2.1 time: 0.196530 Sep 13 16:52:59.726045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2356/4793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:52:59.745268 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9c85da71-c85a-4c8d-ab97-9cd1d564118c tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.126114 Sep 13 16:52:59.746618 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2438/4794] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:52:59.761170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96caf75c-b587-4466-8d21-54ab943f66a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb53a95e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.822255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:52:59.822998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:52:59.840231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:59.842372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:59.842826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:59.843563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:52:59.844040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:52:59.844478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:52:59.968417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96caf75c-b587-4466-8d21-54ab943f66a9 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?changes-since=2022-09-13T16%3A50%3A23Z" status: 200 len: 6327 microversion: 2.1 time: 0.211509 Sep 13 16:52:59.970456 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2357/4795] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-13T16%3A50%3A23Z => generated 6327 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:00.001105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5e6e299-9ed4-49e8-a7b1-f4508a763e0a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4cfdd30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.078883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5e6e299-9ed4-49e8-a7b1-f4508a763e0a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1975723374" status: 200 len: 665 microversion: 2.1 time: 0.083565 Sep 13 16:53:00.079543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2358/4796] 10.222.0.61 () {58 vars in 1252 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1975723374 => generated 665 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:00.119838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-15970fec-fa6d-4178-b677-cfceff3e7f05 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb53a9dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.238566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:00.249945 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-15970fec-fa6d-4178-b677-cfceff3e7f05 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1464 microversion: 2.1 time: 0.129014 Sep 13 16:53:00.262293 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e09b84cb-a79b-4f8d-9195-026d2adb2b25 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.445384 Sep 13 16:53:00.264464 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2359/4797] 10.222.0.61 () {58 vars in 1338 bytes} [Tue Sep 13 16:53:00 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:00.265026 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2439/4798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:52:59 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:00.282212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-acb762bb-5728-45db-becb-4719540e66ca tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a1d040>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.394239 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-acb762bb-5728-45db-becb-4719540e66ca tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1464 microversion: 2.1 time: 0.126955 Sep 13 16:53:00.402541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-02826dca-ff1a-4992-b72d-1d9de9c281e4 req-7ea0b9ca-117f-4b6e-8795-fbcc795d0e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "name": "network-vif-unplugged", "status": "completed", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:00.414923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2360/4799] 10.222.0.61 () {58 vars in 1324 bytes} [Tue Sep 13 16:53:00 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fd3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:00.427197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a3291a37-aaac-4a42-84fa-8769ca2e4c9a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4a73430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.459349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-02826dca-ff1a-4992-b72d-1d9de9c281e4 req-7ea0b9ca-117f-4b6e-8795-fbcc795d0e6e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:00.463430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-02826dca-ff1a-4992-b72d-1d9de9c281e4 req-7ea0b9ca-117f-4b6e-8795-fbcc795d0e6e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:00.464663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-02826dca-ff1a-4992-b72d-1d9de9c281e4 req-7ea0b9ca-117f-4b6e-8795-fbcc795d0e6e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:00.525767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-02826dca-ff1a-4992-b72d-1d9de9c281e4 req-7ea0b9ca-117f-4b6e-8795-fbcc795d0e6e service nova] Creating event network-vif-unplugged:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:53:00.531862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-02826dca-ff1a-4992-b72d-1d9de9c281e4 req-7ea0b9ca-117f-4b6e-8795-fbcc795d0e6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135090 Sep 13 16:53:00.540737 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2440/4800] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:00.590642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a3291a37-aaac-4a42-84fa-8769ca2e4c9a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.173218 Sep 13 16:53:00.605308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2361/4801] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 16:53:00 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:00.631641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f168466c-8114-4dae-bbfb-0c18a6585dc7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb456fee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.740514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.741142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:00.751936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:00.752432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:00.752871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:00.753592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:00.754088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:00.754519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:00.861213 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f168466c-8114-4dae-bbfb-0c18a6585dc7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.233645 Sep 13 16:53:00.862750 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2441/4802] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 16:53:00 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:00.880835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c784f14e-f503-4cd7-9725-a283e84fec82 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb461bf70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:00.994384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c784f14e-f503-4cd7-9725-a283e84fec82 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/5853c870-0393-4bca-bd0a-d3ea26765a2c" status: 200 len: 784 microversion: 2.1 time: 0.117645 Sep 13 16:53:00.995248 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2442/4803] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Sep 13 16:53:00 2022] GET /compute/v2.1/images/5853c870-0393-4bca-bd0a-d3ea26765a2c => generated 784 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:53:01.017707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdb6085d-a359-438e-9675-8814feed3e84 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb458cf70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:01.101793 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bdb6085d-a359-438e-9675-8814feed3e84 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.088445 Sep 13 16:53:01.119245 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2443/4804] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:53:01 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:01.125278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d4e6fd4-c1c7-4b18-ba46-eaad957aca45 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb4561ca0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:01.433711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:01.449438 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a0a8ef3-4548-4138-9e40-3fa6c8f30ad4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.712703 Sep 13 16:53:01.451546 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2362/4805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:00 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:01.462712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:01.470590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:01.484068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:01.484710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:01.486308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:01.491574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:01.493529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:01.495501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:01.995602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:02.008750 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-973d8ed6-a67c-409e-af0b-2def88b2ba56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.555943 Sep 13 16:53:02.010531 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2363/4806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:01 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:02.206034 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d4e6fd4-c1c7-4b18-ba46-eaad957aca45 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad" status: 204 len: 0 microversion: 2.1 time: 1.085286 Sep 13 16:53:02.207485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2444/4807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:01 2022] DELETE /compute/v2.1/images/0c34f7b9-9c7d-4d8b-9a59-c2e2c61df7ad => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:02.216900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca19e5a7-8e14-46f7-a877-8a88f2127f1d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb49c0310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:02.483196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:02.484112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:02.499236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:02.503066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:02.505482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:02.510030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:02.513552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:02.514271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:03.105312 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca19e5a7-8e14-46f7-a877-8a88f2127f1d tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593" status: 204 len: 0 microversion: 2.1 time: 0.893367 Sep 13 16:53:03.106131 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2364/4808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:02 2022] DELETE /compute/v2.1/images/bd75f347-91d4-4527-8b2d-bbf01005d593 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:03.114438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:03.115311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:03.130206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:03.131338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:03.133413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:03.134306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:03.136875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:03.137456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:03.296727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:03.311555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80a88449-c0cd-41d8-af6c-5e96c297b203 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.833078 Sep 13 16:53:03.312577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2445/4809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:02 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:03.317681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-05d28443-018a-4aef-8358-ce4afc0963f6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb456fb80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:03.860275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:03.877929 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c178720-7c2f-4d2a-96e4-75ec0d7e75ab tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.770416 Sep 13 16:53:03.908222 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2365/4810] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:03 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:03.941097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2cc22e6f-552a-4939-a6a9-d16770f30f4d req-3d5f4349-6f0d-4d98-94b3-9fb761ed9d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7eedcc1-56b5-4258-9f98-c39305cd7e65", "tag": "dfc168c0-711c-4893-9a35-c5d006a6b6bd"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:04.005698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2cc22e6f-552a-4939-a6a9-d16770f30f4d req-3d5f4349-6f0d-4d98-94b3-9fb761ed9d13 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.009580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2cc22e6f-552a-4939-a6a9-d16770f30f4d req-3d5f4349-6f0d-4d98-94b3-9fb761ed9d13 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.014537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2cc22e6f-552a-4939-a6a9-d16770f30f4d req-3d5f4349-6f0d-4d98-94b3-9fb761ed9d13 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.073706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2cc22e6f-552a-4939-a6a9-d16770f30f4d req-3d5f4349-6f0d-4d98-94b3-9fb761ed9d13 service nova] Creating event network-changed:dfc168c0-711c-4893-9a35-c5d006a6b6bd for instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 on n-h1-857467-1 Sep 13 16:53:04.092911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2cc22e6f-552a-4939-a6a9-d16770f30f4d req-3d5f4349-6f0d-4d98-94b3-9fb761ed9d13 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176401 Sep 13 16:53:04.100118 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2366/4811] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:04.163560 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-05d28443-018a-4aef-8358-ce4afc0963f6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777" status: 204 len: 0 microversion: 2.1 time: 0.849537 Sep 13 16:53:04.165593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2446/4812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:03 2022] DELETE /compute/v2.1/images/bbfbe763-a5fa-4dcf-901d-04abc161c777 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:04.177560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:04.178276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:04.196593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.198963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.204397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.205456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.206163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.206618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.281322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:53:04.345441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:04.346905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:04.361518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.366990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.368838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.371310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.383557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.395328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.558570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e362c2a4-ea87-436f-aa1c-d5511f52019b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 204 len: 0 microversion: 2.1 time: 0.386538 Sep 13 16:53:04.560761 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2367/4813] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:53:04 2022] DELETE /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:04.582036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:04.583094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:04.593235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.594651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.595488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.596944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.598214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.598840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.831708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:04.865585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76177034-7752-4dee-8b2e-339f74d72ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.522028 Sep 13 16:53:04.867021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2447/4814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:04 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:04.933811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:04.935197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:04.946756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.947623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.948287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:04.949709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:04.952187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:04.954768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:05.308569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:05.328196 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-512b81cd-12e7-4d58-8f3b-0a50b5478744 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1510 microversion: 2.1 time: 0.401490 Sep 13 16:53:05.354791 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2448/4815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:04 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:05.572190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:05.584114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9f46167c-692a-4302-ab98-3394b6ca7dc3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1473 microversion: 2.1 time: 1.011827 Sep 13 16:53:05.588753 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2368/4816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:04 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1473 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:05.895594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:05.896802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:05.914798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:05.921670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:05.922386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:05.923499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:05.924212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:05.924757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:06.229975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:06.244024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-29949663-8a9d-4753-b7df-283a84e3ac07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.354887 Sep 13 16:53:06.248100 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2449/4817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:05 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:06.621725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:06.623292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:06.633320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:06.634626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:06.649738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:06.661579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:06.662718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:06.663570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:06.664315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:06.665150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:06.665840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:06.666816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:06.668448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:06.669505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:06.672320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:06.672742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:06.673411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:06.685844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:07.192508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:07.364330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:07.375916 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3d90188-5e4e-4698-a195-3b01b52068cf tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1473 microversion: 2.1 time: 0.760893 Sep 13 16:53:07.378017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2450/4818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:06 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1473 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:07.395709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:07.396639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:07.412477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:07.412988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:07.413434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:07.414190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:07.414700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:07.415072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:07.604225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:07.620956 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c0a75dd-9f3a-49e3-b24d-83ac1d8fc8d6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1487 microversion: 2.1 time: 1.270380 Sep 13 16:53:07.630431 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2369/4819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:06 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1487 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:07.647933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:07.651474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:07.665263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:07.666168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:07.666853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:07.667800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:07.668487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:07.669778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:07.768641 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4317eb59-7ffc-475b-a33a-1cc4221af046 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 200 len: 169 microversion: 2.1 time: 0.124361 Sep 13 16:53:07.774334 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2370/4820] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:07 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 169 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:07.780119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:07.780830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:07.789653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:07.790486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:07.791698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:07.792242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:07.792954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:07.793680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:07.858087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:07.875238 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23d21746-0fdc-4426-b7b1-c915bbdad4f9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.490732 Sep 13 16:53:07.898811 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2451/4821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:07 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:08.406108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:08.407234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:08.423180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:08.425800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:08.427654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:08.428744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:08.432652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:08.433512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:08.610388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:08.628530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33d2de6a-c22a-456c-ad64-9abedea2250a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1431 microversion: 2.1 time: 0.218448 Sep 13 16:53:08.632647 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2452/4822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:08 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1431 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:08.789029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:08.809239 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92bd461f-a617-4980-8b1c-ae1829a5cbad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 1.033177 Sep 13 16:53:08.813308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2371/4823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:07 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:08.855346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:08.856769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:08.871198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:08.872552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:08.875198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:08.880049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:08.882815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:08.889493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2d729a23-1262-4a3c-9094-593bf0c10c52 req-842e8d77-3dfa-4818-a887-698bfb07379b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c2ae7a-83cc-4182-a6d3-020a00bc333e", "name": "network-vif-deleted", "tag": "b57d7ddb-d6ef-4416-a6db-fda9170363ec"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:08.896094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:08.938239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d729a23-1262-4a3c-9094-593bf0c10c52 req-842e8d77-3dfa-4818-a887-698bfb07379b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:08.938764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d729a23-1262-4a3c-9094-593bf0c10c52 req-842e8d77-3dfa-4818-a887-698bfb07379b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:08.943459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2d729a23-1262-4a3c-9094-593bf0c10c52 req-842e8d77-3dfa-4818-a887-698bfb07379b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:08.973889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2d729a23-1262-4a3c-9094-593bf0c10c52 req-842e8d77-3dfa-4818-a887-698bfb07379b service nova] Creating event network-vif-deleted:b57d7ddb-d6ef-4416-a6db-fda9170363ec for instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e on n-h2-857467-1 Sep 13 16:53:08.992271 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2d729a23-1262-4a3c-9094-593bf0c10c52 req-842e8d77-3dfa-4818-a887-698bfb07379b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106923 Sep 13 16:53:08.992893 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2372/4824] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:53:09.003759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:09.006894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:09.030263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.030770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.031217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.031944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.032410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.032847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.176928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:09.194101 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e02dcf00-ad13-4c34-8472-c1231f717150 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.341133 Sep 13 16:53:09.196063 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2453/4825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:08 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:09.224312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:09.229794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:09.249600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.250136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.250579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.252166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.252638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.253069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.485725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:09.494805 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce40bb21-930f-4818-86bf-a1968c17810a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.276690 Sep 13 16:53:09.495407 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2454/4826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:09 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:09.518298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:09.518947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:09.526252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.526778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.528780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.529623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.530120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.530560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.538761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:09.558473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa768bd4-574e-412f-825f-847eeeb8e014 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.559334 Sep 13 16:53:09.559968 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2373/4827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:08 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:09.658464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:09.659087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:09.680368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.686168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.688605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.690174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.690830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.696611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.829631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:09.830992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:09.831786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:09.832469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lazy-loading 'fault' on Instance uuid d3c2ae7a-83cc-4182-a6d3-020a00bc333e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:53:09.895139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:09.911084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b39ffb3-c8ce-485d-b8a1-0644e77e00ef tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.397017 Sep 13 16:53:09.913903 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2455/4828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:09 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:10.069729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:10.077018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:10.079022 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e68f797d-967d-405a-916d-810b8e07a99a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 200 len: 1308 microversion: 2.1 time: 0.426218 Sep 13 16:53:10.080750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1565329708", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "ebb6466b-9a22-4490-b956-78da5a25f8b5"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:10.089809 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2374/4829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:09 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:10.166454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] validate_networks() for [('ebb6466b-9a22-4490-b956-78da5a25f8b5', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:53:10.585880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:10.587254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:10.598248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:10.599051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:10.599727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:10.600823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:10.601482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:10.602122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:10.790012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:10.817554 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7400077-c6b3-4bd2-b999-79bea032a147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.231829 Sep 13 16:53:10.819005 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2375/4830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:10 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:10.943364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:10.944569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:10.967337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:10.968674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:10.971821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:10.973333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:10.974234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:10.975399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.011012 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] HTTP exception thrown: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Request method failure captured: Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 HTTP/1.1 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILNgbAMBbrpTNiJvgmPrLmfeTQjCs6eVT6ZYXzKtX33Um_U9keB1U9wrDPkVnsmE8xxqgG8yGuQ2igaMOG1OJRXU_DhVucSnFZr-Y57ASNy7kI7ox_wTes-AkHmzCx34gTeOT_CXMgwTxu9iuKxfgiUFUIeA70IUyaVu2Zyl_QjLmCk Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: e2620846244d4943925ca47225a9eb36 Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7b977f7c-ae5d-4018-b738-a59455646029'} Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:11.015917 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.020722 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.027562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Returning 404 to user: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:11.028876 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f91f1ea-7381-4800-b8bc-0a848e0fcd63 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 404 len: 111 microversion: 2.1 time: 0.090250 Sep 13 16:53:11.029963 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2376/4831] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:53:10 2022] DELETE /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:53:11.038707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:11.040781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 7b977f7c-ae5d-4018-b738-a59455646029] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:11.056418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.057634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.058613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.060793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.065959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.069533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.101068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] HTTP exception thrown: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Request method failure captured: Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 HTTP/1.1 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILNgbAMBbrpTNiJvgmPrLmfeTQjCs6eVT6ZYXzKtX33Um_U9keB1U9wrDPkVnsmE8xxqgG8yGuQ2igaMOG1OJRXU_DhVucSnFZr-Y57ASNy7kI7ox_wTes-AkHmzCx34gTeOT_CXMgwTxu9iuKxfgiUFUIeA70IUyaVu2Zyl_QjLmCk Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: e2620846244d4943925ca47225a9eb36 Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7b977f7c-ae5d-4018-b738-a59455646029'} Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:11.110453 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. Sep 13 16:53:11.115358 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.118680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Returning 404 to user: Instance 7b977f7c-ae5d-4018-b738-a59455646029 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:11.119989 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77417fc0-ba9d-4c71-add9-d8a5d65ef61a tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029" status: 404 len: 111 microversion: 2.1 time: 0.085233 Sep 13 16:53:11.122665 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2377/4832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:11 2022] GET /compute/v2.1/servers/7b977f7c-ae5d-4018-b738-a59455646029 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:53:11.144579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:11.153653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: d3c2ae7a-83cc-4182-a6d3-020a00bc333e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:11.172368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.175182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.175926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.177036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.183773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.186302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.243582 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] HTTP exception thrown: Instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e could not be found. Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Request method failure captured: Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e HTTP/1.1 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILTNOcKlNZVWBTwQbK4N7K4n4aTUO1iEDyaNfVTS6CtOS4Z1DReLZlGhSr0A9uMu9hCJ8P_2GNbm0QZsjTCRUXOXLFhsgB0RoSfqI3Mn0UpymaRa-hqOHQEt_GyVNE9xDfRevH3Xm4Twy0MZ0ouVvxrTZLY7UKIKmTzHPsWmClowXRQ Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 62c97812df4c466b9cd8d4562a8cda38 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ListImageFiltersTestJSON-267376297 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "tempest-type-287598230", "name": "tempest-service-1025210988", "endpoints": [{"region": "tempest-region-1159272441", "publicURL": "https://url-1240658970.com"}]}, {"type": "tempest-type-224835265", "name": "tempest-service-2115313391", "endpoints": [{"region": "tempest-region-1816630093", "internalURL": "https://url-20724959.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ListImageFiltersTestJSON-267376297 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 62c97812df4c466b9cd8d4562a8cda38 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-267376297 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ListImageFiltersTestJSON-267376297-project Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: d3318c456e444ce0bf528cc27f0b5046 Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ListImageFiltersTestJSON-267376297-project Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e could not be found. Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd3c2ae7a-83cc-4182-a6d3-020a00bc333e'} Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e could not be found. Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:11.247638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e could not be found. Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e could not be found. Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Returning 404 to user: Instance d3c2ae7a-83cc-4182-a6d3-020a00bc333e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:11.253434 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36ca42a3-8770-48d7-a884-5754b05a3ba7 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e" status: 404 len: 111 microversion: 2.1 time: 0.124508 Sep 13 16:53:11.264349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2378/4833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:11 2022] GET /compute/v2.1/servers/d3c2ae7a-83cc-4182-a6d3-020a00bc333e => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:53:11.273396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:11.277064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:11.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.326352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.388395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:53:11.633197 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9060558-d591-4e37-86e8-318dfe65434b tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 204 len: 0 microversion: 2.1 time: 0.363505 Sep 13 16:53:11.634255 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2379/4834] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:53:11 2022] DELETE /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:11.647611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:11.654557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:11.654792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:53:11.655259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:53:11.655697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:53:11.656115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:53:11.656538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:53:11.674622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.675156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.675698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.676515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.677012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.677490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.677611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.678168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.678596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.680834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.681350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.682233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.771798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:53:11.795230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for user c2c12edf9f8d4b23bd1074facb2fad9d and project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:53:11.827834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:53:11.833972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:53:11.915881 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b8fbdebf-9e46-4932-8c99-8c6c7414e769 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839279 Sep 13 16:53:11.917304 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2456/4835] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:53:11.923128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e319a919-cdea-4a8f-a669-b4540f1f77fd req-06fdbbbf-4b71-4d48-b970-684f561c28dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7eedcc1-56b5-4258-9f98-c39305cd7e65", "name": "network-vif-plugged", "status": "completed", "tag": "dfc168c0-711c-4893-9a35-c5d006a6b6bd"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:11.937526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e319a919-cdea-4a8f-a669-b4540f1f77fd req-06fdbbbf-4b71-4d48-b970-684f561c28dc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:11.938526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e319a919-cdea-4a8f-a669-b4540f1f77fd req-06fdbbbf-4b71-4d48-b970-684f561c28dc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:11.939161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e319a919-cdea-4a8f-a669-b4540f1f77fd req-06fdbbbf-4b71-4d48-b970-684f561c28dc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:11.954983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e319a919-cdea-4a8f-a669-b4540f1f77fd req-06fdbbbf-4b71-4d48-b970-684f561c28dc service nova] Creating event network-vif-plugged:dfc168c0-711c-4893-9a35-c5d006a6b6bd for instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 on n-h1-857467-1 Sep 13 16:53:11.963514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e319a919-cdea-4a8f-a669-b4540f1f77fd req-06fdbbbf-4b71-4d48-b970-684f561c28dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044767 Sep 13 16:53:11.987896 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2457/4836] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:12.023349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:12.025689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:12.044485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:12.060473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:12.064481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:12.065565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:12.065968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:12.066443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:12.334729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:12.344557 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5289c12-3778-458b-8145-783e159ea2d6 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 1472 microversion: 2.1 time: 0.705233 Sep 13 16:53:12.349999 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2380/4837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:11 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:12.368278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9df6100-11da-4ff0-bd0e-b5b83dacf2e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:12.370696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9df6100-11da-4ff0-bd0e-b5b83dacf2e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:12.493304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:12.512310 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e35c552-88c8-474e-9821-bc3dc4d30552 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.519334 Sep 13 16:53:12.513444 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2458/4838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:11 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:12.655562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a9df6100-11da-4ff0-bd0e-b5b83dacf2e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:12.671333 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9df6100-11da-4ff0-bd0e-b5b83dacf2e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1215 microversion: 2.1 time: 0.319069 Sep 13 16:53:12.671930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2381/4839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:12 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:13.377045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:13.377679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:13.384446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:13.384860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:13.385263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:13.386211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:13.386864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:13.388176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:13.536501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:13.537090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:13.568430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:13.569053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:13.569697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:13.570734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:13.571586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:13.572192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:13.895276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:13.928444 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dad3cac0-a962-4a1d-8a24-68d5ad924f23 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 1472 microversion: 2.1 time: 0.554151 Sep 13 16:53:13.929464 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2459/4840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:13 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 1472 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:13.974729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:13.975400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:13.989217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:13.990109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:13.990722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:13.991973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:13.992921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:13.994199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:14.164478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:14.180454 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c29dda42-345e-4052-931a-56da7e07af5f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1267 microversion: 2.1 time: 0.242550 Sep 13 16:53:14.181052 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2460/4841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:13 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:14.414206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:14.423605 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ab9ef30f-cafd-4c95-9cf9-6aa9cc0ec373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1316 microversion: 2.1 time: 0.890963 Sep 13 16:53:14.424224 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2382/4842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:13 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1316 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:14.961776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:14.963324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:14.972961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:14.974502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:14.975009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:14.975481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:14.976165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:14.976624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:14.977079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:15.207313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:15.208218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:15.229024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:15.230008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:15.230951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:15.232611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:15.233138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:15.233679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:15.461100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:15.473186 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b41fef7-7ab0-4c56-8e6c-4ca5ad1aa0ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1273 microversion: 2.1 time: 0.269545 Sep 13 16:53:15.476666 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2383/4843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:15 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:15.489559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:15.490347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:15.506657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:15.507476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:15.508203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:15.509174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:15.509931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:15.510601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:15.976471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:15.984686 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ceaaa88-7b1e-4e83-a6cc-04f13476604f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.506668 Sep 13 16:53:15.991972 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2384/4844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:15 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:16.061283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3318c456e444ce0bf528cc27f0b5046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c97812df4c466b9cd8d4562a8cda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:16.081004 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a165714-1cf8-4ff6-87a2-e4120855c66a tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 200 len: 1472 microversion: 2.1 time: 1.123966 Sep 13 16:53:16.081861 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2461/4845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:14 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 1472 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:16.100363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1dede3f0-92e7-4edb-9689-3c6c4f3dabde req-acc00d2e-d8ac-4a4f-a235-0fdc1752252c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a971fc-7696-411f-b8fe-d28b8827bae8", "name": "network-vif-deleted", "tag": "aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:16.127149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1dede3f0-92e7-4edb-9689-3c6c4f3dabde req-acc00d2e-d8ac-4a4f-a235-0fdc1752252c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:16.127647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1dede3f0-92e7-4edb-9689-3c6c4f3dabde req-acc00d2e-d8ac-4a4f-a235-0fdc1752252c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:16.132701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1dede3f0-92e7-4edb-9689-3c6c4f3dabde req-acc00d2e-d8ac-4a4f-a235-0fdc1752252c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:16.156935 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1dede3f0-92e7-4edb-9689-3c6c4f3dabde req-acc00d2e-d8ac-4a4f-a235-0fdc1752252c service nova] Creating event network-vif-deleted:aaa2bfa9-6d2c-4881-8b0a-6d9b16bf25c1 for instance 19a971fc-7696-411f-b8fe-d28b8827bae8 on n-h2-857467-1 Sep 13 16:53:16.169479 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1dede3f0-92e7-4edb-9689-3c6c4f3dabde req-acc00d2e-d8ac-4a4f-a235-0fdc1752252c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073978 Sep 13 16:53:16.170452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2385/4846] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:16.245199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-687667342", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:16.333180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] validate_networks() for [('52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:53:16.504779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:16.506216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:16.532741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:16.533258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:16.533710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:16.534869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:16.537373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:16.537859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:16.848335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:16.883039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48657864-e8c6-4b93-ab20-c40a3664d6b4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 0.382391 Sep 13 16:53:16.895652 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2386/4847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:16 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:17.109164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:17.109785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] [instance: 19a971fc-7696-411f-b8fe-d28b8827bae8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:17.127186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:17.127688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:17.128140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:17.128866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:17.129330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:17.129769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:17.167643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] HTTP exception thrown: Instance 19a971fc-7696-411f-b8fe-d28b8827bae8 could not be found. Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Request method failure captured: Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 HTTP/1.1 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILTNOcKlNZVWBTwQbK4N7K4n4aTUO1iEDyaNfVTS6CtOS4Z1DReLZlGhSr0A9uMu9hCJ8P_2GNbm0QZsjTCRUXOXLFhsgB0RoSfqI3Mn0UpymaRa-hqOHQEt_GyVNE9xDfRevH3Xm4Twy0MZ0ouVvxrTZLY7UKIKmTzHPsWmClowXRQ Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 62c97812df4c466b9cd8d4562a8cda38 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ListImageFiltersTestJSON-267376297 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "tempest-type-287598230", "name": "tempest-service-1025210988", "endpoints": [{"region": "tempest-region-1159272441", "publicURL": "https://url-1240658970.com"}]}, {"type": "tempest-type-224835265", "name": "tempest-service-2115313391", "endpoints": [{"region": "tempest-region-1816630093", "internalURL": "https://url-20724959.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62c97812df4c466b9cd8d4562a8cda38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ListImageFiltersTestJSON-267376297 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 62c97812df4c466b9cd8d4562a8cda38 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-267376297 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ListImageFiltersTestJSON-267376297-project Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: d3318c456e444ce0bf528cc27f0b5046 Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ListImageFiltersTestJSON-267376297-project Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 19a971fc-7696-411f-b8fe-d28b8827bae8 could not be found. Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '19a971fc-7696-411f-b8fe-d28b8827bae8'} Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a971fc-7696-411f-b8fe-d28b8827bae8 could not be found. Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:17.169424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a971fc-7696-411f-b8fe-d28b8827bae8 could not be found. Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a971fc-7696-411f-b8fe-d28b8827bae8 could not be found. Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Returning 404 to user: Instance 19a971fc-7696-411f-b8fe-d28b8827bae8 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:17.173455 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7019e97-086c-45d2-8770-626b77903fe3 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8" status: 404 len: 111 microversion: 2.1 time: 0.065956 Sep 13 16:53:17.179644 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2387/4848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:17 2022] GET /compute/v2.1/servers/19a971fc-7696-411f-b8fe-d28b8827bae8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:53:17.182977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff82f32c-cca3-41e9-a500-61e7434b4501 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb472f5e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:18.025946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff82f32c-cca3-41e9-a500-61e7434b4501 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/images/f208e1b8-dd46-46e6-a331-9370ab878b3f" status: 204 len: 0 microversion: 2.1 time: 0.846607 Sep 13 16:53:18.029034 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2388/4849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:17 2022] DELETE /compute/v2.1/images/f208e1b8-dd46-46e6-a331-9370ab878b3f => generated 0 bytes in 850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:18.035805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:18.036447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:18.055631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:18.056271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:18.056887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:18.057695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:18.058346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:18.058825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:18.337026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:18.347728 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88dcc943-02fe-4705-a66c-fe79a6d76e7a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 0.317756 Sep 13 16:53:18.348616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2389/4850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:18 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:18.354645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b5ac658-28a5-4793-9b1b-a15c35adb561 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb472fd30>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:18.750300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:53:18.750757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:53:18.751184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:53:18.751599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:53:18.752012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:53:18.774780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:18.777739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:18.779410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:18.782472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:18.784809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:18.786433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:18.863736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Getting quotas for project 74b38fb1b5ed4c3daa5ff12d3c2239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:53:18.873043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Getting quotas for user 156a39f4db5f465da2c19d927fc0b8f2 and project 74b38fb1b5ed4c3daa5ff12d3c2239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:53:18.890736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:53:18.910713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:53:19.019244 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c9ccea0-7ae8-4358-8797-2a144424cdfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.778173 Sep 13 16:53:19.020861 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2462/4851] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:53:19.032249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:19.034592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:19.062412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:19.063581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:19.065463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:19.066273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:19.067302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:19.070399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:19.102556 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] HTTP exception thrown: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Request method failure captured: Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 HTTP/1.1 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILNgbAMBbrpTNiJvgmPrLmfeTQjCs6eVT6ZYXzKtX33Um_U9keB1U9wrDPkVnsmE8xxqgG8yGuQ2igaMOG1OJRXU_DhVucSnFZr-Y57ASNy7kI7ox_wTes-AkHmzCx34gTeOT_CXMgwTxu9iuKxfgiUFUIeA70IUyaVu2Zyl_QjLmCk Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: e2620846244d4943925ca47225a9eb36 Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '76cec120-ddf3-4621-8ccc-88bd968deba0'} Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:19.106439 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Returning 404 to user: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6caf538-8699-4d0d-a1ef-165274120b24 tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 404 len: 111 microversion: 2.1 time: 0.087499 Sep 13 16:53:19.111941 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2463/4852] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:53:19 2022] DELETE /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:53:19.127851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc452c94-f14b-4731-b31b-5a1aef03d443 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:19.128515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc452c94-f14b-4731-b31b-5a1aef03d443 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:19.225150 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b5ac658-28a5-4793-9b1b-a15c35adb561 tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/images/327eafbe-a6eb-4148-ad1e-a573ffc491bc" status: 204 len: 0 microversion: 2.1 time: 0.875245 Sep 13 16:53:19.230565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2390/4853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:18 2022] DELETE /compute/v2.1/images/327eafbe-a6eb-4148-ad1e-a573ffc491bc => generated 0 bytes in 877 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:19.237659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:19.238599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] [instance: 76cec120-ddf3-4621-8ccc-88bd968deba0] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:19.258541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:19.266268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:19.266970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:19.267965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:19.268696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:19.269875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:19.307842 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] HTTP exception thrown: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Request method failure captured: Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 HTTP/1.1 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILNgbAMBbrpTNiJvgmPrLmfeTQjCs6eVT6ZYXzKtX33Um_U9keB1U9wrDPkVnsmE8xxqgG8yGuQ2igaMOG1OJRXU_DhVucSnFZr-Y57ASNy7kI7ox_wTes-AkHmzCx34gTeOT_CXMgwTxu9iuKxfgiUFUIeA70IUyaVu2Zyl_QjLmCk Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/266bcfc04bec48c897f828ed06a1e7fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 266bcfc04bec48c897f828ed06a1e7fe Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944166870 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: e2620846244d4943925ca47225a9eb36 Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeTestJSON-1944166870-project Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '76cec120-ddf3-4621-8ccc-88bd968deba0'} Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:19.324282 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. Sep 13 16:53:19.329120 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:19.332350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] Returning 404 to user: Instance 76cec120-ddf3-4621-8ccc-88bd968deba0 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:19.333720 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7345693-eb6e-480d-a224-53a307f5340e tempest-AttachVolumeTestJSON-1944166870 tempest-AttachVolumeTestJSON-1944166870-project] 10.222.0.61 "GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0" status: 404 len: 111 microversion: 2.1 time: 0.101354 Sep 13 16:53:19.335337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2391/4854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:19 2022] GET /compute/v2.1/servers/76cec120-ddf3-4621-8ccc-88bd968deba0 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:53:19.342999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1563e764-1d1e-4004-967e-256294e9eb2f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] Calling method '.version_select at 0x7fbeb472f700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:19.390672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fc452c94-f14b-4731-b31b-5a1aef03d443 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:19.401210 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc452c94-f14b-4731-b31b-5a1aef03d443 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1216 microversion: 2.1 time: 0.290096 Sep 13 16:53:19.402023 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2464/4855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:19 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:19.425335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:19.434886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:19.448216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:19.449270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:19.453809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:19.456293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:19.456782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:19.457220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:20.046221 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1563e764-1d1e-4004-967e-256294e9eb2f tempest-ListImageFiltersTestJSON-267376297 tempest-ListImageFiltersTestJSON-267376297-project] 10.222.0.61 "DELETE /compute/v2.1/images/f7e678d4-6ceb-4232-82f0-0784ce1d5fdf" status: 204 len: 0 microversion: 2.1 time: 0.709338 Sep 13 16:53:20.046556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:20.047126 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2392/4856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:19 2022] DELETE /compute/v2.1/images/f7e678d4-6ceb-4232-82f0-0784ce1d5fdf => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:20.059486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b37b4853-0ef4-4851-a072-06f01ee84da4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 0.656386 Sep 13 16:53:20.074208 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2465/4857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:19 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:20.360476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c1ea6195-0b5a-4954-b8a0-ef8f4b067e8f req-56c07788-5f75-4611-a42b-205587700361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48ccbf8-5c47-486b-a6c3-47ace85cb776", "tag": "ead3dcc2-6be1-4155-aa2d-777fc78dc1f5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:20.397145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c1ea6195-0b5a-4954-b8a0-ef8f4b067e8f req-56c07788-5f75-4611-a42b-205587700361 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:20.397640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c1ea6195-0b5a-4954-b8a0-ef8f4b067e8f req-56c07788-5f75-4611-a42b-205587700361 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:20.398124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c1ea6195-0b5a-4954-b8a0-ef8f4b067e8f req-56c07788-5f75-4611-a42b-205587700361 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:20.424798 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c1ea6195-0b5a-4954-b8a0-ef8f4b067e8f req-56c07788-5f75-4611-a42b-205587700361 service nova] Creating event network-changed:ead3dcc2-6be1-4155-aa2d-777fc78dc1f5 for instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 on n-h2-857467-1 Sep 13 16:53:20.428846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:20.429592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:20.435770 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c1ea6195-0b5a-4954-b8a0-ef8f4b067e8f req-56c07788-5f75-4611-a42b-205587700361 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078713 Sep 13 16:53:20.440799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2393/4858] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:20.443187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:20.463017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:20.465929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:20.467089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:20.480456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:20.485550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:20.759735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:20.772931 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f77a055d-e9a3-476f-ad0c-d43f0adeeabc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1268 microversion: 2.1 time: 0.348769 Sep 13 16:53:20.775776 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2466/4859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:20 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1268 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:21.085087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:21.085857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:21.095443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:21.098256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:21.099013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:21.099679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:21.100636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:21.101322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:21.102030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:21.506809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:21.522097 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1a6a47e-9405-40e4-ae17-e6bdcb7a4e30 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 0.441629 Sep 13 16:53:21.522451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2394/4860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:21 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:21.806043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:21.806670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:21.821532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:21.826582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:21.827182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:21.828376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:21.829057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:21.829957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:21.968336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:21.978046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b815882e-5c87-4ac8-8532-43f43fc6bf54 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1274 microversion: 2.1 time: 0.175844 Sep 13 16:53:21.979421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2467/4861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:21 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:22.549630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:22.550416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:22.562697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:22.567610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:22.569593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:22.572094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:22.573373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:22.574854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:22.674510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:23.005216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:23.006516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:23.020647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:23.022002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:23.023758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:23.025298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:23.027005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:23.029285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:23.510826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:23.526108 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6676789c-7a88-4b54-8cd3-99d840c61525 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.523502 Sep 13 16:53:23.528839 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2468/4862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:22 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:23.619671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:23.629421 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0bc9060-acf4-4525-9cc8-8d810c28259c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 1.086354 Sep 13 16:53:23.635537 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2395/4863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:22 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:24.555970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:24.557314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:24.573234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:24.576036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:24.580251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:24.581162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:24.581658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:24.585623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:24.665943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:24.667409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:24.690486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:24.709643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:24.710378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:24.711606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:24.712239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:24.713115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:25.380231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:25.394688 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0041917e-6e46-4fce-a440-b2ca165a85a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.842754 Sep 13 16:53:25.395311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2469/4864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:24 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:25.906738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:25.919978 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73872696-d8b0-4c88-8cfa-1ff425d37c2b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 1.258512 Sep 13 16:53:25.923465 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2396/4865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:24 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:26.424426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:26.425071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:26.441618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:26.443380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:26.444032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:26.446071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:26.447019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:26.447718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:26.487358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:26.944517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:26.945287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:26.954278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:26.955138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:26.956222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:26.958482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:26.959284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:26.960178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:27.018267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:27.045697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34c47ecd-ff25-42bb-8329-6d48e94f54b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.625840 Sep 13 16:53:27.047719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2470/4866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:26 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:27.065592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-825a592c-c5eb-4e60-8b90-6b4300485824 req-a102f7d1-dbf1-4623-a7e9-9b62ccda551a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48ccbf8-5c47-486b-a6c3-47ace85cb776", "name": "network-vif-plugged", "status": "completed", "tag": "ead3dcc2-6be1-4155-aa2d-777fc78dc1f5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:27.084629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-825a592c-c5eb-4e60-8b90-6b4300485824 req-a102f7d1-dbf1-4623-a7e9-9b62ccda551a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:27.085375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-825a592c-c5eb-4e60-8b90-6b4300485824 req-a102f7d1-dbf1-4623-a7e9-9b62ccda551a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:27.086083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-825a592c-c5eb-4e60-8b90-6b4300485824 req-a102f7d1-dbf1-4623-a7e9-9b62ccda551a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:27.103613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-825a592c-c5eb-4e60-8b90-6b4300485824 req-a102f7d1-dbf1-4623-a7e9-9b62ccda551a service nova] Creating event network-vif-plugged:ead3dcc2-6be1-4155-aa2d-777fc78dc1f5 for instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 on n-h2-857467-1 Sep 13 16:53:27.113394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-825a592c-c5eb-4e60-8b90-6b4300485824 req-a102f7d1-dbf1-4623-a7e9-9b62ccda551a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063396 Sep 13 16:53:27.114396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2471/4867] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:27.684618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:27.693298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a8ccb13-d007-4f9e-8664-16dada5f2cc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 0.752564 Sep 13 16:53:27.698383 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2397/4868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:26 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:28.073527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:28.076602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:28.094457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:28.095147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:28.096485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:28.097469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:28.100022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:28.100476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:28.532134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:28.550245 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-079ee05a-b690-4112-8a14-148b2654b172 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.481687 Sep 13 16:53:28.551185 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2472/4869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:28 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:28.724554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:28.725225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:28.735586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:28.736492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:28.737380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:28.738564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:28.739399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:28.740333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:28.824357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:28.839051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d10f60ec-b847-4dd7-991e-f9cce0cf6193 req-1055935e-84b9-46f4-842c-9d0bd77e9099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282001d0-4ba5-4e1e-96fa-a48dc071852e", "tag": "82930ba0-8975-43c3-8f81-f1933db203ec"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:28.855358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:28.861205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d10f60ec-b847-4dd7-991e-f9cce0cf6193 req-1055935e-84b9-46f4-842c-9d0bd77e9099 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:28.862165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d10f60ec-b847-4dd7-991e-f9cce0cf6193 req-1055935e-84b9-46f4-842c-9d0bd77e9099 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:28.862769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d10f60ec-b847-4dd7-991e-f9cce0cf6193 req-1055935e-84b9-46f4-842c-9d0bd77e9099 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:28.913500 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d10f60ec-b847-4dd7-991e-f9cce0cf6193 req-1055935e-84b9-46f4-842c-9d0bd77e9099 service nova] Creating event network-changed:82930ba0-8975-43c3-8f81-f1933db203ec for instance 282001d0-4ba5-4e1e-96fa-a48dc071852e on n-h1-857467-1 Sep 13 16:53:28.927499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d10f60ec-b847-4dd7-991e-f9cce0cf6193 req-1055935e-84b9-46f4-842c-9d0bd77e9099 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093272 Sep 13 16:53:28.929144 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2473/4870] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:29.579256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:29.580724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:29.597413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:29.604981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:29.607307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:29.609484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:29.612466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:29.614032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:29.617699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:29.784968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:29.802914 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-569d5bb7-de06-461a-ad75-88118dff3f46 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1315 microversion: 2.1 time: 1.082025 Sep 13 16:53:29.824993 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2398/4871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:28 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:30.406400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:30.419605 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b31e3dec-4d85-4a8d-96fa-12d0d2a5eddc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.846395 Sep 13 16:53:30.421723 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2474/4872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:29 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:30.830825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:30.831508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:30.844870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:30.847302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:30.852257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:30.853281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:30.860070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:30.860943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:31.444853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:31.446470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:31.468080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:31.469624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:31.470124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:31.475538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:31.478887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:31.479436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:31.581627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:31.599285 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e1a5218-a91d-4915-9f67-b0dbf091cc1d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1501 microversion: 2.1 time: 0.774302 Sep 13 16:53:31.611604 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2399/4873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:30 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1501 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:31.640684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:31.642907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:31.665937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:31.666441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:31.666882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:31.667593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:31.669358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:31.670010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:31.758026 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-563cd02a-aa25-4dbd-965a-cfe8752710e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.125407 Sep 13 16:53:31.762019 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2400/4874] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:31 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:32.228605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:32.272350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7814fed9-a7b7-481a-aa26-439391aae6f7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.830982 Sep 13 16:53:32.276316 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2475/4875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:31 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:32.773733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:32.776349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:32.803755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:32.804246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:32.804691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:32.805415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:32.805897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:32.806321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:32.928328 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ce33912-4b99-459d-869e-36aa3857b9e2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.158923 Sep 13 16:53:32.935513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2401/4876] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:32 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:33.308518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:33.311773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:33.328682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:33.329450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:33.330980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:33.332511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:33.333686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:33.334809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:33.942551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:33.946012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:33.961125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:33.966903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:33.967715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:33.969160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:33.969160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:33.969763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:34.068770 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1efa401-712a-45dd-8a59-4ceedba58a9e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.130018 Sep 13 16:53:34.074346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2402/4877] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:33 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:53:34.488850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:34.520905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-091bdd4a-f26f-4c66-a39f-2144634bd87c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 1.223800 Sep 13 16:53:34.538027 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2476/4878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:33 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:35.082627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:35.086606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:35.112974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:35.114942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:35.115587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:35.116954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:35.119189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:35.120658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:35.234990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40622441-5293-4ef7-8feb-4ca451c4a394 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.156482 Sep 13 16:53:35.240041 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2403/4879] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:35 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:35.551615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:35.554198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:35.572965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:35.575351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:35.579159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:35.581059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:35.583501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:35.586711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:35.962267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:35.971152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bcc7b5a4-c018-41ae-8a04-c00400a34f42 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.425113 Sep 13 16:53:35.975147 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2477/4880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:35 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:36.247654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:36.253010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:36.307334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:36.307334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:36.307334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:36.309589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:36.314068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:36.314996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:36.498561 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8e78cfa1-b010-4e00-abda-bc376d35a73f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.256292 Sep 13 16:53:36.500041 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2404/4881] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:36 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:37.008732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:37.015114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:37.037735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:37.039246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:37.040156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:37.041322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:37.042674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:37.043401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:37.512747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:37.515466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:37.541737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:37.544701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:37.545532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:37.548360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:37.551490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:37.552180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:37.663410 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7fd08898-5a20-4dba-9fba-662fbf258f54 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.156303 Sep 13 16:53:37.664222 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2405/4882] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:37 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:37.862063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:37.885122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc3e7a8b-cc21-402a-bd1d-99b8750d474e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.887645 Sep 13 16:53:37.890467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2478/4883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:36 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:38.679691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:38.686064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:38.714590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:38.718270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:38.719757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:38.728060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:38.729177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:38.730730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:38.875170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88a7b29f-4860-4623-9bf2-c235ffcb70a1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.203213 Sep 13 16:53:38.878864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2406/4884] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:38 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:38.914552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:38.915173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:38.936602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:38.937105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:38.937545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:38.938292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:38.938749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:38.939170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:39.599097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:39.609435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6be1fc80-4a5a-40c6-8fe1-d6bac3144147 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.698713 Sep 13 16:53:39.618192 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2479/4885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:38 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:39.887373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:39.890591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:39.926816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:39.927324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:39.927760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:39.930691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:39.931342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:39.932403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:40.075313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a38e09a-aa89-4f35-b53f-afee655c61a4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.191475 Sep 13 16:53:40.076890 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2407/4886] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:39 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:40.639430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:40.640140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:40.662718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:40.664241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:40.665541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:40.669035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:40.669959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:40.672425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:40.736282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-895428086", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "1324e2ca-97db-407f-b483-50c76d8852ff"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:40.869860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] validate_networks() for [('1324e2ca-97db-407f-b483-50c76d8852ff', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:53:41.288438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:41.317964 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-24fa4115-5ee5-468e-99f2-9eb392b589a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.666416 Sep 13 16:53:41.330581 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2408/4887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:40 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:41.344489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ab2fb099-17db-4719-b835-eb732d95e46e req-76c902ba-4e09-41ca-9a61-10baf96dd7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282001d0-4ba5-4e1e-96fa-a48dc071852e", "name": "network-vif-plugged", "status": "completed", "tag": "82930ba0-8975-43c3-8f81-f1933db203ec"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:41.363380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab2fb099-17db-4719-b835-eb732d95e46e req-76c902ba-4e09-41ca-9a61-10baf96dd7c2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:41.366682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab2fb099-17db-4719-b835-eb732d95e46e req-76c902ba-4e09-41ca-9a61-10baf96dd7c2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:41.367267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab2fb099-17db-4719-b835-eb732d95e46e req-76c902ba-4e09-41ca-9a61-10baf96dd7c2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:41.404914 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ab2fb099-17db-4719-b835-eb732d95e46e req-76c902ba-4e09-41ca-9a61-10baf96dd7c2 service nova] Creating event network-vif-plugged:82930ba0-8975-43c3-8f81-f1933db203ec for instance 282001d0-4ba5-4e1e-96fa-a48dc071852e on n-h1-857467-1 Sep 13 16:53:41.423642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ab2fb099-17db-4719-b835-eb732d95e46e req-76c902ba-4e09-41ca-9a61-10baf96dd7c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090977 Sep 13 16:53:41.424723 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2409/4888] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:41.431916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:41.436130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:41.445219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:41.446221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:41.446990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:41.447991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:41.452347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:41.453397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:41.540947 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a4bd41ae-05bc-44a5-8f4c-526e79b32a14 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 14 microversion: 2.1 time: 0.114262 Sep 13 16:53:41.545435 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2410/4889] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:41 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:53:42.356372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:42.357303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:42.413024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:42.413443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:42.413933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:42.414647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:42.415118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:42.415559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:43.065813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:43.076817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1996a604-b76c-4ee9-867b-2939ebeb7312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.733278 Sep 13 16:53:43.086252 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2411/4890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:42 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:43.108734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:43.111903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:43.137717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:43.145485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:43.146355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:43.147359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:43.148030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:43.150518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:43.268707 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b2d8743-79a4-471b-b104-b281ec0139b2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action" status: 200 len: 8205 microversion: 2.1 time: 0.180896 Sep 13 16:53:43.269781 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2412/4891] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:43 2022] POST /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776/action => generated 8205 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:43.283375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:43.284366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:43.300250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:43.307925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:43.308920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:43.313066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:43.313653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:43.314213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:43.943390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:43.961124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2fc97339-a35e-4fc9-b659-c89fc416d85e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.684032 Sep 13 16:53:43.976133 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2413/4892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:43 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:44.004160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:44.004829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:44.023705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:44.025953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:44.027405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:44.030126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:44.032416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:44.032905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:44.416089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:44.428242 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa075866-c06e-4796-a775-cd7bbc764ac0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.435692 Sep 13 16:53:44.451930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2414/4893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:43 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:44.460616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:44.462176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:44.474279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:44.477695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:44.478526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:44.479718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:44.480861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:44.482867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:45.022551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:45.041013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9202de87-08dc-44b1-9e0a-eba4285b3b23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1316 microversion: 2.1 time: 0.585654 Sep 13 16:53:45.053854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2415/4894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:44 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:45.065656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:45.067594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:45.098494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:45.098758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:45.099208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:45.099933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:45.100404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:45.102574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:45.264499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:53:45.266655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:53:45.266655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:53:45.266655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:53:45.266655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:53:45.268889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:45.297329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:45.297750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:45.298225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:45.298971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:45.299437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:45.299870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:45.369335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Getting quotas for project adb0938b4c884dc0a1467383e16fbf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:53:45.388007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Getting quotas for user 24f2e3c66387486c9b8dc9d7dffefe71 and project adb0938b4c884dc0a1467383e16fbf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:53:45.457967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:53:45.463549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:53:45.625840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70ac56a6-5db5-412f-9514-492fb483d0ae tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.398396 Sep 13 16:53:45.636129 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2480/4895] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:53:45.752340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee37b2dc-d4ab-4729-820a-3891de9eb70b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: .version_select at 0x7fbeb45580d0>, body: {"keypair": {"name": "tempest-keypair-1828562179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/0dq+1EllLLlGSsBpAbVNYAzQ0WXkLi3IG53xurHqQqqckmdMbw7gKmUNvG35PPtd/7Hg0u6EjY43gNXwMI37LqOhrkszb3VxmHUmog5mHvOTd2bTdCHDdZm2gY2qAaw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:45.803217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ee37b2dc-d4ab-4729-820a-3891de9eb70b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:53:45.811886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ee37b2dc-d4ab-4729-820a-3891de9eb70b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:53:45.915791 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee37b2dc-d4ab-4729-820a-3891de9eb70b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277453 Sep 13 16:53:45.939414 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2481/4896] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:53:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:45.953386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bda848a9-42f0-431d-9560-c748b235aa1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:45.954047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bda848a9-42f0-431d-9560-c748b235aa1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:45.972151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:45.988258 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-921399a5-bd99-4199-a96e-22cf9ef08b56 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.943136 Sep 13 16:53:45.988874 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2416/4897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:45 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:46.040912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:46.041696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:46.068498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:46.069010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:46.073695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:46.075134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:46.075705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:46.079637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:46.178378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bda848a9-42f0-431d-9560-c748b235aa1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:46.187151 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bda848a9-42f0-431d-9560-c748b235aa1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1217 microversion: 2.1 time: 0.242814 Sep 13 16:53:46.191204 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2482/4898] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:45 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:46.209085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:46.211755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:46.233345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:46.234263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:46.234865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:46.236468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:46.237107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:46.239033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:46.752415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:46.769435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31cc68d9-c928-457d-bf8a-2d150b410ce3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1506 microversion: 2.1 time: 0.576924 Sep 13 16:53:46.786175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2483/4899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:46 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:46.800300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:46.800826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:46.818131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:46.818968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:46.819435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:46.820181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:46.821269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:46.822331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:46.908541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:53:47.211142 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4605540a-f7e2-444d-8ede-54ccd234469c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "DELETE /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 204 len: 0 microversion: 2.1 time: 0.414538 Sep 13 16:53:47.213936 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2484/4900] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:53:46 2022] DELETE /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:53:47.222151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:47.223123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:47.236981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.238109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.238859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.239825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.240700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.242147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.463524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:47.474355 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f23b619d-08a2-448d-8046-67855c7b506f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 1.453017 Sep 13 16:53:47.491354 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2417/4901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:46 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:47.502887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:47.503817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:47.510784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.513190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.513945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.514930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.515602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.516267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.535518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:47.554279 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2f26b25-6e36-4fd1-8273-fc76ea82b33b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1213 microversion: 2.1 time: 0.334316 Sep 13 16:53:47.556047 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2485/4902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:47 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:47.572807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:47.573675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:47.601495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.603174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.608094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.609281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.609780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.611759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.754466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Locking {{(pid=122328) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 13 16:53:47.853261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:47.865444 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b58e711-2267-4af0-85a0-66245edec826 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1512 microversion: 2.1 time: 0.372745 Sep 13 16:53:47.869023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2418/4903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:47 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:47.880467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-328a15ef-da6a-4e18-9c42-372baad4e0aa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.319600 Sep 13 16:53:47.881273 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2486/4904] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:47 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:53:47.889904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:47.890772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:47.900883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.903504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.904926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.908156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:47.908659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:47.909371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:47.942914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:48.247836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:48.276106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-116bd8a6-a0de-4b05-a687-51f54c9c4b84 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.389069 Sep 13 16:53:48.282188 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2419/4905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:47 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:48.307663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:48.327902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:48.329599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:48.330314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:48.584166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:48.584799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:48.606802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:48.607321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:48.618349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:48.619378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:48.619948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:48.620404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.122884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:49.145881 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d320151a-c724-4626-8eec-e3239aebf60c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1269 microversion: 2.1 time: 0.560120 Sep 13 16:53:49.146852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2420/4906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:48 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1269 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:49.152920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:49.153742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:49.166382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.168488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.169096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.170035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.170660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.171283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.229044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:49.244617 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] HTTP exception thrown: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 is locked Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Request method failure captured: Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action HTTP/1.1 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 15 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILREpgdA0POFKZKOjEeabEg6LNC0o1q1LrmhL-MQDYaKVNdWQ4Qnhea6ugkpyR98ZD11R0cCxeNblnQcfFUHpKEb4h_9XuWpiNHUvsl6Sq6IZDepS8ZtRBtbkJOw_aRBoqE13e647mdXEuAVVMrz0HkT1v2nzME7WbRw1Tdv8Ujgf-g Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_080f8140d40642d9b47f0689e294887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c2c12edf9f8d4b23bd1074facb2fad9d Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: {"os-stop": {}} Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 is locked Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '103aa645-a414-44d6-8c46-ab3cf2959ea8', 'body': {'os-stop': {}}} Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 is locked Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 is locked Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 is locked Sep 13 16:53:49.246579 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:49.251679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Returning 409 to user: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 is locked {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:49.251679 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d17a034a-1134-4b90-b311-4779940f933a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 409 len: 107 microversion: 2.1 time: 0.944592 Sep 13 16:53:49.251679 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2487/4907] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:48 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 107 bytes in 946 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:53:49.265233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:49.265795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:49.286072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.286814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.287447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.288717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.291093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.291747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.384653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Unlocking {{(pid=122328) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 13 16:53:49.488936 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2029e7e5-6dc9-46d1-a63f-c933f9533463 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.234725 Sep 13 16:53:49.491069 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2488/4908] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:49 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:53:49.502510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a796f438-17f8-475f-a1b0-c3a0c2a934a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:49.513310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a796f438-17f8-475f-a1b0-c3a0c2a934a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.514053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a796f438-17f8-475f-a1b0-c3a0c2a934a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.514695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a796f438-17f8-475f-a1b0-c3a0c2a934a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.601857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a796f438-17f8-475f-a1b0-c3a0c2a934a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Going to try to stop instance {{(pid=122328) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:53:49.756984 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a796f438-17f8-475f-a1b0-c3a0c2a934a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.260844 Sep 13 16:53:49.758400 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2489/4909] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:53:49 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:53:49.777344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:49.778713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:49.786638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.787351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.787947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:49.788778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:49.789715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:49.790432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:50.438903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:50.451618 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f52f2f88-eff3-4883-bb90-ea4a8cac4325 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.687225 Sep 13 16:53:50.458028 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2490/4910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:49 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:50.474953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:50.476006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:50.487647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:50.488670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:50.489390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:50.492285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:50.493026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:50.493716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:50.568360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:50.587982 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2112e4a4-9d0b-42cb-9036-3ab00c77b8a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1512 microversion: 2.1 time: 1.436518 Sep 13 16:53:50.589417 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2421/4911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:49 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1512 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:50.669517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:50.678620 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8de03ac2-7464-40c6-be8c-ad931b71f274 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1275 microversion: 2.1 time: 0.219277 Sep 13 16:53:50.687822 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2491/4912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:50 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:51.197793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1fdbee6a-da01-4cd7-8675-2f8cce74e642 req-2e81d9bf-342e-4623-b62c-9fbd0817b489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282001d0-4ba5-4e1e-96fa-a48dc071852e", "name": "network-vif-deleted", "tag": "82930ba0-8975-43c3-8f81-f1933db203ec"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:51.229389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=56 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:51.280828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1fdbee6a-da01-4cd7-8675-2f8cce74e642 req-2e81d9bf-342e-4623-b62c-9fbd0817b489 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:51.285322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1fdbee6a-da01-4cd7-8675-2f8cce74e642 req-2e81d9bf-342e-4623-b62c-9fbd0817b489 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:51.294390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1fdbee6a-da01-4cd7-8675-2f8cce74e642 req-2e81d9bf-342e-4623-b62c-9fbd0817b489 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:51.317215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1639178524", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a782e2f4-354d-45ea-a878-8641bbe8c757"}], "security_groups": [{"name": "tempest-securitygroup--1690530935"}], "key_name": "tempest-keypair-1828562179", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:51.324216 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1fdbee6a-da01-4cd7-8675-2f8cce74e642 req-2e81d9bf-342e-4623-b62c-9fbd0817b489 service nova] Creating event network-vif-deleted:82930ba0-8975-43c3-8f81-f1933db203ec for instance 282001d0-4ba5-4e1e-96fa-a48dc071852e on n-h1-857467-1 Sep 13 16:53:51.358838 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1fdbee6a-da01-4cd7-8675-2f8cce74e642 req-2e81d9bf-342e-4623-b62c-9fbd0817b489 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164792 Sep 13 16:53:51.373961 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2422/4913] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:51.479837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:51.481050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:51.517507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:51.518622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:51.519285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:51.520290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:51.521153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:51.521872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:52.052173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:52.072967 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e36ce8f7-19c2-4b28-8f72-4bdfdfa64aa0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.598517 Sep 13 16:53:52.075327 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2423/4914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:51 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:52.082757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:52.088823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:52.100832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:52.105242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:52.106070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:52.107058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:52.107791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:52.113421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:52.191617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:52.194366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:52.195150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:52.197551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'fault' on Instance uuid 282001d0-4ba5-4e1e-96fa-a48dc071852e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:53:52.333216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:52.345330 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-156ef302-38dc-491c-adc9-583a9ebc7dff tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 200 len: 1306 microversion: 2.1 time: 0.265723 Sep 13 16:53:52.346271 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2424/4915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:52 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:52.356193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:52.358709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:52.377571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:52.380493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:52.380989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:52.384522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:52.385044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:52.387580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:52.669125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] validate_networks() for [('a782e2f4-354d-45ea-a878-8641bbe8c757', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:53:52.831987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:52.845521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9c43c4b-f669-4841-80fb-2db9f4a1af92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.496412 Sep 13 16:53:52.860438 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2425/4916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:52 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:53.101638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:53.102362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:53.114349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:53.114871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:53.118112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:53.118900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:53.120196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:53.120726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:53.755538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:53.768852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1990c64-11ec-4206-9e8e-d9de7072d6fd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.670978 Sep 13 16:53:53.772729 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2426/4917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:53 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:53.779357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:53.780734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:53.789958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:53.791053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:53.791821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:53.794285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:53.794972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:53.795716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:53.821014 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e HTTP/1.1 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '282001d0-4ba5-4e1e-96fa-a48dc071852e'} Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:53.822767 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94b9b8a2-0ab7-46f8-b629-1384e0d3b7b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 404 len: 111 microversion: 2.1 time: 0.049828 Sep 13 16:53:53.829235 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2427/4918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:53 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:53:53.841496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:53.842162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:53.853847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:53.869130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:53.869975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:53.871522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:53.872345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:53.872963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:54.295378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:53:54.295880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:53:54.296299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:53:54.297047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:53:54.297484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:53:54.316344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:54.317262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:54.318142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:54.319092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:54.320710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:54.325185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:54.377735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:53:54.390935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:53:54.428770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:53:54.434712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:53:54.484059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:54.498610 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb5e8d91-d17f-4d28-a2ce-a0d9c27e8373 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.662650 Sep 13 16:53:54.499862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2428/4919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:53 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:54.509054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:54.509903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:54.536945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:54.537813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:54.539390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:54.540719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:54.541889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:54.543324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:54.606650 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14d21aee-0437-4d51-9f81-275157e7a043 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.290931 Sep 13 16:53:54.607482 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2492/4920] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:53:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 16:53:54.628012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abe5b13a-29f7-4bc7-9a28-8f756f21eb32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:54.628654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abe5b13a-29f7-4bc7-9a28-8f756f21eb32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:54.738543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abe5b13a-29f7-4bc7-9a28-8f756f21eb32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:54.748396 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abe5b13a-29f7-4bc7-9a28-8f756f21eb32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1242 microversion: 2.1 time: 0.132672 Sep 13 16:53:54.749011 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2493/4921] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:54 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:54.766134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-861dfb7e-55a6-4d0d-88d8-b1fc3cb9847f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-861dfb7e-55a6-4d0d-88d8-b1fc3cb9847f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 163 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": 12345, "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 12345 Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:53:54.770427 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-861dfb7e-55a6-4d0d-88d8-b1fc3cb9847f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-861dfb7e-55a6-4d0d-88d8-b1fc3cb9847f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019701 Sep 13 16:53:54.775729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2494/4922] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:53:54 2022] POST /compute/v2.1/servers => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:53:54.797090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:54.797739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:54.816477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:54.816992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:54.817441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:54.818253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:54.818709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:54.819330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:55.295611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:55.306817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-633dace2-b7d8-4d9b-8f08-6036266aaff7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.805534 Sep 13 16:53:55.310357 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2429/4923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:54 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:55.323279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:55.324507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:55.346571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:55.348906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:55.349544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:55.350511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:55.352267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:55.359968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:55.503116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:55.520723 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8115f62e-5672-4784-8ade-34ead4cec5d9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.740676 Sep 13 16:53:55.526525 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2495/4924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:54 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:55.542263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4fe26549-2300-4564-87fc-2c172af884a0 req-f1a0c1c5-dc37-4727-8d50-7555a1929094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6e5b15-642d-4cbd-b3da-e74c9f583f2c", "tag": "81f88411-ed0b-4ed9-a00a-b499fd3eeb3f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:55.589473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4fe26549-2300-4564-87fc-2c172af884a0 req-f1a0c1c5-dc37-4727-8d50-7555a1929094 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:55.592188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4fe26549-2300-4564-87fc-2c172af884a0 req-f1a0c1c5-dc37-4727-8d50-7555a1929094 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:55.595510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4fe26549-2300-4564-87fc-2c172af884a0 req-f1a0c1c5-dc37-4727-8d50-7555a1929094 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:55.612738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4fe26549-2300-4564-87fc-2c172af884a0 req-f1a0c1c5-dc37-4727-8d50-7555a1929094 service nova] Creating event network-changed:81f88411-ed0b-4ed9-a00a-b499fd3eeb3f for instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c on n-h2-857467-1 Sep 13 16:53:55.646586 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4fe26549-2300-4564-87fc-2c172af884a0 req-f1a0c1c5-dc37-4727-8d50-7555a1929094 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116745 Sep 13 16:53:55.648284 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2496/4925] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:53:55.675951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:55.676880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:55.698780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:55.701463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:55.704272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:55.707694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:55.708378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:55.711855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:56.307403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:56.319312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d807ff51-cff0-4c09-8723-66d3fbb6fa7c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.664059 Sep 13 16:53:56.335418 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2497/4926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:55 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:56.348585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:56.349215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:56.364739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:56.365242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:56.365687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:56.366444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:56.366913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:56.367346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:56.488138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:56.502121 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b59461ce-6ada-4a12-b74d-e09ca7587be2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1294 microversion: 2.1 time: 0.161314 Sep 13 16:53:56.503497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2498/4927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:56 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1294 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:56.508967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:56.514112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:56.517440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:56.528362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:56.534356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:56.535166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:56.536163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:56.536854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:56.537464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:56.542147 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e793a7f5-6828-48a8-b912-07d4bab88ac6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 1.230293 Sep 13 16:53:56.546480 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2430/4928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:55 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:56.811477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:56.822703 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-115b889e-3125-495b-9f33-fea7be3473d1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.317088 Sep 13 16:53:56.826109 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2499/4929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:56 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:57.534597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:57.536045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:57.567915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:57.574443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:57.575464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:57.576234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:57.578483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:57.581226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:57.581817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:57.583932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:57.596657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:57.599125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:57.599774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:57.600686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:57.601322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:57.601967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:57.850974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:57.864013 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-928ade7a-88e8-42e0-a582-01f432e31091 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.290447 Sep 13 16:53:57.866474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:57.878695 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2500/4930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:57 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:57.882999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b03ba9d3-0189-4b38-a60c-91c9fb3922ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1300 microversion: 2.1 time: 0.352219 Sep 13 16:53:57.883914 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2431/4931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:57 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1300 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:57.909649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:57.910604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:57.917623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:57.918420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:57.919037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:57.920161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:57.920822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:57.921442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:58.279024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:58.296613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3439200-e07b-4a2c-9227-aae3731c844e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.396022 Sep 13 16:53:58.297604 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2501/4932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:57 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:58.914406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:58.915031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:58.916157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:58.916794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:58.937240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:58.937240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:58.937240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:58.938089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:58.938089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:58.938279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:58.969748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:58.978667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:58.979134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:58.979900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:58.981235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:58.982570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:59.110663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:59.123911 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-af87508e-0751-46ba-bc8a-4348541da12a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1300 microversion: 2.1 time: 0.211212 Sep 13 16:53:59.124524 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2502/4933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:58 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:53:59.320707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:59.321535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:59.334199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:59.334900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:59.336992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:59.337975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:59.341530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:59.342227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:59.660244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:53:59.673427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:53:59.680024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee0d8522-afcd-4b5e-b6b2-39125432d250 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.363087 Sep 13 16:53:59.681316 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2503/4934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:59 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:53:59.690887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12ccbe8d-36ee-4c01-8cb9-eda174c66a4b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260479779", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "31150698-ce08-4b40-984c-42e14a12e47f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:53:59.811822 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-12ccbe8d-36ee-4c01-8cb9-eda174c66a4b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Block Device 31150698-ce08-4b40-984c-42e14a12e47f is not bootable. Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12ccbe8d-36ee-4c01-8cb9-eda174c66a4b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 358 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260479779", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "31150698-ce08-4b40-984c-42e14a12e47f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: exception: Block Device 31150698-ce08-4b40-984c-42e14a12e47f is not bootable. Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1260479779', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '31150698-ce08-4b40-984c-42e14a12e47f'}], 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 31150698-ce08-4b40-984c-42e14a12e47f is not bootable. Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:53:59.826109 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 31150698-ce08-4b40-984c-42e14a12e47f is not bootable. Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 31150698-ce08-4b40-984c-42e14a12e47f is not bootable. Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12ccbe8d-36ee-4c01-8cb9-eda174c66a4b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Block Device 31150698-ce08-4b40-984c-42e14a12e47f is not bootable. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12ccbe8d-36ee-4c01-8cb9-eda174c66a4b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.144227 Sep 13 16:53:59.830107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2504/4935] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:53:59 2022] POST /compute/v2.1/servers => generated 110 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:53:59.843849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:53:59.844477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:53:59.856481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:59.856990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:59.857433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:53:59.858192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:53:59.858657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:53:59.860926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:00.111533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:00.125037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7b2e4a8-bb5f-4577-afe9-449bd560ebe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.289969 Sep 13 16:54:00.127378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2505/4936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:59 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:00.150562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:00.152982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:00.166088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:00.167283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:00.170413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:00.172254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:00.174144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:00.174774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:00.300773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:00.312126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36e049db-6671-4c01-9f72-7ea7d692e67f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1300 microversion: 2.1 time: 0.166335 Sep 13 16:54:00.313415 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2506/4937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:00 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:00.319714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:00.321765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:00.325321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:00.335564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:00.336395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:00.337124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:00.338653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:00.339507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:00.340554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:00.381847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:00.398489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-358960d2-eb7c-4c63-9b59-4bfa4c4f796a tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 1.489449 Sep 13 16:54:00.400767 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2432/4938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:53:58 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:00.587690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:00.604043 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa6fa58e-af5a-4857-8a1c-7672d33201a7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.289204 Sep 13 16:54:00.607887 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2507/4939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:00 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:00.710929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:00.711921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:00.722314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:00.722823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:00.723268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:00.723986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:00.729323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:00.734149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:01.340211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:01.340874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:01.351987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:01.359258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:01.359983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:01.360934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:01.361578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:01.362242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:01.548098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:01.557660 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-559102de-238a-45b9-a4af-31bd91ed4931 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.853640 Sep 13 16:54:01.561687 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2433/4940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:00 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:01.568337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:01.573176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:01.587535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:01.588300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:01.591373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:01.592403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:01.593043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:01.594355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:01.920763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:01.938920 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e5586cbc-4894-496d-93b7-f594fe774493 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.602809 Sep 13 16:54:01.953854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2508/4941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:01 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:02.172916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:02.181560 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72cfd7d8-a13e-443a-b1c8-d0d90bd0cb66 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1655 microversion: 2.1 time: 0.618483 Sep 13 16:54:02.190627 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2434/4942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:01 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1655 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:02.219972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fdc2bcac-0348-4ac0-815c-bff4e6a50460 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:02.233871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdc2bcac-0348-4ac0-815c-bff4e6a50460 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.235349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdc2bcac-0348-4ac0-815c-bff4e6a50460 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.236050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdc2bcac-0348-4ac0-815c-bff4e6a50460 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:02.296402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fdc2bcac-0348-4ac0-815c-bff4e6a50460 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Going to try to start instance {{(pid=122328) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 16:54:02.397804 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fdc2bcac-0348-4ac0-815c-bff4e6a50460 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.183914 Sep 13 16:54:02.399380 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2509/4943] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:02 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:02.408590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:02.409557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:02.423725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.424516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.425176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:02.426147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.427616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.428275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:02.583228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:02.584033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:02.595910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.596476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.596939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:02.597994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.598480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.598935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:02.915722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:02.952913 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e8b805a-1c4d-4a1e-850f-f2a4fd5fe4f2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1664 microversion: 2.1 time: 0.542059 Sep 13 16:54:02.953608 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2435/4944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:02 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1664 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:02.978483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:02.979596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:02.986575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.987563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.988210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:02.989203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:02.990042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:02.990675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:03.037591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:03.069786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea156b61-d952-4527-ab84-3b4b618bc2c5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 0.491821 Sep 13 16:54:03.076350 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2510/4945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:02 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:03.517232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:03.524302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:03.529785 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0e87e04-bdc0-4c57-ba98-c7d984d4f3d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.561501 Sep 13 16:54:03.543995 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2436/4946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:02 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:03.653415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d1cf647-40b3-4b9a-a90f-6cb5661a4e96 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1169802138", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "destination_type": "local"}, {"source_type": "volume", "uuid": "3fac1e63-ee62-4c11-a5a8-21c4c17f08f4", "destination_type": "invalid"}], "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d1cf647-40b3-4b9a-a90f-6cb5661a4e96 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 495 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1169802138", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "destination_type": "local"}, {"source_type": "volume", "uuid": "3fac1e63-ee62-4c11-a5a8-21c4c17f08f4", "destination_type": "invalid"}], "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1169802138', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3fac1e63-ee62-4c11-a5a8-21c4c17f08f4', 'destination_type': 'invalid'}], 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'invalid' Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:03.661009 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d1cf647-40b3-4b9a-a90f-6cb5661a4e96 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5d1cf647-40b3-4b9a-a90f-6cb5661a4e96 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.016037 Sep 13 16:54:03.664938 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2511/4947] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:03 2022] POST /compute/v2.1/servers => generated 155 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:03.673681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:03.674537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:03.682174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:03.682832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:03.683991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:03.684882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:03.685586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:03.686728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:03.768210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e639c3b6-d7a7-4cc8-ba9b-b6cc6d767cc8 req-be5cb86b-9b9b-4c83-a1b8-0667900e2e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6e5b15-642d-4cbd-b3da-e74c9f583f2c", "name": "network-vif-plugged", "status": "completed", "tag": "81f88411-ed0b-4ed9-a00a-b499fd3eeb3f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:03.784201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e639c3b6-d7a7-4cc8-ba9b-b6cc6d767cc8 req-be5cb86b-9b9b-4c83-a1b8-0667900e2e41 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:03.787965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e639c3b6-d7a7-4cc8-ba9b-b6cc6d767cc8 req-be5cb86b-9b9b-4c83-a1b8-0667900e2e41 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:03.788758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e639c3b6-d7a7-4cc8-ba9b-b6cc6d767cc8 req-be5cb86b-9b9b-4c83-a1b8-0667900e2e41 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:03.803229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e639c3b6-d7a7-4cc8-ba9b-b6cc6d767cc8 req-be5cb86b-9b9b-4c83-a1b8-0667900e2e41 service nova] Creating event network-vif-plugged:81f88411-ed0b-4ed9-a00a-b499fd3eeb3f for instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c on n-h2-857467-1 Sep 13 16:54:03.812096 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e639c3b6-d7a7-4cc8-ba9b-b6cc6d767cc8 req-be5cb86b-9b9b-4c83-a1b8-0667900e2e41 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051467 Sep 13 16:54:03.813168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2512/4948] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:54:03.983382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:03.984337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:03.991647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:03.992486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:03.993195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:03.994286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:03.994980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:03.996261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.184217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:04.221348 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eedc508a-9fc6-4e9f-babe-4735fac23f3c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.552203 Sep 13 16:54:04.224374 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2437/4949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:03 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:04.232935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5d3b778e-1b07-46d6-9efe-89d8c85f2076 req-a626c76b-838f-43cd-b9cb-79de29913332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54d3d86-40a0-4e90-8c28-333d854dc2b9", "tag": "c4ce824e-54d5-45c1-8ef7-f4dc27780125"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:04.251440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5d3b778e-1b07-46d6-9efe-89d8c85f2076 req-a626c76b-838f-43cd-b9cb-79de29913332 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.252264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5d3b778e-1b07-46d6-9efe-89d8c85f2076 req-a626c76b-838f-43cd-b9cb-79de29913332 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.252717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5d3b778e-1b07-46d6-9efe-89d8c85f2076 req-a626c76b-838f-43cd-b9cb-79de29913332 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.267972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5d3b778e-1b07-46d6-9efe-89d8c85f2076 req-a626c76b-838f-43cd-b9cb-79de29913332 service nova] Creating event network-changed:c4ce824e-54d5-45c1-8ef7-f4dc27780125 for instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 on n-h1-857467-1 Sep 13 16:54:04.314571 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5d3b778e-1b07-46d6-9efe-89d8c85f2076 req-a626c76b-838f-43cd-b9cb-79de29913332 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087870 Sep 13 16:54:04.315510 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2438/4950] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:04.320751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:04.321465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:04.328708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.329213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.329662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.330413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.330882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.331322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.358403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:04.363153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:04.376542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a31190d9-e51d-40d6-a81c-b07e5e21c043 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1664 microversion: 2.1 time: 0.397533 Sep 13 16:54:04.381286 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2513/4951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:03 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1664 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:04.388996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:04.389947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:04.403277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.403795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.404251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.404994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.405465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.405928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.743153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:04.785996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:04.810430 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ef7bd46-85ed-4621-a605-42108d3566cf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.425447 Sep 13 16:54:04.811423 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2514/4952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:04 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:04.816679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:04.817532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:04.838548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.839784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.840578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:04.842270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:04.843889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:04.844654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.015732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:05.029743 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4c55b78-45ac-41bb-a4fa-731d404a8f3f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.216949 Sep 13 16:54:05.031565 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2515/4953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:04 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:05.037714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06f56df8-7699-4651-9655-042d3c0a4b78 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-564715481", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06f56df8-7699-4651-9655-042d3c0a4b78 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 491 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-564715481", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-564715481', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.042104 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 13 16:54:05.046864 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.050274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06f56df8-7699-4651-9655-042d3c0a4b78 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:05.052241 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06f56df8-7699-4651-9655-042d3c0a4b78 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.019671 Sep 13 16:54:05.053279 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2516/4954] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:05 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:05.062501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:05.063235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:05.072460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.073297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.074958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.076008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.076685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.077349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.256612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:05.268721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4025d126-3cf4-41e0-b0b3-e2e273f9ea2e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.210951 Sep 13 16:54:05.269230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2517/4955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:05 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:05.295561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:05.296356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:05.299358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:05.305064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.305707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.306203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.307121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.309033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.309996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.318860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4f4f23f-bca0-410d-adc8-68306634828f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1317 microversion: 2.1 time: 1.000171 Sep 13 16:54:05.319920 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2439/4956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:04 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1317 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:05.419881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:05.421152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:05.444089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.444728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.450403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.452008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.463091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.465516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.554715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:05.568511 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fbaff08f-91b8-4bf6-9c02-b0d7e17029a2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.277007 Sep 13 16:54:05.569989 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2518/4957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:05 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:05.706275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e99f97f-2481-4cd6-8ab8-96c007f3ce89 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e99f97f-2481-4cd6-8ab8-96c007f3ce89 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 416 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.712313 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:54:05.717173 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:05.720370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e99f97f-2481-4cd6-8ab8-96c007f3ce89 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:05.721962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e99f97f-2481-4cd6-8ab8-96c007f3ce89 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.021428 Sep 13 16:54:05.723981 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2519/4958] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:05 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:05.761461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:05.776148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:05.797400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.798093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.798719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.799441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.800070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.800517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.921580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:05.929943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-85d40f01-4c5b-4752-a341-dad12e81dbb2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.524713 Sep 13 16:54:05.942620 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2440/4959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:05 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:05.971852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:05.972740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:05.980943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.982065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.982585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:05.983546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:05.984333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:05.984977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.008551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:06.025613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3d40211-e750-4cbe-94ad-c19ff88a2727 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.266855 Sep 13 16:54:06.029367 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2520/4960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:05 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:06.055510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:06.056473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:06.071556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.072415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.072982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.074407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.075400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.076045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.269392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:06.285400 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c714c2a4-cb2a-484a-a282-f93a866766d6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.236929 Sep 13 16:54:06.289946 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2521/4961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:06 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:06.295530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:06.296399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:06.310941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.312344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.313517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.314645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.315252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.315849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.317751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:06.326634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e508588d-1185-477e-8d89-ac0115b8b40b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.358670 Sep 13 16:54:06.338826 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2441/4962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:05 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:06.344935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:06.345757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:06.363742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.364258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.364706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.365429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.365917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.366349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.568074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:06.577239 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44624bc8-f48f-4c0b-b592-56e00a83b9ee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.285777 Sep 13 16:54:06.590108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2522/4963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:06 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:06.590108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:06.590108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:06.591138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.591882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.592789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.593732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.594785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.595448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.634569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:06.653038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Unlocking {{(pid=122328) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 13 16:54:06.694016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:06.715499 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c7be761-8011-4830-9a98-e11de2bb6bc4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1507 microversion: 2.1 time: 0.372848 Sep 13 16:54:06.727808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0bca1694-a7fa-4716-b718-508605cbd6ff tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.148332 Sep 13 16:54:06.728129 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2442/4964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:06 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:06.731160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2523/4965] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:06 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:06.741475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:06.742137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:06.742277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b882dc00-607f-45b6-a0f4-d385a1611d8a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1643739522", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": -1, "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:06.749588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.750483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.751102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.752050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.752686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.753288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.760620 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b882dc00-607f-45b6-a0f4-d385a1611d8a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Flavor -1 could not be found. Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b882dc00-607f-45b6-a0f4-d385a1611d8a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 206 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1643739522", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": -1, "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: exception: Flavor -1 could not be found. Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1643739522', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': -1, 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:06.786153 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 13 16:54:06.792116 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:06.797073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b882dc00-607f-45b6-a0f4-d385a1611d8a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:06.798941 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b882dc00-607f-45b6-a0f4-d385a1611d8a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.068308 Sep 13 16:54:06.800152 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2443/4966] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:54:06.811380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:06.812303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:06.818573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.819074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.819534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.820231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:06.821087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:06.821894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:06.999113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:07.013695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bcec0602-f1cf-4b57-9c78-709163461e0f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.277161 Sep 13 16:54:07.029864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2524/4967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:06 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:07.030511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:07.035687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.051620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.052816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.053477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.054400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.055072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.055747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.079123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:07.097316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb3a9b9d-d526-46ad-823b-54992c58cb90 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1507 microversion: 2.1 time: 0.295836 Sep 13 16:54:07.097941 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2444/4968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:06 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:07.113603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:07.115902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.124965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.125761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.126433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.127487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.131826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.132739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.340709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:07.357531 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d74f6fc7-c2fc-416c-93a1-f1457975111e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.337005 Sep 13 16:54:07.358979 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2525/4969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:07 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:07.370924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:07.386931 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b7ad65c3-a8c5-4351-8658-de0973d36e23 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.280824 Sep 13 16:54:07.387461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:07.390928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.397970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.398778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.398921 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2445/4970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:07 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:07.400211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.401381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.402843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.403512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.419010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:07.419666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.433692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.435438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.436003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.453400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.455691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.456312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.557503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:54:07.559410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:54:07.560216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:54:07.560944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:54:07.562101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:54:07.665797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.684979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.685733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.686963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.687868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.688498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.689094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.729397 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0770ca28-7f11-43ad-adf9-a397413b8576 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "POST /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c/action" status: 202 len: 1109 microversion: 2.1 time: 0.346990 Sep 13 16:54:07.730994 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2526/4971] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:07 2022] POST /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c/action => generated 1109 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 13 16:54:07.737307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:07.738180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.746309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.747117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.747718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.748592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.749611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.750257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.814354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:07.823671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c12f1d1a-9aa3-45b0-bb3d-2207f6e95362 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.423410 Sep 13 16:54:07.824329 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2446/4972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:07 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:07.829767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:07.831083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:07.837404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.838261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.838983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:07.840354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:07.841188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:07.841814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.035260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:08.045528 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5dd8464b-f6e9-4265-bc3a-b91a59735236 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.219875 Sep 13 16:54:08.046658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2447/4973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:07 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:08.062072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:08.063049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:08.071235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.072043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.072673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.074266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.075066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.075827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.204345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:08.218060 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a35e115-9975-4e0e-a9a7-8e80e97870a6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.484897 Sep 13 16:54:08.231169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2527/4974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:07 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:08.242076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-024eefc0-b42e-40aa-a8af-3e2f9f82b699 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1300646457", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-024eefc0-b42e-40aa-a8af-3e2f9f82b699 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 173 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1300646457", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1300646457', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi -1 Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:08.247333 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-024eefc0-b42e-40aa-a8af-3e2f9f82b699 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-024eefc0-b42e-40aa-a8af-3e2f9f82b699 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.016511 Sep 13 16:54:08.253575 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2528/4975] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:08.257527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:08.258097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:08.266630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.267148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.267966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.268325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.268800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.269239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.347250 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7cf110b-8afb-47ae-ace0-9190ed7a973b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.093199 Sep 13 16:54:08.348252 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2529/4976] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:08 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:08.355472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:08.356511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:08.365251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.366855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.367545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.368668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.369328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.369952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.411603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:08.422591 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dfed02a4-c316-41c8-89e6-82ad42da84a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.374630 Sep 13 16:54:08.423587 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2448/4977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:08 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:08.428450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:08.429287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:08.437457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.438495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.439039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.439853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.440547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.441171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.632559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:08.645204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-23a69f96-fc74-4084-83bf-0c31a75fff9c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1673 microversion: 2.1 time: 0.220250 Sep 13 16:54:08.656626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2449/4978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:08 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:08.803813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:08.816852 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5262b58c-4e19-4a62-8290-06fe424ca70c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.467008 Sep 13 16:54:08.818060 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2530/4979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:08 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:08.860733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:08.864033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:08.903744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.910545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.911871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:08.913460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:08.915945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:08.917500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.072319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:09.072992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:09.081520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.082458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.082977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.083970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.084547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.095981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.229193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:09.239142 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7ea18e08-63e9-47ca-b425-0dc0df7215db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.397571 Sep 13 16:54:09.242139 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2450/4980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:08 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:09.388591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0335804-205c-45d8-b3de-a26a9c0ddb00 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063310782", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:09.398977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c0335804-205c-45d8-b3de-a26a9c0ddb00 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0335804-205c-45d8-b3de-a26a9c0ddb00 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 216 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063310782", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2063310782', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:09.400809 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:09.405691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0335804-205c-45d8-b3de-a26a9c0ddb00 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:09.407508 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0335804-205c-45d8-b3de-a26a9c0ddb00 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.022952 Sep 13 16:54:09.413153 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2451/4981] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:09 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:54:09.421977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:09.422903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:09.445297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.447038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.447666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.449943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.450675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.451275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.553840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:09.570230 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a62e2da4-7a72-4058-b2da-01613813b705 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.501199 Sep 13 16:54:09.571996 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2531/4982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:09 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:09.586308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:09.586951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:09.602105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.602841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.603455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.604458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.605163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.605764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.727933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:09.748549 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5fb827fe-95de-4dd0-9ddf-b0e9677c69bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.334228 Sep 13 16:54:09.749348 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2452/4983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:09 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:09.758995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:09.759877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:09.766734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.774008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.774469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.775471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.775935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.776363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.849175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:09.859294 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c56650d0-3c91-444a-bd44-9c5e11c0f221 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.286870 Sep 13 16:54:09.862251 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2532/4984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:09 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:09.870096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:09.871542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:09.896475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.897442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.898057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:09.898907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:09.899570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:09.900572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.038867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:10.049728 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f67808b7-818a-46ab-8fd0-b9457162fc62 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1653 microversion: 2.1 time: 0.299041 Sep 13 16:54:10.050727 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2453/4985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:09 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1653 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:10.163984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:10.180190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44324a0d-1232-455e-9adf-3fda7de8fdb4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.314149 Sep 13 16:54:10.184089 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2533/4986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:09 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:10.210106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:10.211184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:10.227104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:10.229566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:10.231937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.233896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:10.237168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:10.238889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.430630 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bec55998-55ed-4d12-a0e9-5507c69fadaa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.234201 Sep 13 16:54:10.431891 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2534/4987] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:10 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:10.445393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:10.450514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:10.467655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:10.469814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:10.471542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.474500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:10.475767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:10.492072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.550947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:INSERT=4,nova_cell1:SELECT=89 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:10.574096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:10.574631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:10.592379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:10.592977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:10.593426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.594198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:10.597655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:10.598352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:10.668634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:54:10.789497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:10.880129 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-67cc4cb2-a672-4adb-bd79-747dc462c054 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 204 len: 0 microversion: 2.42 time: 0.828096 Sep 13 16:54:10.880729 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2454/4988] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:54:10 2022] DELETE /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:54:10.894243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f2028dd-4936-48ad-88e5-fc7422e3737f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2088637921", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-key-1762357309", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:10.982682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-2f2028dd-4936-48ad-88e5-fc7422e3737f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] validate_networks() for [('52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:54:11.297629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:11.307421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7365e3f6-d651-45ef-a3f2-15b6acb319e1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1660 microversion: 2.1 time: 0.869792 Sep 13 16:54:11.309572 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2535/4989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:10 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1660 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:11.315718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:11.316815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:11.324129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:11.325111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:11.326462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:11.327385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:11.328153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:11.328760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:11.618295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:11.628577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6eaefdcc-b42f-4db0-8958-778b0a348b41 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.317679 Sep 13 16:54:11.629423 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2536/4990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:11 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:11.649177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:11.650919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:11.657961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:11.658729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:11.659355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:11.660240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:11.660870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:11.661498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:11.671627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2f2028dd-4936-48ad-88e5-fc7422e3737f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Invalid key_name provided. Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f2028dd-4936-48ad-88e5-fc7422e3737f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 247 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2088637921", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-key-1762357309", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid key_name provided. Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2088637921', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'key_name': 'tempest-key-1762357309', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1762357309 not found for user 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:11.673570 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f2028dd-4936-48ad-88e5-fc7422e3737f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid key_name provided. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f2028dd-4936-48ad-88e5-fc7422e3737f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.792872 Sep 13 16:54:11.678442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2455/4991] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:10 2022] POST /compute/v2.1/servers => generated 70 bytes in 794 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 13 16:54:11.684468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:11.684468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:11.700308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:11.700823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:11.701277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:11.702046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:11.702517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:11.702956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.067784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.079972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.086680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.088413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.090395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87fd904a-5492-4528-a5ec-ac4acabb4b4e tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2956 microversion: 2.42 time: 0.459722 Sep 13 16:54:12.101866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2537/4992] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:11 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2956 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:12.102879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:12.103509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:12.106166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50a57b75-f9b8-42ab-81f5-0c09419859be tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.429489 Sep 13 16:54:12.106780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2456/4993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:11 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:12.125786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a136da38-90e1-4570-baa1-ff55332fa550 req-efa6c101-c7aa-4ec9-b8cf-3a5aea2fa936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54d3d86-40a0-4e90-8c28-333d854dc2b9", "name": "network-vif-plugged", "status": "completed", "tag": "c4ce824e-54d5-45c1-8ef7-f4dc27780125"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:12.128661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.129208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.129648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.130431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.130938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.131493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.159580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a136da38-90e1-4570-baa1-ff55332fa550 req-efa6c101-c7aa-4ec9-b8cf-3a5aea2fa936 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.160071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a136da38-90e1-4570-baa1-ff55332fa550 req-efa6c101-c7aa-4ec9-b8cf-3a5aea2fa936 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.160508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a136da38-90e1-4570-baa1-ff55332fa550 req-efa6c101-c7aa-4ec9-b8cf-3a5aea2fa936 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.186093 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a136da38-90e1-4570-baa1-ff55332fa550 req-efa6c101-c7aa-4ec9-b8cf-3a5aea2fa936 service nova] Creating event network-vif-plugged:c4ce824e-54d5-45c1-8ef7-f4dc27780125 for instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 on n-h1-857467-1 Sep 13 16:54:12.192536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a136da38-90e1-4570-baa1-ff55332fa550 req-efa6c101-c7aa-4ec9-b8cf-3a5aea2fa936 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083119 Sep 13 16:54:12.193342 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2457/4994] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:12.340822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:12.342246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:12.360799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.362017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.362681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.363563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.366436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.368060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.488133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.498067 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2db95741-81ac-4053-8dc9-a3b5a5e21856 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.399220 Sep 13 16:54:12.499496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2538/4995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:12 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:12.524548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:12.525732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:12.533092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.533980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.534660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.535578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.536218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.536824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.762610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.769566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:12.772314 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bbdbc9f3-8762-43d1-8ab1-e2557beabeb8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.437056 Sep 13 16:54:12.778627 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2458/4996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:12 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:12.783730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e1f5ec3-dd89-4b29-baeb-ca1f2947ee48 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.263103 Sep 13 16:54:12.788061 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2539/4997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:12 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:12.798141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:12.798141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:12.803065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.803770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.804498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.805561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.806263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.806894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.834589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:12.840194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:12.873560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.874995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.875691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:12.881277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:12.881932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:12.882493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.107870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.124145 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d044f431-4402-4e66-ae36-8b96a2c2fabc tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.343905 Sep 13 16:54:13.128185 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2459/4998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:12 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:13.147321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-480aadab-9455-4b9c-9a91-7d5ceef07ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-132925516", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:13.329350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.security_group_api [None req-480aadab-9455-4b9c-9a91-7d5ceef07ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Neutron security group does_not_exist not found {{(pid=122327) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 13 16:54:13.329978 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-480aadab-9455-4b9c-9a91-7d5ceef07ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-480aadab-9455-4b9c-9a91-7d5ceef07ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 257 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-132925516", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-132925516', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 13 16:54:13.350421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:13.355194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-480aadab-9455-4b9c-9a91-7d5ceef07ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:13.359106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-480aadab-9455-4b9c-9a91-7d5ceef07ee6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.222265 Sep 13 16:54:13.359106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2460/4999] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:13 2022] POST /compute/v2.1/servers => generated 106 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:13.359106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:13.359359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:13.380369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.380866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.381521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.382263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.382721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.383148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.506267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.519978 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6671a8c5-f5ac-4765-bec1-d97ebd88a088 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.702250 Sep 13 16:54:13.525117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2540/5000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:12 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:13.559155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:13.560116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:13.572369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.576445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.576977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.578063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.579390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.581020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.704194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.717390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.719209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.722018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-caf835c8-4449-4153-b899-e054daa99042 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2956 microversion: 2.42 time: 0.367959 Sep 13 16:54:13.722897 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2461/5001] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:13 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2956 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:13.728648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:13.729288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:13.736500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.737046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.737878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.738784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.739396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.739982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.917139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.926854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-601eed37-31cd-4e84-8a73-6ee6a9378459 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.202302 Sep 13 16:54:13.937913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:13.937913 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90002cf4-abe6-4880-bdc9-a126c293f866 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.397045 Sep 13 16:54:13.940115 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2462/5002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:13 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:13.950460 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2541/5003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:13 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:13.955319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:13.956187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:13.956725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:13.958830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:13.963399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.964141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.964754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.965686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.966338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.966532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.967114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.967358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.967907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:13.968894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:13.969596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:13.970306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.126222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:14.136801 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ebc580b2-cb59-46f5-a780-fd2aefdce42b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.194242 Sep 13 16:54:14.150101 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2463/5004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:13 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:14.162569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:14.163596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:14.171094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.171839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.172463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.173361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.174246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.174931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.372637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:14.386635 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81634cf3-82d3-4462-bd1c-64c763e18c3e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.434229 Sep 13 16:54:14.387590 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2542/5005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:13 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:14.390632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:14.406129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:14.406986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:14.411903 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9111ffb-c7ee-41ef-be61-a573e8512c82 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1368 microversion: 2.1 time: 0.257623 Sep 13 16:54:14.413341 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2464/5006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:14 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:14.418683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.419446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.420058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.420694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e277465-ecd9-4617-9667-10fa784cce23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:14.422462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.422962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e277465-ecd9-4617-9667-10fa784cce23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: b25a6e15-4b85-4a4a-b421-5e79c5268baa] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:14.423306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.423915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.436292 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-1e277465-ecd9-4617-9667-10fa784cce23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance b25a6e15-4b85-4a4a-b421-5e79c5268baa could not be found. Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e277465-ecd9-4617-9667-10fa784cce23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/b25a6e15-4b85-4a4a-b421-5e79c5268baa HTTP/1.1 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance b25a6e15-4b85-4a4a-b421-5e79c5268baa could not be found. Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'b25a6e15-4b85-4a4a-b421-5e79c5268baa'} Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b25a6e15-4b85-4a4a-b421-5e79c5268baa could not be found. Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b25a6e15-4b85-4a4a-b421-5e79c5268baa could not be found. Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:14.440323 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b25a6e15-4b85-4a4a-b421-5e79c5268baa could not be found. Sep 13 16:54:14.445875 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:14.448277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e277465-ecd9-4617-9667-10fa784cce23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance b25a6e15-4b85-4a4a-b421-5e79c5268baa could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:14.449972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e277465-ecd9-4617-9667-10fa784cce23 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b25a6e15-4b85-4a4a-b421-5e79c5268baa" status: 404 len: 111 microversion: 2.1 time: 0.035251 Sep 13 16:54:14.450643 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2465/5007] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:54:14 2022] DELETE /compute/v2.1/servers/b25a6e15-4b85-4a4a-b421-5e79c5268baa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:14.468032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:14.468772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:14.486803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.487404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.487928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.489502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.491267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.491798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.794157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:14.806473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-26542775-414f-473b-a4fe-1b9b2cd80dda tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.348780 Sep 13 16:54:14.835000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:14.842250 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2466/5008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:14 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:14.845259 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ca89d27-d79b-4b9a-8514-e29153ad4e51 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.456338 Sep 13 16:54:14.849175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:14.849363 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2543/5009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:14 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:14.850283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:14.860996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.862316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.863154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.864100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.865072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.866467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.872044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:14.872792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:14.888117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.895554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.901671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:14.903159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:14.904629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:14.908200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.378865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:15.402822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:15.404913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:15.406265 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0b2c2c1-08a3-4355-8408-c31430e52e7a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2956 microversion: 2.42 time: 0.562608 Sep 13 16:54:15.406990 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2467/5010] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:14 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2956 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:15.409487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:15.419030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:15.419976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:15.435084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:15.435777 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53d4ddc2-dd90-4d20-8468-2cfda4d67daf tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.583447 Sep 13 16:54:15.438497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2544/5011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:14 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:15.444270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.445487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.448873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.451070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.453428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.453943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.459301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:15.459990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:15.469179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.469684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.470335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.471482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.472118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.474155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.756964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:15.767878 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0bce2d4-6306-42d4-91d0-50bbbe4499bf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.360001 Sep 13 16:54:15.779317 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2468/5012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:15 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:15.793969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:15.794965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:15.802755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.803656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.804226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.805023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.805528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.806291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.843396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:15.852178 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef4c5857-c816-4ffb-ac21-1130f74778af tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.410491 Sep 13 16:54:15.859168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2545/5013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:15 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:15.864206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef517103-ac8d-424e-852e-1433204727b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:15.864695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef517103-ac8d-424e-852e-1433204727b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:54:15.865212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ef517103-ac8d-424e-852e-1433204727b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef517103-ac8d-424e-852e-1433204727b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9223372036854775808 could not be found. Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9223372036854775808'} Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:15.866843 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef517103-ac8d-424e-852e-1433204727b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:15.872453 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef517103-ac8d-424e-852e-1433204727b5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.007937 Sep 13 16:54:15.882100 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2546/5014] 10.222.0.61 () {58 vars in 1188 bytes} [Tue Sep 13 16:54:15 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:54:15.890184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:15.891006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:15.901996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.902570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.903317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:15.904605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:15.905082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:15.906422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.059123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:16.075603 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a80b5683-e851-4770-a7c7-7b91e80a331d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1558 microversion: 2.1 time: 0.294823 Sep 13 16:54:16.095529 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2469/5015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:15 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1558 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:16.100745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:16.101376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:16.113188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.114107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.115043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.116741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.117906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.118512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.416055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:16.426362 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6b42da2-0380-4195-b644-0eca2715149b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.329610 Sep 13 16:54:16.437851 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2470/5016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:16 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:16.437851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:16.437851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:16.453798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.454382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.454829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.455565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.456036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.456478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.578122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:16.591269 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f686fdd-4e53-4e4e-af47-afc3fc5de9ad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.707334 Sep 13 16:54:16.592311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2547/5017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:15 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:16.602376 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b258ed51-768f-4fa3-9fc8-8193d2eca691 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174309 Sep 13 16:54:16.603343 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2471/5018] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:54:16 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:16.609055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:16.609672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:16.611676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:16.613143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:16.627799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.628635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.629390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.630338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.632131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.634512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.641529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.642416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.646072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:16.653518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:16.654888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:16.657501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.081965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:17.091061 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c30ee867-996a-44b1-921e-555a74da9c55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.486451 Sep 13 16:54:17.098659 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2472/5019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:16 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:17.107816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:17.110499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:17.118732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:17.128697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.129478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.130091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.130925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.134328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.134328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.134546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:17.137989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:17.141262 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1188be89-3113-43b7-b8bf-f8a9f76e6854 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2935 microversion: 2.42 time: 0.545818 Sep 13 16:54:17.142958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2548/5020] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:16 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2935 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:17.153560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c4cd911-999a-4e2e-87ee-50188749960e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:17.154522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c4cd911-999a-4e2e-87ee-50188749960e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Failed to fetch instance by id -1 {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:54:17.155371 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-5c4cd911-999a-4e2e-87ee-50188749960e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance -1 could not be found. Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c4cd911-999a-4e2e-87ee-50188749960e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance -1 could not be found. Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '-1'} Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:17.157496 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:17.161794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:17.161794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:17.161794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 13 16:54:17.161794 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:17.163307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c4cd911-999a-4e2e-87ee-50188749960e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:17.164392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c4cd911-999a-4e2e-87ee-50188749960e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.020108 Sep 13 16:54:17.172144 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2549/5021] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 16:54:17 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:54:17.181600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:17.182517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:17.195866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.196626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.197275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.199675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.200449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.201479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.577409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:17.615422 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-50e99c8c-8fe9-436c-b17a-8adc1aba34c0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.439260 Sep 13 16:54:17.660564 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2550/5022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:17 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:17.666446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:17.667138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:17.691021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.696333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.697153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.710056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.711017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.713079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.806316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:17.823359 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f8ce6b3d-e056-4ab8-80b3-b63fba927fff tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.723171 Sep 13 16:54:17.824426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2473/5023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:17 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:17.894697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-231deb9b-3e4d-4e7c-bea7-3b8b267fad63 req-aa337b07-84e5-40a7-bf49-33a5860376c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-unplugged", "status": "completed", "tag": "f8d74f64-19aa-442c-8831-3c7580891fc8"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:17.914211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-231deb9b-3e4d-4e7c-bea7-3b8b267fad63 req-aa337b07-84e5-40a7-bf49-33a5860376c0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:17.916339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-231deb9b-3e4d-4e7c-bea7-3b8b267fad63 req-aa337b07-84e5-40a7-bf49-33a5860376c0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:17.917604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-231deb9b-3e4d-4e7c-bea7-3b8b267fad63 req-aa337b07-84e5-40a7-bf49-33a5860376c0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:17.959357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-231deb9b-3e4d-4e7c-bea7-3b8b267fad63 req-aa337b07-84e5-40a7-bf49-33a5860376c0 service nova] Creating event network-vif-unplugged:f8d74f64-19aa-442c-8831-3c7580891fc8 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:17.968473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-231deb9b-3e4d-4e7c-bea7-3b8b267fad63 req-aa337b07-84e5-40a7-bf49-33a5860376c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078377 Sep 13 16:54:17.969391 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2474/5024] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:54:18.178556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:18.179545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:18.188237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.189012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.189623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.190598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.191234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.191840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.311485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:18.325209 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f41c828-3869-4502-a3a0-dd1641eb2823 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.662617 Sep 13 16:54:18.326431 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2551/5025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:17 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:18.354250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a523ab59-72af-437b-ba91-6793d19f39e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:18.356459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a523ab59-72af-437b-ba91-6793d19f39e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 578746b0-3179-4b52-8c30-2d2e9a976d6f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:18.363452 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a523ab59-72af-437b-ba91-6793d19f39e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 578746b0-3179-4b52-8c30-2d2e9a976d6f could not be found. Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a523ab59-72af-437b-ba91-6793d19f39e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/578746b0-3179-4b52-8c30-2d2e9a976d6f/action HTTP/1.1 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 19 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: {"forceDelete": {}} Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 578746b0-3179-4b52-8c30-2d2e9a976d6f could not be found. Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '578746b0-3179-4b52-8c30-2d2e9a976d6f', 'body': {'forceDelete': {}}} Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578746b0-3179-4b52-8c30-2d2e9a976d6f could not be found. Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578746b0-3179-4b52-8c30-2d2e9a976d6f could not be found. Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:18.369151 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:18.375780 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:18.375780 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:18.375780 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578746b0-3179-4b52-8c30-2d2e9a976d6f could not be found. Sep 13 16:54:18.375780 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:18.377702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a523ab59-72af-437b-ba91-6793d19f39e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 578746b0-3179-4b52-8c30-2d2e9a976d6f could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:18.378836 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a523ab59-72af-437b-ba91-6793d19f39e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/578746b0-3179-4b52-8c30-2d2e9a976d6f/action" status: 404 len: 111 microversion: 2.1 time: 0.030918 Sep 13 16:54:18.390931 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2552/5026] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:18 2022] POST /compute/v2.1/servers/578746b0-3179-4b52-8c30-2d2e9a976d6f/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:54:18.405343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:18.406321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:18.415554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.416399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.417732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.418840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.420033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.422057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.562998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:18.565443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:18.580795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:18.587582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:18.590272 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d211e80-6b3a-437d-b341-97252a20fc42 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2914 microversion: 2.42 time: 0.414979 Sep 13 16:54:18.591487 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2475/5027] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:18 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2914 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:54:18.853226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:18.855183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:18.864024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.864858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.866204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.867220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.868198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.868888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.904290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:18.918695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b87094e-94eb-482e-b36d-548e5675b73b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.524864 Sep 13 16:54:18.919680 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2553/5028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:18 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:18.967081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:18.970353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:18.982611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.983905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.984528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:18.985943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:18.986590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:18.987203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:19.373470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:19.399164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-74db7372-7cb8-4ee4-968d-737a77346f18 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.551862 Sep 13 16:54:19.425365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2476/5029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:18 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:19.436558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-111b1a91-34f4-417b-b417-c2ab1e62ba97 req-a36539bd-7b9d-4918-bfee-383c5eeda519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-deleted", "tag": "9f8d4b2e-313f-409c-af69-875f37588cda"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:19.460699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-111b1a91-34f4-417b-b417-c2ab1e62ba97 req-a36539bd-7b9d-4918-bfee-383c5eeda519 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:19.462397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-111b1a91-34f4-417b-b417-c2ab1e62ba97 req-a36539bd-7b9d-4918-bfee-383c5eeda519 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:19.463532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-111b1a91-34f4-417b-b417-c2ab1e62ba97 req-a36539bd-7b9d-4918-bfee-383c5eeda519 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:19.493765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-111b1a91-34f4-417b-b417-c2ab1e62ba97 req-a36539bd-7b9d-4918-bfee-383c5eeda519 service nova] Creating event network-vif-deleted:9f8d4b2e-313f-409c-af69-875f37588cda for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:19.507480 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-111b1a91-34f4-417b-b417-c2ab1e62ba97 req-a36539bd-7b9d-4918-bfee-383c5eeda519 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080473 Sep 13 16:54:19.509352 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2477/5030] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:19.542767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:19.563860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92ececd6-e82f-4662-8fba-90bb451c576e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.610429 Sep 13 16:54:19.570202 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2554/5031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:18 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:19.594644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4f32b3d-b3e0-4fc9-872b-bc3e249bbd80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:19.598397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4f32b3d-b3e0-4fc9-872b-bc3e249bbd80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 175cb1fa-7858-48ad-ad46-acdcbd236f0d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:19.606465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c4f32b3d-b3e0-4fc9-872b-bc3e249bbd80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 175cb1fa-7858-48ad-ad46-acdcbd236f0d could not be found. Sep 13 16:54:19.622000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:19.622426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4f32b3d-b3e0-4fc9-872b-bc3e249bbd80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/175cb1fa-7858-48ad-ad46-acdcbd236f0d/action HTTP/1.1 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 39 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: {"os-getConsoleOutput": {"length": 10}} Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 175cb1fa-7858-48ad-ad46-acdcbd236f0d could not be found. Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '175cb1fa-7858-48ad-ad46-acdcbd236f0d', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175cb1fa-7858-48ad-ad46-acdcbd236f0d could not be found. Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175cb1fa-7858-48ad-ad46-acdcbd236f0d could not be found. Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:19.626278 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:19.631400 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:19.631400 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:19.631400 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:19.631400 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:19.631400 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175cb1fa-7858-48ad-ad46-acdcbd236f0d could not be found. Sep 13 16:54:19.631400 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:19.636029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4f32b3d-b3e0-4fc9-872b-bc3e249bbd80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 175cb1fa-7858-48ad-ad46-acdcbd236f0d could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:19.638854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4f32b3d-b3e0-4fc9-872b-bc3e249bbd80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/175cb1fa-7858-48ad-ad46-acdcbd236f0d/action" status: 404 len: 111 microversion: 2.1 time: 0.049046 Sep 13 16:54:19.644254 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2478/5032] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:19 2022] POST /compute/v2.1/servers/175cb1fa-7858-48ad-ad46-acdcbd236f0d/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:19.646106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:19.650748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:19.654320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:19.655279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:19.656068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:19.656669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:19.665145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:19.666274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:19.684207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:19.684710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:19.685155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:19.685895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:19.697526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:19.698273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:19.720557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:20.045723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:20.063326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:20.065098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:20.070774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75bc442b-9361-4775-897f-20f15abc6475 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2755 microversion: 2.42 time: 0.456236 Sep 13 16:54:20.071383 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2555/5033] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:19 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2755 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:20.090004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-85d94e30-a42e-4159-8c11-7ecd18d72226 req-bb6d9e8a-23f1-4c1a-b080-63e38475e0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54d3d86-40a0-4e90-8c28-333d854dc2b9", "tag": "c4ce824e-54d5-45c1-8ef7-f4dc27780125"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:20.090004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85d94e30-a42e-4159-8c11-7ecd18d72226 req-bb6d9e8a-23f1-4c1a-b080-63e38475e0f9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:20.092529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85d94e30-a42e-4159-8c11-7ecd18d72226 req-bb6d9e8a-23f1-4c1a-b080-63e38475e0f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:20.093267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85d94e30-a42e-4159-8c11-7ecd18d72226 req-bb6d9e8a-23f1-4c1a-b080-63e38475e0f9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:20.119565 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-85d94e30-a42e-4159-8c11-7ecd18d72226 req-bb6d9e8a-23f1-4c1a-b080-63e38475e0f9 service nova] Creating event network-changed:c4ce824e-54d5-45c1-8ef7-f4dc27780125 for instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 on n-h1-857467-1 Sep 13 16:54:20.126203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-85d94e30-a42e-4159-8c11-7ecd18d72226 req-bb6d9e8a-23f1-4c1a-b080-63e38475e0f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053532 Sep 13 16:54:20.127626 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2556/5034] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:20.133060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-unplugged", "status": "completed", "tag": "8d963fa2-857f-48ba-9e30-6eb1f472d8e5"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-unplugged", "status": "completed", "tag": "4cc3d202-6c15-40ca-8e70-39399e2d00e6"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-unplugged", "status": "completed", "tag": "c4de8a56-a7f1-4bc6-96b5-e4f932d9448c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:20.144854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:20.145437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:20.145988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:20.160080 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Creating event network-vif-unplugged:8d963fa2-857f-48ba-9e30-6eb1f472d8e5 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:20.161130 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Creating event network-vif-unplugged:4cc3d202-6c15-40ca-8e70-39399e2d00e6 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:20.161817 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] Creating event network-vif-unplugged:c4de8a56-a7f1-4bc6-96b5-e4f932d9448c for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:20.169756 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-46690d6f-ac9b-4de5-8d7e-92eda8ac2b40 req-04c08ac4-f1f7-47ba-b29b-c46363a4efeb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.040551 Sep 13 16:54:20.170598 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2557/5035] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:20.365797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:20.378225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f1e31630-bc12-4bad-9f5a-5a9b8506260a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.732607 Sep 13 16:54:20.380869 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2479/5036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:19 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:20.411110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:20.411828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:20.423512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:20.429519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:20.430384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:20.437102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:20.437774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:20.438766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:20.440622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:20.442750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:20.443410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:20.445248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:20.447859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:20.450369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:20.452839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:20.453487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.312483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:21.332207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:21.358325 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08eed142-c7ae-4551-bea8-713c73ce2dfb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.951423 Sep 13 16:54:21.382060 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e3c9132-3576-470c-a67a-689db4564f67 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.912399 Sep 13 16:54:21.384640 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2480/5037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:20 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:21.390816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:21.391438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:21.394363 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2558/5038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:20 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:21.409888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2445eca9-1441-4f8b-b0f3-3718c74d7fe3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:21.410803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2445eca9-1441-4f8b-b0f3-3718c74d7fe3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 9206b05f-b4dc-4b24-94e7-f6258306481b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:21.423374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2445eca9-1441-4f8b-b0f3-3718c74d7fe3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 9206b05f-b4dc-4b24-94e7-f6258306481b could not be found. Sep 13 16:54:21.424949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.425786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.426447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2445eca9-1441-4f8b-b0f3-3718c74d7fe3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/9206b05f-b4dc-4b24-94e7-f6258306481b HTTP/1.1 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9206b05f-b4dc-4b24-94e7-f6258306481b could not be found. Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9206b05f-b4dc-4b24-94e7-f6258306481b'} Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9206b05f-b4dc-4b24-94e7-f6258306481b could not be found. Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9206b05f-b4dc-4b24-94e7-f6258306481b could not be found. Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:21.428010 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9206b05f-b4dc-4b24-94e7-f6258306481b could not be found. Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2445eca9-1441-4f8b-b0f3-3718c74d7fe3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 9206b05f-b4dc-4b24-94e7-f6258306481b could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2445eca9-1441-4f8b-b0f3-3718c74d7fe3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/9206b05f-b4dc-4b24-94e7-f6258306481b" status: 404 len: 111 microversion: 2.1 time: 0.033590 Sep 13 16:54:21.434226 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2559/5039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:21 2022] GET /compute/v2.1/servers/9206b05f-b4dc-4b24-94e7-f6258306481b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:21.435226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.435658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.436111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.444244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:21.444897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:21.473127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.473638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.474115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.474842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.475326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.475747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.725967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:21.740722 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b47b0e5-8ceb-4598-8232-23377e4f4ae5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.297980 Sep 13 16:54:21.763071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2560/5040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:21 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:21.768664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-438934e5-7fb7-42e5-b96d-4ea24c2446e4 req-0b45573e-4bd2-48dd-893d-e285457f0051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-deleted", "tag": "4cc3d202-6c15-40ca-8e70-39399e2d00e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:21.778608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:21.780751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-438934e5-7fb7-42e5-b96d-4ea24c2446e4 req-0b45573e-4bd2-48dd-893d-e285457f0051 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.781433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-438934e5-7fb7-42e5-b96d-4ea24c2446e4 req-0b45573e-4bd2-48dd-893d-e285457f0051 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.782071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-438934e5-7fb7-42e5-b96d-4ea24c2446e4 req-0b45573e-4bd2-48dd-893d-e285457f0051 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.810179 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-438934e5-7fb7-42e5-b96d-4ea24c2446e4 req-0b45573e-4bd2-48dd-893d-e285457f0051 service nova] Creating event network-vif-deleted:4cc3d202-6c15-40ca-8e70-39399e2d00e6 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:21.822248 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-438934e5-7fb7-42e5-b96d-4ea24c2446e4 req-0b45573e-4bd2-48dd-893d-e285457f0051 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057464 Sep 13 16:54:21.823096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2561/5041] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:21.833736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:21.836546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:21.850421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.851369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.854009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:21.856697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:21.857373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:21.862355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:22.052280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:22.073084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:22.076876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:22.078487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b99d3889-7a06-4dde-8012-e063124357f9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2663 microversion: 2.42 time: 0.692676 Sep 13 16:54:22.079550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2481/5042] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:21 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2663 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:22.196266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:22.211171 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5bc4f26-1c38-4e3e-932f-fca22ed283a3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.385340 Sep 13 16:54:22.225746 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2562/5043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:21 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:22.316939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7ed3d95-89da-4fa5-9be1-56f49c21c121 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-63592275", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7ed3d95-89da-4fa5-9be1-56f49c21c121 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 236 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-63592275", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-63592275', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.335723 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 13 16:54:22.344082 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:22.348821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7ed3d95-89da-4fa5-9be1-56f49c21c121 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:22.349956 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7ed3d95-89da-4fa5-9be1-56f49c21c121 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037505 Sep 13 16:54:22.361459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:22.365161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:22.372669 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2482/5044] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:22.376333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:22.377029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:22.377670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:22.378589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:22.379219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:22.380397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:22.410002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:22.411233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:22.439811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:22.459001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:22.461904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:22.463301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:22.469007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:22.473071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:22.892855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:22.906540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8997fad6-ef76-4459-9554-06c55f46d8c9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.500933 Sep 13 16:54:22.907963 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2483/5045] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:22 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:23.046464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:23.077078 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-168de7f9-b678-42e5-b1fc-a86e292c782b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.721539 Sep 13 16:54:23.095058 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2563/5046] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:22 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:23.108672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:23.109527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:23.127246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.127971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.128735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.129635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.130290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.130884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.131939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:23.132782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:23.142361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.146577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.147257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.148468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.148962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.149459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.516383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:23.530709 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f205692f-d938-4d22-a338-04fb0ddf47fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.425984 Sep 13 16:54:23.531463 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2484/5047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:23 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:23.619819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-086eda53-9a3b-4e19-aa66-4d3925771ad7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-734591634", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-086eda53-9a3b-4e19-aa66-4d3925771ad7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 234 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-734591634", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-734591634', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.625185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 13 16:54:23.632207 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:23.637120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-086eda53-9a3b-4e19-aa66-4d3925771ad7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:23.638320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-086eda53-9a3b-4e19-aa66-4d3925771ad7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.028270 Sep 13 16:54:23.639029 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2485/5048] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:23.651177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:23.652280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:23.661513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.664571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.665298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.666418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.667166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.670165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.825209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:23.846424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:23.848479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:23.850022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61281335-15af-4a6f-a1d2-d767ede238bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2549 microversion: 2.42 time: 0.737648 Sep 13 16:54:23.850774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2564/5049] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:23 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2549 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:23.934215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-deleted", "tag": "f8d74f64-19aa-442c-8831-3c7580891fc8"}, {"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-deleted", "tag": "8d963fa2-857f-48ba-9e30-6eb1f472d8e5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:23.953080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:23.953329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:23.955187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:23.982781 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] Creating event network-vif-deleted:f8d74f64-19aa-442c-8831-3c7580891fc8 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:23.983612 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] Creating event network-vif-deleted:8d963fa2-857f-48ba-9e30-6eb1f472d8e5 for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:23.992903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3c8595e7-a266-46cc-8b74-3aa96f377789 req-a3f3a412-2c21-4dbd-bf59-9f3dd070ff74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064988 Sep 13 16:54:24.004988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2565/5050] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:24.027565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:24.028596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:24.036328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.038273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.039069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.041041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.043699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.044613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.312212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:24.322349 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b968bc17-ff24-487d-9dca-d923e25ee895 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.678117 Sep 13 16:54:24.326652 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2486/5051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:23 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:24.353867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:24.355356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:24.367251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.367975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.369904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.373922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.374626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.375272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.379993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:24.396303 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33ac945a-d395-41ef-a44e-d11d1a7dbabb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.374289 Sep 13 16:54:24.397214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2566/5052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:24 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:24.757977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:24.768998 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2e085a5-7366-4b2a-aaa9-0d66f7538a02 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.419384 Sep 13 16:54:24.769592 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2487/5053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:24 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:24.803806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-046bf64d-89f2-460b-bdb3-c40f08d5b0fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:24.804361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-046bf64d-89f2-460b-bdb3-c40f08d5b0fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 9268f75c-cf66-4789-9cd7-e8e1cfea151c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:24.827819 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-046bf64d-89f2-460b-bdb3-c40f08d5b0fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 9268f75c-cf66-4789-9cd7-e8e1cfea151c could not be found. Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-046bf64d-89f2-460b-bdb3-c40f08d5b0fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/9268f75c-cf66-4789-9cd7-e8e1cfea151c/action HTTP/1.1 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 13 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: {"pause": {}} Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9268f75c-cf66-4789-9cd7-e8e1cfea151c could not be found. Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9268f75c-cf66-4789-9cd7-e8e1cfea151c', 'body': {'pause': {}}} Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9268f75c-cf66-4789-9cd7-e8e1cfea151c could not be found. Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9268f75c-cf66-4789-9cd7-e8e1cfea151c could not be found. Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:24.842480 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9268f75c-cf66-4789-9cd7-e8e1cfea151c could not be found. Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-046bf64d-89f2-460b-bdb3-c40f08d5b0fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 9268f75c-cf66-4789-9cd7-e8e1cfea151c could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-046bf64d-89f2-460b-bdb3-c40f08d5b0fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/9268f75c-cf66-4789-9cd7-e8e1cfea151c/action" status: 404 len: 111 microversion: 2.1 time: 0.048662 Sep 13 16:54:24.847659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2567/5054] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:24 2022] POST /compute/v2.1/servers/9268f75c-cf66-4789-9cd7-e8e1cfea151c/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:24.855023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:24.855977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:24.864481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.866484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.869036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.870059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.874155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.874838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.883261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:24.884672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:24.929972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.930675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.932788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:24.933672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:24.936816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:24.937357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:25.085576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:25.105084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:25.107490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:25.111276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-498f8f17-909a-422b-83e6-f3278da2d794 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 2165 microversion: 2.42 time: 0.233531 Sep 13 16:54:25.126238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2568/5055] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:24 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 2165 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:25.430516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:25.431274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:25.448728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:25.449237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:25.454826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:25.456826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:25.457538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:25.462855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:25.764676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:25.779466 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df2a22bc-1a7e-4de4-938c-550b8270beb7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.359515 Sep 13 16:54:25.783117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2569/5056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:25 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:26.014762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:26.031136 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b3c1eea7-3dc6-49b0-81a6-75283290de75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 1.180499 Sep 13 16:54:26.031742 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2488/5057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:24 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:26.057456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:26.059202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:26.067386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.068196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.069118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.071500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.072199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.072875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.122499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f45f2375-ce9b-4e28-9d12-b4e14dd63f02 req-8aa9b732-b341-4c05-964b-44b56c22880e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee36ddc-3c5e-44b2-88af-b78a509b94af", "name": "network-vif-deleted", "tag": "c4de8a56-a7f1-4bc6-96b5-e4f932d9448c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:26.152609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f45f2375-ce9b-4e28-9d12-b4e14dd63f02 req-8aa9b732-b341-4c05-964b-44b56c22880e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.163040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f45f2375-ce9b-4e28-9d12-b4e14dd63f02 req-8aa9b732-b341-4c05-964b-44b56c22880e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.164470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f45f2375-ce9b-4e28-9d12-b4e14dd63f02 req-8aa9b732-b341-4c05-964b-44b56c22880e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.203946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f45f2375-ce9b-4e28-9d12-b4e14dd63f02 req-8aa9b732-b341-4c05-964b-44b56c22880e service nova] Creating event network-vif-deleted:c4de8a56-a7f1-4bc6-96b5-e4f932d9448c for instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af on n-h2-857467-1 Sep 13 16:54:26.211958 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f45f2375-ce9b-4e28-9d12-b4e14dd63f02 req-8aa9b732-b341-4c05-964b-44b56c22880e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092878 Sep 13 16:54:26.214930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2489/5058] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:54:26.231459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:26.240882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:26.268109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.269011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.270314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.277884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.278812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.279517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.373564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:26.390048 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a718ab16-76cf-46f6-841e-9be8970f72a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.335543 Sep 13 16:54:26.394779 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2570/5059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:26 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:26.419172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:26.419641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:26.426189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.426773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.427283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.428477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.428477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.428886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.447458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:26.460582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:26.462503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:26.463807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aaf5fc0-305b-46ec-883d-80496500c9bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.246543 Sep 13 16:54:26.465020 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2490/5060] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:26 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:26.591955 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-09ec8513-ac31-4923-a748-ade0a634451c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.174331 Sep 13 16:54:26.595615 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2571/5061] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:26 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:26.601051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:26.601755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:26.608568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.609155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.609657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.610503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.611222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.617093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.816614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:26.817507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:26.842157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.843218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.844036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:26.846562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:26.847332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:26.851241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:27.127351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:27.144799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd887c8c-5a34-4bfa-8b6a-273c50585326 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.340977 Sep 13 16:54:27.150151 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2572/5062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:26 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:27.339781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:27.351789 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66ed694d-0982-4ed0-82a1-7dfc0b0683db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1511 microversion: 2.1 time: 0.754594 Sep 13 16:54:27.363071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2491/5063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:26 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1511 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:27.500465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:27.502249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:27.514952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:27.515718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:27.520484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:27.521501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:27.523036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:27.525159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:27.737673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:27.756510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:27.771027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:27.772410 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e47fa582-72fc-4415-8071-8a963020b20d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.283343 Sep 13 16:54:27.776557 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2573/5064] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:27 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:28.173161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:28.173789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:28.188691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.189192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.189634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.190374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.190842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.191272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.385185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:28.387551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:28.394845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.395685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.396384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.397375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.398425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.400786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.703709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:28.717041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99163db4-f9a1-493c-a593-e5abde1976e4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1491 microversion: 2.1 time: 0.331557 Sep 13 16:54:28.731512 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2574/5065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:28 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1491 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:28.753815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:28.754466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:28.768787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.769302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.769752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.770556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.770975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.771415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.796732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:28.829019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'pause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state paused Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 13 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: {"pause": {}} Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'pause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state paused Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'pause': {}}} Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state paused. Cannot pause while the instance is in this state. Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state paused Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:28.830765 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state paused Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'pause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state paused {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:28.836197 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cfa7cf85-ecb4-4d4e-862f-abc8ca94ff55 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 143 microversion: 2.1 time: 0.092245 Sep 13 16:54:28.837237 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2575/5066] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:28 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 143 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:54:28.844111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:28.844741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:28.852471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.853334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.853798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:28.854651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:28.855474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:28.855930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:29.035175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:29.057001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:29.060562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:29.063697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-292f8e33-4c7b-40f1-9351-95bc17491143 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.225472 Sep 13 16:54:29.077865 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2576/5067] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:28 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:29.085869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:29.087289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:29.098821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:29.099716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:29.100277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:29.106262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:29.107156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:29.107859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:29.203339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f0eb37a-e5aa-4d21-8dba-4bfd3b55a445 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.134800 Sep 13 16:54:29.208063 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2577/5068] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:29 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:29.221058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:29.222222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:29.228724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:29.229337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:29.229993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:29.230917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:29.231385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:29.231829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:29.353642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:29.364796 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6a43ac8c-374e-48d3-90f9-98eaa4f77a6a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 1.195208 Sep 13 16:54:29.366027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2492/5069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:28 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:29.396916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:29.407210 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a67f3422-5b5c-4346-8562-9cbe1ec8179c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1498 microversion: 2.1 time: 0.190463 Sep 13 16:54:29.422771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2578/5070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:29 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:30.096481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:30.097464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:30.106216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.107182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.108048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.109012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.109742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.110515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.238949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:30.250492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:30.253421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:30.255777 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14976f06-f3ea-47f7-b591-f619d331798c tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.163491 Sep 13 16:54:30.256905 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2493/5071] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:30 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:30.388501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:30.389134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:30.408661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.409318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.409499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.410570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.410933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.411368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.432422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:30.433095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:30.444054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.444554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.446660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.447073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.447548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.448007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.614515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:30.623704 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7bdcc632-be79-403b-85eb-9032c91901fc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.239199 Sep 13 16:54:30.625113 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2579/5072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:30 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:30.828799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:30.837929 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e800dc4-853b-40c7-a488-6d41bdd24808 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.409314 Sep 13 16:54:30.856441 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2494/5073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:30 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:30.869650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:30.871163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:30.879728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.880445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.881049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:30.882122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:30.882578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:30.883181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.106568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:31.125782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e661a6f-b724-4030-8798-a4c89abc4a3f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.262417 Sep 13 16:54:31.127907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2580/5074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:30 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:31.162500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:31.166383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.175150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.175988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.176759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.177719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.178485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.179137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.198862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e/action HTTP/1.1 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 28 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: {"reboot": {"type": "SOFT"}} Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '282001d0-4ba5-4e1e-96fa-a48dc071852e', 'body': {'reboot': {'type': 'SOFT'}}} Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:31.201379 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:31.207250 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.209272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:31.211461 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9169b1e-d02f-48ca-b5ad-6b0e1e898935 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e/action" status: 404 len: 111 microversion: 2.1 time: 0.053731 Sep 13 16:54:31.212247 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2495/5075] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:31 2022] POST /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:31.221300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:31.221992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.228265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.229040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.230144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.231080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.231721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.232325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.282398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:31.282938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.291098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.291591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.294929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.295667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.300218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.300716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.398852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:31.408889 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f94634b-0ba0-47fa-ae59-fd48b5d79676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.191427 Sep 13 16:54:31.410940 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2581/5076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:31 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:31.440608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:31.441672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:31.446594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.462176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:31.462783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.463584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.466247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:31.466983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.467968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.468669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.470179 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4945c43-2997-419c-8772-8a64e2a7894d tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.192048 Sep 13 16:54:31.470865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.471862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2496/5077] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:31 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:31.648695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:31.649498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.660415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.660907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.662496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.664778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.665265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.665707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.689533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:31.853659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:31.876769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-74a73610-692c-49b5-9744-17c3ec7fbeeb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.441293 Sep 13 16:54:31.878498 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2582/5078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:31 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:31.910931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e6652ba-41df-4822-9aa5-9f196a079355 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:31.913689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e6652ba-41df-4822-9aa5-9f196a079355 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: c473ae75-4167-4c4d-af74-ee5fdafa9d1d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.925862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2e6652ba-41df-4822-9aa5-9f196a079355 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance c473ae75-4167-4c4d-af74-ee5fdafa9d1d could not be found. Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e6652ba-41df-4822-9aa5-9f196a079355 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/c473ae75-4167-4c4d-af74-ee5fdafa9d1d/action HTTP/1.1 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 28 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: {"reboot": {"type": "SOFT"}} Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance c473ae75-4167-4c4d-af74-ee5fdafa9d1d could not be found. Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'c473ae75-4167-4c4d-af74-ee5fdafa9d1d', 'body': {'reboot': {'type': 'SOFT'}}} Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c473ae75-4167-4c4d-af74-ee5fdafa9d1d could not be found. Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c473ae75-4167-4c4d-af74-ee5fdafa9d1d could not be found. Sep 13 16:54:31.928047 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c473ae75-4167-4c4d-af74-ee5fdafa9d1d could not be found. Sep 13 16:54:31.932478 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:31.934900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e6652ba-41df-4822-9aa5-9f196a079355 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance c473ae75-4167-4c4d-af74-ee5fdafa9d1d could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:31.936885 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e6652ba-41df-4822-9aa5-9f196a079355 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/c473ae75-4167-4c4d-af74-ee5fdafa9d1d/action" status: 404 len: 111 microversion: 2.1 time: 0.030743 Sep 13 16:54:31.938031 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2583/5079] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:31 2022] POST /compute/v2.1/servers/c473ae75-4167-4c4d-af74-ee5fdafa9d1d/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:31.950724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:31.951602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:31.959772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.960411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.960945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.962126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:31.962816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:31.964104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:31.995381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:32.011458 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a99d4c25-c5dd-4de6-892c-48f40c844b55 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.366187 Sep 13 16:54:32.028519 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2497/5080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:31 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:32.192115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:32.217200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ca6620c-dc88-4dc6-8215-e62d0ad91d18 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.271884 Sep 13 16:54:32.218440 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2584/5081] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:31 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:32.251783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:32.252410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:32.261697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:32.262220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:32.262662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:32.263378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:32.263854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:32.264296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:32.501422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:32.503500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:32.519451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:32.520007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:32.520551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:32.521340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:32.522089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:32.522613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:32.651187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:32.684454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:32.687687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:32.692709 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27f5df9b-1a4b-4d94-875b-cb5bd1b9f63f tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.196138 Sep 13 16:54:32.696613 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2585/5082] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:32 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:32.931582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:32.942075 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e61e2d0d-a264-4d59-995f-7047495474c1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.694617 Sep 13 16:54:32.943233 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2498/5083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:32 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:32.967191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:32.971605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:32.982182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:32.982983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:32.983616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:32.984560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:32.985779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:32.986428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.007024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e/action HTTP/1.1 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 65 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '282001d0-4ba5-4e1e-96fa-a48dc071852e', 'body': {'rebuild': {'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c'}}} Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 13 16:54:33.008846 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:33.014240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42ddc846-945e-480b-bf47-fd050ab525b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e/action" status: 404 len: 111 microversion: 2.1 time: 0.047651 Sep 13 16:54:33.020633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:33.021784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:33.027949 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2586/5084] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:32 2022] POST /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:33.029746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.030282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.031410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.032161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.032631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.033065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.047635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:33.048266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:33.078627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.079314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.080979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.082598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.083277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.084038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.288257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:33.303346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6dbc873a-ab67-4a71-b852-4f6f20c8c480 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.262120 Sep 13 16:54:33.304780 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2587/5085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:33 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:33.545355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:33.560268 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-26aa4aab-5ccd-48f8-b43f-ab7583ee1901 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.544041 Sep 13 16:54:33.583814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:33.586921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:33.592858 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2499/5086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:33 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:33.597912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.598633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.599273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.600158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.600790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.606132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.727554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:33.728737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:33.744525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.747174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.747822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.752559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:33.753029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:33.753475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:33.892228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:33.913037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:33.914544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:33.915810 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6a15c32-b58d-4c06-a73f-b5597cfb42bc tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.193564 Sep 13 16:54:33.927946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2500/5087] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:33 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:34.021887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:34.037317 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ffd84be6-1f16-472f-87a3-dd041285057c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.457350 Sep 13 16:54:34.056714 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2588/5088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:33 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:34.066718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8744380b-15d4-4486-8401-c0e55abd6c07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:34.069769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8744380b-15d4-4486-8401-c0e55abd6c07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 4a7ff495-3486-4529-8b33-a20d8f8d2630] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:34.083631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8744380b-15d4-4486-8401-c0e55abd6c07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 4a7ff495-3486-4529-8b33-a20d8f8d2630 could not be found. Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8744380b-15d4-4486-8401-c0e55abd6c07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/4a7ff495-3486-4529-8b33-a20d8f8d2630/action HTTP/1.1 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 65 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 4a7ff495-3486-4529-8b33-a20d8f8d2630 could not be found. Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '4a7ff495-3486-4529-8b33-a20d8f8d2630', 'body': {'rebuild': {'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c'}}} Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a7ff495-3486-4529-8b33-a20d8f8d2630 could not be found. Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 13 16:54:34.085390 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a7ff495-3486-4529-8b33-a20d8f8d2630 could not be found. Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a7ff495-3486-4529-8b33-a20d8f8d2630 could not be found. Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8744380b-15d4-4486-8401-c0e55abd6c07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 4a7ff495-3486-4529-8b33-a20d8f8d2630 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8744380b-15d4-4486-8401-c0e55abd6c07 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/4a7ff495-3486-4529-8b33-a20d8f8d2630/action" status: 404 len: 111 microversion: 2.1 time: 0.024421 Sep 13 16:54:34.098983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2501/5089] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:34 2022] POST /compute/v2.1/servers/4a7ff495-3486-4529-8b33-a20d8f8d2630/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:34.110212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:34.111079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:34.122851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:34.123254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:34.125805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:34.128840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:34.129783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:34.130340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:34.328443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:34.329928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:34.344090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:34.349051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:34.357817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:34.359252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:34.360460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:34.361134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:34.716948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:34.738968 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7be0379d-2f35-4f6b-92dd-e481126978c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.410062 Sep 13 16:54:34.742702 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2502/5090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:34 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:34.959677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:34.959677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:34.976894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:34.977447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:34.977940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:34.978843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:34.979361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:34.979813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:35.133029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:35.142652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:35.147957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:35.151309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:35.153415 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e716470c-81c0-41e9-9f0b-465f7d9677e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.207079 Sep 13 16:54:35.161600 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-50485797-3340-4d5b-b546-9b4b6ab95b6a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 1.057779 Sep 13 16:54:35.165212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2589/5091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:34 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:35.167688 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2503/5092] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:34 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:35.204215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:35.207099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:35.219591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:35.223274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:35.223952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:35.224861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:35.226377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:35.227941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:35.629701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:35.644694 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bdca3168-14d2-4252-877a-ad15f76c3c76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.448963 Sep 13 16:54:35.645297 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2590/5093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:35 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:35.672189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ccd12e2-2091-4b45-8b4a-9b031fb3cffb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:35.672787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ccd12e2-2091-4b45-8b4a-9b031fb3cffb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: ad40821d-74a0-4a37-90ad-64efbe6b1e68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:35.686130 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4ccd12e2-2091-4b45-8b4a-9b031fb3cffb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance ad40821d-74a0-4a37-90ad-64efbe6b1e68 could not be found. Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ccd12e2-2091-4b45-8b4a-9b031fb3cffb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/ad40821d-74a0-4a37-90ad-64efbe6b1e68/action HTTP/1.1 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 15 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: {"restore": {}} Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ad40821d-74a0-4a37-90ad-64efbe6b1e68 could not be found. Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ad40821d-74a0-4a37-90ad-64efbe6b1e68', 'body': {'restore': {}}} Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad40821d-74a0-4a37-90ad-64efbe6b1e68 could not be found. Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad40821d-74a0-4a37-90ad-64efbe6b1e68 could not be found. Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:35.688206 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:35.693702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:35.693702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:35.693702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad40821d-74a0-4a37-90ad-64efbe6b1e68 could not be found. Sep 13 16:54:35.693702 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:35.697740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ccd12e2-2091-4b45-8b4a-9b031fb3cffb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance ad40821d-74a0-4a37-90ad-64efbe6b1e68 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:35.699572 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ccd12e2-2091-4b45-8b4a-9b031fb3cffb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/ad40821d-74a0-4a37-90ad-64efbe6b1e68/action" status: 404 len: 111 microversion: 2.1 time: 0.031611 Sep 13 16:54:35.702664 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2504/5094] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:35 2022] POST /compute/v2.1/servers/ad40821d-74a0-4a37-90ad-64efbe6b1e68/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:35.710937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:35.711784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:35.725512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:35.726282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:35.726889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:35.727779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:35.728400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:35.728994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:35.768720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:35.769683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:35.779778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:35.788693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:35.791034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:35.796285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:35.797037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:35.797667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.226540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:36.232279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:36.258240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dad843e6-82f5-44b6-ade0-4c8eb1d4e3a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.550959 Sep 13 16:54:36.258740 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a4d401f8-5411-40e2-accb-1ed3dbb42ef6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.485437 Sep 13 16:54:36.259588 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2505/5095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:35 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:36.262056 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2591/5096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:35 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:36.271939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:36.272787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:36.292835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:36.299887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:36.301288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.303838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.304709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.310050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.310903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.312627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.319165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.323977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.324453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.328225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.328725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.329180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.513809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:36.525429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:36.529949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:36.531372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a1bb030-9c18-4e71-b482-55067133dac9 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.269551 Sep 13 16:54:36.532139 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2506/5097] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:36 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:36.725812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:36.762771 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a284113f-7a73-490f-9523-f4f3dd3bf8db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.477754 Sep 13 16:54:36.766685 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2592/5098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:36 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:36.791146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:36.792469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:36.815518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.816428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.818353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.819363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.822657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.824361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.892456 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'restore' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 15 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: {"restore": {}} Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: exception: Cannot 'restore' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'restore': {}}} Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state active. Cannot restore while the instance is in this state. Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:36.898344 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:36.905003 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:36.905003 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:36.905003 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:36.905003 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:36.905003 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:36.905003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'restore' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:36.905761 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8bfd2828-de67-436b-8940-42a604b0ab0e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 145 microversion: 2.1 time: 0.118824 Sep 13 16:54:36.911663 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2507/5099] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:36 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 145 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:54:36.924731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:36.929968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:36.940630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.942939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.945171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.947623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:36.949406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:36.950077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:36.954173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:37.287826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:37.288474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:37.304013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:37.304503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:37.304946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:37.314821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:37.315645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:37.316353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:37.674363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:37.680207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:37.693188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b9e3f9a-44e0-4bba-b176-3599df649380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.778619 Sep 13 16:54:37.696435 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bca7312-6585-41ad-a81f-4185881585e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.413254 Sep 13 16:54:37.698944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2593/5100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:36 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:37.708772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:37.711064 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2508/5101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:37 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:37.719324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:37.732421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:37.733404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:37.733963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:37.734485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:37.738958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:37.742238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:37.742962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:37.743660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:37.744562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:37.745272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:37.746301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:37.747288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:37.747814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:37.751944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:37.928184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:37.945865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:37.947453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:37.949240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e25963e-9129-4678-8672-dc65bc222c69 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.249028 Sep 13 16:54:37.954501 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2594/5102] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:37 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:38.355939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:38.380547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e5e0d72f-3f96-47d2-abba-9599361fa04e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.653463 Sep 13 16:54:38.383832 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2509/5103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:37 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:38.440904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7232d0a1-a4e5-4774-85cf-dd4047f0215a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:38.441057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7232d0a1-a4e5-4774-85cf-dd4047f0215a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 99a74ff0-b174-4637-a62e-0017cac0733a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:38.456014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7232d0a1-a4e5-4774-85cf-dd4047f0215a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 99a74ff0-b174-4637-a62e-0017cac0733a could not be found. Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7232d0a1-a4e5-4774-85cf-dd4047f0215a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/99a74ff0-b174-4637-a62e-0017cac0733a/action HTTP/1.1 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 14 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: {"resume": {}} Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 99a74ff0-b174-4637-a62e-0017cac0733a could not be found. Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '99a74ff0-b174-4637-a62e-0017cac0733a', 'body': {'resume': {}}} Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a74ff0-b174-4637-a62e-0017cac0733a could not be found. Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a74ff0-b174-4637-a62e-0017cac0733a could not be found. Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:38.464335 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a74ff0-b174-4637-a62e-0017cac0733a could not be found. Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7232d0a1-a4e5-4774-85cf-dd4047f0215a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 99a74ff0-b174-4637-a62e-0017cac0733a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7232d0a1-a4e5-4774-85cf-dd4047f0215a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/99a74ff0-b174-4637-a62e-0017cac0733a/action" status: 404 len: 111 microversion: 2.1 time: 0.029518 Sep 13 16:54:38.469434 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2595/5104] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:38 2022] POST /compute/v2.1/servers/99a74ff0-b174-4637-a62e-0017cac0733a/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:38.475503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:38.476339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:38.485473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:38.486276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:38.487070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:38.488810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:38.489317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:38.490079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:38.722233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:38.724416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:38.734849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:38.735750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:38.737052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:38.738223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:38.741025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:38.741579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:38.743874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-686a30fc-83bf-4bd7-b14e-b35e0413fa15 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.272368 Sep 13 16:54:38.745150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:38.748077 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2510/5105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:38 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:38.776268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:38.777187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:38.784895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:38.785573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:38.786215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:38.787539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:38.788169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:38.788878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.103522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:39.118122 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a7abd94-6182-4815-8d67-181e7cdf8d75 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.345872 Sep 13 16:54:39.119637 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2511/5106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:38 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:39.125198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:39.126215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:39.132869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:39.133564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:39.134380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.135996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:39.138802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:39.145342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.226045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:39.239962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:39.242679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:39.245267 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06ed47cd-64c9-4da9-bc3b-b283ec204dc4 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.123354 Sep 13 16:54:39.246159 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2512/5107] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:39 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:39.258268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:39.258268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:39.258491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:39.259157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:39.260274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:39.261383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.263146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:39.263795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:39.264388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.268599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-359e6f54-6b15-43a1-a238-5569cf966235 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1514 microversion: 2.1 time: 0.546784 Sep 13 16:54:39.277861 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2596/5108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:38 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1514 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:39.295462 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'resume' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 14 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: {"resume": {}} Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: exception: Cannot 'resume' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'resume': {}}} Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state active. Cannot resume while the instance is in this state. Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:39.311017 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:54:39.315335 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:39.326391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'resume' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:39.328801 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e439e07-b014-44e0-8ee0-52c0627a79c6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 144 microversion: 2.1 time: 0.081596 Sep 13 16:54:39.329467 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2513/5109] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:39 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 144 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:54:39.339008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:39.339879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:39.346749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:39.348052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:39.348857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.349820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:39.350543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:39.351277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:39.977998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:39.991528 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5d5bb0c-bb74-4539-9796-2be39194dcea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.654571 Sep 13 16:54:39.995356 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2597/5110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:39 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:40.022518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:40.023784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:40.034085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.034825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.035681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.036640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.037279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.037936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.273876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:40.274510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:40.287433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.287944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.288387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.289121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.289773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.290230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.314059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:40.326547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1e783b8-694b-4280-aff1-fabc96aa77e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.309484 Sep 13 16:54:40.327061 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2514/5111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:40 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:40.334362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:40.335668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:40.344654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.349693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.350982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.351961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.352645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.353289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.551743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:40.560842 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1302fd0-0119-4308-84fd-27377cee8f00 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.230650 Sep 13 16:54:40.565279 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2515/5112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:40 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:40.574220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-09c526db-3e95-4f60-90f8-53edb00c47a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-09c526db-3e95-4f60-90f8-53edb00c47a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 160 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969"}]}} Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'server': {'name': '', 'imageRef': '5853c870-0393-4bca-bd0a-d3ea26765a2c', 'flavorRef': '452', 'networks': [{'uuid': '52e8ad1c-b8ed-4a3e-a2c3-6a7aa165d969'}]}}} Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '' Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:54:40.590220 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-09c526db-3e95-4f60-90f8-53edb00c47a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:40.602309 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-09c526db-3e95-4f60-90f8-53edb00c47a8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.033103 Sep 13 16:54:40.608662 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2516/5113] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:40 2022] POST /compute/v2.1/servers => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:40.622935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:40.623567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:40.654543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.655335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.660681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.661651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.662180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.668000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.700336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:40.720715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:40.722243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:40.723989 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93a31f08-18ea-44fb-b7de-0403e54ef97a tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.454517 Sep 13 16:54:40.751752 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2598/5114] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:40 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:40.906626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:40.914327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:40.916640 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a42d33f4-0db4-42ae-bc27-20cc5b45a8a6 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.307050 Sep 13 16:54:40.925024 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2517/5115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:40 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:40.951044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:40.951668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:40.961019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.961521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.962000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:40.963010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:40.963551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:40.964945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.439439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:41.454079 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c653fac6-f05a-41f6-8c7e-2131aef32086 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.507461 Sep 13 16:54:41.462307 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2599/5116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:40 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:41.488376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afb52626-a0d2-4099-8b6a-9a2c3a20aa46 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:41.488915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-afb52626-a0d2-4099-8b6a-9a2c3a20aa46 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 74e531e7-98b7-47c2-8f0b-d798887fdc4e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:41.499711 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-afb52626-a0d2-4099-8b6a-9a2c3a20aa46 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 74e531e7-98b7-47c2-8f0b-d798887fdc4e could not be found. Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afb52626-a0d2-4099-8b6a-9a2c3a20aa46 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/74e531e7-98b7-47c2-8f0b-d798887fdc4e/action HTTP/1.1 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 14 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: {"shelve": {}} Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 74e531e7-98b7-47c2-8f0b-d798887fdc4e could not be found. Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '74e531e7-98b7-47c2-8f0b-d798887fdc4e', 'body': {'shelve': {}}} Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e531e7-98b7-47c2-8f0b-d798887fdc4e could not be found. Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e531e7-98b7-47c2-8f0b-d798887fdc4e could not be found. Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:41.514679 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:41.519410 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:41.519410 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:41.519410 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e531e7-98b7-47c2-8f0b-d798887fdc4e could not be found. Sep 13 16:54:41.519410 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:41.521405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afb52626-a0d2-4099-8b6a-9a2c3a20aa46 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 74e531e7-98b7-47c2-8f0b-d798887fdc4e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:41.522529 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-afb52626-a0d2-4099-8b6a-9a2c3a20aa46 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/74e531e7-98b7-47c2-8f0b-d798887fdc4e/action" status: 404 len: 111 microversion: 2.1 time: 0.038412 Sep 13 16:54:41.523336 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2518/5117] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:41 2022] POST /compute/v2.1/servers/74e531e7-98b7-47c2-8f0b-d798887fdc4e/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:54:41.532347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:41.533207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:41.539582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:41.540334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:41.540973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.541998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:41.542655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:41.543283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.592561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:41.593481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:41.608042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:41.608847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:41.609509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.610483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:41.611348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:41.611980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.815533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:41.841988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ded746b0-ae36-49f2-99fc-2e9aa57e970b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.306617 Sep 13 16:54:41.854792 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2600/5118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:41 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:41.869128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:41.872793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:41.884692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:41.885394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:41.886026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.889982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:41.890749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:41.891192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:41.962458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:41.978681 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3697cf03-f92d-4ce1-b2f0-39335ed98ca1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.390397 Sep 13 16:54:41.979826 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2519/5119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:41 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:41.984546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:41.985156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:42.001322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:42.001898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:42.002321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:42.003053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:42.003527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:42.003968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:42.156983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:42.191820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:42.217778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:42.219892 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97fe59a4-c1f8-4dd7-af0a-76aeebebc894 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.368550 Sep 13 16:54:42.235021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2601/5120] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:41 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:42.538128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:42.552056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c7e7d63-d7a4-4171-acfe-41e80de4279f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.571186 Sep 13 16:54:42.555513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2520/5121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:41 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:42.598642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:42.600100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:42.611590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:42.617311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:42.617949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:42.621010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:42.621919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:42.622374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:42.675278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'flavor' on Instance uuid d7eedcc1-56b5-4258-9f98-c39305cd7e65 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:54:43.023612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:43.024516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:43.033241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:43.037486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.039927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.040396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.041128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.041739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.045899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.084135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3038f222-9931-4af8-a651-17f2c7f4f2c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.490111 Sep 13 16:54:43.099318 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2602/5122] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:54:42 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:54:43.124451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:43.125236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:43.150616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.151448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.152171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.152911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.157803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.161933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.424459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:43.434771 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e45988b3-9969-47ac-91ed-355a42fa1eb5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.328864 Sep 13 16:54:43.466171 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2603/5123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:43 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:43.471640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:43.472672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:43.483020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.483893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.484557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.485524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.486474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.487168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.561195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:43.586655 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ab6cbca-d9ae-4afe-bcd7-74a9f62e541b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.566775 Sep 13 16:54:43.596889 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2521/5124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:43 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:43.644560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:43.664443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:43.675391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:43.676596 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8d36315f-f49e-4543-8bff-3d3c30515230 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.208927 Sep 13 16:54:43.689858 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2604/5125] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:43 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:43.824534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4c422613-bbd4-481e-8801-f5fefad9d015 req-8d3dd2ec-3f65-4ae6-bf2c-d8885b7489b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6e5b15-642d-4cbd-b3da-e74c9f583f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "81f88411-ed0b-4ed9-a00a-b499fd3eeb3f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:43.848233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4c422613-bbd4-481e-8801-f5fefad9d015 req-8d3dd2ec-3f65-4ae6-bf2c-d8885b7489b1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:43.853022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4c422613-bbd4-481e-8801-f5fefad9d015 req-8d3dd2ec-3f65-4ae6-bf2c-d8885b7489b1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:43.853749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4c422613-bbd4-481e-8801-f5fefad9d015 req-8d3dd2ec-3f65-4ae6-bf2c-d8885b7489b1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:43.893129 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4c422613-bbd4-481e-8801-f5fefad9d015 req-8d3dd2ec-3f65-4ae6-bf2c-d8885b7489b1 service nova] Creating event network-vif-unplugged:81f88411-ed0b-4ed9-a00a-b499fd3eeb3f for instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c on n-h2-857467-1 Sep 13 16:54:43.924326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4c422613-bbd4-481e-8801-f5fefad9d015 req-8d3dd2ec-3f65-4ae6-bf2c-d8885b7489b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102433 Sep 13 16:54:43.935760 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2522/5126] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:44.461660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:44.463687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:44.475210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:44.476770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:44.477401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:44.478347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:44.479016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:44.480695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:44.612499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:44.614628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:44.629288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:44.629958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:44.634722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:44.636273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:44.636923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:44.637477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:44.714955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:44.723705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9182da9c-0162-425b-b9ab-9b4d6cbf25de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.266540 Sep 13 16:54:44.737383 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2605/5127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:44 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:44.737383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:44.737383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:44.737383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:44.737383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:44.737383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:44.738713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:44.739277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:44.739808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:44.876628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:44.888247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:44.889792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:44.891651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e15f979-80c5-45ca-8a6b-c0eacd188f37 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.165727 Sep 13 16:54:44.892361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2606/5128] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:44 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:54:45.077809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:45.093053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4613598b-128a-4f91-b618-101411fd1241 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.484897 Sep 13 16:54:45.094190 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2523/5129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:44 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:45.753217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:45.753857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:45.766569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:45.767327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:45.767932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:45.771016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:45.771729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:45.773652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:45.916673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:45.917528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:45.935319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:45.935824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:45.936284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:45.937011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:45.937692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:45.938351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:46.175177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:46.186019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-031edb64-872a-4bde-aa36-b2f5020a8ea7 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.436551 Sep 13 16:54:46.203249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2607/5130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:45 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:46.219336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:46.221484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:46.236306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:46.237706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:46.239703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:46.240705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:46.242389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:46.246159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:46.253612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:46.270882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:46.279215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:46.280822 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da4b9956-261d-4440-873a-6a358ab023d7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1605 microversion: 2.42 time: 0.368155 Sep 13 16:54:46.316144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2524/5131] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:45 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1605 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:54:46.548082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:46.548082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:46.588667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ada5f252-7284-4039-a297-56b3926095c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.383953 Sep 13 16:54:46.589711 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2608/5132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:46 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:47.215573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:47.216225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:47.233490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.234032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.234479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:47.235203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.235665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.236309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:47.312862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:47.314147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:47.328642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.330230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.331157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:47.332191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.333321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.334138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:47.405223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.413690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.418248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:47.418835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lazy-loading 'fault' on Instance uuid 0ee36ddc-3c5e-44b2-88af-b78a509b94af {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:54:47.544403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:47.566490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:47.583662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed6d4ab471514a30b56943e5a4335600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d9c9874b7c41f082ad52a82e7faf1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:47.585894 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-168b4fa4-0801-4679-b289-c6333b684653 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 200 len: 1372 microversion: 2.42 time: 0.277414 Sep 13 16:54:47.590081 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2609/5133] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:47 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:54:47.615976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:47.625254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:47.629507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:47.629967 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-389c3cac-31f2-49c7-be6a-edadf5d3c7e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.418107 Sep 13 16:54:47.640608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:47.642732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.646658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.649724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:47.651164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:47.651532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2525/5134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:47 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:47.652117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:47.652637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:48.091842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:48.110705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa20368b-0bab-4260-b9c9-ade43723c8e2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.495356 Sep 13 16:54:48.112077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2610/5135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:47 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:48.530372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ab20302a-79db-4d2b-a141-b0368a965ebb req-e0d11fd6-54a4-407f-b839-a135a43e182a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6e5b15-642d-4cbd-b3da-e74c9f583f2c", "name": "network-vif-plugged", "status": "completed", "tag": "81f88411-ed0b-4ed9-a00a-b499fd3eeb3f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:48.578118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab20302a-79db-4d2b-a141-b0368a965ebb req-e0d11fd6-54a4-407f-b839-a135a43e182a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:48.578836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab20302a-79db-4d2b-a141-b0368a965ebb req-e0d11fd6-54a4-407f-b839-a135a43e182a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:48.579289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab20302a-79db-4d2b-a141-b0368a965ebb req-e0d11fd6-54a4-407f-b839-a135a43e182a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:48.601780 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ab20302a-79db-4d2b-a141-b0368a965ebb req-e0d11fd6-54a4-407f-b839-a135a43e182a service nova] Creating event network-vif-plugged:81f88411-ed0b-4ed9-a00a-b499fd3eeb3f for instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c on n-h2-857467-1 Sep 13 16:54:48.611752 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ab20302a-79db-4d2b-a141-b0368a965ebb req-e0d11fd6-54a4-407f-b839-a135a43e182a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088142 Sep 13 16:54:48.615402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:48.616029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:48.617342 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2526/5136] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:54:48.629228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:48.629741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:48.633365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:48.634205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:48.634704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:48.635832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:48.663900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:48.665357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:48.671193 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] HTTP exception thrown: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Request method failure captured: Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af HTTP/1.1 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILRHlp5qBe_tjfSDHL30ReFFgPFnyBWDSnZhxaQWsG2g6q9arB6F1D2tF5OeTgsROkJL88EKYP0viNSEhLQ9pn1bvCnjEiJef8r2G0TdjSdmlfqt_1x4AObjlRxCiw3QvWKHB-vpbryzQk5FYuP-Z5i_Y_Fro6J20ellTel3ue-36-o Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.42 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 66d9c9874b7c41f082ad52a82e7faf1e Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 66d9c9874b7c41f082ad52a82e7faf1e Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TaggedBootDevicesTest_v242-984125349-project Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: ed6d4ab471514a30b56943e5a4335600 Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TaggedBootDevicesTest_v242-984125349-project Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '0ee36ddc-3c5e-44b2-88af-b78a509b94af'} Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:48.675004 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:54:48.679554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Returning 404 to user: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:48.688673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-29adc16b-0acb-40aa-8040-b3c1fffdc622 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 404 len: 111 microversion: 2.42 time: 0.077107 Sep 13 16:54:48.695623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2611/5137] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:48 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:54:48.703343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f45f737b-d8c5-476d-a099-87a0ed71fa65 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '.version_select at 0x7fbeb45941f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:48.705721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:48.708167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:48.710517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:48.716391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:48.718745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:48.719447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:48.756813 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f45f737b-d8c5-476d-a099-87a0ed71fa65 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696033212" status: 204 len: 0 microversion: 2.42 time: 0.059516 Sep 13 16:54:48.768215 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2612/5138] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Sep 13 16:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696033212 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:54:49.137681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:49.138356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:49.147294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:49.147822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:49.148277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:49.149087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:49.149573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:49.150351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:49.211727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:49.221322 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-46bb12b8-fcf2-4b53-9c9d-8287a559ff44 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.567310 Sep 13 16:54:49.222297 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2527/5139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:48 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:49.486754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:49.505581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0e7ba65-f288-4b22-9943-58d65c3a87e9 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.371340 Sep 13 16:54:49.526378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2613/5140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:49 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:50.244718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:50.245536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:50.253249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:50.254081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:50.254869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:50.255911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:50.258391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:50.259078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:50.531933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:50.533365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:50.555481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:50.555994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:50.556446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:50.557737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:50.558252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:50.558688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:50.967893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:50.982115 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed4d04f6-85d0-4a8c-b8de-f7a608cf3742 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.739427 Sep 13 16:54:50.982997 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2528/5141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:50 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:51.009174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:51.020882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-048c7718-9f30-441f-8706-9aad7101181b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1520 microversion: 2.1 time: 0.492908 Sep 13 16:54:51.023284 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2614/5142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:50 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:52.014798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:52.015478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:52.035757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:52.036281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:52.036739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:52.037626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:52.038121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:52.038559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:52.055943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:52.058424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:52.079458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:52.082183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:52.082925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:52.084787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:52.088713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:52.090435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:52.754461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:52.766183 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14d7b0db-7a89-423c-bbef-716d5bc8ed45 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1505 microversion: 2.1 time: 0.717839 Sep 13 16:54:52.767116 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2615/5143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:52 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:52.799972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:52.800888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:52.820590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:52.826153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:52.826815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:52.827981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:52.830396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:52.832145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:53.071121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:53.083388 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3c81626-f984-41ab-a096-9de12357efea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 1.073338 Sep 13 16:54:53.085568 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2529/5144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:52 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:53.473653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:53.501968 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3eeb410b-169a-471a-9c12-1f5d8e0a1b2e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 200 len: 1505 microversion: 2.1 time: 0.713424 Sep 13 16:54:53.504181 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2616/5145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:52 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:53.527972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:53.528725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:53.535207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:53.535699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:53.536141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:53.536854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:53.537342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:53.537770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:53.586869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:54:53.776675 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-38ab65d7-fe29-4f6c-80d1-b4125756943c tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 204 len: 0 microversion: 2.1 time: 0.252426 Sep 13 16:54:53.777922 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2530/5146] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:54:53 2022] DELETE /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:54:54.006917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-367655391", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "1324e2ca-97db-407f-b483-50c76d8852ff"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:54.118625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:54.119997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:54.132332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] validate_networks() for [('1324e2ca-97db-407f-b483-50c76d8852ff', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:54:54.152015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:54.168816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:54.170190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:54.175135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:54.175851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:54.176622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:54.613233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:54.639472 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a344207d-5797-4c95-9ff8-95c67ed2caf8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.533741 Sep 13 16:54:54.641337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2531/5147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:54 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:54:55.485693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:54:55.488195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:54:55.490138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:54:55.491424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:54:55.494046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:54:55.524594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:55.525355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:55.526520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:55.527221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:55.527956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:55.528392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:55.571327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Getting quotas for project adb0938b4c884dc0a1467383e16fbf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:54:55.577454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Getting quotas for user 24f2e3c66387486c9b8dc9d7dffefe71 and project adb0938b4c884dc0a1467383e16fbf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:54:55.614646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:54:55.617052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:54:55.669398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:55.670812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:55.686078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:55.686867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:55.689964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:55.691237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:55.693622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:55.695008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:55.704093 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1543c8d5-d054-41e2-96eb-6e09c9b794b5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713672 Sep 13 16:54:55.714955 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2617/5148] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:54:55.730636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc27d9bb-535b-4fef-b702-6de6ec3e4bb3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:55.731295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc27d9bb-535b-4fef-b702-6de6ec3e4bb3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:55.998516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fc27d9bb-535b-4fef-b702-6de6ec3e4bb3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:56.008349 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc27d9bb-535b-4fef-b702-6de6ec3e4bb3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1217 microversion: 2.1 time: 0.291692 Sep 13 16:54:56.028268 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2618/5149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:55 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1217 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:56.210910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:56.227871 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12465372-62e0-4d22-9201-38bb782f2bd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1533 microversion: 2.1 time: 0.564121 Sep 13 16:54:56.238503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2532/5150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:55 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1533 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:57.035141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:57.036401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:57.044948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.045648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.046365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.047459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.048176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.048824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.139522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:57.140905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:57.152085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.153008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.153699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.154705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.155570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.156583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.183621 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] HTTP exception thrown: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.184608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Request method failure captured: Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af HTTP/1.1 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILRHlp5qBe_tjfSDHL30ReFFgPFnyBWDSnZhxaQWsG2g6q9arB6F1D2tF5OeTgsROkJL88EKYP0viNSEhLQ9pn1bvCnjEiJef8r2G0TdjSdmlfqt_1x4AObjlRxCiw3QvWKHB-vpbryzQk5FYuP-Z5i_Y_Fro6J20ellTel3ue-36-o Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.42 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 66d9c9874b7c41f082ad52a82e7faf1e Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 66d9c9874b7c41f082ad52a82e7faf1e Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TaggedBootDevicesTest_v242-984125349-project Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ed6d4ab471514a30b56943e5a4335600 Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TaggedBootDevicesTest_v242-984125349-project Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '0ee36ddc-3c5e-44b2-88af-b78a509b94af'} Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:57.187629 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.193432 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.196549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Returning 404 to user: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:57.199062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad1a2683-4bb6-474e-924b-9c4861ccb2e7 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 404 len: 111 microversion: 2.42 time: 0.066378 Sep 13 16:54:57.200255 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2533/5151] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:54:57 2022] DELETE /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:54:57.207561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d155b4a5-585a-4786-abcd-d8bc31ca2ab0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1269 microversion: 2.1 time: 0.176590 Sep 13 16:54:57.210428 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2619/5152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:57 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:57.211969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:57.212616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] [instance: 0ee36ddc-3c5e-44b2-88af-b78a509b94af] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:57.222621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.223246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.223699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.224419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.224881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.227731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.254250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:57.254915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:57.269766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] HTTP exception thrown: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.273348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.274535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Request method failure captured: Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af HTTP/1.1 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILRHlp5qBe_tjfSDHL30ReFFgPFnyBWDSnZhxaQWsG2g6q9arB6F1D2tF5OeTgsROkJL88EKYP0viNSEhLQ9pn1bvCnjEiJef8r2G0TdjSdmlfqt_1x4AObjlRxCiw3QvWKHB-vpbryzQk5FYuP-Z5i_Y_Fro6J20ellTel3ue-36-o Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.42 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 66d9c9874b7c41f082ad52a82e7faf1e Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/66d9c9874b7c41f082ad52a82e7faf1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 66d9c9874b7c41f082ad52a82e7faf1e Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-984125349 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TaggedBootDevicesTest_v242-984125349-project Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ed6d4ab471514a30b56943e5a4335600 Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TaggedBootDevicesTest_v242-984125349-project Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '0ee36ddc-3c5e-44b2-88af-b78a509b94af'} Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.277633 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. Sep 13 16:54:57.282852 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:54:57.283436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.283436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.283436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.283436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.286694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] Returning 404 to user: Instance 0ee36ddc-3c5e-44b2-88af-b78a509b94af could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:54:57.288017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-381f54f8-cff3-4f9f-ba37-743995c3c772 tempest-TaggedBootDevicesTest_v242-984125349 tempest-TaggedBootDevicesTest_v242-984125349-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af" status: 404 len: 111 microversion: 2.42 time: 0.083729 Sep 13 16:54:57.289799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2534/5153] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:54:57 2022] GET /compute/v2.1/servers/0ee36ddc-3c5e-44b2-88af-b78a509b94af => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:54:57.575385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-de638069-3c3b-4e70-abdd-3470e417ba98 req-b9d06e4d-7a6e-4fdb-9551-bc8c0d4e8ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6e5b15-642d-4cbd-b3da-e74c9f583f2c", "name": "network-vif-deleted", "tag": "81f88411-ed0b-4ed9-a00a-b499fd3eeb3f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:54:57.605917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-de638069-3c3b-4e70-abdd-3470e417ba98 req-b9d06e4d-7a6e-4fdb-9551-bc8c0d4e8ffc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:57.609007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-de638069-3c3b-4e70-abdd-3470e417ba98 req-b9d06e4d-7a6e-4fdb-9551-bc8c0d4e8ffc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:57.610518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-de638069-3c3b-4e70-abdd-3470e417ba98 req-b9d06e4d-7a6e-4fdb-9551-bc8c0d4e8ffc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:57.661791 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-de638069-3c3b-4e70-abdd-3470e417ba98 req-b9d06e4d-7a6e-4fdb-9551-bc8c0d4e8ffc service nova] Creating event network-vif-deleted:81f88411-ed0b-4ed9-a00a-b499fd3eeb3f for instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c on n-h2-857467-1 Sep 13 16:54:57.678890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-de638069-3c3b-4e70-abdd-3470e417ba98 req-b9d06e4d-7a6e-4fdb-9551-bc8c0d4e8ffc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111418 Sep 13 16:54:57.680549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2535/5154] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:54:58.055715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:58.071610 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d438e2c-547b-4eed-badd-2c091dc0d5e2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1533 microversion: 2.1 time: 0.822814 Sep 13 16:54:58.085875 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2620/5155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:57 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1533 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:58.233622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:58.235424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:58.268009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:58.271311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:58.271950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:58.272823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:58.274621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:58.276672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:58.673027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:58.688212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65068d5f-d2c8-4f5e-a3b4-7884576d74dd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1275 microversion: 2.1 time: 0.459298 Sep 13 16:54:58.705864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2536/5156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:58 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1275 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:59.101070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:59.101743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:59.114844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:59.115825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:59.118014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:59.118981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:59.120396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:59.125545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:59.524840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:59.538624 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3adcda0c-37e0-48b6-9e88-b080d741585d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1533 microversion: 2.1 time: 0.442105 Sep 13 16:54:59.539788 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2621/5157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:59 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1533 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:54:59.727204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:54:59.729086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:54:59.751885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:59.756087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:59.756553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:59.759491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:54:59.762427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:54:59.762891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:54:59.778117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:54:59.888991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:54:59.903347 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d087f592-b7e4-441d-b084-785ff5bfed7f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1275 microversion: 2.1 time: 0.183213 Sep 13 16:54:59.904296 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2537/5158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:54:59 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:00.278717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-61489ba8-9e5a-4af0-ad9a-30bf5b8888ea req-cd34ddfa-ff4b-4509-bfde-4a1b7d44c11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7eedcc1-56b5-4258-9f98-c39305cd7e65", "name": "network-vif-plugged", "status": "completed", "tag": "dfc168c0-711c-4893-9a35-c5d006a6b6bd"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:00.289529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-61489ba8-9e5a-4af0-ad9a-30bf5b8888ea req-cd34ddfa-ff4b-4509-bfde-4a1b7d44c11b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:00.290333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-61489ba8-9e5a-4af0-ad9a-30bf5b8888ea req-cd34ddfa-ff4b-4509-bfde-4a1b7d44c11b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:00.290977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-61489ba8-9e5a-4af0-ad9a-30bf5b8888ea req-cd34ddfa-ff4b-4509-bfde-4a1b7d44c11b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:00.309084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-61489ba8-9e5a-4af0-ad9a-30bf5b8888ea req-cd34ddfa-ff4b-4509-bfde-4a1b7d44c11b service nova] Creating event network-vif-plugged:dfc168c0-711c-4893-9a35-c5d006a6b6bd for instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 on n-h1-857467-1 Sep 13 16:55:00.315254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-61489ba8-9e5a-4af0-ad9a-30bf5b8888ea req-cd34ddfa-ff4b-4509-bfde-4a1b7d44c11b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042345 Sep 13 16:55:00.316649 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2622/5159] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:00.562938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:00.563634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:00.574031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:00.575670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:00.576124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:00.579139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:00.579638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:00.581802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:00.927830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:00.928534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:00.938648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:00.942524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:00.943009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:00.943884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:00.944361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:00.944797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:01.132160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:01.149278 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-164ec8a7-61d5-4dfe-aaae-30ab67a58676 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1533 microversion: 2.1 time: 0.589156 Sep 13 16:55:01.177976 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2538/5160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:00 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1533 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:01.364810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:01.380276 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12f83d5e-34ac-4c1f-9cf6-899374bc2069 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.456727 Sep 13 16:55:01.380797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2623/5161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:00 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:02.185055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:02.186351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:02.220106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:02.221269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:02.225575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:02.229624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:02.233994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:02.234751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:02.410911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:02.412260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:02.424500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:02.425532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:02.426199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:02.427350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:02.428020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:02.428812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:03.700304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:03.726097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d0c9485-99a7-4ca9-9685-bab9fa1e3323 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 1.319491 Sep 13 16:55:03.732531 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2624/5162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:02 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:03.743231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f0c61893-b2a3-4cec-b598-d735a74469af req-638cdabd-27b3-488e-a8ba-f4e3d182a036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8771f19c-7855-47e1-a507-b620155e6174", "tag": "4691661c-1e17-4836-bd21-65c434a2d923"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:03.779347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0c61893-b2a3-4cec-b598-d735a74469af req-638cdabd-27b3-488e-a8ba-f4e3d182a036 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:03.780111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0c61893-b2a3-4cec-b598-d735a74469af req-638cdabd-27b3-488e-a8ba-f4e3d182a036 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:03.780782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0c61893-b2a3-4cec-b598-d735a74469af req-638cdabd-27b3-488e-a8ba-f4e3d182a036 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:03.810558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f0c61893-b2a3-4cec-b598-d735a74469af req-638cdabd-27b3-488e-a8ba-f4e3d182a036 service nova] Creating event network-changed:4691661c-1e17-4836-bd21-65c434a2d923 for instance 8771f19c-7855-47e1-a507-b620155e6174 on n-h2-857467-1 Sep 13 16:55:03.828164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f0c61893-b2a3-4cec-b598-d735a74469af req-638cdabd-27b3-488e-a8ba-f4e3d182a036 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087979 Sep 13 16:55:03.829521 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2625/5163] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:04.126965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:04.143619 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7f628f66-753e-41f2-8308-42c351a7b2a0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1533 microversion: 2.1 time: 1.963031 Sep 13 16:55:04.145967 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2539/5164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:02 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1533 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:04.762944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:04.768414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:04.786929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:04.789768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:04.792844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:04.794418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:04.797246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:04.798162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:05.138242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:05.160664 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-65235c15-73c8-407c-8f27-08b96725aab1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.404168 Sep 13 16:55:05.163716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2626/5165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:04 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:05.173951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:05.174576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:05.187086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:05.188888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:05.191040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:05.191992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:05.193143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:05.195167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:05.924261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:05.946837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4449b7ca-3a5d-47cc-9054-e83f8b0a89bc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.774459 Sep 13 16:55:05.957849 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2540/5166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:05 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:06.192458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:06.193991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:06.216315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:06.224110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:06.228134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:06.228975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:06.229992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:06.232318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:06.234611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:06.236225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:06.722190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:06.731060 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f093f56a-536c-4e18-ad96-373088bd0571 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.548554 Sep 13 16:55:06.749705 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2627/5167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:06 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:06.976634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:06.977585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:06.995851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:07.003800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:07.007634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:07.011552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:07.017293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:07.017954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:07.438059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:07.453263 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5ec743f-4f91-43de-8c6e-63d4f18c8702 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.481045 Sep 13 16:55:07.455794 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2541/5168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:06 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:07.756789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:07.757411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:07.769792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:07.779528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:07.780005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:07.780962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:07.781630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:07.782311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:08.084403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:08.098271 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-84ccb4f4-6292-4bac-9314-acfed970fdd1 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.345207 Sep 13 16:55:08.115294 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2628/5169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:07 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:08.481446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:08.482154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:08.498265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:08.498715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:08.499197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:08.499926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:08.500412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:08.500860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:09.127237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:09.128495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:09.148690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:09.149417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:09.152063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:09.153107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:09.153975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:09.156168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:09.216923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:09.224877 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f279271a-5b6f-4055-9d07-95cff1fa48b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.748971 Sep 13 16:55:09.225597 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2542/5170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:08 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:09.940681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:09.948955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:09.960811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7304450c-7941-4f4a-812c-fa2075d77fc5 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.838908 Sep 13 16:55:09.965335 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2629/5171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:09 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:10.251243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:10.252500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:10.268695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:10.269492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:10.277388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:10.278477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:10.279666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:10.280289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:10.768965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6532d509-464c-40ae-8a4e-ae15422b4bb6 req-1e42a27d-feab-4e34-b91d-d45010f449cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771f19c-7855-47e1-a507-b620155e6174", "name": "network-vif-plugged", "status": "completed", "tag": "4691661c-1e17-4836-bd21-65c434a2d923"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:10.812634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6532d509-464c-40ae-8a4e-ae15422b4bb6 req-1e42a27d-feab-4e34-b91d-d45010f449cc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:10.813069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6532d509-464c-40ae-8a4e-ae15422b4bb6 req-1e42a27d-feab-4e34-b91d-d45010f449cc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:10.813521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6532d509-464c-40ae-8a4e-ae15422b4bb6 req-1e42a27d-feab-4e34-b91d-d45010f449cc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:10.862765 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6532d509-464c-40ae-8a4e-ae15422b4bb6 req-1e42a27d-feab-4e34-b91d-d45010f449cc service nova] Creating event network-vif-plugged:4691661c-1e17-4836-bd21-65c434a2d923 for instance 8771f19c-7855-47e1-a507-b620155e6174 on n-h2-857467-1 Sep 13 16:55:10.875608 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6532d509-464c-40ae-8a4e-ae15422b4bb6 req-1e42a27d-feab-4e34-b91d-d45010f449cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110155 Sep 13 16:55:10.879907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2630/5172] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:10.991018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:10.992046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:11.005708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:11.008266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:11.008991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:11.010829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:11.014754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:11.015333 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8903ef6f-4176-4773-8d99-1aca6965bf37 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.767951 Sep 13 16:55:11.015523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:11.016223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:11.022935 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2543/5173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:10 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:11.613800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:11.623111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82d70c29-2fbe-407a-8a8c-dc7e5012b5bc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.637003 Sep 13 16:55:11.626451 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2631/5174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:10 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:12.064701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:12.065293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:12.087719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:12.088243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:12.088706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:12.093840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:12.094362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:12.094831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:12.656623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:12.657993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:12.670300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:12.671230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:12.672619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:12.673607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:12.677224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:12.678111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:12.820151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:12.839056 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-160b989f-b97b-4c2c-b88a-8e777fbed8d4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.791959 Sep 13 16:55:12.864531 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2544/5175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:12 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:13.498525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:13.518025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-acbcd577-3d50-45dd-a238-625104fae3c8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1317 microversion: 2.1 time: 0.864227 Sep 13 16:55:13.521361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2632/5176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:12 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:13.879707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:13.880359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:13.904160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:13.915523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:13.916714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:13.917168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:13.917944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:13.918416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:13.918851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:14.450083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:14.458754 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6b1e86c-6b81-4e93-af52-a327b176be86 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.586070 Sep 13 16:55:14.477947 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2545/5177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:13 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:14.557356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:14.567722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:14.587152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:14.590346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:14.592565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:14.595520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:14.597162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:14.600283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:15.191598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:15.207285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64cc3477-b4c1-47af-bb3d-1492dd89be65 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1506 microversion: 2.1 time: 0.656610 Sep 13 16:55:15.210487 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2633/5178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:14 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:15.235738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:15.236532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:15.254620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:15.257897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:15.258850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:15.261307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:15.267187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:15.270399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:15.498101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:15.499214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:15.523022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:15.526970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:15.532196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:15.533946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:15.535612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:15.536750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:15.984427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:15.994731 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1260989d-05b1-4db9-bee0-5722e54ca26d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1506 microversion: 2.1 time: 0.762806 Sep 13 16:55:16.016059 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2546/5179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:15 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1506 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:16.018807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:16.023070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:16.026497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:16.034479 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fb88a726-93ea-4c61-ae88-27466be1dc8e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.545953 Sep 13 16:55:16.035849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:16.036597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:16.037075 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2634/5180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:15 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:16.064059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:16.071423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:16.072525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:16.073226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:16.299926 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9aa4c3f-155e-40c6-b23f-b73371e19093 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "PUT /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1078 microversion: 2.1 time: 0.280717 Sep 13 16:55:16.301780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2547/5181] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:55:16 2022] PUT /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1078 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:16.324921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:16.325553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:16.337998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:16.341423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:16.345365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:16.346852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:16.348701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:16.349454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:16.913140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:16.923022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2faf7ebc-3a5e-4548-ac5b-fdc81497deca tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1504 microversion: 2.1 time: 0.603581 Sep 13 16:55:16.927944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2635/5182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:16 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:16.949190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:16.950207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:16.957615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:16.958531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:16.959227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:16.960390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:16.961108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:16.961860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:17.073002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:17.074460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:17.083762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:17.084528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:17.086547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:17.087550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:17.089217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:17.090657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:17.622448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:17.638843 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-415a7b21-3eff-4d6b-b64a-4dc016855539 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1504 microversion: 2.1 time: 0.694433 Sep 13 16:55:17.662844 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2548/5183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:16 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:17.700551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:17.722622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:17.749106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:17.754739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:17.756548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:17.758848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:17.761654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:17.763750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:17.840031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:17.866624 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e86e302-e36f-455d-a3f1-e7752f13e87a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.807142 Sep 13 16:55:17.878843 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2636/5184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:17 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:17.988865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:17.989685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:17.990972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:17.991628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:17.992265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:18.136811 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:55:18.227213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:18.230430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:18.248888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:18.257089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:18.259471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:18.260104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:18.274263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:18.275961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:18.276751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:18.433225 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-48d2e3d4-1f14-41cb-b9d6-cd2e59f13996 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.209887 Sep 13 16:55:18.437081 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2637/5185] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:55:18 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:55:18.443135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:18.448173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:18.464983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:18.466138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:18.466851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:18.467850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:18.472567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:18.473407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:18.854197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:18.882194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca4cfa17-125d-49e6-825c-e9ca8a88d9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1670 microversion: 2.1 time: 0.443184 Sep 13 16:55:18.883816 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2638/5186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:18 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1670 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:18.909393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:18.910491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:18.934102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:18.935468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:18.937100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:18.941952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:18.945941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:18.947374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:19.149684 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 60524. Sep 13 16:55:19.161005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:19.200841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:19.202784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:19.205613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:19.211435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:19.212218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:19.214630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:19.329016 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-143c11a5-af9c-4470-a436-fc0a1721b6e6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "POST /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174/action" status: 202 len: 1110 microversion: 2.1 time: 1.642974 Sep 13 16:55:19.332801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2549/5187] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:55:17 2022] POST /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174/action => generated 1110 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 13 16:55:19.356591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:19.357725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:19.370268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:19.371304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:19.371918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:19.373360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:19.374154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:19.375465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:19.507757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:19.523011 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-039b4a46-dea4-4090-bc44-ee4ebab96174 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.633906 Sep 13 16:55:19.523633 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2639/5188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:18 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:19.918200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:19.919211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:19.939215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:19.939610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:19.940064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:19.940793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:19.941257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:19.945297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:20.217178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:20.240652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d8f12e25-e7ff-433a-a8e9-ef9571fd971e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.892795 Sep 13 16:55:20.255773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2550/5189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:19 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:20.555096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:20.557023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:20.565676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:20.566513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:20.567167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:20.568063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:20.568745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:20.569360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:20.651848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:21.130067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:21.149148 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a71d03cc-4766-4f60-97f4-18cc3cd06f43 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1670 microversion: 2.1 time: 1.242817 Sep 13 16:55:21.151096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2640/5190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:19 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1670 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:21.268373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:21.269416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:21.293627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:21.297082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:21.297565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:21.300535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:21.301031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:21.301499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:21.508291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:21.522880 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94fbba7d-5489-4dba-8439-4e9b308f43b0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.976139 Sep 13 16:55:21.528336 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2551/5191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:20 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:21.995776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:22.017145 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a49e888-45d8-48eb-afa1-ea4395f2b37b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.752884 Sep 13 16:55:22.020419 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2641/5192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:21 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:22.180206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:22.181427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:22.212128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:22.214241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:22.214962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:22.219670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:22.226183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:22.227347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:22.550091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:22.550725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:22.562343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:22.563187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:22.564098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:22.565415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:22.566130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:22.566823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:22.684939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:22.701802 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-484a232c-f542-4185-8466-fcbf3842a2a5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.525751 Sep 13 16:55:22.702955 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2552/5193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:22 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:23.030869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:23.050394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:23.051027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:23.060162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:23.060673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:23.061127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:23.061888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:23.062368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:23.062811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:23.064536 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-09e031f3-b436-4ff7-b47e-de93c71f2ddd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.518460 Sep 13 16:55:23.065148 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2642/5194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:22 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:23.558710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:23.575273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-011b9d62-8ce9-4d80-8ab0-1f0b3650cef8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.530332 Sep 13 16:55:23.575959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2553/5195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:23 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:24.119955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:24.121562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:24.140804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:24.141636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:24.142286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:24.143194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:24.143823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:24.144424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:24.444410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:24.453452 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aca1205f-7010-4618-8ff3-c483b6cdbe5f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.338153 Sep 13 16:55:24.460082 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2643/5196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:24 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:24.612406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:24.613003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:24.635319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:24.636505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:24.637170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:24.640299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:24.641010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:24.641869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:25.485674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:25.486337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:25.500847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:25.510705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:25.511468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:25.512406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:25.513637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:25.516768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:25.867448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:25.878824 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02a9b9fb-4aee-40b3-b67d-5a4e08b4b4c7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 1.278232 Sep 13 16:55:25.879411 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2554/5197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:24 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:26.908636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:26.909341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:26.922484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:26.926339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:26.926918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:26.928934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:26.930099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:26.933195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:26.942200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:26.953310 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dede0be5-4c94-4d8f-8ccd-173cba9b1fbd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 1.471452 Sep 13 16:55:26.963928 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2644/5198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:25 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:26.997165 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 16:55:26.997421 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 16:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 (ip 10.222.0.61) !!! Sep 13 16:55:27.417191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:27.431943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73135281-5577-44dd-8955-d6808152a1c2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.527283 Sep 13 16:55:27.432598 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2555/5199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:26 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:27.976335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:27.976954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:28.024043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:28.026518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:28.027267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:28.028261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:28.028971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:28.030262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:28.395697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:28.410090 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0f7639a-79c3-449c-9237-e786ec2206e8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.437510 Sep 13 16:55:28.418466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2645/5200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:27 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:28.456221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:28.457940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:28.472272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:28.476801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:28.479576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:28.480705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:28.483426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:28.485437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:28.941946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:28.966331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-069ec239-bbc3-478f-ab72-1218aaec14df tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.514405 Sep 13 16:55:28.975015 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2556/5201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:28 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:29.440718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:29.443667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:29.481348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:29.482048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:29.482484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:29.483243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:29.483711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:29.484139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:29.497438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:29.812791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:29.840347 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6f644ba-a725-4d93-bff3-b529679c4b28 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.404250 Sep 13 16:55:29.851782 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2646/5202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:29 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:29.976277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:29.979608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:29.980378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:29.981059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:29.983953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:29.984828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:29.985686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:29.997272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:30.001640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:30.029086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:30.030238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:30.031465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:30.034273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:30.036603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:30.038452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:30.041652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-472bf28c-b520-4f5d-83f2-be79d7ac1f4f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.324455 Sep 13 16:55:30.049574 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2557/5203] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Sep 13 16:55:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:55:30.266945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:30.284672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82ba275a-bdc8-4ef6-afa5-5c76919462d3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.292523 Sep 13 16:55:30.285991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2647/5204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:29 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:30.385057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1015921763", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "availability_zone": "nova:n-h2-857467-1", "networks": [{"uuid": "311b0333-16e8-4f40-89d8-7feb767dde01"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:30.533886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] validate_networks() for [('311b0333-16e8-4f40-89d8-7feb767dde01', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:55:30.866325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:30.867083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:30.887740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:30.888221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:30.888650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:30.889372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:30.889873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:30.890299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:31.230585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:31.239545 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27509bb1-d0ec-414b-9f76-293452ba69cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.377670 Sep 13 16:55:31.242759 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2648/5205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:30 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:31.312218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:31.313685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:31.333086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:31.337789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:31.338578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:31.344428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:31.345227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:31.345930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:31.681570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:31.694206 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b3299e4-d9a0-4fa4-b389-4d0e604aa9a6 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.388644 Sep 13 16:55:31.695425 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2649/5206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:31 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:31.902526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:31.903124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:31.903516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:31.906297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:31.906932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:31.941238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:31.943191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:31.943673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:31.948156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:31.948673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:31.949126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:32.016207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Getting quotas for project f568b0a290084c2f8614d9f0bc47be21. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:32.030452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Getting quotas for user 0b1f2d9a9d0340fba7c5023a4798db5d and project f568b0a290084c2f8614d9f0bc47be21. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:32.116357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:55:32.120750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:55:32.266748 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03f166fc-b22d-48ff-a1d1-83df081fa478 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.886132 Sep 13 16:55:32.268095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:32.268729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:32.273697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2558/5207] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:55:32.287599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5b5cd60-1556-43e2-9d2d-d6063bf592a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:32.289115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:32.291164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5b5cd60-1556-43e2-9d2d-d6063bf592a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:32.293629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:32.294199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:32.295406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:32.295910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:32.296350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:32.471389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5b5cd60-1556-43e2-9d2d-d6063bf592a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1329 microversion: 2.1 time: 0.188089 Sep 13 16:55:32.472000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2559/5208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:32 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1329 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:32.722993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:32.723887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:32.736325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:32.736909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:32.750832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:32.762344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:32.765640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:32.769300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:32.772037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6f0a557-762a-4183-a018-30116efc438a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.497483 Sep 13 16:55:32.789946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:32.802118 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2650/5209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:32 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:33.204840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:33.234006 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c38ce4f6-2962-4065-8fbc-c47c6e1c6006 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.511395 Sep 13 16:55:33.234647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2560/5210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:32 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:33.506660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:33.513035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:33.540877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:33.542793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:33.543440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:33.544410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:33.545054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:33.547417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:33.805601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:33.806491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:33.825316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:33.827304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:33.827304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:33.828775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:33.840572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:33.841439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:33.850766 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96411104-51f4-48ba-bff0-b2c398532273 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1346 microversion: 2.1 time: 0.358282 Sep 13 16:55:33.854518 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2651/5211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:33 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1346 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:34.219215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:34.236537 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3116f5b-8e1c-41a7-804d-b5e48a54a372 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1528 microversion: 2.1 time: 0.435753 Sep 13 16:55:34.237143 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2561/5212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:33 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1528 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:34.257873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:34.258570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:34.268860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:34.269372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:34.270002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:34.270790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:34.271436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:34.271885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:34.707710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:34.719593 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33ef0cf6-e6d4-4b75-b762-4bae06b5244b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.466157 Sep 13 16:55:34.730543 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2652/5213] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:34 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:34.888332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:34.889243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:34.906278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:34.911659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:34.912886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:34.914347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:34.916061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:34.916939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:35.172881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:35.173689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:35.185116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:35.186143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:35.187129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:35.196222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:35.197471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:35.198340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:35.291171 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81fec77e-8178-4639-aeb8-41e53f55b163 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.121935 Sep 13 16:55:35.293351 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2653/5214] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:55:35 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/ips => generated 150 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:35.339219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:35.343097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:35.359458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:35.360324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:35.361024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:35.362118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:35.362758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:35.363406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:35.480634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e014531-a77c-4d0c-a072-2109c0c05bf1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1424 microversion: 2.1 time: 0.597486 Sep 13 16:55:35.491932 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2562/5215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:34 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1424 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:35.753861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:35.754627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:35.766297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:35.767891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:35.768355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:35.769188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:35.769679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:35.781908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:36.694565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:36.705759 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26917012-37cd-490d-9b03-cfbaf8b73cae tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1510 microversion: 2.1 time: 1.409558 Sep 13 16:55:36.719607 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2654/5216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:35 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1510 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:36.737031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:36.737977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:36.746579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:36.747384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:36.748019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:36.750108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:36.750767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:36.751397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:36.953500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:36.963950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e4c7701-faf3-4dc5-86e9-bc31b79062bf tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 1.213824 Sep 13 16:55:36.969147 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2563/5217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:35 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:37.167751 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f089c2f-d303-43bf-a37f-f5e11a50ecca tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.445503 Sep 13 16:55:37.183234 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2655/5218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:36 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:37.738530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:37.738530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:37.750803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:37.751327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:37.753606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:37.754629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:37.756844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:37.757546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:37.991361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:37.996662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:37.997301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:38.009601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eeb54cba-28d0-4fc7-aa8d-b2c6fd118a70 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1510 microversion: 2.1 time: 0.278095 Sep 13 16:55:38.017471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.018009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.018445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.019658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2564/5219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:37 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:38.022777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.023412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.037243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.200478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3153a80e-9750-485e-9370-dabb5e74ad36 req-52705528-3b72-42f9-8773-e9bd9d517d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7eedcc1-56b5-4258-9f98-c39305cd7e65", "name": "network-vif-unplugged", "status": "completed", "tag": "dfc168c0-711c-4893-9a35-c5d006a6b6bd"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:38.213394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3153a80e-9750-485e-9370-dabb5e74ad36 req-52705528-3b72-42f9-8773-e9bd9d517d2e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.214191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3153a80e-9750-485e-9370-dabb5e74ad36 req-52705528-3b72-42f9-8773-e9bd9d517d2e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.214738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3153a80e-9750-485e-9370-dabb5e74ad36 req-52705528-3b72-42f9-8773-e9bd9d517d2e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.241547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3153a80e-9750-485e-9370-dabb5e74ad36 req-52705528-3b72-42f9-8773-e9bd9d517d2e service nova] Creating event network-vif-unplugged:dfc168c0-711c-4893-9a35-c5d006a6b6bd for instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 on n-h1-857467-1 Sep 13 16:55:38.256021 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3153a80e-9750-485e-9370-dabb5e74ad36 req-52705528-3b72-42f9-8773-e9bd9d517d2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060200 Sep 13 16:55:38.258319 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2565/5220] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:38.269979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:38.271053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:38.281695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.288263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.288916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.290000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.291192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.291831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.504212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9435195b-a4e3-4a71-a00e-56b1afb2a15a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.244270 Sep 13 16:55:38.505602 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2566/5221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:38 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:38.512452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "469018a0-4bec-43c6-9542-3e498669eb91"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:38.515517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:38.539552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.540357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.541177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.542329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:38.543116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:38.544050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:38.832197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:38.865502 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f625e81f-ab61-42ff-a5e1-c5ec19dc951f tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.873596 Sep 13 16:55:38.873187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2656/5222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:37 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:39.044018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:39.045395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:39.058105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.058105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.058105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:39.071352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.073435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.074587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:39.277779 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a325ce6c-94bd-4e40-ba1e-973916962c8e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770172 Sep 13 16:55:39.282578 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2567/5223] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:55:38 2022] POST /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:39.304021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-0906555d-3a79-4cd6-8744-268b55e7f443 req-8d98a147-00e9-4b35-9ec1-e57f05d229f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c", "tag": "5e3d43fb-1209-4ba9-8b7c-99f1d36116fb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:39.331585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0906555d-3a79-4cd6-8744-268b55e7f443 req-8d98a147-00e9-4b35-9ec1-e57f05d229f1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.332549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0906555d-3a79-4cd6-8744-268b55e7f443 req-8d98a147-00e9-4b35-9ec1-e57f05d229f1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.333334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0906555d-3a79-4cd6-8744-268b55e7f443 req-8d98a147-00e9-4b35-9ec1-e57f05d229f1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:39.353585 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-0906555d-3a79-4cd6-8744-268b55e7f443 req-8d98a147-00e9-4b35-9ec1-e57f05d229f1 service nova] Creating event network-changed:5e3d43fb-1209-4ba9-8b7c-99f1d36116fb for instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c on n-h2-857467-1 Sep 13 16:55:39.361749 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-0906555d-3a79-4cd6-8744-268b55e7f443 req-8d98a147-00e9-4b35-9ec1-e57f05d229f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077252 Sep 13 16:55:39.363602 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2568/5224] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:39.534915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:39.535956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:39.537724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:39.549801 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b7c49a7-f0ff-4060-836a-3d92a142a56f tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1510 microversion: 2.1 time: 0.508628 Sep 13 16:55:39.552451 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2657/5225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:39 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:39.560753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.561640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.562870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:39.564472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.565593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.566437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:39.898493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:39.900898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:39.918549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.919412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.925155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:39.929817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:39.933959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:39.935826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:40.072200 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e64235c-d0e6-44da-b6e8-d03bc52a46d7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.542991 Sep 13 16:55:40.073554 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2569/5226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:39 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:40.200043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:40.215170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1d8a5c9-c7d8-4508-a733-3f50c74db1e7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.321024 Sep 13 16:55:40.216556 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2658/5227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:39 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:40.579968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:40.580603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:40.591111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:40.595094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:40.595870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:40.596843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:40.600762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:40.601487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:40.614881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:41.101365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:41.102478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:41.109870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:41.121357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-85cb8a17-a843-4842-b90d-5ca4706b7c51 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1453 microversion: 2.1 time: 0.542483 Sep 13 16:55:41.121630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.122180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.122641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.123532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2570/5228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:40 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1453 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:41.131056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.142598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.143363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.147302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:41.149900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:41.162949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.163458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.164018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.164750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.165865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.170107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.450019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27acdde1-dc12-40ce-bcf5-15ed5ac8a076 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.353306 Sep 13 16:55:41.452488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2659/5229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:41 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:41.486685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:41.486685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:41.532344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.533377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.534091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.537116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.540577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.541410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.575976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:41.594478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c57ab65-1640-4690-b14b-64bc2b6b3e9c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1453 microversion: 2.1 time: 0.451298 Sep 13 16:55:41.609075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2571/5230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:41 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1453 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:41.910692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:41.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1831854412", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "12c49317-997a-442b-b5c2-a8d4e6fa1393"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:41.926390 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9526629a-82c2-4697-942a-abf853f496b8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.454891 Sep 13 16:55:41.928378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2660/5231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:41 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:41.957817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:41.958645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:41.970854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.971606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.972657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.974243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:41.974998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:41.975648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:41.983294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:42.029012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] validate_networks() for [('12c49317-997a-442b-b5c2-a8d4e6fa1393', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:55:42.037902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'flavor' on Instance uuid d7eedcc1-56b5-4258-9f98-c39305cd7e65 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:55:42.060712 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'shelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state shelved_offloaded Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 14 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: {"shelve": {}} Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'shelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state shelved_offloaded Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'shelve': {}}} Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:55:42.062604 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state shelved_offloaded Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state shelved_offloaded Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:55:42.068184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'shelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state shelved_offloaded {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:55:42.072716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32ce0a14-ceaa-4700-82e9-c91b79604463 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 155 microversion: 2.1 time: 0.120836 Sep 13 16:55:42.073755 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2661/5232] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:55:41 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 155 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:55:42.083053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:42.084013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:42.093098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:42.094204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:42.095175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:42.096178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:42.096870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:42.097778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:42.172443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122328) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 16:55:42.218870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:42.289922 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7331fb6e-2787-403b-a563-5d7718e748bb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.211300 Sep 13 16:55:42.298206 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2662/5233] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:55:42 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:55:42.305067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:42.306482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:42.315815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:42.317403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:42.318529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:42.336146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:42.342678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:42.343518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:42.445781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:42.708629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:42.722940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d5940e27-8406-4f8a-a495-1b406c8a9e67 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1461 microversion: 2.1 time: 0.418282 Sep 13 16:55:42.723187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2663/5234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:42 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1461 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:42.738960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:42.738960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:42.781624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:42.782907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:42.783375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:42.784121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:42.787030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:42.787030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:43.439364 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b5b0942-9bf8-4b34-834a-2f0d8ddc81c4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.715062 Sep 13 16:55:43.440627 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2664/5235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:42 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:43.445671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:43.446403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:43.474420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:43.476275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:43.478720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:43.480530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:43.481808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:43.483306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:43.601888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:43.602283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:43.603436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:43.604108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:43.606236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:43.625418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:43.625987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:43.626447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:43.627210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:43.627865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:43.628495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:43.671735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Getting quotas for project 6c5468ee1375411db9511ff69640ed52. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:43.686411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Getting quotas for user e7e557c82fca42388e4406f56bbb433f and project 6c5468ee1375411db9511ff69640ed52. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:43.717014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:55:43.722642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:55:43.849546 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d1ceb86b-aaea-4397-9fb7-1b6eae4d7139 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.210380 Sep 13 16:55:43.850191 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2572/5236] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:55:43.859812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:43.865683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:43.877730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:43.892071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:43.892730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:43.898967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:43.899720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:43.900629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:44.215561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:44.231139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-408ffdf0-64b3-43ef-98af-2549373f49b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.789103 Sep 13 16:55:44.231662 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2665/5237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:43 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:44.257738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1826384277", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "12c49317-997a-442b-b5c2-a8d4e6fa1393"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:44.384892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] validate_networks() for [('12c49317-997a-442b-b5c2-a8d4e6fa1393', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:55:44.866033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:44.886140 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7de8e38d-5997-45ed-801a-74a4a7c28a76 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1461 microversion: 2.1 time: 1.022241 Sep 13 16:55:44.887291 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2573/5238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:43 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1461 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:44.902531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:44.903188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:44.924524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:44.926616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:44.927116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:44.934885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:44.938962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:44.942632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:44.943335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:45.193476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2394cd29-83df-451a-a36a-a014677927b7 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.304524 Sep 13 16:55:45.194464 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2574/5239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:44 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:45.259963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:45.262397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:45.277763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:45.278308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:45.280101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:45.280272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:45.282804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:45.284944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:45.624880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:45.638360 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21f15b54-8b42-41e6-93b2-31499e887079 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1515 microversion: 2.1 time: 0.383570 Sep 13 16:55:45.639704 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2575/5240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:45 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:45.919753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:45.921714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:45.931532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:45.932065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:45.933588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:45.934491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:45.934973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:45.935390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:46.293560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:46.304775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-643fd279-65f2-4bab-85eb-1dd3a0ad1f82 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1461 microversion: 2.1 time: 0.395398 Sep 13 16:55:46.313939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:46.314451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:46.314830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:46.315243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:46.315658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:46.332532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2576/5241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:45 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1461 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:46.358696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:46.359344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:46.361228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:46.362703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:46.363155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:46.363903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:46.370391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:46.370899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:46.397639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:46.398182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:46.404356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:46.409779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:46.410828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:46.411905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:46.471441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Getting quotas for project 6c5468ee1375411db9511ff69640ed52. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:46.497733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Getting quotas for user e7e557c82fca42388e4406f56bbb433f and project 6c5468ee1375411db9511ff69640ed52. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:46.551103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:55:46.577947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:55:46.752758 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33bdf7e9-06d2-4ef7-b45d-104373c800ba tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.518635 Sep 13 16:55:46.766444 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2666/5242] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:55:46.776352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:46.776980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:46.814860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1f27787-971d-4de2-91b0-9d7ca1e7882f tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.481060 Sep 13 16:55:46.821294 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2577/5243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:46 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:46.826044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:46.829206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:46.829988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:46.831318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:46.831994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:46.834052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:47.052947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-728219084", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "451", "networks": [{"uuid": "12c49317-997a-442b-b5c2-a8d4e6fa1393"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:47.193279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] validate_networks() for [('12c49317-997a-442b-b5c2-a8d4e6fa1393', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:55:47.647091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:47.663751 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ffaeeb88-3e82-43cf-88f6-1dd2b64e5633 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1533 microversion: 2.1 time: 0.896094 Sep 13 16:55:47.678108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2667/5244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:46 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1533 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:47.678108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:47.685642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:47.705618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:47.706278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:47.706813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:47.709417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:47.710033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:47.711057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:48.346927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:48.348463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:48.348953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:48.350048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:48.350490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:48.377803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:48.378338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:48.378900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:48.379653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:48.380124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:48.380562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:48.428221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Getting quotas for project 6c5468ee1375411db9511ff69640ed52. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:48.439766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Getting quotas for user e7e557c82fca42388e4406f56bbb433f and project 6c5468ee1375411db9511ff69640ed52. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:48.473887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:55:48.476460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:55:48.548826 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df76b63a-9be3-4d9b-a2ef-e81b7b857c53 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501240 Sep 13 16:55:48.555288 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2578/5245] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:55:48.567044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:48.567917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:48.579664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:48.580382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:48.581142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:48.582597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:48.584057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:48.584687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:49.219718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-53bb6620-e1b6-4771-96da-73a0978ef13e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.662434 Sep 13 16:55:49.230739 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2579/5246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:48 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:49.230739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fae3b7ee-a39a-4e8f-9d0b-73e05b3f9ba3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:49.230739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fae3b7ee-a39a-4e8f-9d0b-73e05b3f9ba3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:49.363047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fae3b7ee-a39a-4e8f-9d0b-73e05b3f9ba3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:49.376408 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fae3b7ee-a39a-4e8f-9d0b-73e05b3f9ba3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1220 microversion: 2.1 time: 0.153354 Sep 13 16:55:49.377730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2580/5247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:49 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:49.382690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:49.383387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:49.408739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:49.409246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:49.409688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:49.416961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:49.417527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:49.418024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:49.567559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:49.577402 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6a0e208-f214-4d32-b6c3-e0f3d4070979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 1.905891 Sep 13 16:55:49.578448 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2668/5248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:47 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:49.583812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-13796a72-e403-4701-be9d-353fa31390f2 req-c99f2007-ceec-480b-8761-fe0a3da98386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c", "name": "network-vif-plugged", "status": "completed", "tag": "5e3d43fb-1209-4ba9-8b7c-99f1d36116fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:49.594472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:49.596665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-13796a72-e403-4701-be9d-353fa31390f2 req-c99f2007-ceec-480b-8761-fe0a3da98386 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:49.597439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-13796a72-e403-4701-be9d-353fa31390f2 req-c99f2007-ceec-480b-8761-fe0a3da98386 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:49.598207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-13796a72-e403-4701-be9d-353fa31390f2 req-c99f2007-ceec-480b-8761-fe0a3da98386 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:49.618425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-13796a72-e403-4701-be9d-353fa31390f2 req-c99f2007-ceec-480b-8761-fe0a3da98386 service nova] Creating event network-vif-plugged:5e3d43fb-1209-4ba9-8b7c-99f1d36116fb for instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c on n-h2-857467-1 Sep 13 16:55:49.627588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-13796a72-e403-4701-be9d-353fa31390f2 req-c99f2007-ceec-480b-8761-fe0a3da98386 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047442 Sep 13 16:55:49.628888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2669/5249] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:49.990991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:50.011859 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3743e474-0161-4007-9d1c-d52401c682ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1521 microversion: 2.1 time: 0.632883 Sep 13 16:55:50.015859 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2581/5250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:49 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:50.248255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:50.248966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:50.255242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:50.256760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:50.257729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:50.259379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:50.260021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:50.260532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:50.408129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:50.408948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:50.418032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:50.418812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:50.419374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:50.420204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:50.420733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:50.421405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:50.562873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:50.585765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47dd950f-5092-49d6-9266-ae51edef8d8d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1272 microversion: 2.1 time: 0.183965 Sep 13 16:55:50.588592 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2582/5251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:50 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:50.609530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:50.610172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:50.617086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:50.617617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:50.618799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:50.619721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:50.620198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:50.620633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:50.685767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dacf91cb-df16-4bd5-b3d3-76edc8d0d921 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.443385 Sep 13 16:55:50.697280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2670/5252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:50 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:50.792086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53ca8baf-5cf8-4946-af97-a45f7d69fba4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: .version_select at 0x7fbeb96f01f0>, body: {"keypair": {"name": "tempest-keypair-1775297187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTYeJinVAKP+wF4B+NsMt9R0tmTYhbLFfHyzYw+uhBXDMU8niZsNSc3LoaPC9PU40qzJ2CoN6IxeIEUM7/klYg1tHMBUQxUENGVof3y4mTIVCVfMoyijq+CxnVs0ymGAw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:50.837968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-53ca8baf-5cf8-4946-af97-a45f7d69fba4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:50.841502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:50.845735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-53ca8baf-5cf8-4946-af97-a45f7d69fba4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:50.853241 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f8481a73-f7de-41ca-af7b-6ee04d565646 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.247416 Sep 13 16:55:50.866669 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2583/5253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:50 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:50.898170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53ca8baf-5cf8-4946-af97-a45f7d69fba4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111273 Sep 13 16:55:50.907344 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2671/5254] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:55:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:55:51.039350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:51.040886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:51.049259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.051551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:51.052031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:51.052769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.053240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:51.053675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:51.614770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:51.615428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:51.629915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.630669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:51.633316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:51.634547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.635885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:51.637679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:51.898812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:51.901803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:51.919936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bdfd4ed4-9d42-4f97-9c69-6c49fcd716da tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1521 microversion: 2.1 time: 0.884846 Sep 13 16:55:51.920719 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e030fd8-08dc-409f-8d87-c2b261ff0fbf tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1290 microversion: 2.1 time: 0.308852 Sep 13 16:55:51.922273 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2672/5255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:51 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1290 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:51.924669 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2584/5256] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:51 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1521 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:51.929796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:51.939102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:51.956638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f6268b99-0866-4692-841a-cdbc6bde1e49 req-95eb1067-545e-439b-9e30-cc678c46a604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771f19c-7855-47e1-a507-b620155e6174", "name": "network-vif-unplugged", "status": "completed", "tag": "4691661c-1e17-4836-bd21-65c434a2d923"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:51.958455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.959268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:51.959486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:51.960154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.960627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:51.961081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:51.999011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6268b99-0866-4692-841a-cdbc6bde1e49 req-95eb1067-545e-439b-9e30-cc678c46a604 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:51.999497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6268b99-0866-4692-841a-cdbc6bde1e49 req-95eb1067-545e-439b-9e30-cc678c46a604 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.004722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6268b99-0866-4692-841a-cdbc6bde1e49 req-95eb1067-545e-439b-9e30-cc678c46a604 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:52.047869 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f6268b99-0866-4692-841a-cdbc6bde1e49 req-95eb1067-545e-439b-9e30-cc678c46a604 service nova] Creating event network-vif-unplugged:4691661c-1e17-4836-bd21-65c434a2d923 for instance 8771f19c-7855-47e1-a507-b620155e6174 on n-h2-857467-1 Sep 13 16:55:52.079683 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f6268b99-0866-4692-841a-cdbc6bde1e49 req-95eb1067-545e-439b-9e30-cc678c46a604 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154515 Sep 13 16:55:52.081876 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2673/5257] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:52.100735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:52.102703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:52.134606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:52.135600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.136661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:52.138978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:52.141222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.144337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:52.591320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-44abb43b-4c9c-47e4-b035-2cad7c95c0f0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1464 microversion: 2.1 time: 0.665135 Sep 13 16:55:52.604378 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2585/5258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:51 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1464 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:52.746251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:52.759320 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc93ca09-5119-4afa-881c-5ffd95b6f795 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.669670 Sep 13 16:55:52.778531 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2674/5259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:52 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:52.945041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:52.946461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:52.954345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:52.955682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:52.962109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:52.962628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.963131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:52.963851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:52.970711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:52.970981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.974026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.974609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:52.975117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:52.976218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:52.980396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:52.981155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:53.247898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:53.284671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d133b717-8d81-4cbe-a8d7-ec3707902c0a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1278 microversion: 2.1 time: 0.328616 Sep 13 16:55:53.286984 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2586/5260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:52 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1278 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:53.314149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:53.333581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00e2d0ac-3f2c-4189-b70e-25b2ca6698a2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1521 microversion: 2.1 time: 0.380899 Sep 13 16:55:53.335374 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2675/5261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:52 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:53.338968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-35a08826-b8bf-4133-a78c-27716322de8a req-fc1c3675-d9b5-46f1-ac3b-ade59fbc3932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37098b61-3180-4011-b6e0-b705b7ac00d7", "tag": "0d407450-392f-4caa-9bad-41c34aa655d9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:53.374279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-35a08826-b8bf-4133-a78c-27716322de8a req-fc1c3675-d9b5-46f1-ac3b-ade59fbc3932 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:53.375018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-35a08826-b8bf-4133-a78c-27716322de8a req-fc1c3675-d9b5-46f1-ac3b-ade59fbc3932 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:53.378087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-35a08826-b8bf-4133-a78c-27716322de8a req-fc1c3675-d9b5-46f1-ac3b-ade59fbc3932 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:53.439314 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-35a08826-b8bf-4133-a78c-27716322de8a req-fc1c3675-d9b5-46f1-ac3b-ade59fbc3932 service nova] Creating event network-changed:0d407450-392f-4caa-9bad-41c34aa655d9 for instance 37098b61-3180-4011-b6e0-b705b7ac00d7 on n-h1-857467-1 Sep 13 16:55:53.468447 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-35a08826-b8bf-4133-a78c-27716322de8a req-fc1c3675-d9b5-46f1-ac3b-ade59fbc3932 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134158 Sep 13 16:55:53.472962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2587/5262] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:53.527858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f9b7aa93-4015-4926-81d5-c175771012a2 req-f731ef8a-c622-47f7-ab32-da490096e8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6928ce8-dbfc-445f-835a-1628c71e2999", "tag": "9d5da709-eaa9-487e-b89d-0dc5c954b6b0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:53.565983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9b7aa93-4015-4926-81d5-c175771012a2 req-f731ef8a-c622-47f7-ab32-da490096e8e6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:53.567061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9b7aa93-4015-4926-81d5-c175771012a2 req-f731ef8a-c622-47f7-ab32-da490096e8e6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:53.567695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9b7aa93-4015-4926-81d5-c175771012a2 req-f731ef8a-c622-47f7-ab32-da490096e8e6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:53.588458 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f9b7aa93-4015-4926-81d5-c175771012a2 req-f731ef8a-c622-47f7-ab32-da490096e8e6 service nova] Creating event network-changed:9d5da709-eaa9-487e-b89d-0dc5c954b6b0 for instance a6928ce8-dbfc-445f-835a-1628c71e2999 on n-h1-857467-1 Sep 13 16:55:53.595484 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f9b7aa93-4015-4926-81d5-c175771012a2 req-f731ef8a-c622-47f7-ab32-da490096e8e6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074668 Sep 13 16:55:53.596868 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2676/5263] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:53.632647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:53.636238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:53.671886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:53.676497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:53.677401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:53.684167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:53.687712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:53.690338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:53.794518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:53.795583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:53.854323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:53.858818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:53.862414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:53.864296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:53.870401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:53.871955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:54.202406 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c254b18-b6dc-43f7-85f6-2e1385b703a5 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1648 microversion: 2.1 time: 0.578204 Sep 13 16:55:54.205960 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2588/5264] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:53 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1648 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:54.235613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:54.236375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:54.257665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:54.258646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:54.260137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:54.261687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:54.263631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:54.264198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:54.547752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:54.573379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23fb5867-2b0a-4491-a6f4-3b96c195e3b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.782010 Sep 13 16:55:54.578165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2677/5265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:53 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:54.599348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:54.603223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:54.623963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:54.625903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:54.627422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:54.631589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:54.635718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:54.637128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.187770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:55.211042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dedf42a4-4117-4d0c-adc6-9d56c035f9f1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1648 microversion: 2.1 time: 0.975953 Sep 13 16:55:55.217340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2589/5266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:54 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1648 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:55:55.245372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:55.247129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:55.270201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.271501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.276803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.279051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.280999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.281550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.700258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:55.713328 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-847ef5ee-9753-4556-94aa-c161f52d0be7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1521 microversion: 2.1 time: 0.494699 Sep 13 16:55:55.714559 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2590/5267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:55 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:55.728729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8bfb64e7-a61c-49ba-9783-0960252130f7 req-b9ffb6b3-f94e-460b-a810-b3ee83e32dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771f19c-7855-47e1-a507-b620155e6174", "name": "network-vif-plugged", "status": "completed", "tag": "4691661c-1e17-4836-bd21-65c434a2d923"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:55.749761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8bfb64e7-a61c-49ba-9783-0960252130f7 req-b9ffb6b3-f94e-460b-a810-b3ee83e32dd7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.752370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8bfb64e7-a61c-49ba-9783-0960252130f7 req-b9ffb6b3-f94e-460b-a810-b3ee83e32dd7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.753735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8bfb64e7-a61c-49ba-9783-0960252130f7 req-b9ffb6b3-f94e-460b-a810-b3ee83e32dd7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.788147 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8bfb64e7-a61c-49ba-9783-0960252130f7 req-b9ffb6b3-f94e-460b-a810-b3ee83e32dd7 service nova] Creating event network-vif-plugged:4691661c-1e17-4836-bd21-65c434a2d923 for instance 8771f19c-7855-47e1-a507-b620155e6174 on n-h2-857467-1 Sep 13 16:55:55.798642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8bfb64e7-a61c-49ba-9783-0960252130f7 req-b9ffb6b3-f94e-460b-a810-b3ee83e32dd7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082475 Sep 13 16:55:55.799809 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2591/5268] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:55.811914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:55.815076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:55.829127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.830806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.831496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.833560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.841076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.841950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.887809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:55.904032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-730a098a-a1a1-4bec-a3b1-eac3aa3ade74 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 1.322436 Sep 13 16:55:55.907306 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2678/5269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:54 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:55.913577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:55.914244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:55.934267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.935735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.935927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:55.937039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:55.937737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:55.938419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:56.249656 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55ab2552-54da-4592-a5b2-16cd24e6fe78 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1648 microversion: 2.1 time: 0.448276 Sep 13 16:55:56.251056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2592/5270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:55 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1648 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:56.290905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:56.316083 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d2d1023-5c48-4b1e-a098-e5136880cdb3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.405868 Sep 13 16:55:56.318551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2679/5271] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:55 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:56.427986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1558197836", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "availability_zone": "nova:n-h1-857467-1", "networks": [{"uuid": "311b0333-16e8-4f40-89d8-7feb767dde01"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:56.522676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] validate_networks() for [('311b0333-16e8-4f40-89d8-7feb767dde01', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:55:56.739353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:56.740113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:56.743336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:56.750193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:56.751068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:56.751780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:56.752836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:56.753567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:56.754405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:56.916500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:56.929688 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ee3075d-42af-412b-a6e5-c813675c07b3 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1521 microversion: 2.1 time: 0.194408 Sep 13 16:55:56.931228 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2680/5272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:56 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:56.940293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1231993386", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a782e2f4-354d-45ea-a878-8641bbe8c757"}], "security_groups": [{"name": "tempest-securitygroup--1866320501"}], "key_name": "tempest-keypair-1775297187", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:57.078121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] validate_networks() for [('a782e2f4-354d-45ea-a878-8641bbe8c757', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:55:57.635559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:57.636073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:57.636630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:57.637275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:57.638240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:57.672833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:57.674038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:57.675883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:57.676824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:57.678406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:57.685066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:57.745906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Getting quotas for project f568b0a290084c2f8614d9f0bc47be21. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:57.757485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Getting quotas for user 0b1f2d9a9d0340fba7c5023a4798db5d and project f568b0a290084c2f8614d9f0bc47be21. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:57.783365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:55:57.793230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:55:57.878055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:55:57.878569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:55:57.879268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:55:57.880106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:55:57.880814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:55:57.909905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:57.916710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:57.923396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:57.924534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:57.927394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:57.933540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb32815c-38f5-4054-b170-604fa91158a9 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510203 Sep 13 16:55:57.939992 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2593/5273] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:55:57.951960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:57.954251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:57.956707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:57.970440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:57.971090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:57.971759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:57.974062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:57.974808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:57.997004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:55:57.997469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:58.005450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:55:58.025809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:55:58.028989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:55:58.114738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-041232e7-9968-43ed-a833-9f93fe526af1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.181534 Sep 13 16:55:58.115848 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2681/5274] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:55:58.121851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:58.123044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:58.141219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:58.142401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:58.143561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:58.144748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:58.145506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:58.146411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:58.807850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:58.827968 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e198e839-2ffd-4801-b646-aae9349eb7ce tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.710521 Sep 13 16:55:58.847735 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2682/5275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:58 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:58.870758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-88f3cd9c-ffd8-428f-af9d-1e1e7cb28fdf req-193159f6-8b7e-4898-8524-65e4db4d74c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef17809-c5b4-4cb7-82b5-04f4230c898a", "tag": "fbfba143-5496-4524-8a26-650d71a2fa86"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:55:58.897237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-88f3cd9c-ffd8-428f-af9d-1e1e7cb28fdf req-193159f6-8b7e-4898-8524-65e4db4d74c8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:58.900720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-88f3cd9c-ffd8-428f-af9d-1e1e7cb28fdf req-193159f6-8b7e-4898-8524-65e4db4d74c8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:58.903001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-88f3cd9c-ffd8-428f-af9d-1e1e7cb28fdf req-193159f6-8b7e-4898-8524-65e4db4d74c8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:58.909185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:55:58.929444 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-88f3cd9c-ffd8-428f-af9d-1e1e7cb28fdf req-193159f6-8b7e-4898-8524-65e4db4d74c8 service nova] Creating event network-changed:fbfba143-5496-4524-8a26-650d71a2fa86 for instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a on n-h2-857467-1 Sep 13 16:55:58.945012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-88f3cd9c-ffd8-428f-af9d-1e1e7cb28fdf req-193159f6-8b7e-4898-8524-65e4db4d74c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095907 Sep 13 16:55:58.948681 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2683/5276] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:55:58.957532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a514bd0d-6c6d-4664-b5ff-5b22f453cfe8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:58.963035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a514bd0d-6c6d-4664-b5ff-5b22f453cfe8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:59.141616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a514bd0d-6c6d-4664-b5ff-5b22f453cfe8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1329 microversion: 2.1 time: 0.189127 Sep 13 16:55:59.143739 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2684/5277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:58 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1329 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:59.164388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:59.175726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:59.187082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.187672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.188759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.190002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.190744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.191060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:59.192892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.208812 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9078391-6a67-4d01-849a-868f78da6fd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 1.267148 Sep 13 16:55:59.235394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2594/5278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:57 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:59.247634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3de6f2f4-94b5-408b-8d1f-de93031701f4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:59.248592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3de6f2f4-94b5-408b-8d1f-de93031701f4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:59.323386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3de6f2f4-94b5-408b-8d1f-de93031701f4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:59.335439 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3de6f2f4-94b5-408b-8d1f-de93031701f4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1242 microversion: 2.1 time: 0.097982 Sep 13 16:55:59.336052 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2595/5279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:59 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:59.441218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:59.452949 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c856a62-7c69-458b-bca4-59672a63f0aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1506 microversion: 2.1 time: 0.305685 Sep 13 16:55:59.453584 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2685/5280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:59 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:59.477339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:59.478779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:59.487965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.488729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.489548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.490484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.491152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.491624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.646904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:55:59.656483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-687e5b73-a5bb-4365-9f8f-5cee31f47e97 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 200 len: 1506 microversion: 2.1 time: 0.183101 Sep 13 16:55:59.657180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2596/5281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:59 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:55:59.678955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:59.679569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:59.685929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.686529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.687046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.687823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.688599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.689041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.715655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:55:59.793393 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b4ed459-cff9-4e2e-bf71-c6158907a7aa tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 204 len: 0 microversion: 2.1 time: 0.118155 Sep 13 16:55:59.794034 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2686/5282] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:55:59 2022] DELETE /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:55:59.855771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:55:59.856442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:55:59.872988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.873490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.874180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.875104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:55:59.875748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:55:59.876359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:55:59.959133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-580971470", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "1324e2ca-97db-407f-b483-50c76d8852ff"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:00.023446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] validate_networks() for [('1324e2ca-97db-407f-b483-50c76d8852ff', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:56:00.155750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:00.172884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19d900c4-fd43-4927-9e4d-a8c098542f5b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.321142 Sep 13 16:56:00.174807 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2597/5283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:55:59 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:00.183877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:00.185488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:00.210844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.213184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.213994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.214923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.215697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.216431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.390878 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f1740c7b-fa99-462e-b735-1f42f2d8968a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1346 microversion: 2.1 time: 0.198541 Sep 13 16:56:00.391663 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2598/5284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:00 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1346 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:00.396951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:00.397558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:00.405109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.405611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.406340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.407694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.408169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.408791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.707372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:56:00.707801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:56:00.708689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:56:00.709123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:56:00.709544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:56:00.712755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:00.721972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.722944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.723406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.724163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.724378 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d37eea4-46ed-45df-886e-a64b618d6516 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 0.331614 Sep 13 16:56:00.724628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.724985 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2599/5285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:00 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:00.727217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.743051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:00.744389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:00.755405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.759687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.760418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.762831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Getting quotas for project adb0938b4c884dc0a1467383e16fbf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:56:00.763262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:00.763913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:00.764544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:00.776556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Getting quotas for user 24f2e3c66387486c9b8dc9d7dffefe71 and project adb0938b4c884dc0a1467383e16fbf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:56:00.797775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:56:00.801408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:56:00.857105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:00.872333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76bfa6de-65b9-4cfd-8c78-86345de5e135 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913751 Sep 13 16:56:00.876510 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3cb1e94b-a292-4aae-95d8-5f393d5db33b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1246 microversion: 2.1 time: 0.139710 Sep 13 16:56:00.877137 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2600/5286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:00 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1246 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:00.885957 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2687/5287] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:56:00.901332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-befdb89f-a4b6-4d48-9228-fa67dc64dc1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:00.904641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-befdb89f-a4b6-4d48-9228-fa67dc64dc1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:00.997980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-befdb89f-a4b6-4d48-9228-fa67dc64dc1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:01.005508 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-befdb89f-a4b6-4d48-9228-fa67dc64dc1e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1217 microversion: 2.1 time: 0.112458 Sep 13 16:56:01.017948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2601/5288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:00 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:01.219201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:01.220411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:01.229794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.230675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.231969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.233237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.234012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.235239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.418427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:01.420781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:01.434686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.437700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.438234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.452880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.454743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.455618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.588675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:01.611643 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-29496e7d-9df0-41dd-bf4a-bdfd8af85216 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.397714 Sep 13 16:56:01.616012 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2688/5289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:01 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:01.705963 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c7e549e-ca59-4741-a0f4-69d9c7b926d1 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1346 microversion: 2.1 time: 0.293852 Sep 13 16:56:01.710406 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2602/5290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:01 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:01.752336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:01.753578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:01.765738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.766520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.770120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.771458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.772494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.772947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.902393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:01.903449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:01.928331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.929144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.929759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:01.930734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:01.931544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:01.932305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:02.409696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:02.440596 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e745b832-77dd-44a1-a498-b27f9faa9085 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 0.694106 Sep 13 16:56:02.461018 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2689/5291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:01 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:02.473467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:02.486642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:02.488182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-30a9dc07-52db-4759-b383-08be3c4edc84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1246 microversion: 2.1 time: 0.584799 Sep 13 16:56:02.489129 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2603/5292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:01 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1246 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:02.495214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:02.520267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:02.521175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:02.526706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:02.528988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:02.530268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:02.531883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:02.640853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:02.641489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:02.663239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:02.665534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:02.667071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:02.669568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:02.670421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:02.671403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:02.904143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:02.917781 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-486da32d-9db0-4c86-a50d-d1df4e3499dc tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1213 microversion: 2.1 time: 0.449708 Sep 13 16:56:02.918427 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2690/5293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:02 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1213 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:02.940714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:02.941536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:02.970539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:02.971061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:02.971557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:02.972302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:02.978825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:02.984163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:03.390420 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-665db42a-761e-4bf4-b734-6628eaf83f36 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1416 microversion: 2.1 time: 0.468030 Sep 13 16:56:03.391110 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2691/5294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:02 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1416 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:03.471949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:03.472635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:03.489913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:03.490954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:03.493753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:03.497204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:03.497722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:03.503000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:03.868769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:03.881207 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c38f8417-77f0-4022-864c-64229fe0e532 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 1.244570 Sep 13 16:56:03.884256 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2604/5295] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:02 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:03.895476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:03.898077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:03.915912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:03.918093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:03.922201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:03.925213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:03.926031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:03.928845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.091499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:04.103564 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b1081b3-1722-46e5-880c-05c151ad9c85 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 0.635395 Sep 13 16:56:04.106673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2692/5296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:03 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:04.115516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-da51e525-a7ff-40a8-bf91-232844def33e req-42f9be8a-bdec-4306-a276-30c62e020549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37098b61-3180-4011-b6e0-b705b7ac00d7", "name": "network-vif-plugged", "status": "completed", "tag": "0d407450-392f-4caa-9bad-41c34aa655d9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:04.141693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-da51e525-a7ff-40a8-bf91-232844def33e req-42f9be8a-bdec-4306-a276-30c62e020549 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.159677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-da51e525-a7ff-40a8-bf91-232844def33e req-42f9be8a-bdec-4306-a276-30c62e020549 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.160466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-da51e525-a7ff-40a8-bf91-232844def33e req-42f9be8a-bdec-4306-a276-30c62e020549 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.198308 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-da51e525-a7ff-40a8-bf91-232844def33e req-42f9be8a-bdec-4306-a276-30c62e020549 service nova] Creating event network-vif-plugged:0d407450-392f-4caa-9bad-41c34aa655d9 for instance 37098b61-3180-4011-b6e0-b705b7ac00d7 on n-h1-857467-1 Sep 13 16:56:04.224957 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-da51e525-a7ff-40a8-bf91-232844def33e req-42f9be8a-bdec-4306-a276-30c62e020549 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116973 Sep 13 16:56:04.232006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2693/5297] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:04.249041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:04.258848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:04.286476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.287290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.292483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.293266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.294104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.294823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.308273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:04.324423 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49e2cc5f-dcb2-471c-b1a2-76f5e55fb38d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1238 microversion: 2.1 time: 0.438524 Sep 13 16:56:04.326592 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2605/5298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:03 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1238 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:04.421791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:04.423047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:04.425791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:04.458716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.459833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.464670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.465645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.469652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.470992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.583711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:04.600340 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9a34c90d-e3dc-4f33-9c76-74f12253d9b4 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1213 microversion: 2.1 time: 0.366634 Sep 13 16:56:04.600962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2694/5299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:04 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1213 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:04.904829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:04.906137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:04.910036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:04.925925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.926394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.926844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:04.927584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:04.928055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:04.939102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:05.256166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65ca2410-b1f2-454a-953a-8f6bc4081042 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1422 microversion: 2.1 time: 0.837911 Sep 13 16:56:05.257802 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2606/5300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:04 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1422 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:05.285812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:05.286655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:05.327423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:05.331501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:05.333371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:05.338874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:05.344123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:05.344917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:06.079715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:06.096025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12873416-5a7a-4a39-866d-e74fc56529cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 1.195288 Sep 13 16:56:06.097256 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2695/5301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:04 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:06.114402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:06.115709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:06.142926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:06.145752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:06.146258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:06.147355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:06.152479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:06.152959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:06.430092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:06.448089 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9dd8492a-4da0-49fe-a42f-806e64e790b7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1300 microversion: 2.1 time: 0.342923 Sep 13 16:56:06.464854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2696/5302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:06 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1300 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:06.470388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:06.471301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:06.479545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:06.480325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:06.480967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:06.482137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:06.482803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:06.483568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:06.640942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:06.666230 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0184ea7e-4423-4284-80b3-688d2508d7ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1269 microversion: 2.1 time: 0.199623 Sep 13 16:56:06.678447 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2697/5303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:06 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:06.687428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:06.688078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:06.708757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:06.709281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:06.709735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:06.710503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:06.710977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:06.711986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.360052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2588d00b-d497-4b47-b66a-776544986d33 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.684438 Sep 13 16:56:07.362516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2698/5304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:06 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:07.621733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a65b64ea-ea2f-42ce-a987-175f87cfe374 req-24af96df-b14c-49de-a160-4ddc4e5e9796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771f19c-7855-47e1-a507-b620155e6174", "name": "network-vif-deleted", "tag": "4691661c-1e17-4836-bd21-65c434a2d923"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:07.631807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:07.637657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a65b64ea-ea2f-42ce-a987-175f87cfe374 req-24af96df-b14c-49de-a160-4ddc4e5e9796 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.637657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a65b64ea-ea2f-42ce-a987-175f87cfe374 req-24af96df-b14c-49de-a160-4ddc4e5e9796 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.637657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a65b64ea-ea2f-42ce-a987-175f87cfe374 req-24af96df-b14c-49de-a160-4ddc4e5e9796 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.642860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e2b255d-626c-4719-b9bd-1e8ef74b48f2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 2.380163 Sep 13 16:56:07.649599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a65b64ea-ea2f-42ce-a987-175f87cfe374 req-24af96df-b14c-49de-a160-4ddc4e5e9796 service nova] Creating event network-vif-deleted:4691661c-1e17-4836-bd21-65c434a2d923 for instance 8771f19c-7855-47e1-a507-b620155e6174 on n-h2-857467-1 Sep 13 16:56:07.669410 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a65b64ea-ea2f-42ce-a987-175f87cfe374 req-24af96df-b14c-49de-a160-4ddc4e5e9796 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302575 Sep 13 16:56:07.671286 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2699/5306] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:07.671535 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2607/5306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:05 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:07.682746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:07.683525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:07.687024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:07.689038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:07.691966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.692484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.692925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.693909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.701220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.702177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.703120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.704715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.705168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.705724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.714717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.717223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.735075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:07.794639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:07.810807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fffc1ed0-1452-4fcd-b055-745f9e20b83d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1300 microversion: 2.1 time: 0.137246 Sep 13 16:56:07.818063 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2608/5307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:07 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:07.826565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:07.827471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:07.835977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.837684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.838573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:07.839613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:07.840257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:07.840890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.032909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:08.040846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:08.060601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-684d5297-6c21-4307-87ff-9bad93f94e03 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1269 microversion: 2.1 time: 0.239951 Sep 13 16:56:08.064930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2609/5308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:07 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1269 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:08.074311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:08.075660 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2fe6d91-f02e-4610-b089-783c6bc6b5e0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.403143 Sep 13 16:56:08.081341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-431c29a5-2664-4174-ab7c-826bbf701c09 req-0411538c-fbb3-4bb5-87a7-13112a933c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6928ce8-dbfc-445f-835a-1628c71e2999", "name": "network-vif-plugged", "status": "completed", "tag": "9d5da709-eaa9-487e-b89d-0dc5c954b6b0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:08.094383 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2700/5309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:07 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:08.145611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-431c29a5-2664-4174-ab7c-826bbf701c09 req-0411538c-fbb3-4bb5-87a7-13112a933c36 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.151805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-431c29a5-2664-4174-ab7c-826bbf701c09 req-0411538c-fbb3-4bb5-87a7-13112a933c36 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.152560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-431c29a5-2664-4174-ab7c-826bbf701c09 req-0411538c-fbb3-4bb5-87a7-13112a933c36 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.189626 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-431c29a5-2664-4174-ab7c-826bbf701c09 req-0411538c-fbb3-4bb5-87a7-13112a933c36 service nova] Creating event network-vif-plugged:9d5da709-eaa9-487e-b89d-0dc5c954b6b0 for instance a6928ce8-dbfc-445f-835a-1628c71e2999 on n-h1-857467-1 Sep 13 16:56:08.197159 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-431c29a5-2664-4174-ab7c-826bbf701c09 req-0411538c-fbb3-4bb5-87a7-13112a933c36 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130782 Sep 13 16:56:08.197788 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2610/5310] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:08.386242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:08.386990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:08.401990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.405695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.407850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.410572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.411080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.411532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.669656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:08.671097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:08.684238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.686545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.692096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.693383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.694540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.696192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.708034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:08.718394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-902caf5c-993d-4821-9968-710ed66f5d6d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.337305 Sep 13 16:56:08.719680 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2701/5311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:08 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:08.838599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:08.839287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:08.866736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.867276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.868385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.877623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:08.878493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:08.879145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:08.951618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:08.961892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4e49ef1-99fc-443d-9a6c-fdd6700a12d1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 0.296541 Sep 13 16:56:08.963766 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2611/5312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:08 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:09.090175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:09.090919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:09.129895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:09.132349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:09.134375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:09.151514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:09.152284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:09.152705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:09.359510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:09.378243 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-817d783b-4d30-4294-be52-a3c3c21fc3ab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1269 microversion: 2.1 time: 0.293165 Sep 13 16:56:09.383928 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2612/5313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:09 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1269 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:09.395587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:09.401361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:09.419324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:09.421377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:09.423571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:09.426287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:09.427083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:09.430392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:09.503631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:09.519514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73b5c59c-e85b-47a1-9cdd-c9364b27cc74 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1300 microversion: 2.1 time: 0.686383 Sep 13 16:56:09.520455 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2702/5314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:08 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1300 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:09.746811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:09.747874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:09.754665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:09.755504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:09.766471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:09.767685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:09.768514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:09.769191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:09.938567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:09.947645 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21657434-bba6-47cc-be81-317d12a6a08a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.561160 Sep 13 16:56:09.964330 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2613/5315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:09 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:09.991734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:09.992972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:10.011049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.011783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.012386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.013350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.014050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.014653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.232723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:10.241698 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fdb2fa3e-2015-469c-a57c-844ba3b42713 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 0.256805 Sep 13 16:56:10.243012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2614/5316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:09 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:10.250980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7b0cb152-ff79-41fd-bb95-d2ac4e053f09 req-e2d70f64-ebb5-4258-b79a-9e217c4fb79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef17809-c5b4-4cb7-82b5-04f4230c898a", "name": "network-vif-plugged", "status": "completed", "tag": "fbfba143-5496-4524-8a26-650d71a2fa86"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:10.271015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7b0cb152-ff79-41fd-bb95-d2ac4e053f09 req-e2d70f64-ebb5-4258-b79a-9e217c4fb79a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.271182 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e88fdddf-596a-433b-a554-7c371fcae351 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.528952 Sep 13 16:56:10.277178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7b0cb152-ff79-41fd-bb95-d2ac4e053f09 req-e2d70f64-ebb5-4258-b79a-9e217c4fb79a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.277639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7b0cb152-ff79-41fd-bb95-d2ac4e053f09 req-e2d70f64-ebb5-4258-b79a-9e217c4fb79a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.287272 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2703/5317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:09 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:10.293742 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7b0cb152-ff79-41fd-bb95-d2ac4e053f09 req-e2d70f64-ebb5-4258-b79a-9e217c4fb79a service nova] Creating event network-vif-plugged:fbfba143-5496-4524-8a26-650d71a2fa86 for instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a on n-h2-857467-1 Sep 13 16:56:10.298820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7b0cb152-ff79-41fd-bb95-d2ac4e053f09 req-e2d70f64-ebb5-4258-b79a-9e217c4fb79a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054085 Sep 13 16:56:10.299976 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2615/5318] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:10.413139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:10.414107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:10.424193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.425769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.426772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.428010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.428653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.429597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.538643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:10.547392 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9876022b-e2bc-4182-8871-03e2759b5713 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1269 microversion: 2.1 time: 0.141818 Sep 13 16:56:10.547644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:10.548144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:10.550180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2704/5319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:10 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:10.561612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.562448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.563090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.563998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.564637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.565257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.826869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:10.835880 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abc7eaf5-6514-441a-8193-f8abb3614806 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.294201 Sep 13 16:56:10.837860 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2616/5320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:10 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:10.975825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:10.977347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:10.979973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:10.982361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=24 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:10.982669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a57559d7-a7b6-4ac0-b166-a4b3800e51ed req-2b3d6b96-ad9e-4642-9f29-63e1ee86feb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ec55d93-49ec-4688-81de-eecb6e41973b", "tag": "42048d98-1897-4df4-9820-d53d8410e9d9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:10.989766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.990629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.991297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.992724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.993523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.994331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:10.998269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a57559d7-a7b6-4ac0-b166-a4b3800e51ed req-2b3d6b96-ad9e-4642-9f29-63e1ee86feb6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:10.998866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a57559d7-a7b6-4ac0-b166-a4b3800e51ed req-2b3d6b96-ad9e-4642-9f29-63e1ee86feb6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:10.999743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a57559d7-a7b6-4ac0-b166-a4b3800e51ed req-2b3d6b96-ad9e-4642-9f29-63e1ee86feb6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.015100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=24 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:11.027159 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a57559d7-a7b6-4ac0-b166-a4b3800e51ed req-2b3d6b96-ad9e-4642-9f29-63e1ee86feb6 service nova] Creating event network-changed:42048d98-1897-4df4-9820-d53d8410e9d9 for instance 5ec55d93-49ec-4688-81de-eecb6e41973b on n-h1-857467-1 Sep 13 16:56:11.035310 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a57559d7-a7b6-4ac0-b166-a4b3800e51ed req-2b3d6b96-ad9e-4642-9f29-63e1ee86feb6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059788 Sep 13 16:56:11.036359 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2617/5321] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:56:11.182384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:11.194555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cd68680-9684-405f-bd9c-12c96fa1a2cd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.223460 Sep 13 16:56:11.195195 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2705/5322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:10 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:11.271812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:11.272561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:11.279964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.280474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.280934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.281658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.282158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.282603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.296499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:11.297126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:11.311414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.311904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.312356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.313075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.313547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.314221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.464843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:11.475046 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-718725cb-c942-425a-8bfc-d98dff6e0867 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1320 microversion: 2.1 time: 0.207502 Sep 13 16:56:11.475788 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2618/5323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:11 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:11.520391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e9b2e6e-fab3-484b-ac9f-ec5fcf0913ab tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.227593 Sep 13 16:56:11.521536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2706/5324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:11 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:11.574604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:11.575354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:11.582181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.582753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.583274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.584079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.584616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.585125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.669884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:11.678038 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-30abc928-d1bc-4220-9d32-d18543468dbb tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1269 microversion: 2.1 time: 0.108471 Sep 13 16:56:11.678633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2619/5325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:11 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:11.860207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:11.861181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:11.870022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.870913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.871458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:11.872181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:11.872648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:11.873139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.058320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:12.070193 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9c9966dc-ddd5-4cac-bfbb-d11185440539 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.214570 Sep 13 16:56:12.071434 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2707/5326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:11 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:12.223149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:12.224067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:12.231811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.232459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.233018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.233916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.234493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.235041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.421149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:12.431093 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73ee07a2-3d0a-451f-a948-34ee2960d8ea tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.215813 Sep 13 16:56:12.432236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2620/5327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:12 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:12.501084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:12.501849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:12.513542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.514775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.515764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.517452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.518326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.520662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.545200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:12.545861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:12.557275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.557793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.558280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.559077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.563375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.563666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.730984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-476dd06a-96c8-4ec2-b3a5-85d6da198a7a tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.189585 Sep 13 16:56:12.733264 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2621/5328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:12 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:12.738659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:12.739468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:12.748138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.748896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.749518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.751339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.752000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.752650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.833161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:12.844376 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8bf58314-ddde-48a3-b80f-2c03e78f236b tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1269 microversion: 2.1 time: 0.109529 Sep 13 16:56:12.845464 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2622/5329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:12 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:12.919866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:12.931444 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e010f48-9ee6-4c30-a137-e20db0f380be tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1511 microversion: 2.1 time: 0.436639 Sep 13 16:56:12.936224 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2708/5330] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:12 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:12.956481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:12.957112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:12.965644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.966215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.973285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:12.974389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:12.975080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:12.976487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.095488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:13.096504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:13.116229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.117433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.118511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.119707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.120562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.121284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.359491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:13.370541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-146b96a7-ed44-466a-88f0-11a2ad3bbbff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1512 microversion: 2.1 time: 0.418029 Sep 13 16:56:13.371452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2623/5331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:12 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:13.395252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:13.395898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:13.412724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.413698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.414787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.416468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.417113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.417901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.487608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:13.502313 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-729d0e70-6791-487c-91a1-8535879a84d3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.412302 Sep 13 16:56:13.518419 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2709/5332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:13 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:13.523365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:13.524516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:13.537703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.538299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.538744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.540014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.540480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.540911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.751965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:13.769970 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08d0411a-0116-4526-ad59-2370d91a4d41 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1321 microversion: 2.1 time: 0.380208 Sep 13 16:56:13.770931 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2624/5333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:13 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:13.777815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:13.778691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:13.785109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.785606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.786102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:13.787014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:13.787486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:13.787924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.031647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:14.046661 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40a5aec0-3359-4195-9381-b798efb6df38 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.527125 Sep 13 16:56:14.047459 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2710/5334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:13 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:14.065090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:14.065798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:14.068828 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8dc4e369-c0c1-4283-bc59-105f0b6eae51 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.295685 Sep 13 16:56:14.069421 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2625/5335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:13 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:14.077184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.077692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.078166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.078883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.079348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.080204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.171333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:14.180881 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-37d9c732-031d-48db-a7bc-7236c8a1f99d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1275 microversion: 2.1 time: 0.132372 Sep 13 16:56:14.182147 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2711/5336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:14 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:14.439751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6f17cbd0-9e28-48b5-a6fe-2b575700e8af req-f76e1fff-72b3-4711-b839-11252480517f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f18c88e-68df-4252-881b-7bd9c71bec1a", "tag": "9d007216-438e-4ab3-927d-7e3c5102b0b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:14.453668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6f17cbd0-9e28-48b5-a6fe-2b575700e8af req-f76e1fff-72b3-4711-b839-11252480517f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.454690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6f17cbd0-9e28-48b5-a6fe-2b575700e8af req-f76e1fff-72b3-4711-b839-11252480517f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.455366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6f17cbd0-9e28-48b5-a6fe-2b575700e8af req-f76e1fff-72b3-4711-b839-11252480517f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.473797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6f17cbd0-9e28-48b5-a6fe-2b575700e8af req-f76e1fff-72b3-4711-b839-11252480517f service nova] Creating event network-changed:9d007216-438e-4ab3-927d-7e3c5102b0b2 for instance 3f18c88e-68df-4252-881b-7bd9c71bec1a on n-h1-857467-1 Sep 13 16:56:14.481234 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6f17cbd0-9e28-48b5-a6fe-2b575700e8af req-f76e1fff-72b3-4711-b839-11252480517f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046145 Sep 13 16:56:14.482261 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2626/5337] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:14.528246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:14.538305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:14.555018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.556318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.557684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.559268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.561043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.562048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.802095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:14.803674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:14.810403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:14.817902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.818772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.819822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.821338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:14.822215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:14.822907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:14.826403 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3dbf882e-9adc-48f9-a80f-0fd3b22e94f0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.305273 Sep 13 16:56:14.827008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2712/5338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:14 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:15.087090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:15.088511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:15.113149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.113149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.113149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.113149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.113149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.113149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.152814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:15.177264 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0cb002b-cb33-40d4-9f04-b1e37076989f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1321 microversion: 2.1 time: 0.372981 Sep 13 16:56:15.181953 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2627/5339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:14 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:15.202110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:15.202713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:15.211884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.212437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.212961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.214337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.214818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.215270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.336268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:15.346729 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-893cdd9c-16f4-4005-82e8-7faebd5bbcd0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.264188 Sep 13 16:56:15.347420 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2713/5340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:15 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:15.354435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:15.355853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:15.362513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.363531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.364243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.365100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.366282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.366833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.530893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:15.545740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17a32151-73b5-48c4-9573-f5576619f791 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.196122 Sep 13 16:56:15.558694 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2714/5341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:15 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:15.771923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-584c16c2-fbc7-4b14-b021-b4b208b05d5b tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.588611 Sep 13 16:56:15.773462 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2628/5342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:15 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:15.849902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:15.850607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:15.884485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.886207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.886207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:15.886671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:15.888591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:15.889455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.075345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:16.084342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-133c5c35-9d42-40d9-8e32-0145ed8dbfee tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.238246 Sep 13 16:56:16.085378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2715/5343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:15 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:16.207606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:16.208324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:16.217499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.218737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.219477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.220580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.221545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.222070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.226762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:16.379174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:16.380688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:16.388355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.389096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.389853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.391228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.391945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.392532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.410570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:16.424089 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94544d13-beb1-4aa9-b5ba-d34451fb85e6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1321 microversion: 2.1 time: 0.217525 Sep 13 16:56:16.425633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2629/5344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:16 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:16.574126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:16.575313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:16.583760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.584559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.586928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.588282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.589002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.590134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.880003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:16.892154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c83aa369-5c10-4792-8bfb-cc0b3d2eddcd tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.325215 Sep 13 16:56:16.903780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2630/5345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:16 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:16.914742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:16.916442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:16.923778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.924475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.925096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:16.926343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:16.927044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:16.928310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.138952 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08fbf4f8-dbad-4339-8ff0-b8eb5898d7ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.233927 Sep 13 16:56:17.154217 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2631/5346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:16 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:17.161309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:17.162076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:17.168950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.169804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.170498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.171579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.172273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.172928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.252506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:17.277274 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca7964eb-2fe8-4817-a083-ee9c051711c8 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.908337 Sep 13 16:56:17.278674 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2716/5347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:16 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:17.452662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:17.454427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:17.455734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:17.464321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef480d23-cb95-44a9-80e1-e94197e3d7ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.308583 Sep 13 16:56:17.467959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2632/5348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:17 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:17.483052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.483562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.489972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.490744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.491590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.492266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.899866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:17.913082 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80283308-3d8f-4a37-b343-b313865671c5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1511 microversion: 2.1 time: 0.464300 Sep 13 16:56:17.913729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2717/5349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:17 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:17.930393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:17.930393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:17.937937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.940124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.940704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.941427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:17.941990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.942631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.943183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.951040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:17.954144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:17.968114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.968905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.969526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:17.970619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:17.971079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:17.971768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.164745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:18.184399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:18.229386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:18.238460 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b525c4c8-d2f8-4e98-8a3b-e0ab8e4e052d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.322959 Sep 13 16:56:18.259940 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2633/5350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:17 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:18.274600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:18.274600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:18.302565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.303366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.304006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.304959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.305650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.306312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.308274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:18.316550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.317052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.317771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.493053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e488af4-b06d-46f8-b73c-c620cdc4f4a8 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.231884 Sep 13 16:56:18.494252 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2634/5351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:18 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:18.511687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:18.512358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:18.519585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.520421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.521249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.522027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.522501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.523168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.600252 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cd65e8e-6857-4247-bd75-74d12630e325 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.664699 Sep 13 16:56:18.611541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2718/5352] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 16:56:17 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:18.618321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:18.619339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:18.627071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.627916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.628546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.629439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.630347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.630951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.693681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:18.704102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fcb321e5-5a42-4f85-b617-48b91a878838 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.207834 Sep 13 16:56:18.705109 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2635/5353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:18 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:18.713587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:18.719553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:18.720709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1831854412', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:18.726374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.726938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.727380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.728324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.729066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.729516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.837054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:18.916794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:18.923055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:18.924836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.925336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.925777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:18.944922 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6024fe3c-b3f6-461f-9b96-c9ff68be4485 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.342949 Sep 13 16:56:18.959187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2719/5354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:18 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:18.971042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b83f8bc8-0b1c-44bd-a0ab-b710114b5b5e req-941a859a-472e-49d1-8132-fbbb1bf56364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed437847-060d-461f-9a74-3e010ca9b37d", "tag": "aa02333c-7ac7-4735-ad2b-1bc4a02e49ad"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:18.990240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b83f8bc8-0b1c-44bd-a0ab-b710114b5b5e req-941a859a-472e-49d1-8132-fbbb1bf56364 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:18.991342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b83f8bc8-0b1c-44bd-a0ab-b710114b5b5e req-941a859a-472e-49d1-8132-fbbb1bf56364 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:18.992658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b83f8bc8-0b1c-44bd-a0ab-b710114b5b5e req-941a859a-472e-49d1-8132-fbbb1bf56364 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.014795 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b83f8bc8-0b1c-44bd-a0ab-b710114b5b5e req-941a859a-472e-49d1-8132-fbbb1bf56364 service nova] Creating event network-changed:aa02333c-7ac7-4735-ad2b-1bc4a02e49ad for instance ed437847-060d-461f-9a74-3e010ca9b37d on n-h1-857467-1 Sep 13 16:56:19.021199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b83f8bc8-0b1c-44bd-a0ab-b710114b5b5e req-941a859a-472e-49d1-8132-fbbb1bf56364 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060419 Sep 13 16:56:19.021915 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2720/5355] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:19.102880 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96572590-88a0-47e1-b885-58e0a6c05307 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1831854412" status: 200 len: 1515 microversion: 2.1 time: 0.392484 Sep 13 16:56:19.104259 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2636/5356] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 16:56:18 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1831854412 => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:19.135692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:19.140585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:19.141491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:19.152367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.152857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.153402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.154166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.154624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.155103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.267029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:19.267904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:19.274316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.275106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.276061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.276910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:19.277550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.278320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.279168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.378180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:19.387659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.388073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.388634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.459067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:19.468807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f0d03a5-6699-45b8-9b24-45cdcab37420 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.205810 Sep 13 16:56:19.470194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2637/5357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:19 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:19.520715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:19.521352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:19.529048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.529547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.530030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.530748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.531262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.532155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.596175 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8297ab35-25ac-49c8-86d0-d2ff3710bcf8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.459769 Sep 13 16:56:19.596175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2721/5358] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Sep 13 16:56:19 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:19.622644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:19.638785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:19.641551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.servers [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Removing options 'limit' from query {{(pid=122328) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 13 16:56:19.642578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:19.654314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.654806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.655249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.655969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.656423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.656996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.696745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:19.703742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.704449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.705128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.775695 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e152ba84-0e9a-42ba-bb2f-fada85c96a62 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.261885 Sep 13 16:56:19.776780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2638/5359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:19 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:19.781808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:19.782456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:19.802701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.803204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.803866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.806017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.808629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.809269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.872190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e323419e-f90f-456f-8e8e-047b4e07f372 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.255934 Sep 13 16:56:19.872988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2722/5360] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Sep 13 16:56:19 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:19.903383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:19.911290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:19.917008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:19.931084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.931590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.932047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.932810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:19.936533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:19.936930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:19.975442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:20.028535 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f8b046c4-9bae-4b12-8119-01aa54996dd7 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.130890 Sep 13 16:56:20.030008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2723/5361] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 16:56:19 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:20.033506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.036104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-94f48e65-7e66-41eb-a351-159dce5df9bf req-7696df8e-af42-481c-b206-2c3a92cef4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7eedcc1-56b5-4258-9f98-c39305cd7e65", "name": "network-vif-plugged", "status": "completed", "tag": "dfc168c0-711c-4893-9a35-c5d006a6b6bd"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:20.043919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-41a3f8b4-7e76-4561-84af-a0e4c794c662 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.266052 Sep 13 16:56:20.044682 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2639/5362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:19 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:20.047857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-94f48e65-7e66-41eb-a351-159dce5df9bf req-7696df8e-af42-481c-b206-2c3a92cef4ae service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.048558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-94f48e65-7e66-41eb-a351-159dce5df9bf req-7696df8e-af42-481c-b206-2c3a92cef4ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.049182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-94f48e65-7e66-41eb-a351-159dce5df9bf req-7696df8e-af42-481c-b206-2c3a92cef4ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.050220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.050940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:20.072868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.073462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.074024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.074925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.081353 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-94f48e65-7e66-41eb-a351-159dce5df9bf req-7696df8e-af42-481c-b206-2c3a92cef4ae service nova] Creating event network-vif-plugged:dfc168c0-711c-4893-9a35-c5d006a6b6bd for instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 on n-h1-857467-1 Sep 13 16:56:20.083263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.084077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.088036 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-94f48e65-7e66-41eb-a351-159dce5df9bf req-7696df8e-af42-481c-b206-2c3a92cef4ae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056440 Sep 13 16:56:20.089673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2724/5363] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:20.097128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.104451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.104897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.servers [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Removing options 'limit' from query {{(pid=122328) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 13 16:56:20.106569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:20.115254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.115874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.116318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.117618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.118317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.118918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.152426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:20.192456 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-345a524e-9b37-4c47-9b77-2e3dc4a2409e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.100311 Sep 13 16:56:20.193897 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2725/5364] 10.222.0.61 () {58 vars in 1150 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:20.207014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.212767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.213397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:20.218641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.219744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.220187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.221271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.221409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.221773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.265786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.269160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:20.279424 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a566dcdb-b02d-4b5a-a0f8-e014f4d5e19e tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.233506 Sep 13 16:56:20.280690 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2640/5365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:20.309979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3737b984-b4e5-4189-87bd-36c324ca4049 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.106683 Sep 13 16:56:20.311000 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2726/5366] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers => generated 1011 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:20.325268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.330907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.331807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:20.346196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.346903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.347531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.348448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.349090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.349721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.458322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:20.498389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.499392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:20.506824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.507539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.508804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.510091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.511985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.512511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.545556 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f30b338-33bd-415f-a92b-0d7afe8ccd7e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.223946 Sep 13 16:56:20.547208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2641/5367] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:20.560999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.566231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.566685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.servers [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Removing options 'limit' from query {{(pid=122327) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 13 16:56:20.567353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:20.574318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.574808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.575254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.575987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.576433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.576864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.623142 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34522f2c-1065-43f3-b8fe-feb4290eb52e tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.064959 Sep 13 16:56:20.624838 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2642/5368] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:20.642171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.651700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:20.652819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1831854412', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:20.659602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.660449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.661084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.662738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.663400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.664657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.783198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:20.874851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e054a27-bd60-4646-b686-c3844de1c670 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1831854412" status: 200 len: 346 microversion: 2.1 time: 0.234873 Sep 13 16:56:20.884437 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2643/5369] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1831854412 => generated 346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:56:20.888754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:20.893021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:20.904257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.904768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.905220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:20.909112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:20.909638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:20.910141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.111936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:21.118162 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d90da8a-9d78-467f-be82-2e6eff0ab1ed tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.237406 Sep 13 16:56:21.135099 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2644/5370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:21.141619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3c45a92-9739-40bc-a338-02bf92f34bb2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:21.149462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c45a92-9739-40bc-a338-02bf92f34bb2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.150128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c45a92-9739-40bc-a338-02bf92f34bb2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.150953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3c45a92-9739-40bc-a338-02bf92f34bb2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.153722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:21.162994 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5d49a380-5c6c-459b-b1f6-d64cf13035e0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.669332 Sep 13 16:56:21.173850 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2727/5371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:20 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:21.173850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:21.173850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:21.176100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.176663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.177101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.182544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.182544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.182544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.182950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f3c45a92-9739-40bc-a338-02bf92f34bb2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Going to try to stop instance {{(pid=122327) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:56:21.267787 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3c45a92-9739-40bc-a338-02bf92f34bb2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "POST /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7/action" status: 202 len: 0 microversion: 2.1 time: 0.130719 Sep 13 16:56:21.270211 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2645/5372] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:21 2022] POST /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:56:21.283098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:21.284010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:21.299760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.300275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.300783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.305709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.306288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.306747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.396232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:21.409769 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d43418e4-60ce-4feb-a008-fb35380bda6e tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.243848 Sep 13 16:56:21.424122 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2728/5373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:21 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:21.435677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:21.437065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:21.443739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.444546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.445763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.447017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:21.448042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:21.448643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:21.602345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:21.614196 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50818b88-8478-4cfd-a56e-ee61ca7797c8 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.339471 Sep 13 16:56:21.615071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2646/5374] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:21 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:21.705521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:21.720311 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ad56f19-a7c2-4b0f-b42a-6111a73a8884 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.294944 Sep 13 16:56:21.720916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2729/5375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:21 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:22.144910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:22.145642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:22.154027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.154817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.155265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.155982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.156452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.156892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.190350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:22.202793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:22.216931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.217561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.219096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.219973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.220520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.221890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.313250 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fee42346-ae36-487a-9892-66d240dbe130 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.172307 Sep 13 16:56:22.314139 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2647/5376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:22 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:22.436174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:22.436981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:22.443639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.444142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.444746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.445781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.446157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.446640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.597862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:22.607741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58a101f5-7fd8-4664-8a55-6c0385ede7aa tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.175753 Sep 13 16:56:22.608651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2648/5377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:22 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:22.639450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:22.640105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:22.646480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.646975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.647420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.648129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.648626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.649062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.696938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:22.706816 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f279a3c8-c48f-472a-8693-b9dd819bc848 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.520815 Sep 13 16:56:22.718575 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2730/5378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:22 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:22.744298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:22.745114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:22.754047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.756019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.756807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.758731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:22.759708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:22.760453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:22.809628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:22.819520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cfde87d0-7bdd-45ea-afd4-b58e5e17cc0b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.184574 Sep 13 16:56:22.820661 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2649/5379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:22 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:23.015540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:23.030041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-91c2a7fd-c706-4e9f-9baf-ae00523c3193 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.289926 Sep 13 16:56:23.030682 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2731/5380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:22 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:23.336968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:23.338342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:23.345934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.346386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.346842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.347584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.348246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.348876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.501153 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f3c5ea4-2962-400a-b257-959896ce2ce4 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.167432 Sep 13 16:56:23.501762 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2650/5381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:23 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:23.632167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:23.634795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:23.647939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.649250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.650008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.651552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.652564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.653354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.741784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:23.743339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:23.756386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.761422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.761898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.762632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.763259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.763704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.813500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:23.823887 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fff37c29-8833-41dc-9c19-0285f393961b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.196528 Sep 13 16:56:23.825054 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2732/5382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:23 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:23.843161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:23.844206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:23.850168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.850914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.851828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.852916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:23.853579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:23.854237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:23.927074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:23.938385 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fcb5bd66-e44a-4ad1-8fc9-42065825d16a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.205853 Sep 13 16:56:23.947371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2651/5383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:23 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:24.022627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:24.037761 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-16bd7d27-f4b9-42bd-994e-d2ebbd59e205 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.198328 Sep 13 16:56:24.038406 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2733/5384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:23 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:24.055795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:24.056734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:24.065085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.065499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.065991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.067395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.067877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.068306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.241640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:24.250511 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2562ae87-90b1-41c6-b812-1a58cf00c536 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.201906 Sep 13 16:56:24.252240 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2652/5385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:24 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:24.525344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:24.527667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:24.536179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.537361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.538184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.539517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.540126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.541171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.549117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:24.706387 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-78e53021-78ec-487f-9eb1-903fc44cc23d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.185335 Sep 13 16:56:24.717853 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2734/5386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:24 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:24.848624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:24.849221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:24.872158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.872657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.874548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.877442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.880683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.881197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.962686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:24.963475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:24.974298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.975118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.976801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:24.980856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:24.982458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:24.982934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.040524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:25.050536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0cb10d11-b9dc-4864-a7b2-3bc853eda979 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.205799 Sep 13 16:56:25.052077 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2653/5387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:24 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:25.064159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:25.064939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:25.073705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:25.075717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.076377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.076993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.077996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.078784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.079686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.292182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:25.301442 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1eb1a3b4-bf87-44e3-9e78-2777e062b4a3 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.242398 Sep 13 16:56:25.302959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2654/5388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:25 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:25.308116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:25.308932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:25.315309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.316018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.316647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.317693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.318351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.318956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.543019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:25.571396 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a694623-3991-4e7d-bd95-e62bfdbdc215 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.610451 Sep 13 16:56:25.572670 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2735/5389] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:24 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:25.607384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:25.616574 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-016138a6-386a-4113-92b1-b36461648ebd tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.311943 Sep 13 16:56:25.630922 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2655/5390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:25 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:25.733580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:25.735543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:25.756832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.758153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.770910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.775811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.777594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.778996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.854412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9f5009f7-054b-4c40-9439-08f30b2efb32 req-1a1f15c5-1ee9-4d52-9bd8-f4022f1874bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f18c88e-68df-4252-881b-7bd9c71bec1a", "name": "network-vif-plugged", "status": "completed", "tag": "9d007216-438e-4ab3-927d-7e3c5102b0b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:25.880682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9f5009f7-054b-4c40-9439-08f30b2efb32 req-1a1f15c5-1ee9-4d52-9bd8-f4022f1874bf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:25.881337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9f5009f7-054b-4c40-9439-08f30b2efb32 req-1a1f15c5-1ee9-4d52-9bd8-f4022f1874bf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:25.881880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9f5009f7-054b-4c40-9439-08f30b2efb32 req-1a1f15c5-1ee9-4d52-9bd8-f4022f1874bf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:25.916410 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9f5009f7-054b-4c40-9439-08f30b2efb32 req-1a1f15c5-1ee9-4d52-9bd8-f4022f1874bf service nova] Creating event network-vif-plugged:9d007216-438e-4ab3-927d-7e3c5102b0b2 for instance 3f18c88e-68df-4252-881b-7bd9c71bec1a on n-h1-857467-1 Sep 13 16:56:25.929010 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9f5009f7-054b-4c40-9439-08f30b2efb32 req-1a1f15c5-1ee9-4d52-9bd8-f4022f1874bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080224 Sep 13 16:56:25.930839 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2656/5391] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:26.083895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.084619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.096306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.097124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.098614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.100052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.101055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.101958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.102876 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64931f3a-7256-4e08-9f84-5a9ce89fe661 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.373771 Sep 13 16:56:26.103484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2736/5392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:25 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:26.269150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:26.278875 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bceaa01-82c4-4b4a-868b-67c34fc1a875 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.202635 Sep 13 16:56:26.280855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2657/5393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:26.342418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.343037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.350135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.350871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.352303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.353662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.354487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.355230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.355914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.356954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.364059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.364785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.366186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.367896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.369208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.369657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.552870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:26.562421 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b2b0eae8-3743-49ad-b60f-ad716a42b4fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.211692 Sep 13 16:56:26.563024 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2658/5394] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:26.587593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.588219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.594811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.595309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.595959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.596854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.597496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.598131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.615637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:26.630103 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4cc8316a-4683-4e3e-83cc-10a4ffd7331a tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.291042 Sep 13 16:56:26.631404 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2737/5395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:26.642785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.646403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.654821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.656761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.657454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.658435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.658894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.659322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.759070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:26.771310 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-155bd94d-043c-4f5f-a6a8-02cdc9ede3bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.188219 Sep 13 16:56:26.772091 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2659/5396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:26.783167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.784356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.794039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.794835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.796093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.797113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.797635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.798138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.853883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:26.863271 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0d0ae24-5bfc-4112-b58d-a8d8f0bd9a83 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.230714 Sep 13 16:56:26.864199 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2738/5397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:26.871101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:26.872041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:26.881638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.883436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.884170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.885265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:26.886000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:26.886667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:26.999801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:27.008770 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af638925-ab56-4254-b247-dac25a729271 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.235281 Sep 13 16:56:27.010586 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2660/5398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:27.074130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:27.082609 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2634294a-3cd3-4a7c-85fc-3c4520dcf028 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.217167 Sep 13 16:56:27.083204 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2739/5399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:26 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:27.104934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:27.105494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:27.112182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.112718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.113685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.114715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.115229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.115810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.122645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:27.129165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:27.129956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:27.139722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.141215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.142626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.143798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.144758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.145514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.284846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:27.312742 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-421ba745-afc0-4af3-a63b-0b228717d7ac tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.205034 Sep 13 16:56:27.314692 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2661/5400] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:27 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:27.320495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:27.321413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:27.328757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.329782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.330480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.331409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.332067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.333013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.364266 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68b9483e-596d-40db-abe5-27f9c521bc31 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.240315 Sep 13 16:56:27.364876 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2740/5401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:27 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:27.483331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-197354305", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "ebb6466b-9a22-4490-b956-78da5a25f8b5"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:27.496785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:27.505102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:27.524901 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b5eef6d-5676-4045-85b6-4005b9390537 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.208300 Sep 13 16:56:27.525773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2662/5402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:27 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:27.591811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] validate_networks() for [('ebb6466b-9a22-4490-b956-78da5a25f8b5', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:56:27.656687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:27.657521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:27.664381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.664893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.665458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.666293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.666887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.667439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.897967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:27.909372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-059279b2-057b-4b7a-979c-7d6e7132a669 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.258422 Sep 13 16:56:27.910911 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2663/5403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:27 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:27.919504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:27.921889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:27.935480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.936046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.936876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:27.937758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:27.939115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:27.939570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.115924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:28.127219 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-272eab1f-4deb-40ad-aa89-ead061123219 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.215104 Sep 13 16:56:28.128301 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2664/5404] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:27 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:28.133768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:28.134504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:28.150206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:56:28.151555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:56:28.151924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:56:28.152359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:56:28.152749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:56:28.157307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.157974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.158601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.159204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.159680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.161974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.162120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.162621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.163290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.164743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.165270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.165702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.183206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:56:28.189046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for user c2c12edf9f8d4b23bd1074facb2fad9d and project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:56:28.203074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:56:28.205713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:56:28.266849 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-464017ab-4096-4d29-be41-f2b8a1099e1c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788851 Sep 13 16:56:28.274661 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2741/5405] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:56:28.280820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0ac350c-5d84-40d9-ac85-6af6841483cf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:28.281736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0ac350c-5d84-40d9-ac85-6af6841483cf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:28.356746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:28.365996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5f6ec26-9e00-4654-ae17-8f5cbbf23da4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.236666 Sep 13 16:56:28.369386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0ac350c-5d84-40d9-ac85-6af6841483cf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:28.381895 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2665/5406] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:28 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:28.382116 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0ac350c-5d84-40d9-ac85-6af6841483cf tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1214 microversion: 2.1 time: 0.100873 Sep 13 16:56:28.382116 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2742/5407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:28 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:28.398773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:28.399675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:28.408111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.408746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.409198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.409984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.410420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.410857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.549122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:28.549751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:28.561556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.562109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.562528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.563291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.563737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.566752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.627283 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-efe8943a-8499-4170-b376-9ef63f5d9049 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.235932 Sep 13 16:56:28.628527 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2666/5408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:28 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:28.858493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:28.867126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-123c9db3-45fe-4e5e-af22-aae198694312 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1519 microversion: 2.1 time: 0.322104 Sep 13 16:56:28.868525 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2743/5409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:28 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:28.933732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:28.934295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:28.937992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:28.942380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.943950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.944402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:28.945926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:28.946594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:28.947225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.110085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:29.120473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7892950d-bc67-4166-921a-db34d9faadf5 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.190712 Sep 13 16:56:29.121434 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2667/5410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:28 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:29.154666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:29.155659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:29.168084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.168602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.169123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.169927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.170629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.171292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.346657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:29.355418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e635f6a-7284-429e-9c27-20ebcc15d187 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.207616 Sep 13 16:56:29.356547 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2744/5411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:29 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:29.407311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:29.408587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:29.431332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:29.434325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.434829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.435285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.436015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.438841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:29.441087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.442851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.453114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.455605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.457505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.458541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.460299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.463539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.602074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:29.626264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7aed2c46-cd35-43a1-b3c6-30366d351ad6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1266 microversion: 2.1 time: 0.209696 Sep 13 16:56:29.626937 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2745/5412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:29 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:29.655698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:29.657128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:29.664971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.665647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.666847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.667832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.669806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.670584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.728683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:29.738633 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-381a611f-16e3-4aca-a0f0-4cafd9eb5ac8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1368 microversion: 2.1 time: 0.339257 Sep 13 16:56:29.739228 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2668/5413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:29 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1368 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:29.850990 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-580daf4d-8a03-45ed-9130-224a72e5a2fd tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.199261 Sep 13 16:56:29.851577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2746/5414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:29 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:29.892505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:29.893140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:29.903391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.903898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.904347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.906482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-7f59adf7-340c-41d7-ba54-686348284c1a req-4ee46eb9-91e0-45e2-9e2b-48224405df2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec55d93-49ec-4688-81de-eecb6e41973b", "name": "network-vif-plugged", "status": "completed", "tag": "42048d98-1897-4df4-9820-d53d8410e9d9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:29.909614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.910146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.910597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.933249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7f59adf7-340c-41d7-ba54-686348284c1a req-4ee46eb9-91e0-45e2-9e2b-48224405df2b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:29.933751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7f59adf7-340c-41d7-ba54-686348284c1a req-4ee46eb9-91e0-45e2-9e2b-48224405df2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:29.934229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7f59adf7-340c-41d7-ba54-686348284c1a req-4ee46eb9-91e0-45e2-9e2b-48224405df2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:29.967479 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-7f59adf7-340c-41d7-ba54-686348284c1a req-4ee46eb9-91e0-45e2-9e2b-48224405df2b service nova] Creating event network-vif-plugged:42048d98-1897-4df4-9820-d53d8410e9d9 for instance 5ec55d93-49ec-4688-81de-eecb6e41973b on n-h1-857467-1 Sep 13 16:56:29.972993 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-7f59adf7-340c-41d7-ba54-686348284c1a req-4ee46eb9-91e0-45e2-9e2b-48224405df2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073228 Sep 13 16:56:29.974169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2747/5415] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:30.096891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:30.106114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b14dba5-4893-4491-b3cf-e8647368ad80 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.217354 Sep 13 16:56:30.118279 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2669/5416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:29 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:30.130061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.131148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.138517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.139343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.145256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.146390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.147254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.148745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.151500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.153439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.161490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.166019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.166467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.167215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.167684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.184925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.395934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:30.407756 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f9953bd-e0de-4ebe-b089-0b8efc1758e5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.281466 Sep 13 16:56:30.424302 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2748/5417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:30.435863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.439544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.447654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.448736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.449569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.450659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.451367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.452034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.662168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:30.679652 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3347621-43c2-4369-8d4a-dbeaf3174d58 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.246896 Sep 13 16:56:30.680415 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2749/5418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:30.685584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.686232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.696350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.697400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.699359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.700088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.700845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.701503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.711289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:30.727544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:30.731219 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3bf623c8-36f4-4372-b30d-aefe0a03d084 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.590090 Sep 13 16:56:30.732119 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2670/5419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:30.739352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.740351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.748163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.748907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.749573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.750959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.751732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.752249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.828642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:30.846277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5381455a-ee75-4e7d-a013-a84cc231f545 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1272 microversion: 2.1 time: 0.107261 Sep 13 16:56:30.846940 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2671/5420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:30.852891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.853768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.861369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.862098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.862731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.863991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.864633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.865238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.914789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:30.926383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-da3cb9b0-c23a-431c-a40a-d911cd8863cc tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.244602 Sep 13 16:56:30.927691 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2750/5421] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:30.934255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:30.935589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:30.946352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.947521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.948178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:30.949138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:30.949949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:30.950425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.127911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:31.146158 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7665bd41-30b2-4b7f-9e5c-7b7183560187 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1558 microversion: 2.1 time: 0.296879 Sep 13 16:56:31.147274 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2672/5422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:31.156560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c844ce0-ffd5-4d67-99cd-1076394a0bb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:31.165972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0c844ce0-ffd5-4d67-99cd-1076394a0bb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e has no mapping to a cell. Sep 13 16:56:31.169141 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ef2be5d-d6e4-4e21-a490-8d8987a9d606 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1464 microversion: 2.1 time: 0.239816 Sep 13 16:56:31.169778 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2751/5423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:30 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c844ce0-ffd5-4d67-99cd-1076394a0bb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e/action HTTP/1.1 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 15 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: {"os-stop": {}} Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e has no mapping to a cell. Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e', 'body': {'os-stop': {}}} Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e has no mapping to a cell. Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:31.171143 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e has no mapping to a cell. Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e has no mapping to a cell. Sep 13 16:56:31.176816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:31.178148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:31.178148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:31.180020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c844ce0-ffd5-4d67-99cd-1076394a0bb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e has no mapping to a cell. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:31.181270 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c844ce0-ffd5-4d67-99cd-1076394a0bb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e/action" status: 404 len: 117 microversion: 2.1 time: 0.032447 Sep 13 16:56:31.182171 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2673/5424] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:31 2022] POST /compute/v2.1/servers/dc6f5f57-eef8-4e74-bab8-dcbf1ccda45e/action => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:31.191117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:31.192147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:31.197293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.197767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.198412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.199322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.199950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.200548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.206463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.206998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.207451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.208245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.209928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.210392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.320258 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30cd2d69-0964-43f3-8983-a7e0f70eadc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149205 Sep 13 16:56:31.321127 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2752/5425] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:56:31 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:31.472098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:31.485220 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-386beb7b-6d4f-46cd-9140-89bbe480f7b4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.298706 Sep 13 16:56:31.487923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2674/5426] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:31 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:31.511851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:31.512461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:31.518917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.519739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.520859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.521316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.522025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.522673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.546930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:31.708093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:31.708831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:31.719818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.720831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.721908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.723055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.723848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.726624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.868546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:31.881950 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-810203a4-a35d-44d9-8b3e-3d6f7a9b88a1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.370087 Sep 13 16:56:31.885722 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2753/5427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:31 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:31.893414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:31.896352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:31.917748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.918583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.919207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:31.925700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:31.926230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:31.926679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:32.238982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:32.252000 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3998f6be-39bd-4070-90de-d9bf0cbf4e12 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.548023 Sep 13 16:56:32.252937 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2675/5428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:31 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:32.261616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:32.262260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:32.283515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:32.284018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:32.284461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:32.285175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:32.285633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:32.298559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:32.787680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:32.799878 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-347409f9-0bfa-45a5-9597-9df5cc660719 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.912703 Sep 13 16:56:32.822506 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2754/5429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:31 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:32.833655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-951b7629-d42c-4853-bef3-0d71135841db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:32.847113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-951b7629-d42c-4853-bef3-0d71135841db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 15199a03-b962-4b08-8705-aa091965b211] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:32.889566 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-951b7629-d42c-4853-bef3-0d71135841db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 15199a03-b962-4b08-8705-aa091965b211 could not be found. Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-951b7629-d42c-4853-bef3-0d71135841db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/15199a03-b962-4b08-8705-aa091965b211/action HTTP/1.1 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 15 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: {"suspend": {}} Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 15199a03-b962-4b08-8705-aa091965b211 could not be found. Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '15199a03-b962-4b08-8705-aa091965b211', 'body': {'suspend': {}}} Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15199a03-b962-4b08-8705-aa091965b211 could not be found. Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15199a03-b962-4b08-8705-aa091965b211 could not be found. Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:32.891666 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:32.897175 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:32.897175 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:32.897175 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15199a03-b962-4b08-8705-aa091965b211 could not be found. Sep 13 16:56:32.897175 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:32.902279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-951b7629-d42c-4853-bef3-0d71135841db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 15199a03-b962-4b08-8705-aa091965b211 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:32.904288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-951b7629-d42c-4853-bef3-0d71135841db tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/15199a03-b962-4b08-8705-aa091965b211/action" status: 404 len: 111 microversion: 2.1 time: 0.080439 Sep 13 16:56:32.912129 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2755/5430] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:32 2022] POST /compute/v2.1/servers/15199a03-b962-4b08-8705-aa091965b211/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:32.923667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:32.924336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:32.959003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:32.959505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:32.959956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:32.961198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:32.979813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:32.984379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.033536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:33.052467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9bf1ecc-e7b8-4abe-a455-8132e01e53bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.798327 Sep 13 16:56:33.053386 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2676/5431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:32 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:33.063666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:33.064352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:33.091305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.106254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.106729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.107498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.107971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.108410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.294759 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a7dcfd7f-35a1-4d78-bd5b-90abda5be642 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1648 microversion: 2.1 time: 0.380852 Sep 13 16:56:33.295668 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2756/5432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:32 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1648 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:33.300790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:33.301755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:33.308397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.309087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.309747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.310631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.311427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.312096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.598202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:33.620000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1cdcbda9-5d51-4f2c-b16b-f49d625764a7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.320834 Sep 13 16:56:33.622809 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2757/5433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:33 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:33.628046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:33.629115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:33.635925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.636670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.637317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.645281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.650999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.651718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.849779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:33.886219 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-808fe1c7-71c1-49f6-90d2-a11bc2118d24 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.831075 Sep 13 16:56:33.887289 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2677/5434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:33 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:33.900939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:33.903113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:33.938603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.943813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.945709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.951823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:33.952605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:33.953311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:33.982280 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-018ec1d6-33e4-46d9-aa80-2a3b5d2c66ad tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1648 microversion: 2.1 time: 0.357354 Sep 13 16:56:33.984871 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2758/5435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:33 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1648 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:34.028337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:34.028958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:34.073320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.074787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.076238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.077771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.078450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.079183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.400933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:34.412412 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df3cb83c-dd39-4efc-aa97-4871ed95b59a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.404988 Sep 13 16:56:34.417441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:34.422772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:34.428328 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2759/5436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:33 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:34.437929 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e9c439a-e194-49f6-a8b9-1eb741e3c662 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.548137 Sep 13 16:56:34.439110 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2678/5437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:33 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:34.444080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:34.445515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:34.446625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-28605943-41ec-42e6-bd63-7c6697a63bc7 req-0b4c16fd-41e2-4ff4-a4fe-e182826c52b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd499bd3-53af-43f8-8c53-bf4db0b034ed", "tag": "44d0c5c5-aede-4fdd-80ec-dc1992caae00"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:34.453540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.454358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.454973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.455994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.456719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.457322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.474760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-28605943-41ec-42e6-bd63-7c6697a63bc7 req-0b4c16fd-41e2-4ff4-a4fe-e182826c52b0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.475794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-28605943-41ec-42e6-bd63-7c6697a63bc7 req-0b4c16fd-41e2-4ff4-a4fe-e182826c52b0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.477432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-28605943-41ec-42e6-bd63-7c6697a63bc7 req-0b4c16fd-41e2-4ff4-a4fe-e182826c52b0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.498395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-28605943-41ec-42e6-bd63-7c6697a63bc7 req-0b4c16fd-41e2-4ff4-a4fe-e182826c52b0 service nova] Creating event network-changed:44d0c5c5-aede-4fdd-80ec-dc1992caae00 for instance dd499bd3-53af-43f8-8c53-bf4db0b034ed on n-h2-857467-1 Sep 13 16:56:34.504674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-28605943-41ec-42e6-bd63-7c6697a63bc7 req-0b4c16fd-41e2-4ff4-a4fe-e182826c52b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073570 Sep 13 16:56:34.505932 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2760/5438] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:34.515259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:34.516301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:34.524866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.525918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.526573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.527599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.529224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.530177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.933886 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8710ce18-85db-4fdc-a4b6-1847cdc769a0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1648 microversion: 2.1 time: 0.485739 Sep 13 16:56:34.941175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:34.942247 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2679/5439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:34 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1648 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:34.950817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d6bee28f-2549-4935-b874-a5a38343915a req-585464a0-d2f8-4922-ab41-f4644a4d4764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f18c88e-68df-4252-881b-7bd9c71bec1a", "tag": "9d007216-438e-4ab3-927d-7e3c5102b0b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:34.974039 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3780864b-f3ae-4730-bcb1-7dc1d27e5644 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.464285 Sep 13 16:56:34.975119 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2761/5440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:34 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:34.983167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d6bee28f-2549-4935-b874-a5a38343915a req-585464a0-d2f8-4922-ab41-f4644a4d4764 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:34.984455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d6bee28f-2549-4935-b874-a5a38343915a req-585464a0-d2f8-4922-ab41-f4644a4d4764 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:34.985390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d6bee28f-2549-4935-b874-a5a38343915a req-585464a0-d2f8-4922-ab41-f4644a4d4764 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:34.996999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:34.997561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:35.026549 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d6bee28f-2549-4935-b874-a5a38343915a req-585464a0-d2f8-4922-ab41-f4644a4d4764 service nova] Creating event network-changed:9d007216-438e-4ab3-927d-7e3c5102b0b2 for instance 3f18c88e-68df-4252-881b-7bd9c71bec1a on n-h1-857467-1 Sep 13 16:56:35.032918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.035172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.042000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.045580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d6bee28f-2549-4935-b874-a5a38343915a req-585464a0-d2f8-4922-ab41-f4644a4d4764 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102059 Sep 13 16:56:35.046204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.046363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2680/5441] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:35.046954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.048262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.067670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:35.068401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:35.088334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.088837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.089284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.093176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'flavor' on Instance uuid d7eedcc1-56b5-4258-9f98-c39305cd7e65 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:56:35.094447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.095073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.095531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.230873 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39458415-0d51-4ca4-ab0f-08704f4f37fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.248546 Sep 13 16:56:35.235172 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2762/5442] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:34 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:56:35.252888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:35.259757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:35.293025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.295461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.297719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.298782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.301254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.303972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.373707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:56:35.456108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:35.468585 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5f1aaae-e9b6-4c7c-832a-d7ea74fa01ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.420976 Sep 13 16:56:35.484238 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2681/5443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:35 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:35.497738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e80fe49d-5963-40e6-a5ed-3efe90dfbd9f req-4e9b59b8-aff1-45af-a8e8-ea038b8e8cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed437847-060d-461f-9a74-3e010ca9b37d", "name": "network-vif-plugged", "status": "completed", "tag": "aa02333c-7ac7-4735-ad2b-1bc4a02e49ad"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:35.510962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e80fe49d-5963-40e6-a5ed-3efe90dfbd9f req-4e9b59b8-aff1-45af-a8e8-ea038b8e8cfb service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.511890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e80fe49d-5963-40e6-a5ed-3efe90dfbd9f req-4e9b59b8-aff1-45af-a8e8-ea038b8e8cfb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.512590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e80fe49d-5963-40e6-a5ed-3efe90dfbd9f req-4e9b59b8-aff1-45af-a8e8-ea038b8e8cfb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.531512 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e80fe49d-5963-40e6-a5ed-3efe90dfbd9f req-4e9b59b8-aff1-45af-a8e8-ea038b8e8cfb service nova] Creating event network-vif-plugged:aa02333c-7ac7-4735-ad2b-1bc4a02e49ad for instance ed437847-060d-461f-9a74-3e010ca9b37d on n-h1-857467-1 Sep 13 16:56:35.543205 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e80fe49d-5963-40e6-a5ed-3efe90dfbd9f req-4e9b59b8-aff1-45af-a8e8-ea038b8e8cfb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056985 Sep 13 16:56:35.546626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2682/5444] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:35.560573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:35.566603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:35.573943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.574790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.575633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.578579 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b846a80-6f30-42b9-8d59-ed785b78d269 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 204 len: 0 microversion: 2.1 time: 0.341415 Sep 13 16:56:35.579260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.579396 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2763/5445] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:56:35 2022] DELETE /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:56:35.580193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.581691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.591588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:35.592409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:35.601707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.602307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.602807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.603739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.604366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.604842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.866338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:35.878244 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8138270f-2f55-4453-9e53-2fb2f4a3afa0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1514 microversion: 2.1 time: 0.326569 Sep 13 16:56:35.879834 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2683/5446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:35 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:35.890838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:35.894418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:35.911540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.912376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.913072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.913317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:35.914989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:35.915675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:35.916386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:35.922309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69b90c6e-4c98-438b-bc77-cb9d286defd1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.337801 Sep 13 16:56:35.922907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2764/5447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:35 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:36.004403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:36.005864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:36.013097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.013606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.014078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.014794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.015262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.015697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.108644 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d0d34af-3587-48c7-a098-72b9181e1725 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1654 microversion: 2.1 time: 0.226569 Sep 13 16:56:36.109566 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2684/5448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:35 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1654 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:36.247377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:36.258685 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed0b2d19-1a6d-4170-bec4-5c8bda16391c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.258381 Sep 13 16:56:36.259696 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2765/5449] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:35 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:36.497370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:36.498282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:36.519121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.519655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.520110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.520845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.521307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.521748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.704382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:36.713954 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c66d5908-81db-43c8-957c-226a0b41f5ef tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.220696 Sep 13 16:56:36.714782 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2685/5450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:36 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:36.904545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:36.905167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:36.911931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.912419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.912860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.914183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.914839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.915276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.948182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:36.948823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:36.956644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.957427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.958030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:36.958602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:36.959068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:36.959501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.084238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:37.099008 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cd7d5bd-5dbe-448b-9e21-664184e13a81 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1514 microversion: 2.1 time: 0.198431 Sep 13 16:56:37.101510 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2766/5451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:36 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:37.133871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:37.138046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:37.138684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:37.143392 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5142616c-7451-440e-ac00-41588f7ab69d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.200871 Sep 13 16:56:37.147174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:37.147694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:37.148695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.149427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:37.150089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:37.151053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.151823 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2686/5452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:36 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:37.286133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:37.286762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:37.293536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:37.294093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:37.294535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.295236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:37.295886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:37.296319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.373938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e52dd1f-49bb-4c39-9db1-8e923c3556ec tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1654 microversion: 2.1 time: 0.242359 Sep 13 16:56:37.375016 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2767/5453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:37 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1654 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:37.513404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:37.529397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-31b29ad6-cf7f-46cf-8cb7-ea643a7d8f89 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.246703 Sep 13 16:56:37.530568 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2687/5454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:37 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:37.739297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:37.740191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:37.749026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:37.749794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:37.751274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.752395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:37.752945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:37.753325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:37.779280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:37.931331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:37.942129 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee52cc3e-b301-4597-95c9-fc05b73f5723 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.206717 Sep 13 16:56:37.943294 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2768/5455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:37 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:38.124539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:38.125142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:38.131957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.133122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.134086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.135454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.136105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.136718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.167509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:38.168167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:38.173222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:38.180378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.181164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.181790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.182721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.186423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.190396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.374153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:38.567733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:38.576014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81c680dd-77a9-4fb9-aace-0a118b2f18aa tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.412436 Sep 13 16:56:38.593671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2769/5456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:38 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:38.598977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1d63632f-0f65-46de-b5b1-5f8e421458fe req-44df6305-effd-44d8-b88d-a0a3591bf3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec55d93-49ec-4688-81de-eecb6e41973b", "name": "network-vif-deleted", "tag": "42048d98-1897-4df4-9820-d53d8410e9d9"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:38.609983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1d63632f-0f65-46de-b5b1-5f8e421458fe req-44df6305-effd-44d8-b88d-a0a3591bf3a1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.610777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1d63632f-0f65-46de-b5b1-5f8e421458fe req-44df6305-effd-44d8-b88d-a0a3591bf3a1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.611409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1d63632f-0f65-46de-b5b1-5f8e421458fe req-44df6305-effd-44d8-b88d-a0a3591bf3a1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.659588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1d63632f-0f65-46de-b5b1-5f8e421458fe req-44df6305-effd-44d8-b88d-a0a3591bf3a1 service nova] Creating event network-vif-deleted:42048d98-1897-4df4-9820-d53d8410e9d9 for instance 5ec55d93-49ec-4688-81de-eecb6e41973b on n-h1-857467-1 Sep 13 16:56:38.666039 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1d63632f-0f65-46de-b5b1-5f8e421458fe req-44df6305-effd-44d8-b88d-a0a3591bf3a1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070686 Sep 13 16:56:38.667017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2770/5457] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:38.686408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:38.687461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:38.698405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.703904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.710605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.713552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.715285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.715285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.812218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:38.824486 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5bcdcac6-f852-4385-8850-6c5f3638960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1497 microversion: 2.1 time: 0.704179 Sep 13 16:56:38.825686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2688/5458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:38 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1497 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:38.843839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:38.847224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:38.857023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.858534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.859478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.860640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.861446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.862223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.928779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e904aa6c-4742-4f2c-8af4-2eff6d46c437 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1449 microversion: 2.1 time: 0.257850 Sep 13 16:56:38.933769 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2771/5459] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:38 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1449 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:38.950173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:38.951104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:38.969677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.971271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.972956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:38.973741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:38.975780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:38.978100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.049132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'flavor' on Instance uuid d7eedcc1-56b5-4258-9f98-c39305cd7e65 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:56:39.098531 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'suspend' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state suspended Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 15 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: {"suspend": {}} Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'suspend' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state suspended Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'suspend': {}}} Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 13 16:56:39.103906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state suspended Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state suspended Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'suspend' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state suspended {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e9c62c4-5b29-48db-b948-e0c164e974e1 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 148 microversion: 2.1 time: 0.168335 Sep 13 16:56:39.109369 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2772/5460] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:38 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 148 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:56:39.126083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:39.131340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:39.134828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:39.136895 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e390fd47-6908-4c72-b2c3-de3c82688404 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.309632 Sep 13 16:56:39.137622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2689/5461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:38 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:39.154140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.154140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.154140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.154820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.154967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:39.155366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.155524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:39.156043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.168310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.169219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.170335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.171561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.172260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.172921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.281022 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9eb107b5-8300-4e30-9a87-3b57acea1c8d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 202 len: 0 microversion: 2.1 time: 0.141760 Sep 13 16:56:39.282575 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2690/5462] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:39 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:56:39.292743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:39.293819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:39.300982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.301562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.302215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.303253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.304853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.305315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.357495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:39.368389 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac680044-25bf-43f3-9709-34670a049c5d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1317 microversion: 2.1 time: 0.258617 Sep 13 16:56:39.369566 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2773/5463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:39 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:39.481750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:39.496793 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6b57b8bd-b96f-48d5-b11d-77bffdde4380 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1503 microversion: 2.1 time: 0.209075 Sep 13 16:56:39.497730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2691/5464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:39 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:39.601778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:39.602790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:39.610565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.611321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.612609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.613536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.614223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.615473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.957075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:39.957699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:39.971959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.972485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.972931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:39.973669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:39.974181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:39.985551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.030122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.030545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.031072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.031545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lazy-loading 'fault' on Instance uuid 5ec55d93-49ec-4688-81de-eecb6e41973b {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:56:40.091706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da71425c-02af-423e-8ecb-0251005f64d0 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 200 len: 1454 microversion: 2.1 time: 0.138539 Sep 13 16:56:40.092310 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2692/5465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:39 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:40.160701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:40.161405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:40.170091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.170588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.171109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.171816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.172290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.172703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.291598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:40.300139 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-281e0ab8-54dc-4afe-b04e-3d54610b4557 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.703492 Sep 13 16:56:40.300834 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2774/5466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:39 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:40.344416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:40.353329 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ce68fbb-9150-4a56-8fd8-3686f14ab003 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.196460 Sep 13 16:56:40.353956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2693/5467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:40 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:40.391803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:40.392430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:40.399545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.400058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.400762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.401474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.401974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.402438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.520775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:40.521399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:40.528892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.529380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.529819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.530537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.530995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.531422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.690886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:40.699551 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e312c068-d1ec-4863-9f80-723ab4bd76ef tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1503 microversion: 2.1 time: 0.182178 Sep 13 16:56:40.709936 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2694/5468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:40 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:40.718250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:40.730159 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94a27cee-7f03-43f8-8e50-049cc209a6a8 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1506 microversion: 2.1 time: 0.341903 Sep 13 16:56:40.730890 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2775/5469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:40 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:40.753693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:40.754483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:40.761640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.762267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.762784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.763565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.764100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.764607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.784824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:40.914006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:40.923339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bae897ea-e680-416f-b10e-c42f40451fab tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1506 microversion: 2.1 time: 0.173551 Sep 13 16:56:40.939229 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2695/5470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:40 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:40.949077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:40.952562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:40.961619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.962409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.962872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:40.963988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:40.964724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:40.965484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.058311 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47b373ea-61ff-4bb4-af8c-3a528bf5a8c0 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "PUT /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1078 microversion: 2.1 time: 0.114688 Sep 13 16:56:41.059246 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2776/5471] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:56:40 2022] PUT /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1078 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:41.078599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.079224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.087575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.088187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.088934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.090051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.090548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.090993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.119313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.120593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: 5ec55d93-49ec-4688-81de-eecb6e41973b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.130964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.133956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.134648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.135594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.136482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.137118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.155886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] HTTP exception thrown: Instance 5ec55d93-49ec-4688-81de-eecb6e41973b could not be found. Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Request method failure captured: Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b HTTP/1.1 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILYBLm4wnr9DN31yoxerCC5nkaaEeWgfHAyq6_Tn1Wq1KH4_f_7b-HTzPQE6Z_Kqh1DmFkPYc9uTPa1NFmLOQowHQOuDBPGvshTAp_5ZRr8GNUy0HCPJQVpwLYt78bU0Ujyq7-2HfMkkBDeYcutfyVnb55noEnMvgt7rEYfGAk3_CZU Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f568b0a290084c2f8614d9f0bc47be21 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestServerMultinode-589947869 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestServerMultinode-589947869 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f568b0a290084c2f8614d9f0bc47be21 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestServerMultinode-589947869 Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestServerMultinode-589947869-project-admin Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 0b1f2d9a9d0340fba7c5023a4798db5d Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestServerMultinode-589947869-project-admin Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 5ec55d93-49ec-4688-81de-eecb6e41973b could not be found. Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '5ec55d93-49ec-4688-81de-eecb6e41973b'} Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec55d93-49ec-4688-81de-eecb6e41973b could not be found. Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec55d93-49ec-4688-81de-eecb6e41973b could not be found. Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:41.157911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec55d93-49ec-4688-81de-eecb6e41973b could not be found. Sep 13 16:56:41.164087 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:41.166076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Returning 404 to user: Instance 5ec55d93-49ec-4688-81de-eecb6e41973b could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:41.167138 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc7f8af5-5bfe-4a9e-8934-3861734daea3 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b" status: 404 len: 111 microversion: 2.1 time: 0.054406 Sep 13 16:56:41.168250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2777/5472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/5ec55d93-49ec-4688-81de-eecb6e41973b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:56:41.180522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.181326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.189155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.194076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.194769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.198493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.199115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.199652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.258114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:56:41.361060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:41.385447 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d7eec5dc-c4b9-4467-8bcb-a5805c9c5095 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1504 microversion: 2.1 time: 0.307420 Sep 13 16:56:41.386306 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2696/5473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:41.393516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:41.396704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.399969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.409311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.410373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.411341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.412350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.413926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.414736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.417285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12179bf3-cd29-46e9-a52a-57ddffc0cc6e tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 204 len: 0 microversion: 2.1 time: 0.240668 Sep 13 16:56:41.421591 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2778/5474] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:56:41 2022] DELETE /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:56:41.427682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.431491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.445768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.449319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.450658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.454323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.455512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.456288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.641756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:41.654497 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bef9f53-78ee-4855-8567-308b5f0803ee tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.266923 Sep 13 16:56:41.655330 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2697/5475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:41.670467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.671335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.679491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.680151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.680811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.681739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.682547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.683155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.776273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:41.785376 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df7f2c38-2111-41d4-959d-e06af555e344 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.365228 Sep 13 16:56:41.786724 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2779/5476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:41.792465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.793268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.799923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.800873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.801380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.802487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.803347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.804577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.848733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:41.858130 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-53a38c0a-6f75-4378-a3cb-b4053abbc08e tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1504 microversion: 2.1 time: 0.193784 Sep 13 16:56:41.872042 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2698/5477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:41.891067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:41.891614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:41.901130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.901635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.902172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:41.902905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:41.903347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:41.903776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.075943 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-446922a2-d964-4ba6-afe1-e9bb7900b4ef tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1654 microversion: 2.1 time: 0.287797 Sep 13 16:56:42.076869 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2780/5478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1654 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:42.099063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:42.102107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:42.108615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.109737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.110288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.111084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.111633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.112144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.123699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:42.135881 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a00a60e7-5602-477c-bfda-00f5473f71b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1503 microversion: 2.1 time: 0.262629 Sep 13 16:56:42.151275 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2699/5479] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:41 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:42.204130 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f122d166-a1e9-419f-908c-470794003431 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "PUT /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1080 microversion: 2.1 time: 0.112205 Sep 13 16:56:42.205452 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2781/5480] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:56:42 2022] PUT /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1080 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:42.233239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:42.234296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:42.242897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.243725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.244465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.245468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.246255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.247045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.421141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:42.435670 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c2e38ef-8636-4c1f-821c-25dfafaf04d7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1506 microversion: 2.1 time: 0.215581 Sep 13 16:56:42.436587 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2700/5481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:42 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:42.457572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:42.458859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:42.465817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.466842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.467445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.468261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.468852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.469357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.677335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:42.678066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:42.689687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.690353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.690884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.691667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.692205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.692710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.786803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:42.798105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-befb4e2a-8379-4e2a-8588-b922ad39c424 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1506 microversion: 2.1 time: 0.344166 Sep 13 16:56:42.816022 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2782/5482] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:42 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:42.823677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:42.824697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:42.833219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.834151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.834821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.836440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.837148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.837751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.867747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:42.899300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:42.925039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c01683f1-bccd-40f8-92a3-717c4c081b27 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1522 microversion: 2.1 time: 0.251305 Sep 13 16:56:42.925640 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2701/5483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:42 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:42.936858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:42.937713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:42.947306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.948714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.949609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.951524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:42.952181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:42.954180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:42.990151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:56:43.063388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:43.085282 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52aac057-db7b-452d-b1cb-0494b53edc5a tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 204 len: 0 microversion: 2.1 time: 0.157828 Sep 13 16:56:43.086062 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2702/5484] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:56:42 2022] DELETE /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:56:43.103307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:43.103912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:43.110934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.111371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.111812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.112661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.113305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.113662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.148367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:56:43.154614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:43.166970 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bcc5670f-0afb-426f-a755-223f75833fc5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.349175 Sep 13 16:56:43.168386 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2783/5485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:42 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:43.175469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:43.177035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:43.186553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.187448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.188248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.189208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.190656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.191597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.271190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Instance is already in deleting state, ignoring this request Sep 13 16:56:43.272547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6cee8036-5833-46ce-b010-1176309fbfd2 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 204 len: 0 microversion: 2.1 time: 0.174485 Sep 13 16:56:43.281195 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2703/5486] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:56:43 2022] DELETE /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:56:43.287422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:43.289611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:43.298597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.300697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.301397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.302603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.303310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.307189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.512986 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c0a6229-0775-4836-9800-b8b2f4fe601d tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1654 microversion: 2.1 time: 0.342057 Sep 13 16:56:43.518120 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2784/5487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:43 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1654 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:43.525817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:43.527375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:43.556573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.557082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.557524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.558281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.560516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.560967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.684361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:43.692453 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9dfceba6-c97f-43f1-a829-df82b3f64330 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.409466 Sep 13 16:56:43.698377 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2704/5488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:43 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:43.755544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:43.766349 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f379426-c390-4d49-88c8-ceeb0675a8f7 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1512 microversion: 2.1 time: 0.246802 Sep 13 16:56:43.766964 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2785/5489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:43 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:43.791658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:43.792581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:43.799293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.800013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.800650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.801611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.802377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.803072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.956069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-416d66e1-b8e5-43ef-926a-ce1f5e0e109b req-882df464-0f30-41b1-8a56-2e651e8e4396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd499bd3-53af-43f8-8c53-bf4db0b034ed", "name": "network-vif-plugged", "status": "completed", "tag": "44d0c5c5-aede-4fdd-80ec-dc1992caae00"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:43.969108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-416d66e1-b8e5-43ef-926a-ce1f5e0e109b req-882df464-0f30-41b1-8a56-2e651e8e4396 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:43.969875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-416d66e1-b8e5-43ef-926a-ce1f5e0e109b req-882df464-0f30-41b1-8a56-2e651e8e4396 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:43.970516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-416d66e1-b8e5-43ef-926a-ce1f5e0e109b req-882df464-0f30-41b1-8a56-2e651e8e4396 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:43.983939 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-416d66e1-b8e5-43ef-926a-ce1f5e0e109b req-882df464-0f30-41b1-8a56-2e651e8e4396 service nova] Creating event network-vif-plugged:44d0c5c5-aede-4fdd-80ec-dc1992caae00 for instance dd499bd3-53af-43f8-8c53-bf4db0b034ed on n-h2-857467-1 Sep 13 16:56:44.003346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-416d66e1-b8e5-43ef-926a-ce1f5e0e109b req-882df464-0f30-41b1-8a56-2e651e8e4396 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303219 Sep 13 16:56:44.004539 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2705/5490] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:44.014832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:44.016104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:44.024521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.025297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.026207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.027172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.027846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.028491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.356452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:44.368519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55a23857-bb13-4d14-9841-88946d7317e2 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1499 microversion: 2.1 time: 0.361377 Sep 13 16:56:44.386823 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2706/5491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:44 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1499 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:44.386823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:44.386823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:44.391439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.391909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.392366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.393402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.394081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.394520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.552209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:44.560903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b05c19b6-bf67-4342-9a2a-0ad3cf7594de tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.780751 Sep 13 16:56:44.561517 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2786/5492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:43 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:44.592958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:44.599229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:44.600480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:44.607499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.608475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.609115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.610151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.611496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.612174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.643172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:44.688516 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c334aaae-4c78-48fb-8576-bf7547a29a7c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.109967 Sep 13 16:56:44.689667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2787/5493] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Sep 13 16:56:44 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:44.694406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:44.696116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:44.703148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.703651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.704096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.706090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.706650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.707093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.826201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5dee886d-213d-4f1a-8e65-4c2ed13c5442 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1612 microversion: 2.1 time: 0.135191 Sep 13 16:56:44.830982 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2788/5494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:44 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1612 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:44.837152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-018fc345-5841-45a2-8dcb-e20bd8a21684 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:44.837707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-018fc345-5841-45a2-8dcb-e20bd8a21684 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 1f852ae9-180d-4fed-a045-46619b3d1ba8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:44.850935 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-018fc345-5841-45a2-8dcb-e20bd8a21684 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 1f852ae9-180d-4fed-a045-46619b3d1ba8 could not be found. Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-018fc345-5841-45a2-8dcb-e20bd8a21684 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/1f852ae9-180d-4fed-a045-46619b3d1ba8/action HTTP/1.1 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 15 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: {"unpause": {}} Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1f852ae9-180d-4fed-a045-46619b3d1ba8 could not be found. Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1f852ae9-180d-4fed-a045-46619b3d1ba8', 'body': {'unpause': {}}} Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f852ae9-180d-4fed-a045-46619b3d1ba8 could not be found. Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f852ae9-180d-4fed-a045-46619b3d1ba8 could not be found. Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:44.853590 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:44.859393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:44.859393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:44.859393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f852ae9-180d-4fed-a045-46619b3d1ba8 could not be found. Sep 13 16:56:44.859393 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:44.861026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-018fc345-5841-45a2-8dcb-e20bd8a21684 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 1f852ae9-180d-4fed-a045-46619b3d1ba8 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:44.862288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-018fc345-5841-45a2-8dcb-e20bd8a21684 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/1f852ae9-180d-4fed-a045-46619b3d1ba8/action" status: 404 len: 111 microversion: 2.1 time: 0.030243 Sep 13 16:56:44.878496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2789/5495] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:44 2022] POST /compute/v2.1/servers/1f852ae9-180d-4fed-a045-46619b3d1ba8/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:44.891328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c1fd27f-f241-4a4d-8a09-a474d7c4854f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:44.909251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c1fd27f-f241-4a4d-8a09-a474d7c4854f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:44.909670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c1fd27f-f241-4a4d-8a09-a474d7c4854f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:44.910142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c1fd27f-f241-4a4d-8a09-a474d7c4854f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:44.955844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c1fd27f-f241-4a4d-8a09-a474d7c4854f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Going to try to start instance {{(pid=122328) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 16:56:45.070576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c1fd27f-f241-4a4d-8a09-a474d7c4854f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "POST /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7/action" status: 202 len: 0 microversion: 2.1 time: 0.188981 Sep 13 16:56:45.072036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2790/5496] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:44 2022] POST /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:56:45.085166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:45.088764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:45.104807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.107020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.108715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:45.109657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.111025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.112090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:45.177173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:45.187378 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8952fd7b-c215-4d00-b839-b87a0d99b7ba tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1314 microversion: 2.1 time: 0.811908 Sep 13 16:56:45.198535 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2707/5497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:44 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:45.208266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:45.210790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:45.235307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.243393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.244755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:45.245642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.250467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.251086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:45.745285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:45.763340 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-635faef2-561d-476f-bccb-1857d81d6f92 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1512 microversion: 2.1 time: 0.683688 Sep 13 16:56:45.778392 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2791/5498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:45 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1512 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:45.806412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-eeecfa0f-ca3d-4780-8c69-e4256e510cfb req-95c38c0b-b6fd-4341-a4fb-e31e844474eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c", "name": "network-vif-deleted", "tag": "5e3d43fb-1209-4ba9-8b7c-99f1d36116fb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:45.834119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-eeecfa0f-ca3d-4780-8c69-e4256e510cfb req-95c38c0b-b6fd-4341-a4fb-e31e844474eb service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.835833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-eeecfa0f-ca3d-4780-8c69-e4256e510cfb req-95c38c0b-b6fd-4341-a4fb-e31e844474eb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.838355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-eeecfa0f-ca3d-4780-8c69-e4256e510cfb req-95c38c0b-b6fd-4341-a4fb-e31e844474eb service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:45.882246 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-eeecfa0f-ca3d-4780-8c69-e4256e510cfb req-95c38c0b-b6fd-4341-a4fb-e31e844474eb service nova] Creating event network-vif-deleted:5e3d43fb-1209-4ba9-8b7c-99f1d36116fb for instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c on n-h2-857467-1 Sep 13 16:56:45.909020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-eeecfa0f-ca3d-4780-8c69-e4256e510cfb req-95c38c0b-b6fd-4341-a4fb-e31e844474eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113222 Sep 13 16:56:45.911114 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2792/5499] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:45.933467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:45.938828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:45.957619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.959515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.960287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:45.961511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:45.963361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:45.964368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.054044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:46.065275 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1581fdc1-63ac-4deb-9014-b47e2349d30d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.865220 Sep 13 16:56:46.073771 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2708/5500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:45 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:46.079679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:46.086836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:46.097783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.098719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.099353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.100151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.100620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.102361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.193423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.195220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.195996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.196659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lazy-loading 'fault' on Instance uuid de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:56:46.200223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:46.344897 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b22dc62f-fff2-475c-874f-226b1df273af tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 200 len: 1454 microversion: 2.1 time: 0.269667 Sep 13 16:56:46.345557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2709/5501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:46 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:46.352452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:46.353464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:46.365663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.366882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.367514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.368848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.369509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.370297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.564651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:46.573705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-edcc09de-afb8-442b-961e-e71c034baa14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1508 microversion: 2.1 time: 0.660709 Sep 13 16:56:46.574214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2793/5502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:45 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1508 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:46.592257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:46.602379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:46.612213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.612733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.613185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.613955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.614422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.614856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.729536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:46.740443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7027e0cf-5bbb-4213-a1ca-f15b4360ec56 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.393215 Sep 13 16:56:46.744492 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2710/5503] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:46 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:46.768760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:46.769626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:46.780798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.781306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.781741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.782479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.782937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.783364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.856184 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'unpause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 15 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: {"unpause": {}} Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: exception: Cannot 'unpause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'unpause': {}}} Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state active. Cannot unpause while the instance is in this state. Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:46.857982 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:46.866031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:46.866031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:46.866031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:46.866031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:46.866031 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:46.866031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'unpause' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:46.874174 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-950eee08-1481-490d-bade-127a0698e666 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 145 microversion: 2.1 time: 0.094648 Sep 13 16:56:46.878098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2711/5504] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:46 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 145 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 16:56:46.884780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:46.885408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:46.903624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.904123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.904566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:46.905281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:46.905749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:46.906231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.368879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:47.378781 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2486d916-18f8-4db3-b203-1961447e535d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1501 microversion: 2.1 time: 0.803668 Sep 13 16:56:47.391828 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2794/5505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:46 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1501 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:47.419013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:47.426940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:47.463236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.463743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.464195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.464917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.465385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.465849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.517154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f2e3c66387486c9b8dc9d7dffefe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb0938b4c884dc0a1467383e16fbf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:47.531568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-739d0c6c-d763-4739-b6a2-bc46392cf6ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 200 len: 1470 microversion: 2.1 time: 0.652555 Sep 13 16:56:47.532176 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2712/5506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:46 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:47.540334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-757dab70-bdab-438b-860f-3332cd7b496f req-3b8b8146-5253-4d60-8670-529af5ed1ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed437847-060d-461f-9a74-3e010ca9b37d", "name": "network-vif-deleted", "tag": "aa02333c-7ac7-4735-ad2b-1bc4a02e49ad"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:47.566886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-757dab70-bdab-438b-860f-3332cd7b496f req-3b8b8146-5253-4d60-8670-529af5ed1ae5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.570319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-757dab70-bdab-438b-860f-3332cd7b496f req-3b8b8146-5253-4d60-8670-529af5ed1ae5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.570809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-757dab70-bdab-438b-860f-3332cd7b496f req-3b8b8146-5253-4d60-8670-529af5ed1ae5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.597227 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-757dab70-bdab-438b-860f-3332cd7b496f req-3b8b8146-5253-4d60-8670-529af5ed1ae5 service nova] Creating event network-vif-deleted:aa02333c-7ac7-4735-ad2b-1bc4a02e49ad for instance ed437847-060d-461f-9a74-3e010ca9b37d on n-h1-857467-1 Sep 13 16:56:47.609786 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-757dab70-bdab-438b-860f-3332cd7b496f req-3b8b8146-5253-4d60-8670-529af5ed1ae5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075445 Sep 13 16:56:47.613184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2713/5507] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:47.623923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:47.629782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] [instance: de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:47.642587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.643975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.644959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.652561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.653257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.654103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.683429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] HTTP exception thrown: Instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c could not be found. Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Request method failure captured: Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c HTTP/1.1 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILYBLm4wnr9DN31yoxerCC5nkaaEeWgfHAyq6_Tn1Wq1KH4_f_7b-HTzPQE6Z_Kqh1DmFkPYc9uTPa1NFmLOQowHQOuDBPGvshTAp_5ZRr8GNUy0HCPJQVpwLYt78bU0Ujyq7-2HfMkkBDeYcutfyVnb55noEnMvgt7rEYfGAk3_CZU Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f568b0a290084c2f8614d9f0bc47be21 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestServerMultinode-589947869 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f568b0a290084c2f8614d9f0bc47be21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestServerMultinode-589947869 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f568b0a290084c2f8614d9f0bc47be21 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestServerMultinode-589947869 Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestServerMultinode-589947869-project-admin Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 0b1f2d9a9d0340fba7c5023a4798db5d Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestServerMultinode-589947869-project-admin Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c could not be found. Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c'} Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c could not be found. Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c could not be found. Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:47.693601 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c could not be found. Sep 13 16:56:47.699103 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:47.702143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] Returning 404 to user: Instance de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:47.703558 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ff9db6d-f774-44e1-9442-08cd52067a73 tempest-TestServerMultinode-589947869 tempest-TestServerMultinode-589947869-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c" status: 404 len: 111 microversion: 2.1 time: 0.089172 Sep 13 16:56:47.704361 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2714/5508] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:47 2022] GET /compute/v2.1/servers/de6c9e75-3b9f-4c34-9caf-8f1a3232fa7c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:47.709364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:47.716273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:47.732018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.732894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.738523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:47.740429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:47.741138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:47.742256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:48.058245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:48.073619 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8bda1be-7f93-4bb3-acfc-875a9e52259d tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.659287 Sep 13 16:56:48.091833 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2795/5509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:47 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:48.103464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:48.108568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:48.120540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.network.security_group_api [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Removing security group 62ce7eb0-b5aa-434b-ac6c-7f32a5cc5b38 from port 44d0c5c5-aede-4fdd-80ec-dc1992caae00 Sep 13 16:56:48.126798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:48.127514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:48.128138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:48.130971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:48.131660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:48.132175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:48.603171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:48.613181 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea704ed3-cec0-4db1-859e-f20200b80fff tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1508 microversion: 2.1 time: 0.519809 Sep 13 16:56:48.617060 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2796/5510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:48 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1508 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:48.639105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:48.640020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:48.656936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:48.664469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:48.667712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:48.669131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:48.673028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:48.677315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:48.996386 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-de368152-8e8e-4d52-8a9c-270bb33a3436 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed/action" status: 202 len: 0 microversion: 2.1 time: 1.288462 Sep 13 16:56:49.001177 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2715/5511] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:47 2022] POST /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed/action => generated 0 bytes in 1296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:56:49.006479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:49.008642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: ed437847-060d-461f-9a74-3e010ca9b37d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:49.023594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.031113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.031837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.032822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.033498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.034452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.081487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] HTTP exception thrown: Instance ed437847-060d-461f-9a74-3e010ca9b37d could not be found. Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Request method failure captured: Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d HTTP/1.1 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWTDZcLXQbHZSZq24QC3I6HMw_BgzA74EreTKIP-U7ksx3VhIjQOimenZCmEKPUETX5yd6uCkAmJCjQjRHVwoHuLZOR7k-t-Pq470Jhdx24fLtohc6L6ZB8cADbpLRGVn0AagS9eS4ZHWgJ0B2DfeigTiqsW3GYdMPP4Csb3lQ6IxM Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 24f2e3c66387486c9b8dc9d7dffefe71 Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ed437847-060d-461f-9a74-3e010ca9b37d could not be found. Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ed437847-060d-461f-9a74-3e010ca9b37d'} Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed437847-060d-461f-9a74-3e010ca9b37d could not be found. Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed437847-060d-461f-9a74-3e010ca9b37d could not be found. Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:49.087011 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed437847-060d-461f-9a74-3e010ca9b37d could not be found. Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Returning 404 to user: Instance ed437847-060d-461f-9a74-3e010ca9b37d could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-deeb21f6-2a2c-4e15-8917-9696e3261a56 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d" status: 404 len: 111 microversion: 2.1 time: 0.089920 Sep 13 16:56:49.097419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2716/5512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:49 2022] GET /compute/v2.1/servers/ed437847-060d-461f-9a74-3e010ca9b37d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:49.113254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:49.113968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:49.123100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.123775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.124072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.138929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.139765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.140430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.348618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:49.364601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d310f0dc-5b12-4983-8685-87bae876eaa9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1459 microversion: 2.1 time: 0.270511 Sep 13 16:56:49.368996 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2717/5513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:49 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1459 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:49.377587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4b125ff4-1bf3-4502-8704-c2c2652602c7 req-6b39a571-f261-40c2-b3c8-eddcbd05b93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd499bd3-53af-43f8-8c53-bf4db0b034ed", "tag": "44d0c5c5-aede-4fdd-80ec-dc1992caae00"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:49.402572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4b125ff4-1bf3-4502-8704-c2c2652602c7 req-6b39a571-f261-40c2-b3c8-eddcbd05b93c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.403551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4b125ff4-1bf3-4502-8704-c2c2652602c7 req-6b39a571-f261-40c2-b3c8-eddcbd05b93c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.404385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4b125ff4-1bf3-4502-8704-c2c2652602c7 req-6b39a571-f261-40c2-b3c8-eddcbd05b93c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.420656 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4b125ff4-1bf3-4502-8704-c2c2652602c7 req-6b39a571-f261-40c2-b3c8-eddcbd05b93c service nova] Creating event network-changed:44d0c5c5-aede-4fdd-80ec-dc1992caae00 for instance dd499bd3-53af-43f8-8c53-bf4db0b034ed on n-h2-857467-1 Sep 13 16:56:49.442751 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4b125ff4-1bf3-4502-8704-c2c2652602c7 req-6b39a571-f261-40c2-b3c8-eddcbd05b93c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071352 Sep 13 16:56:49.443797 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2718/5514] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:49.452135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:49.454036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:49.463936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.464722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.466598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.473163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.484256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.485075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.508255 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] HTTP exception thrown: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Request method failure captured: Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 HTTP/1.1 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWTDZcLXQbHZSZq24QC3I6HMw_BgzA74EreTKIP-U7ksx3VhIjQOimenZCmEKPUETX5yd6uCkAmJCjQjRHVwoHuLZOR7k-t-Pq470Jhdx24fLtohc6L6ZB8cADbpLRGVn0AagS9eS4ZHWgJ0B2DfeigTiqsW3GYdMPP4Csb3lQ6IxM Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 24f2e3c66387486c9b8dc9d7dffefe71 Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8771f19c-7855-47e1-a507-b620155e6174'} Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:49.510064 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Returning 404 to user: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63542570-e788-4978-a8fb-21644a4fc4ea tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 404 len: 111 microversion: 2.1 time: 0.066354 Sep 13 16:56:49.514667 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2719/5515] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:56:49 2022] DELETE /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:49.518525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:49.519283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:49.530026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.530949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.531439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.535676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.536557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.537205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.915549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:49.924431 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d249bb45-85a2-48e4-8faf-0a7f0a45a244 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 1.305923 Sep 13 16:56:49.930014 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2797/5516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:48 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:49.935129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:49.935737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 8771f19c-7855-47e1-a507-b620155e6174] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:49.959091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.959834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.960664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.961671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:49.962322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:49.962922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:49.992423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] HTTP exception thrown: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Request method failure captured: Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 HTTP/1.1 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILWTDZcLXQbHZSZq24QC3I6HMw_BgzA74EreTKIP-U7ksx3VhIjQOimenZCmEKPUETX5yd6uCkAmJCjQjRHVwoHuLZOR7k-t-Pq470Jhdx24fLtohc6L6ZB8cADbpLRGVn0AagS9eS4ZHWgJ0B2DfeigTiqsW3GYdMPP4Csb3lQ6IxM Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 24f2e3c66387486c9b8dc9d7dffefe71 Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '8771f19c-7855-47e1-a507-b620155e6174'} Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.004402 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Returning 404 to user: Instance 8771f19c-7855-47e1-a507-b620155e6174 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ec41013-c6c8-4665-a9c4-ffcc66196312 tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174" status: 404 len: 111 microversion: 2.1 time: 0.074533 Sep 13 16:56:50.013702 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2798/5517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:49 2022] GET /compute/v2.1/servers/8771f19c-7855-47e1-a507-b620155e6174 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:50.019397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.020275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.035075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.035579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.036019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.042890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.043402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.043853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.101563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:50.114089 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2734f5e4-e06d-4a99-b85a-7323f38199f7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.600386 Sep 13 16:56:50.115067 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2720/5518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:49 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:50.125109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c9da47b-03fe-4ff2-a4d4-9f68a38c52b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:50.131759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c9da47b-03fe-4ff2-a4d4-9f68a38c52b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: dc9afca6-4458-4cd7-a4da-e11b7768311f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.152002 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0c9da47b-03fe-4ff2-a4d4-9f68a38c52b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance dc9afca6-4458-4cd7-a4da-e11b7768311f could not be found. Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c9da47b-03fe-4ff2-a4d4-9f68a38c52b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/dc9afca6-4458-4cd7-a4da-e11b7768311f/action HTTP/1.1 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 18 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: {"unshelve": null} Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance dc9afca6-4458-4cd7-a4da-e11b7768311f could not be found. Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'dc9afca6-4458-4cd7-a4da-e11b7768311f', 'body': {'unshelve': None}} Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc9afca6-4458-4cd7-a4da-e11b7768311f could not be found. Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc9afca6-4458-4cd7-a4da-e11b7768311f could not be found. Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.159529 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc9afca6-4458-4cd7-a4da-e11b7768311f could not be found. Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c9da47b-03fe-4ff2-a4d4-9f68a38c52b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance dc9afca6-4458-4cd7-a4da-e11b7768311f could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:50.165081 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c9da47b-03fe-4ff2-a4d4-9f68a38c52b2 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/dc9afca6-4458-4cd7-a4da-e11b7768311f/action" status: 404 len: 111 microversion: 2.1 time: 0.046965 Sep 13 16:56:50.167672 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2721/5519] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:50 2022] POST /compute/v2.1/servers/dc9afca6-4458-4cd7-a4da-e11b7768311f/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:50.174888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.178605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.192221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.192722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.193162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.193892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.194392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.194968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.215344 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] HTTP exception thrown: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Request method failure captured: Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c HTTP/1.1 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWTDZcLXQbHZSZq24QC3I6HMw_BgzA74EreTKIP-U7ksx3VhIjQOimenZCmEKPUETX5yd6uCkAmJCjQjRHVwoHuLZOR7k-t-Pq470Jhdx24fLtohc6L6ZB8cADbpLRGVn0AagS9eS4ZHWgJ0B2DfeigTiqsW3GYdMPP4Csb3lQ6IxM Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 24f2e3c66387486c9b8dc9d7dffefe71 Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6e6e5b15-642d-4cbd-b3da-e74c9f583f2c'} Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:50.219706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Returning 404 to user: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c36f8375-0b55-4adc-92da-ef82db37d1ac tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 404 len: 111 microversion: 2.1 time: 0.054169 Sep 13 16:56:50.224876 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2722/5520] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:56:50 2022] DELETE /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:50.230248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.230876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.237998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.238504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.238945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.239650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.240108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.240684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.493978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:50.510190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-904fe21e-e781-4fdd-a78c-716cb15abb13 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1512 microversion: 2.1 time: 0.501893 Sep 13 16:56:50.511390 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2799/5521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:50.518519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.519902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.529640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.530798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.531506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.532408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.533165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.533794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.571207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:50.580863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79d0c9fb-8183-469e-b546-2497d89d501c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.354884 Sep 13 16:56:50.586651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2723/5522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:50.596596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.597917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] [instance: 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.613029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.613875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.614525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.615480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.617631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.618357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.652179 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] HTTP exception thrown: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Request method failure captured: Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c HTTP/1.1 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWTDZcLXQbHZSZq24QC3I6HMw_BgzA74EreTKIP-U7ksx3VhIjQOimenZCmEKPUETX5yd6uCkAmJCjQjRHVwoHuLZOR7k-t-Pq470Jhdx24fLtohc6L6ZB8cADbpLRGVn0AagS9eS4ZHWgJ0B2DfeigTiqsW3GYdMPP4Csb3lQ6IxM Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/adb0938b4c884dc0a1467383e16fbf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: adb0938b4c884dc0a1467383e16fbf8d Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-275608744 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 24f2e3c66387486c9b8dc9d7dffefe71 Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerDiskConfigTestJSON-275608744-project Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6e6e5b15-642d-4cbd-b3da-e74c9f583f2c'} Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:50.653939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] Returning 404 to user: Instance 6e6e5b15-642d-4cbd-b3da-e74c9f583f2c could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-38b1f61d-cb5b-4c9c-ab5c-680ab54a7e2d tempest-ServerDiskConfigTestJSON-275608744 tempest-ServerDiskConfigTestJSON-275608744-project] 10.222.0.61 "GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c" status: 404 len: 111 microversion: 2.1 time: 0.068133 Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2724/5523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers/6e6e5b15-642d-4cbd-b3da-e74c9f583f2c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:50.669242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.679644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:50.680251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.servers [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Removing options 'limit' from query {{(pid=122327) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 13 16:56:50.681313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:50.682648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.683240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.683785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.684627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.685346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.686075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.687770 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e16f62a-4505-4e62-a180-36851f566beb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029596 Sep 13 16:56:50.688908 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2725/5524] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:56:50.693747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.695257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.703439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.704291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.704981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.705945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.706661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.707315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.947524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:50.959206 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf27e2c8-4658-4583-93a7-89477456fdb0 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.445823 Sep 13 16:56:50.959819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2800/5525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:50.974683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:50.976052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:50.993845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:50.996056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:50.997604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:50.998871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.000978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.002970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:51.015268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:51.313099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:51.337322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:51.352887 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed50b71b-c215-42ae-9214-7592c7da667f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.638893 Sep 13 16:56:51.355248 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2726/5526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:51.364390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:51.365354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:51.377300 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8298e0af-056f-45f2-8500-1260b01bc42c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1512 microversion: 2.1 time: 0.412713 Sep 13 16:56:51.378597 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2801/5527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:50 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:51.384478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:51.392767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:51.403598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.404116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.404567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:51.405301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.405768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.408278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:51.417709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.418483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.420752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:51.421673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.423446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.427100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:51.828998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:51.840163 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7db2bbed-a645-4a48-97bb-145074573bd3 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.482306 Sep 13 16:56:51.842209 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2727/5528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:51 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:51.854846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:51.856835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:51.879552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.880053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.883151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:51.886195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:51.887526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:51.888174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:52.015641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:52.036140 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-41dded35-48bd-4cc4-a817-77ecc27cfce6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.656385 Sep 13 16:56:52.041281 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2802/5529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:51 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:52.046341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:52.062641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:52.087552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:52.087896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:52.092225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:52.093357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:52.094077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:52.094687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:52.155293 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Cannot 'unshelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action HTTP/1.1 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 18 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: {"unshelve": null} Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: exception: Cannot 'unshelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'unshelve': None}} Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 in vm_state active. Cannot unshelve while the instance is in this state. Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 16:56:52.166275 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 409 to user: Cannot 'unshelve' instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 while it is in vm_state active {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35664081-f261-42b9-869c-2add90c2b7d5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action" status: 409 len: 146 microversion: 2.1 time: 0.125547 Sep 13 16:56:52.175691 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2803/5530] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:56:52 2022] POST /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65/action => generated 146 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:56:52.178577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:52.178577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:52.195474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:52.195839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:52.196100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:52.196830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:52.197293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:52.197739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:52.415317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:52.449298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68c7e248-2972-4b3f-abe8-79b1c2b33a47 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.275801 Sep 13 16:56:52.449914 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2804/5531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:52 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:52.470026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-691398467", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "ebb6466b-9a22-4490-b956-78da5a25f8b5"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:52.556440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] validate_networks() for [('ebb6466b-9a22-4490-b956-78da5a25f8b5', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:56:52.776488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:52.801212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9fbf52b-831a-44d6-bdec-31497eaebaf9 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1511 microversion: 2.1 time: 0.957413 Sep 13 16:56:52.819216 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2728/5532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:51 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1511 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:52.833560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:52.834624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:52.851485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:52.852431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:52.853102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:52.854464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:52.855676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:52.861473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:53.292361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:53.307627 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4adf9921-43e7-46f6-a867-0ba2b486cfe5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.483631 Sep 13 16:56:53.309068 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2729/5533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:52 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:53.318996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:53.319927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:53.329141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:53.331000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:53.331666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:53.332462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:53.333349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:53.333792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:53.726498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:53.736925 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a3179e62-1b8d-44bd-bc62-a9a3cfbf2763 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1511 microversion: 2.1 time: 0.426583 Sep 13 16:56:53.739888 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2730/5534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:53 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:53.751628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-804327a0-b124-4a56-96d8-88166c8017b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-548152356_updated"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:53.760003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-804327a0-b124-4a56-96d8-88166c8017b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 737bd72f-bda7-491a-8a2f-66c7ec42ce8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:53.776157 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-804327a0-b124-4a56-96d8-88166c8017b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 737bd72f-bda7-491a-8a2f-66c7ec42ce8b could not be found. Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-804327a0-b124-4a56-96d8-88166c8017b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/servers/737bd72f-bda7-491a-8a2f-66c7ec42ce8b HTTP/1.1 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 80 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-548152356_updated"}} Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 737bd72f-bda7-491a-8a2f-66c7ec42ce8b could not be found. Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '737bd72f-bda7-491a-8a2f-66c7ec42ce8b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-548152356_updated'}}} Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737bd72f-bda7-491a-8a2f-66c7ec42ce8b could not be found. Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 13 16:56:53.782689 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737bd72f-bda7-491a-8a2f-66c7ec42ce8b could not be found. Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737bd72f-bda7-491a-8a2f-66c7ec42ce8b could not be found. Sep 13 16:56:53.787930 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:53.793652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-804327a0-b124-4a56-96d8-88166c8017b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 737bd72f-bda7-491a-8a2f-66c7ec42ce8b could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:53.794881 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-804327a0-b124-4a56-96d8-88166c8017b9 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "PUT /compute/v2.1/servers/737bd72f-bda7-491a-8a2f-66c7ec42ce8b" status: 404 len: 111 microversion: 2.1 time: 0.052669 Sep 13 16:56:53.795730 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2731/5535] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:56:53 2022] PUT /compute/v2.1/servers/737bd72f-bda7-491a-8a2f-66c7ec42ce8b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:56:53.805902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:53.820657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:53.821763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:53.990704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:53.992157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:53.992912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:53.994680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:53.995675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:53.996772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.018985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:56:54.019956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:56:54.020611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:56:54.021394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:56:54.024151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:56:54.042812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.061200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.065196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.066386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.067220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.070309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.114188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:56:54.126542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Getting quotas for user c2c12edf9f8d4b23bd1074facb2fad9d and project 080f8140d40642d9b47f0689e294887b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:56:54.159386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:56:54.162521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:56:54.283021 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92e03f85-f2b7-433a-b544-258bbb5db5bb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816785 Sep 13 16:56:54.283690 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2805/5536] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:56:54.296103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:54.301447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:54.311842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:54.345680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.346223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.346671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.351420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.363078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.363078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.484265 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1cd127c-726a-4635-8f2a-a9de2bd2ad14 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.685068 Sep 13 16:56:54.484929 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2732/5537] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Sep 13 16:56:53 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:54.514391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d364c34c-17bb-4bcb-89c9-4273568ec446 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:54.515094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d364c34c-17bb-4bcb-89c9-4273568ec446 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:54.654077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:54.662670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6751faa-21d0-4052-b56f-cbeb3b334a27 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.377791 Sep 13 16:56:54.664778 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2806/5538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:54 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:54.703516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73a77eb9-7485-49cc-a616-330ddc2089e9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'create', calling method: .version_select at 0x7fbeb4aa0670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-901658986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+jHYIo6c/vwYJus8tRrHGm19VrCDYIpiZZF6ewk3T/CycfTB6U8ADBffj7Np91G8V2c7MUvlc+9hFINy4zkvKGZbbZuORythATT2TEh0kNb1cXN6OgsU9sJAtvxIGUAQ=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:54.748173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-73a77eb9-7485-49cc-a616-330ddc2089e9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:56:54.761552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-73a77eb9-7485-49cc-a616-330ddc2089e9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for user c57ef3ccd1c74d67b86e8ea75aafd433 and project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:56:54.821005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73a77eb9-7485-49cc-a616-330ddc2089e9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.127549 Sep 13 16:56:54.823086 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2807/5539] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:56:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:54.844866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d364c34c-17bb-4bcb-89c9-4273568ec446 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:54.858311 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d364c34c-17bb-4bcb-89c9-4273568ec446 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1214 microversion: 2.1 time: 0.358478 Sep 13 16:56:54.859621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:54.860996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:54.865486 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2733/5540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:54 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:54.885215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:54.886463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:54.889528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.892074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.892977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.894031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.896802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.897635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.916577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.916577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.917985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:54.918754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:54.924404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:54.924878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:55.230243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:55.269233 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ad91272-53b8-4599-9308-bb759409d941 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1512 microversion: 2.1 time: 0.444691 Sep 13 16:56:55.274733 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2808/5541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:54 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:55.299260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:55.302541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:55.322664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:55.323585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:55.324352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:55.326270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:55.327056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:55.328128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:55.536931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:55.552110 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6dafa7d4-a313-4de8-a4d3-6968a04ef635 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.682997 Sep 13 16:56:55.566054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2734/5542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:54 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:55.587898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9797430b-de42-42d7-9f08-a768895c8bfd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9797430b-de42-42d7-9f08-a768895c8bfd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 HTTP/1.1 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 280 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.598073 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 13 16:56:55.604632 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:55.607634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9797430b-de42-42d7-9f08-a768895c8bfd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:55.608806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9797430b-de42-42d7-9f08-a768895c8bfd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "PUT /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 400 len: 619 microversion: 2.1 time: 0.027022 Sep 13 16:56:55.612300 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2735/5543] 10.222.0.61 () {60 vars in 1257 bytes} [Tue Sep 13 16:56:55 2022] PUT /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:56:55.623263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:55.627070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:55.643025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:55.644002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:55.645324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:55.649537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:55.651111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:55.651753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:55.673090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:55.850467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:55.863348 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd143bf4-164e-4890-91ae-7b6046c6ef2f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1511 microversion: 2.1 time: 0.570569 Sep 13 16:56:55.873990 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2809/5544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:55 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:55.915284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:55.916416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:55.947148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:55.948973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:55.952945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:55.954147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:55.964475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:55.966446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.102794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:56.126161 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-71fb26d3-0ef3-417c-834f-334706946083 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1266 microversion: 2.1 time: 0.223400 Sep 13 16:56:56.127262 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2810/5545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:55 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:56.140147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:56.141084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:56.150285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.151043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.151481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.152192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.152651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.153084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.254263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:56.267865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ae52f55-9f0e-4b94-be37-3062bf2b9d65 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.649182 Sep 13 16:56:56.268687 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2736/5546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:55 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:56.302494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:56.303872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:56.316575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.317272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.317854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.321042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.321651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.322254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.429155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:56.454162 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8748123a-8683-4338-99e8-023355d1dbf6 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1511 microversion: 2.1 time: 0.323882 Sep 13 16:56:56.454781 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2811/5547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:56 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:56.482264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:56.508402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:56.509383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:56.536615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.537359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.543068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.547894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.550478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.554930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:56.677715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:56.775057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:56.784707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:56.785523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:56.786763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.174671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b111d467-aa5c-4995-880d-e1f51146554c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.697619 Sep 13 16:56:57.191083 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2812/5548] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 16:56:56 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:57.206367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:57.210553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:57.223162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:57.223683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:57.224132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.224875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:57.225362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:57.226098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.373660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:57.393674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36d5c53c-143c-41a4-809c-18498d0e65c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1272 microversion: 2.1 time: 0.197686 Sep 13 16:56:57.397278 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2813/5549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:57 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:57.409485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:57.418016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:57.418843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:57.654506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:57.655797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:57.656446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.658523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:57.659244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:57.659920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.809409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:57.880545 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-334bf658-983c-4944-810e-ade68c65e606 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.480837 Sep 13 16:56:57.882261 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2814/5550] 10.222.0.61 () {58 vars in 1150 bytes} [Tue Sep 13 16:56:57 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:57.900907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:57.908719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:57.909652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:57.924320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:56:57.934129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:57.935201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:57.937182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.939744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:57.941792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:57.943309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:57.974904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:57.984306 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-164396f0-4ed5-43fb-aa14-02eb453933fd tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 1.688462 Sep 13 16:56:57.991467 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2737/5551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:56 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:58.020812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a85fba0d-b4f6-4c2a-8bd3-b9f5a8b68390 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a85fba0d-b4f6-4c2a-8bd3-b9f5a8b68390 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: request: PUT /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 HTTP/1.1 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 24 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: {"server": {"name": ""}} Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65', 'body': {'server': {'name': ''}}} Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '' Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 16:56:58.026668 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 13 16:56:58.033230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:56:58.035319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a85fba0d-b4f6-4c2a-8bd3-b9f5a8b68390 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:56:58.041046 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a85fba0d-b4f6-4c2a-8bd3-b9f5a8b68390 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "PUT /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 400 len: 108 microversion: 2.1 time: 0.026306 Sep 13 16:56:58.041948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2738/5552] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 16:56:58 2022] PUT /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 16:56:58.056221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:58.058748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:58.081650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:58.082200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:58.082649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:58.083368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:58.083838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:58.084277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:58.184029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:58.298452 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bea58cd0-ce96-4bf9-afaa-f76af0cb129b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.403436 Sep 13 16:56:58.299920 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2815/5553] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Sep 13 16:56:57 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:58.305464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-330483066", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "939027ea-8274-40af-b985-5e093192228e"}], "key_name": "tempest-TestNetworkBasicOps-901658986", "security_groups": [{"name": "tempest-secgroup-smoke-299860568"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:56:58.444082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] validate_networks() for [('939027ea-8274-40af-b985-5e093192228e', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:56:58.600937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:58.614103 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c92921c7-4f5d-4cd7-890e-f1841050f79b tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1506 microversion: 2.1 time: 0.567510 Sep 13 16:56:58.616709 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2739/5554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:58 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:58.631211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:58.678725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:58.688330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:58.709250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:58.709875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:58.726938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:58.727780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:58.732626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:58.733265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:58.990919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:59.129181 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b36f4c0-2fe3-4d33-a09f-ba4b7c9c7e61 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.511836 Sep 13 16:56:59.130640 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2740/5555] 10.222.0.61 () {58 vars in 1196 bytes} [Tue Sep 13 16:56:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:59.138042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:59.139124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:59.148828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.149493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.150219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.151476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.152079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.152792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.258009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:56:59.258552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:56:59.259222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:56:59.259771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:56:59.260336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:56:59.280956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.281468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.281965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.282705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.283398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.283977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.330588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:56:59.343697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:59.355231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for user c57ef3ccd1c74d67b86e8ea75aafd433 and project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:56:59.357427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b4ec3e2-82e1-4037-a8fb-60d49a091ff1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1272 microversion: 2.1 time: 0.225164 Sep 13 16:56:59.359855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2741/5556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:59 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:56:59.374073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:59.395567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:56:59.400501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:59.404095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': '1831854412', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:59.407123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:56:59.436533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.437288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.440029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.446146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.448040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.448734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.590050 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d27de322-4bff-4bd0-8c6a-e04a17d39948 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.288778 Sep 13 16:56:59.591032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2816/5557] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:56:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:56:59.604389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4670d3d-ab89-4698-8312-aeb791e9f208 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:59.606722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4670d3d-ab89-4698-8312-aeb791e9f208 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:56:59.697203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:56:59.858736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4670d3d-ab89-4698-8312-aeb791e9f208 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:59.892837 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4670d3d-ab89-4698-8312-aeb791e9f208 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1247 microversion: 2.1 time: 0.291134 Sep 13 16:56:59.894959 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2817/5558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:56:59 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1247 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:56:59.896964 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e54320f-2267-4454-9bd2-3628f601429f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?name=1831854412" status: 200 len: 346 microversion: 2.1 time: 0.535716 Sep 13 16:56:59.897786 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2742/5559] 10.222.0.61 () {58 vars in 1156 bytes} [Tue Sep 13 16:56:59 2022] GET /compute/v2.1/servers?name=1831854412 => generated 346 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:56:59.935587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:56:59.948179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:56:59.948880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:56:59.969943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.970479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.971162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:56:59.971937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:56:59.972410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:56:59.972845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.137883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:57:00.216200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ff94302-24ad-40e7-9478-506cf162b091 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.303437 Sep 13 16:57:00.219871 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2818/5560] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Sep 13 16:56:59 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:00.234195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:00.243589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:00.250242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-183185441', 'deleted': False, 'project_id': '6c5468ee1375411db9511ff69640ed52'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:57:00.261078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.261722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.262273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.263605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.265235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.266282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.386678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:00.387305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:00.417709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:57:00.421676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.425740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.428152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.429137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.429725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.430195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.523441 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb6893ee-d1a5-445d-a6bf-6f7deabbb374 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-183185441" status: 200 len: 346 microversion: 2.1 time: 0.293622 Sep 13 16:57:00.524535 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2743/5561] 10.222.0.61 () {58 vars in 1228 bytes} [Tue Sep 13 16:57:00 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-183185441 => generated 346 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:00.543888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:00.544558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:00.553468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.553468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.553468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.555922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.556521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.559451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.623570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:57:00.762518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4c723d3-02c5-488b-b739-1a1afa51c8df tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 204 len: 0 microversion: 2.1 time: 0.226709 Sep 13 16:57:00.763137 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2744/5562] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:00 2022] DELETE /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:57:00.774347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:00.778595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:00.791181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.791694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.793308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:00.794081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:00.794554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:00.797160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:01.236726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:01.239831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:01.245155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:01.253890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47268b81-afba-4ce0-aa03-62fed34cc793 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1517 microversion: 2.1 time: 0.486163 Sep 13 16:57:01.255634 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8132cc1-afbf-4ddc-a41a-b599ef1fd101 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.873806 Sep 13 16:57:01.260041 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2819/5563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:00 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:01.274659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:01.275863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:01.280310 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2745/5564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:00 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1517 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:01.290187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:01.294594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:01.295360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:01.296314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:01.296976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:01.297646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:01.809579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:01.821816 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fcadba61-b8e7-4e2c-948a-8acd2d36e278 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1243 microversion: 2.1 time: 0.558858 Sep 13 16:57:01.822999 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2820/5565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:01 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1243 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:02.284200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:02.284906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:02.300155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:02.302880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:02.304909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:02.307141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:02.307914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:02.309136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:02.309249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:02.310185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:02.330615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:02.332284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:02.332805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:02.342775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:02.343280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:02.343837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:02.799789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:02.808991 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78931019-9039-4a5e-b68d-a805a80fdae0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.530382 Sep 13 16:57:02.809598 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2746/5566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:02 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:02.820991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:02.832439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63698444-0d22-4eee-bc19-bfd5e2a8d4d0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1517 microversion: 2.1 time: 0.530233 Sep 13 16:57:02.836749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2821/5567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:02 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1517 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:02.846886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:02.847516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:02.857525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:02.860166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:02.860792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:02.861701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:02.864664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:02.865282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:02.969242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:02.997845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eaae4958-8065-4a53-9488-fe682c80ce03 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1299 microversion: 2.1 time: 0.155083 Sep 13 16:57:03.000983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2747/5568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:02 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:03.072227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-460f5cbc-4c0a-4578-94bf-6af73ccfaca3 req-44efcafe-896b-4f8d-b390-fb1279d247ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2659ee-3df6-4ba8-b11f-c8b526223d40", "tag": "4d557627-d564-46a8-8e97-247256052111"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:03.095801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-460f5cbc-4c0a-4578-94bf-6af73ccfaca3 req-44efcafe-896b-4f8d-b390-fb1279d247ee service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:03.096640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-460f5cbc-4c0a-4578-94bf-6af73ccfaca3 req-44efcafe-896b-4f8d-b390-fb1279d247ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:03.097270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-460f5cbc-4c0a-4578-94bf-6af73ccfaca3 req-44efcafe-896b-4f8d-b390-fb1279d247ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:03.122339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-460f5cbc-4c0a-4578-94bf-6af73ccfaca3 req-44efcafe-896b-4f8d-b390-fb1279d247ee service nova] Creating event network-changed:4d557627-d564-46a8-8e97-247256052111 for instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 on n-h1-857467-1 Sep 13 16:57:03.136464 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-460f5cbc-4c0a-4578-94bf-6af73ccfaca3 req-44efcafe-896b-4f8d-b390-fb1279d247ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069488 Sep 13 16:57:03.138577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2822/5569] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:03.832914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:03.834982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:03.853810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:03.860552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:03.861347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:03.874868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:03.877179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:03.877876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:03.882957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:03.883574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:03.886300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:03.887021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:03.890021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:03.896252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:03.898522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:03.899610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:04.309243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:04.319489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54c6d930-d2ab-46f2-8950-e530521ae878 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.490294 Sep 13 16:57:04.324950 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2748/5570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:03 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:04.330867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:04.334564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:04.347570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:04.351638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:04.357454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:04.358283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:04.359236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:04.359898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:04.360523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:04.594748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:04.609202 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69d802f7-dd1c-4042-bce4-a6c982907e1b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1305 microversion: 2.1 time: 0.282588 Sep 13 16:57:04.609853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2749/5571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:04 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1305 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:04.954138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d2c933cd-a106-432e-8050-23b7ace6d7ca req-3b550af0-9187-42ce-97ce-524a0ef8c91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef17809-c5b4-4cb7-82b5-04f4230c898a", "name": "network-vif-deleted", "tag": "fbfba143-5496-4524-8a26-650d71a2fa86"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:04.968162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:04.992645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d2c933cd-a106-432e-8050-23b7ace6d7ca req-3b550af0-9187-42ce-97ce-524a0ef8c91f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:04.993480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d2c933cd-a106-432e-8050-23b7ace6d7ca req-3b550af0-9187-42ce-97ce-524a0ef8c91f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:04.995444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d2c933cd-a106-432e-8050-23b7ace6d7ca req-3b550af0-9187-42ce-97ce-524a0ef8c91f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:05.082509 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d2c933cd-a106-432e-8050-23b7ace6d7ca req-3b550af0-9187-42ce-97ce-524a0ef8c91f service nova] Creating event network-vif-deleted:fbfba143-5496-4524-8a26-650d71a2fa86 for instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a on n-h2-857467-1 Sep 13 16:57:05.102074 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d2c933cd-a106-432e-8050-23b7ace6d7ca req-3b550af0-9187-42ce-97ce-524a0ef8c91f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151267 Sep 13 16:57:05.103848 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2750/5572] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:05.315046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:05.329741 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b26908ff-c214-439c-93ea-9c8b035e8ca0 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 200 len: 1517 microversion: 2.1 time: 1.469155 Sep 13 16:57:05.332518 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2823/5573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:03 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 1517 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:05.344212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:05.347582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:05.365355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:05.365958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:05.366411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:05.367129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:05.367597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:05.368032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:05.638929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:05.639554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:05.655288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:05.656276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:05.656928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:05.658628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:05.673427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:05.673762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:05.855599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:05.867305 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-acbde926-e683-4a5e-aea6-a6801795069f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1305 microversion: 2.1 time: 0.232228 Sep 13 16:57:05.874260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2824/5574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:05 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1305 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:06.103884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:06.110553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:06.119345 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b514fa8-dcd2-43e8-8c3e-c4a28b51e121 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.773885 Sep 13 16:57:06.120395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2751/5575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:05 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:06.359724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:06.360358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 9ef17809-c5b4-4cb7-82b5-04f4230c898a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:06.396720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.398898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.400860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.401997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.402619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.403529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.447718 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] HTTP exception thrown: Instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a could not be found. Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Request method failure captured: Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a HTTP/1.1 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILYNo5KmdMNRSKBUtN1NniClg5VFc87eD19_d05Og6iF-SoXnmAZLJKDcQ-PJPjw1wgwnzxcOMlpLyKn2vQ7wd80r4mBGZ3MOKi-JAMyKT27gZSt2f0BxPvjCl3pMfdOhDMNf8jghzJpXsiKRxnmXFVj5CjAxllbaMNhrfBWXcWPZno Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6c5468ee1375411db9511ff69640ed52 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c5468ee1375411db9511ff69640ed52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6c5468ee1375411db9511ff69640ed52 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServerFiltersTestJSON-1240920543-project Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: e7e557c82fca42388e4406f56bbb433f Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServerFiltersTestJSON-1240920543-project Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a could not be found. Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9ef17809-c5b4-4cb7-82b5-04f4230c898a'} Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a could not be found. Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a could not be found. Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:06.452308 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a could not be found. Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.456152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Returning 404 to user: Instance 9ef17809-c5b4-4cb7-82b5-04f4230c898a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:06.458896 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b3cf9b2-4881-46d9-8462-e18d5371fc1f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a" status: 404 len: 111 microversion: 2.1 time: 0.104972 Sep 13 16:57:06.458896 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2825/5576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:06 2022] GET /compute/v2.1/servers/9ef17809-c5b4-4cb7-82b5-04f4230c898a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:06.470640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:06.471458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:06.484295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.486548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.487117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.488786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.493110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.496361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.563317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:57:06.747841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:06.748683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:06.763596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.764328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.764952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.765855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.766471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.767052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.791558 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9546e2ac-f533-4171-aa3b-c32c770f3aad tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 204 len: 0 microversion: 2.1 time: 0.327180 Sep 13 16:57:06.792944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2752/5577] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:06 2022] DELETE /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:57:06.800581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e HTTP/1.1 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '282001d0-4ba5-4e1e-96fa-a48dc071852e'} Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:06.806235 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.809182 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.811284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:06.812350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b34712bb-51a2-466e-b558-9a7c014fc2ee tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "DELETE /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 404 len: 111 microversion: 2.1 time: 0.069122 Sep 13 16:57:06.815633 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2826/5578] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:06 2022] DELETE /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:57:06.815820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:06.816577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:06.822729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:06.825256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: 282001d0-4ba5-4e1e-96fa-a48dc071852e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:06.840915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.841516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.842043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.842835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.843301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.843732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.846951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.851013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.858542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.859334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.859839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.860324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.886275 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e HTTP/1.1 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '282001d0-4ba5-4e1e-96fa-a48dc071852e'} Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:06.891814 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. Sep 13 16:57:06.894875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:06.896589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance 282001d0-4ba5-4e1e-96fa-a48dc071852e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:06.899827 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-386512ec-fc8c-4392-bf69-65dee5be3429 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e" status: 404 len: 111 microversion: 2.1 time: 0.081730 Sep 13 16:57:06.901817 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2827/5579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:06 2022] GET /compute/v2.1/servers/282001d0-4ba5-4e1e-96fa-a48dc071852e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:06.911314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:06.914330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:06.927930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.933212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.933954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:06.934934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:06.936277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:06.938040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:07.561082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:07.572924 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-adad95f7-7afe-432b-ba3c-235d8835e42d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1517 microversion: 2.1 time: 0.772943 Sep 13 16:57:07.589196 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2753/5580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:06 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1517 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:07.589196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:07.589196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:07.604848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:07.605671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:07.606303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:07.608423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:07.610031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:07.610031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:07.683157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:57:07.956342 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-589c20cf-b870-46a7-bc8b-3e032cbbe7a5 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 204 len: 0 microversion: 2.1 time: 0.376888 Sep 13 16:57:07.957149 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2754/5581] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:07 2022] DELETE /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:57:07.963013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:07.964773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:07.997903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.010333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.011014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.012026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.012608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.013116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.211559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:08.245904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aaaec54c-7f52-4ce1-8fa6-fb8a662d4082 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 1.341460 Sep 13 16:57:08.246401 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2828/5582] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:06 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:08.300482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:08.302373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:08.347682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.356878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.357448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.358446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.359762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.360385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.721026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:08.735350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57a3e777-2d66-4c33-a574-137355a73ecb tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.467120 Sep 13 16:57:08.738154 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2829/5583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:08 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:08.744474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-844ffe54-35a1-45c0-a48c-d8a46f27876c req-2f7805b3-5f08-4737-9e7c-a76d666a9d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4a80a-d5be-48e5-88ba-595109dfaf96", "tag": "83d91a64-6d6d-4caf-8cea-9f62325069c0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:08.759681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:08.762610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-844ffe54-35a1-45c0-a48c-d8a46f27876c req-2f7805b3-5f08-4737-9e7c-a76d666a9d7c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.763290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-844ffe54-35a1-45c0-a48c-d8a46f27876c req-2f7805b3-5f08-4737-9e7c-a76d666a9d7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.763782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-844ffe54-35a1-45c0-a48c-d8a46f27876c req-2f7805b3-5f08-4737-9e7c-a76d666a9d7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.769892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49328d69-540b-4e5b-a3e4-37a49eaef118 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.811291 Sep 13 16:57:08.771145 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2755/5584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:07 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:08.783848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:08.784718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:08.796491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.798331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.798331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.799926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-844ffe54-35a1-45c0-a48c-d8a46f27876c req-2f7805b3-5f08-4737-9e7c-a76d666a9d7c service nova] Creating event network-changed:83d91a64-6d6d-4caf-8cea-9f62325069c0 for instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 on n-h2-857467-1 Sep 13 16:57:08.800697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:08.801536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:08.802098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:08.809307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-844ffe54-35a1-45c0-a48c-d8a46f27876c req-2f7805b3-5f08-4737-9e7c-a76d666a9d7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069389 Sep 13 16:57:08.809959 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2830/5585] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:09.265192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:09.270314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:09.271720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:09.282276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:09.283906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:09.290406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:09.291466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:09.292206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:09.293175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:09.296173 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ebe9d86-609f-4680-8130-dc6199f8a440 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1517 microversion: 2.1 time: 0.523705 Sep 13 16:57:09.296784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2756/5586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:08 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1517 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:09.612776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:09.629115 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d7c68bc-257b-4661-9bca-5aa3a8b850a0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.356977 Sep 13 16:57:09.630027 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2831/5587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:09 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:09.776329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:09.776969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:09.803060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:09.804757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:09.817849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:09.821211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:09.828323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:09.829436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:09.832972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:09.833268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:09.834219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:09.836254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:09.836937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:09.839097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:09.843267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:09.845637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:09.867016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:10.020229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:10.185053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:10.190339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:10.195740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92a07bd0-d3cc-4c09-9243-224187b676b7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.397555 Sep 13 16:57:10.197187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2832/5588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:09 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:10.201436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea3ebeda-b18c-489e-8c78-aff30ef450a4 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.441257 Sep 13 16:57:10.202392 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2757/5589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:09 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:10.335431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:10.345316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:10.368623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:10.369318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:10.369963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:10.370899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:10.371866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:10.373287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:10.653645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:10.654326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:10.656343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:10.662551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:10.663806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:10.664404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:10.665286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:10.665757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:10.666220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:10.874071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:10.887215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9bba8157-830c-427f-95eb-4026be776f57 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1517 microversion: 2.1 time: 0.560882 Sep 13 16:57:10.888388 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2833/5590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:10 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1517 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:10.938125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:10.950339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4325b9a-3e2b-477b-8e05-8e746322a501 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.300777 Sep 13 16:57:10.959197 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2758/5591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:10 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:11.219132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:11.220032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:11.226347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:11.227315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:11.237139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.240897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.241695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.242367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:11.243180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.244110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.244770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:11.245437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.246454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.247109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:11.248828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.250256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:11.552084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:11.564467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-addd4151-5e06-442f-a226-bcb9251f960a tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1512 microversion: 2.1 time: 0.342561 Sep 13 16:57:11.572238 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2759/5592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:11 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:11.627258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c332af6b-c238-4764-82d7-c04f728fb48a req-366e45e8-f6ac-4f98-b036-89d98fd0c75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2659ee-3df6-4ba8-b11f-c8b526223d40", "name": "network-vif-plugged", "status": "completed", "tag": "4d557627-d564-46a8-8e97-247256052111"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:11.653450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c332af6b-c238-4764-82d7-c04f728fb48a req-366e45e8-f6ac-4f98-b036-89d98fd0c75a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.654403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c332af6b-c238-4764-82d7-c04f728fb48a req-366e45e8-f6ac-4f98-b036-89d98fd0c75a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.656867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c332af6b-c238-4764-82d7-c04f728fb48a req-366e45e8-f6ac-4f98-b036-89d98fd0c75a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:11.694330 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c332af6b-c238-4764-82d7-c04f728fb48a req-366e45e8-f6ac-4f98-b036-89d98fd0c75a service nova] Creating event network-vif-plugged:4d557627-d564-46a8-8e97-247256052111 for instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 on n-h1-857467-1 Sep 13 16:57:11.707663 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c332af6b-c238-4764-82d7-c04f728fb48a req-366e45e8-f6ac-4f98-b036-89d98fd0c75a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085276 Sep 13 16:57:11.712800 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2760/5593] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:11.915114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:11.916740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:11.932447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.935486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.937068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:11.940199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:11.941817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:11.943336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:12.115466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:12.125381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52c5bba8-d66a-46e1-9c40-2eec12597627 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.909864 Sep 13 16:57:12.138637 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2834/5594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:11 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:12.150017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:12.151555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:12.158612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:12.159449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:12.160690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:12.162203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:12.163505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:12.164363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:12.293475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:12.335987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f0c5b77-2bf2-4ff3-8245-b7cedefd2e3d tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1475 microversion: 2.1 time: 0.426374 Sep 13 16:57:12.338240 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2761/5595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:11 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1475 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:12.355688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8f9e728b-eb1a-4a63-aadf-a2b7c93fff43 req-5ee499e1-c344-46bc-b738-f7f3d58f2b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6928ce8-dbfc-445f-835a-1628c71e2999", "name": "network-vif-deleted", "tag": "9d5da709-eaa9-487e-b89d-0dc5c954b6b0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:12.396728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8f9e728b-eb1a-4a63-aadf-a2b7c93fff43 req-5ee499e1-c344-46bc-b738-f7f3d58f2b2b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:12.408006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8f9e728b-eb1a-4a63-aadf-a2b7c93fff43 req-5ee499e1-c344-46bc-b738-f7f3d58f2b2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:12.410175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8f9e728b-eb1a-4a63-aadf-a2b7c93fff43 req-5ee499e1-c344-46bc-b738-f7f3d58f2b2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:12.445559 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8f9e728b-eb1a-4a63-aadf-a2b7c93fff43 req-5ee499e1-c344-46bc-b738-f7f3d58f2b2b service nova] Creating event network-vif-deleted:9d5da709-eaa9-487e-b89d-0dc5c954b6b0 for instance a6928ce8-dbfc-445f-835a-1628c71e2999 on n-h1-857467-1 Sep 13 16:57:12.457120 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8f9e728b-eb1a-4a63-aadf-a2b7c93fff43 req-5ee499e1-c344-46bc-b738-f7f3d58f2b2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111808 Sep 13 16:57:12.462896 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2762/5596] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:12.604348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:12.605062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:12.636306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:12.638692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:12.639159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:12.639903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:12.640377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:12.648780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:12.795087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:12.813001 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff8c2cfe-4b11-4f66-836c-068dddc54738 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.667911 Sep 13 16:57:12.815250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2835/5597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:12 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:12.917488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:12.931687 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2831837d-c68e-4af3-ab6d-b54eb04e6778 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1470 microversion: 2.1 time: 0.332133 Sep 13 16:57:12.934936 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2763/5598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:12 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:13.160867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:13.162411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:13.172516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.173155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.173676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.174500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.175238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.175744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.361486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:13.363644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:13.375877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.376157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.381135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.383551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.384061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.384512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.443359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.443964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.444455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.445041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lazy-loading 'fault' on Instance uuid a6928ce8-dbfc-445f-835a-1628c71e2999 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:13.485227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:13.495961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-339b408d-12c0-42f6-8de7-6598d778c0f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1314 microversion: 2.1 time: 0.344176 Sep 13 16:57:13.497901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2836/5599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:13 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:13.508590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:13.517520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7cf9ff45-ca9e-42ee-8914-f99e019b1c6c tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 200 len: 1311 microversion: 2.1 time: 0.160130 Sep 13 16:57:13.518426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2764/5600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:13 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:13.842788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:13.843404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:13.856415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.857800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.860010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.862508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.863149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.863733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.963431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:13.964050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:13.986239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.989634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.990409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:13.992432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:13.993217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:13.993673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.043493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.044217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.044813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.045578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'fault' on Instance uuid d7eedcc1-56b5-4258-9f98-c39305cd7e65 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:14.134654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:14.139493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:14.145566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee327c93-a884-4df0-b3d8-cc111cbae472 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1306 microversion: 2.1 time: 0.189496 Sep 13 16:57:14.167135 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2765/5601] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:13 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1306 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:14.527026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:14.527719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:14.553079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.554183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.558202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.559379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.560148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.560809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.644286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:14.655876 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32d1c168-15b8-418b-9d8c-6e8309792f70 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.819773 Sep 13 16:57:14.674604 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2837/5602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:13 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:14.682773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:14.683700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: a6928ce8-dbfc-445f-835a-1628c71e2999] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:14.696212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.700553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.701192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.703553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.704136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.710832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.732485 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] HTTP exception thrown: Instance a6928ce8-dbfc-445f-835a-1628c71e2999 could not be found. Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Request method failure captured: Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 HTTP/1.1 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILYNo5KmdMNRSKBUtN1NniClg5VFc87eD19_d05Og6iF-SoXnmAZLJKDcQ-PJPjw1wgwnzxcOMlpLyKn2vQ7wd80r4mBGZ3MOKi-JAMyKT27gZSt2f0BxPvjCl3pMfdOhDMNf8jghzJpXsiKRxnmXFVj5CjAxllbaMNhrfBWXcWPZno Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6c5468ee1375411db9511ff69640ed52 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c5468ee1375411db9511ff69640ed52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6c5468ee1375411db9511ff69640ed52 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServerFiltersTestJSON-1240920543-project Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: e7e557c82fca42388e4406f56bbb433f Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServerFiltersTestJSON-1240920543-project Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance a6928ce8-dbfc-445f-835a-1628c71e2999 could not be found. Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'a6928ce8-dbfc-445f-835a-1628c71e2999'} Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6928ce8-dbfc-445f-835a-1628c71e2999 could not be found. Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6928ce8-dbfc-445f-835a-1628c71e2999 could not be found. Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:14.734488 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6928ce8-dbfc-445f-835a-1628c71e2999 could not be found. Sep 13 16:57:14.737713 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:14.739898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Returning 404 to user: Instance a6928ce8-dbfc-445f-835a-1628c71e2999 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:14.741801 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ea4a385-1fbe-48f9-afd4-1962fc3b438f tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999" status: 404 len: 111 microversion: 2.1 time: 0.065953 Sep 13 16:57:14.743150 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2838/5603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:14 2022] GET /compute/v2.1/servers/a6928ce8-dbfc-445f-835a-1628c71e2999 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:14.748388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-61aa6263-5ef3-4642-976b-a94d94f95a7d req-b63fa4fc-d1a3-449d-8dd9-06d31dd5838b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7eedcc1-56b5-4258-9f98-c39305cd7e65", "name": "network-vif-deleted", "tag": "dfc168c0-711c-4893-9a35-c5d006a6b6bd"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:14.760611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-61aa6263-5ef3-4642-976b-a94d94f95a7d req-b63fa4fc-d1a3-449d-8dd9-06d31dd5838b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.762049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-61aa6263-5ef3-4642-976b-a94d94f95a7d req-b63fa4fc-d1a3-449d-8dd9-06d31dd5838b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.762809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-61aa6263-5ef3-4642-976b-a94d94f95a7d req-b63fa4fc-d1a3-449d-8dd9-06d31dd5838b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.790789 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-61aa6263-5ef3-4642-976b-a94d94f95a7d req-b63fa4fc-d1a3-449d-8dd9-06d31dd5838b service nova] Creating event network-vif-deleted:dfc168c0-711c-4893-9a35-c5d006a6b6bd for instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 on n-h1-857467-1 Sep 13 16:57:14.796564 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-61aa6263-5ef3-4642-976b-a94d94f95a7d req-b63fa4fc-d1a3-449d-8dd9-06d31dd5838b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051785 Sep 13 16:57:14.797496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2839/5604] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:14.805011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:14.806402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:14.814966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.815870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.816592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.817601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.818329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.819035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.851648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:57:14.858702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:14.875892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:14.915086 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63d29d1a-0189-4bfd-8517-7fb067f948b3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1501 microversion: 2.1 time: 0.395491 Sep 13 16:57:14.915636 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2766/5605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:14 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1501 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:14.944648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:14.946191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:14.955559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.956745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.957665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:14.959229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:14.960044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:14.960928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.000842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7db0c0f1-0559-4b37-9ac0-6e93ef7a0069 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "DELETE /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 204 len: 0 microversion: 2.1 time: 0.201516 Sep 13 16:57:15.001814 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2840/5606] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:14 2022] DELETE /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:57:15.014222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:15.015304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:15.024164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.024939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.026523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.027942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.028722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.029329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.073888 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a308baa-6958-420b-9dcf-a8d2ee7b15c7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40/action" status: 202 len: 0 microversion: 2.1 time: 0.136612 Sep 13 16:57:15.079204 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2767/5607] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:57:14 2022] POST /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:57:15.086030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:15.088742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:15.096169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.096864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.097457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.098513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.099262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.099851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.275169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:15.290768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:15.293196 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c84bed25-cc0a-4ee5-a602-3caf45e8dae4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1506 microversion: 2.1 time: 0.212222 Sep 13 16:57:15.294019 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2768/5608] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:15 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:15.301029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:15.301864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:15.304609 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-72bfca7a-96b8-411a-8703-13071be902ab tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1518 microversion: 2.1 time: 0.293157 Sep 13 16:57:15.305606 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2841/5609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:15 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1518 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:15.331274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.332344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.333021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.334490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.335062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.335582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.380151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.381064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.382467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.383026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lazy-loading 'fault' on Instance uuid d7eedcc1-56b5-4258-9f98-c39305cd7e65 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:15.426391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '156a39f4db5f465da2c19d927fc0b8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b38fb1b5ed4c3daa5ff12d3c2239ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:15.434174 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e39be7f5-3ac5-470e-aaa3-114ca70e1a2c tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 200 len: 1306 microversion: 2.1 time: 0.138960 Sep 13 16:57:15.445469 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2769/5610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:15 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 1306 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:15.687804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:15.688437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:15.696025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.696774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.697867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.698742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:15.699347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:15.699913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:15.959717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:15.968733 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-503edad2-e4a2-4efd-8daa-e27223f3bc08 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.284649 Sep 13 16:57:15.969981 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2842/5611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:15 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:16.320027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:16.321932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:16.331463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:16.332472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:16.348796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.348796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.348796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.348796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.348796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.348796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.349247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.349247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.349437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.351469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.352828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.353587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.622858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:16.649282 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-594261c1-0048-46b3-adce-b1fbfa381373 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1506 microversion: 2.1 time: 0.331195 Sep 13 16:57:16.650483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2770/5612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:16 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:16.675757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:16.676648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] [instance: d7eedcc1-56b5-4258-9f98-c39305cd7e65] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:16.695175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.695991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.696607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.697738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.698419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.699045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.716250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:16.720449 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] HTTP exception thrown: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 could not be found. Sep 13 16:57:16.734438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0da4ec4-9709-43b7-8c6a-ccc74d4ad048 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1518 microversion: 2.1 time: 0.408699 Sep 13 16:57:16.735336 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2843/5613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:16 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1518 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Request method failure captured: Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 HTTP/1.1 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILVmWpN7x_2GXWdmri49UuJgXg9oCLb_rdlx3WYPQCJT-eA86ZjXb1-tWYjurJ0S9UQUqE4xy0SIRyU46CBMyy-Pd_OCLOe5KgoPFQ17D5rYUjcjdo2d3_SpsqeeJfenCG93yoeOQcc8WhBhhWfXM0bbbncBuzTgTx6MnNn7INKgiYM Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/74b38fb1b5ed4c3daa5ff12d3c2239ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 74b38fb1b5ed4c3daa5ff12d3c2239ce Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-902503774 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 156a39f4db5f465da2c19d927fc0b8f2 Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-902503774-project Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 could not be found. Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'd7eedcc1-56b5-4258-9f98-c39305cd7e65'} Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 could not be found. Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 could not be found. Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:16.751274 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 could not be found. Sep 13 16:57:16.755939 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:16.758319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] Returning 404 to user: Instance d7eedcc1-56b5-4258-9f98-c39305cd7e65 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:16.759552 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98534404-6ff3-4858-837b-e0ac07960912 tempest-ServersNegativeTestJSON-902503774 tempest-ServersNegativeTestJSON-902503774-project] 10.222.0.61 "GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65" status: 404 len: 111 microversion: 2.1 time: 0.091347 Sep 13 16:57:16.760149 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2771/5614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:16 2022] GET /compute/v2.1/servers/d7eedcc1-56b5-4258-9f98-c39305cd7e65 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:16.823598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-519f651d-6357-45a5-802a-471936903cde req-868dd984-426a-4a8a-8e09-1a95f848ac4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da4a80a-d5be-48e5-88ba-595109dfaf96", "name": "network-vif-plugged", "status": "completed", "tag": "83d91a64-6d6d-4caf-8cea-9f62325069c0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:16.853168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-519f651d-6357-45a5-802a-471936903cde req-868dd984-426a-4a8a-8e09-1a95f848ac4e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:16.854220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-519f651d-6357-45a5-802a-471936903cde req-868dd984-426a-4a8a-8e09-1a95f848ac4e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:16.854930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-519f651d-6357-45a5-802a-471936903cde req-868dd984-426a-4a8a-8e09-1a95f848ac4e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:16.888443 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-519f651d-6357-45a5-802a-471936903cde req-868dd984-426a-4a8a-8e09-1a95f848ac4e service nova] Creating event network-vif-plugged:83d91a64-6d6d-4caf-8cea-9f62325069c0 for instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 on n-h2-857467-1 Sep 13 16:57:16.895594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-519f651d-6357-45a5-802a-471936903cde req-868dd984-426a-4a8a-8e09-1a95f848ac4e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080332 Sep 13 16:57:16.898075 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2844/5615] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:57:16.995064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:16.996474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:17.022809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:17.028558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:17.030495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:17.031584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:17.032680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:17.033353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:17.280432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:17.294852 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0fa14e63-7d8f-4571-a285-0bca91e5119f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.306127 Sep 13 16:57:17.295457 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2772/5616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:16 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:17.690883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:17.691604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:17.706637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:17.707763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:17.708652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:17.709587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:17.710255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:17.711025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:17.762806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:17.763965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:17.801724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:17.804432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:17.805463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:17.807907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:17.809872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:17.811167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:17.948032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:17.965239 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-181a23aa-92d9-47f1-9626-0304eb4c6eeb tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1476 microversion: 2.1 time: 0.209869 Sep 13 16:57:17.981361 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2773/5617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:17 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:18.238071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a5a013ad-f88a-49f4-bac9-6fc73f81ada7 req-9c88b36d-0d10-48da-a017-cbb91897ae09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37098b61-3180-4011-b6e0-b705b7ac00d7", "name": "network-vif-deleted", "tag": "0d407450-392f-4caa-9bad-41c34aa655d9"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:18.272612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5a013ad-f88a-49f4-bac9-6fc73f81ada7 req-9c88b36d-0d10-48da-a017-cbb91897ae09 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:18.273443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5a013ad-f88a-49f4-bac9-6fc73f81ada7 req-9c88b36d-0d10-48da-a017-cbb91897ae09 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:18.274531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5a013ad-f88a-49f4-bac9-6fc73f81ada7 req-9c88b36d-0d10-48da-a017-cbb91897ae09 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:18.310097 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a5a013ad-f88a-49f4-bac9-6fc73f81ada7 req-9c88b36d-0d10-48da-a017-cbb91897ae09 service nova] Creating event network-vif-deleted:0d407450-392f-4caa-9bad-41c34aa655d9 for instance 37098b61-3180-4011-b6e0-b705b7ac00d7 on n-h1-857467-1 Sep 13 16:57:18.326135 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a5a013ad-f88a-49f4-bac9-6fc73f81ada7 req-9c88b36d-0d10-48da-a017-cbb91897ae09 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089756 Sep 13 16:57:18.327484 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2774/5618] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:57:18.338369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:18.344709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:18.362150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:18.366714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:18.373887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:18.376291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:18.376867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:18.378299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:18.519014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:18.531436 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a5315620-e8a2-422a-bfd0-a2256a41091c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1486 microversion: 2.1 time: 0.854604 Sep 13 16:57:18.535049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2845/5619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:17 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1486 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:18.562675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:18.563222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:18.574144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:18.574645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:18.575078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:18.575803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:18.576262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:18.576689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:18.631500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lazy-loading 'flavor' on Instance uuid 9e2659ee-3df6-4ba8-b11f-c8b526223d40 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:18.983144 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11edc7a2-0551-42e6-85f8-f4b0a842a318 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40/action" status: 202 len: 0 microversion: 2.1 time: 0.425147 Sep 13 16:57:18.984290 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2846/5620] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:57:18 2022] POST /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:57:18.991511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:19.002753 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff6890dd-8c0b-45f4-ad62-cbe207b54776 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1372 microversion: 2.1 time: 0.673817 Sep 13 16:57:19.003354 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2775/5621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:18 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1372 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:19.013241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:19.014484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:19.030489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:19.036304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:19.037739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:19.039599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:19.042044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:19.042762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:19.149906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:19.149906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:19.154086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:19.154086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lazy-loading 'fault' on Instance uuid 37098b61-3180-4011-b6e0-b705b7ac00d7 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:19.243303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1965415066", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "d5b0a7b5-d314-4e04-9504-708fdff97db3"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:19.327235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e557c82fca42388e4406f56bbb433f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5468ee1375411db9511ff69640ed52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:19.336164 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51f6cb5a-3a96-436a-abc6-59b58bbcffc1 tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 200 len: 1311 microversion: 2.1 time: 0.331507 Sep 13 16:57:19.336850 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2776/5622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:19 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:19.342028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:19.342856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:19.351868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:19.352375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:19.352980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:19.354346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:19.355153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:19.355838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:19.380841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] validate_networks() for [('d5b0a7b5-d314-4e04-9504-708fdff97db3', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:57:19.859446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:19.874495 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-386f778f-3391-48b8-8a84-a29f453d395b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1492 microversion: 2.1 time: 0.532110 Sep 13 16:57:19.885973 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2777/5623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:19 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1492 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:20.004222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:57:20.004663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:57:20.005253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:57:20.005943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:57:20.007688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:57:20.026601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.028856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.029313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.030121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.030590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.031022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:20.031477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.032280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:20.056710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.058107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.058757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.061631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.063739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.064515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.065508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Getting quotas for project 7c23a6a694804d418e65ea9a302d116b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:57:20.076427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Getting quotas for user b701d9d0eec04da98436d41bcfe1c302 and project 7c23a6a694804d418e65ea9a302d116b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:57:20.105806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:57:20.108271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:57:20.163748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:20.191096 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c43793a1-cabc-4841-8610-638c4e39bcc1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205295 Sep 13 16:57:20.191752 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2847/5624] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:57:20.203680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99a74264-1c7f-4215-94d6-8e6c92bc7569 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:20.204787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99a74264-1c7f-4215-94d6-8e6c92bc7569 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:20.276698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-99a74264-1c7f-4215-94d6-8e6c92bc7569 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:20.289383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99a74264-1c7f-4215-94d6-8e6c92bc7569 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1225 microversion: 2.1 time: 0.089856 Sep 13 16:57:20.292039 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2848/5625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:20 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:20.361268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:20.362143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] [instance: 37098b61-3180-4011-b6e0-b705b7ac00d7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:20.374327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.375787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.376725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.377679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.378434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.379178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.402862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] HTTP exception thrown: Instance 37098b61-3180-4011-b6e0-b705b7ac00d7 could not be found. Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Request method failure captured: Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 HTTP/1.1 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILYNo5KmdMNRSKBUtN1NniClg5VFc87eD19_d05Og6iF-SoXnmAZLJKDcQ-PJPjw1wgwnzxcOMlpLyKn2vQ7wd80r4mBGZ3MOKi-JAMyKT27gZSt2f0BxPvjCl3pMfdOhDMNf8jghzJpXsiKRxnmXFVj5CjAxllbaMNhrfBWXcWPZno Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6c5468ee1375411db9511ff69640ed52 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6c5468ee1375411db9511ff69640ed52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6c5468ee1375411db9511ff69640ed52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6c5468ee1375411db9511ff69640ed52 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1240920543 Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ListServerFiltersTestJSON-1240920543-project Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: e7e557c82fca42388e4406f56bbb433f Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ListServerFiltersTestJSON-1240920543-project Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 37098b61-3180-4011-b6e0-b705b7ac00d7 could not be found. Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '37098b61-3180-4011-b6e0-b705b7ac00d7'} Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37098b61-3180-4011-b6e0-b705b7ac00d7 could not be found. Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37098b61-3180-4011-b6e0-b705b7ac00d7 could not be found. Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:20.407153 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37098b61-3180-4011-b6e0-b705b7ac00d7 could not be found. Sep 13 16:57:20.410362 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:20.413791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] Returning 404 to user: Instance 37098b61-3180-4011-b6e0-b705b7ac00d7 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:20.415023 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fdf93ff-7c26-4277-9a75-072a39e23b5b tempest-ListServerFiltersTestJSON-1240920543 tempest-ListServerFiltersTestJSON-1240920543-project] 10.222.0.61 "GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7" status: 404 len: 111 microversion: 2.1 time: 0.058934 Sep 13 16:57:20.416157 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2849/5626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:20 2022] GET /compute/v2.1/servers/37098b61-3180-4011-b6e0-b705b7ac00d7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:20.482893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:20.509468 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d412369-e49e-493d-a762-cc104f0afe2c tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1543 microversion: 2.1 time: 0.484406 Sep 13 16:57:20.515207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2778/5627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:20 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1543 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:20.541047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:20.542424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:20.549816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.550703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.551412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.552631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.554850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.555722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.901922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:20.902629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:20.922668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.923505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.924351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:20.925278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:20.934947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:20.936412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:21.005370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:21.015630 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64cccb0d-f203-4d79-b89f-3b5e460a3aa3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1543 microversion: 2.1 time: 0.479421 Sep 13 16:57:21.032225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2850/5628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:20 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1543 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:21.292607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:21.308397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00206e49-0755-4522-b069-0a9a2416a992 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1513 microversion: 2.1 time: 0.411647 Sep 13 16:57:21.310523 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2779/5629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:20 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1513 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:21.316351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:21.317214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:21.340133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:21.341674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:21.344387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:21.345255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:21.345862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:21.347728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:21.583187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:21.595084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab774dbf-f8f5-444f-83f8-fed2f788810c tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1277 microversion: 2.1 time: 0.282702 Sep 13 16:57:21.598081 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2851/5630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:21 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:22.345082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:22.348385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:22.370732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:22.371476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:22.377235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:22.378372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:22.379004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:22.381253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:22.621771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:22.622568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:22.633804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:22.634350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:22.634800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:22.635523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:22.635988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:22.636421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:22.857224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:22.871340 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77994a1d-da11-4d09-92fb-8f312fb580d9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1513 microversion: 2.1 time: 0.536384 Sep 13 16:57:22.892895 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2780/5631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:22 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1513 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:23.209714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:23.218650 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0c2bd10a-da18-4d2d-9e63-c0e40b8dd9a3 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1283 microversion: 2.1 time: 0.600662 Sep 13 16:57:23.219781 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2852/5632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:22 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1283 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:23.919796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:23.920449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:23.940075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:23.940589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:23.941040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:23.941773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:23.946228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:23.946679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:24.243490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:24.244787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:24.261540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:24.262416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:24.263867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:24.264786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:24.267503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:24.268157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:24.353230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:24.362244 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a2cebdb-2018-4e9f-bd76-807dd7e66595 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1513 microversion: 2.1 time: 0.448704 Sep 13 16:57:24.363475 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2781/5633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:23 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1513 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:24.475886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:24.485714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e37f1dfb-06aa-46b0-8661-e6285c8cbb3e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1283 microversion: 2.1 time: 0.247073 Sep 13 16:57:24.498610 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2853/5634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:24 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1283 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:25.153611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2b086988-25a4-487a-8deb-ff9b27368643 req-02899495-23dc-442e-a06d-e8ab4fa8a15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4a80a-d5be-48e5-88ba-595109dfaf96", "tag": "83d91a64-6d6d-4caf-8cea-9f62325069c0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:25.191575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2b086988-25a4-487a-8deb-ff9b27368643 req-02899495-23dc-442e-a06d-e8ab4fa8a15b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:25.198115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2b086988-25a4-487a-8deb-ff9b27368643 req-02899495-23dc-442e-a06d-e8ab4fa8a15b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:25.198730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2b086988-25a4-487a-8deb-ff9b27368643 req-02899495-23dc-442e-a06d-e8ab4fa8a15b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:25.216136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:25.265505 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2b086988-25a4-487a-8deb-ff9b27368643 req-02899495-23dc-442e-a06d-e8ab4fa8a15b service nova] Creating event network-changed:83d91a64-6d6d-4caf-8cea-9f62325069c0 for instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 on n-h2-857467-1 Sep 13 16:57:25.284462 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2b086988-25a4-487a-8deb-ff9b27368643 req-02899495-23dc-442e-a06d-e8ab4fa8a15b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.621802 Sep 13 16:57:25.294207 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2782/5635] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:25.388208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:25.389418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:25.408396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:25.408910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:25.409359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:25.410126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:25.410593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:25.411030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:25.528564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:25.529367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:25.536386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:25.558629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:25.562674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:25.563512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:25.564010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:25.564466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:25.948403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:25.956318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10eeb829-0b16-44f3-9242-2c133dce2e8f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1513 microversion: 2.1 time: 0.572961 Sep 13 16:57:25.966199 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2854/5636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:25 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1513 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:25.971016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2fd50134-b9c5-48c5-8170-64a1b2d0de80 req-3ea22907-f2d0-4c01-a0d4-5696237a39af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2659ee-3df6-4ba8-b11f-c8b526223d40", "name": "network-vif-plugged", "status": "completed", "tag": "4d557627-d564-46a8-8e97-247256052111"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:26.004301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2fd50134-b9c5-48c5-8170-64a1b2d0de80 req-3ea22907-f2d0-4c01-a0d4-5696237a39af service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:26.005399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2fd50134-b9c5-48c5-8170-64a1b2d0de80 req-3ea22907-f2d0-4c01-a0d4-5696237a39af service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:26.005399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2fd50134-b9c5-48c5-8170-64a1b2d0de80 req-3ea22907-f2d0-4c01-a0d4-5696237a39af service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:26.058849 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2fd50134-b9c5-48c5-8170-64a1b2d0de80 req-3ea22907-f2d0-4c01-a0d4-5696237a39af service nova] Creating event network-vif-plugged:4d557627-d564-46a8-8e97-247256052111 for instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 on n-h1-857467-1 Sep 13 16:57:26.073090 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2fd50134-b9c5-48c5-8170-64a1b2d0de80 req-3ea22907-f2d0-4c01-a0d4-5696237a39af service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105534 Sep 13 16:57:26.082036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2855/5637] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:26.665337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:26.686006 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2acf28be-c90a-4878-8c02-791204ad0833 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 1.163090 Sep 13 16:57:26.686934 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2783/5638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:25 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:26.986555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:26.986555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:26.994340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:26.996326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:26.997071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:26.998277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:27.000522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:27.001036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:27.105026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-71774a7e-c79e-4e52-b835-9d0a6ed292fb req-73eb73bb-2aed-456e-b95b-aac28784e307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf", "tag": "d3eb052f-4029-4049-b7e7-2b58da25f867"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:27.163800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-71774a7e-c79e-4e52-b835-9d0a6ed292fb req-73eb73bb-2aed-456e-b95b-aac28784e307 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:27.165159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-71774a7e-c79e-4e52-b835-9d0a6ed292fb req-73eb73bb-2aed-456e-b95b-aac28784e307 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:27.167087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-71774a7e-c79e-4e52-b835-9d0a6ed292fb req-73eb73bb-2aed-456e-b95b-aac28784e307 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:27.190535 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-71774a7e-c79e-4e52-b835-9d0a6ed292fb req-73eb73bb-2aed-456e-b95b-aac28784e307 service nova] Creating event network-changed:d3eb052f-4029-4049-b7e7-2b58da25f867 for instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf on n-h1-857467-1 Sep 13 16:57:27.197980 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-71774a7e-c79e-4e52-b835-9d0a6ed292fb req-73eb73bb-2aed-456e-b95b-aac28784e307 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100067 Sep 13 16:57:27.199849 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2784/5639] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:27.426048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:27.449229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd69d338-d28e-48dd-8f11-d390e716ebcd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.471824 Sep 13 16:57:27.450225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2856/5640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:26 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:27.716635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:27.718421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:27.737096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:27.740808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:27.741544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:27.742469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:27.743170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:27.744349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:27.964242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:27.976428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 0.267110 Sep 13 16:57:27.977495 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2785/5641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:27 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:28.476348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:28.477605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:28.493506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:28.494077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:28.494522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:28.495239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:28.495697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:28.496122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:28.660915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:28.661922 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001332 Sep 13 16:57:28.663611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2786/5642] 10.222.0.61 () {56 vars in 886 bytes} [Tue Sep 13 16:57:28 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 13 16:57:28.671347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:28.672977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002274 Sep 13 16:57:28.673609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2787/5643] 10.222.0.61 () {54 vars in 1035 bytes} [Tue Sep 13 16:57:28 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 13 16:57:28.680741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:28.682007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 13 16:57:28.682847 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2788/5644] 10.222.0.61 () {54 vars in 1041 bytes} [Tue Sep 13 16:57:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:57:28.691165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:28.692518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01ebf26f-751b-432b-9874-0bf379f30ab1 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001733 Sep 13 16:57:28.693872 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2789/5645] 10.222.0.61 () {56 vars in 886 bytes} [Tue Sep 13 16:57:28 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 13 16:57:28.794871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:28.799597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:28.816244 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12c907cf-7c63-42ed-8c9b-6a3d4366ec79 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.345208 Sep 13 16:57:28.839516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2857/5646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:28 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:29.001630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:29.005515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:29.019416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:29.023931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:29.024637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:29.025540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:29.026503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:29.027151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:29.300102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:29.309955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c8f73888-09fb-4cbd-95a7-7b9e00cb2614 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 0.313655 Sep 13 16:57:29.322643 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2790/5647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:28 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:29.846438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:29.847072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:29.875404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:29.875917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:29.876367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:29.877103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:29.877574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:29.888076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:30.044767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:30.288020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:30.295855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:30.306756 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46141e60-d8eb-4b9a-bbdd-690eecfa5cad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.465283 Sep 13 16:57:30.311410 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2858/5648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:29 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:30.336024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:30.336775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:30.355578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:30.356597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:30.357061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:30.359744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:30.360234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:30.360706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:30.618901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:30.628997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9ad5122-d7e1-43dc-ba30-a74980ae5b37 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 0.298500 Sep 13 16:57:30.634895 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2791/5649] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:30 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:31.335734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:31.337070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:31.357064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:31.359724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:31.362087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:31.368564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:31.370605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:31.372333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:31.656152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:31.656875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:31.671374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:31.674221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:31.676094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:31.678617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:31.681917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:31.683765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:31.949109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:31.975766 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-730bd432-aa07-43c9-8308-4cd976bf8e03 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.647527 Sep 13 16:57:32.004805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2859/5650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:31 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:32.465351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:32.486835 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b66a041-486c-466e-9930-044706c4570a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 0.834390 Sep 13 16:57:32.512236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2792/5651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:31 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:33.000417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:33.002836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:33.018384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:33.019401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:33.021117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:33.023888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:33.027611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:33.029884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:33.311694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:33.325141 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c03f6d53-bf94-4c00-b8f1-ea2962064995 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.328028 Sep 13 16:57:33.327016 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2860/5652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:32 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:33.525202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:33.527130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:33.531522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:33.546658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:33.547445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:33.548659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:33.549571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:33.550222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:33.550815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:34.199959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:34.211448 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89a52f89-2cb4-4352-bea0-eb6556930be8 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 0.690479 Sep 13 16:57:34.212060 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2793/5653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:33 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:34.351008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:34.352519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:34.367819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:34.368693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:34.370176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:34.371685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:34.377050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:34.377846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:34.499733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-25939bc9-4264-45e8-996f-d2ffefa65730 req-8577b823-bec1-4c29-a492-bc59f8f8b0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf", "name": "network-vif-plugged", "status": "completed", "tag": "d3eb052f-4029-4049-b7e7-2b58da25f867"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:34.534204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-25939bc9-4264-45e8-996f-d2ffefa65730 req-8577b823-bec1-4c29-a492-bc59f8f8b0b4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:34.535592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-25939bc9-4264-45e8-996f-d2ffefa65730 req-8577b823-bec1-4c29-a492-bc59f8f8b0b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:34.538893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-25939bc9-4264-45e8-996f-d2ffefa65730 req-8577b823-bec1-4c29-a492-bc59f8f8b0b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:34.572425 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-25939bc9-4264-45e8-996f-d2ffefa65730 req-8577b823-bec1-4c29-a492-bc59f8f8b0b4 service nova] Creating event network-vif-plugged:d3eb052f-4029-4049-b7e7-2b58da25f867 for instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf on n-h1-857467-1 Sep 13 16:57:34.582816 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-25939bc9-4264-45e8-996f-d2ffefa65730 req-8577b823-bec1-4c29-a492-bc59f8f8b0b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088219 Sep 13 16:57:34.587049 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2794/5654] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:57:34.948591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:34.960224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b4d24b9-8004-48c8-bbde-b49eff27f7fe tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.615272 Sep 13 16:57:34.962310 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2861/5655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:34 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:35.250965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:35.251634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:35.274609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:35.277577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:35.279496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:35.281409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:35.284443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:35.285030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:35.989462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:35.992135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:36.001762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:36.002641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:36.003331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:36.004341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:36.005037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:36.006695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:36.309965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:36.319197 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fcfcbf54-f24f-426c-82e3-17ed0af4c684 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.336147 Sep 13 16:57:36.322167 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2862/5656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:35 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:36.736095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:36.765105 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-09f82453-2ab3-43c9-8367-db8679cea0c7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1325 microversion: 2.1 time: 1.528100 Sep 13 16:57:36.767435 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2795/5657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:35 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1325 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:37.358277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:37.359593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:37.374657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:37.375507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:37.378193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:37.379199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:37.379873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:37.391226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:37.735201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:37.744888 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97a26aba-5e82-43d5-aea3-c5c2fa2b6a2d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.399409 Sep 13 16:57:37.763254 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2863/5658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:37 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:37.791715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:37.792446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:37.806551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:37.807601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:37.810082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:37.811063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:37.811734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:37.812335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.208106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:38.221129 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa7da9ab-42e3-4754-af5a-42efc7b0637e tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1522 microversion: 2.1 time: 0.432350 Sep 13 16:57:38.225268 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2796/5659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:37 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:38.255343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:38.255908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:38.266026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.266470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.267081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.267825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.268289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.269472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.361551 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] HTTP exception thrown: Action 999 not found Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Request method failure captured: Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf/os-instance-actions/999 HTTP/1.1 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILZurDv0-4LW9-JHXFppi720xuimSAKS_osqCDOBSM632XX5ydQAm8XLsurgV5mIH0qmf7lpphQZ3HQP9TmAXnNRTLu6Rg46EiiZo6WQkzfR_XpTD-o7_eF87_DNE8yyfopRlH-JBKl4Ekm5yh1Nh86bAHUnRaR1JyqJLPlxN5cz024 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 7c23a6a694804d418e65ea9a302d116b Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 7c23a6a694804d418e65ea9a302d116b Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-InstanceActionsNegativeTestJSON-1703986762-project Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: b701d9d0eec04da98436d41bcfe1c302 Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1703986762-project Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: exception: Action 999 not found Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf', 'id': '999'} Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 13 16:57:38.370421 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.373491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Returning 404 to user: Action 999 not found {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:38.373491 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12cca163-d254-47d4-93fe-3ac94b6040e7 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.121190 Sep 13 16:57:38.373491 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2864/5660] 10.222.0.61 () {58 vars in 1308 bytes} [Tue Sep 13 16:57:38 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf/os-instance-actions/999 => generated 66 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:57:38.383381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e102cd59-fe2a-4da0-852f-1dfb92be9264 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '.version_select at 0x7fbeb4bdf940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:38.384338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e102cd59-fe2a-4da0-852f-1dfb92be9264 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 63e21bed-4810-4803-81b6-f7af7df8c60c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:38.397026 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-e102cd59-fe2a-4da0-852f-1dfb92be9264 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] HTTP exception thrown: Instance 63e21bed-4810-4803-81b6-f7af7df8c60c could not be found. Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e102cd59-fe2a-4da0-852f-1dfb92be9264 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Request method failure captured: Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/63e21bed-4810-4803-81b6-f7af7df8c60c/os-instance-actions HTTP/1.1 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILZurDv0-4LW9-JHXFppi720xuimSAKS_osqCDOBSM632XX5ydQAm8XLsurgV5mIH0qmf7lpphQZ3HQP9TmAXnNRTLu6Rg46EiiZo6WQkzfR_XpTD-o7_eF87_DNE8yyfopRlH-JBKl4Ekm5yh1Nh86bAHUnRaR1JyqJLPlxN5cz024 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7c23a6a694804d418e65ea9a302d116b Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7c23a6a694804d418e65ea9a302d116b Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-InstanceActionsNegativeTestJSON-1703986762-project Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b701d9d0eec04da98436d41bcfe1c302 Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1703986762-project Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 63e21bed-4810-4803-81b6-f7af7df8c60c could not be found. Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': '63e21bed-4810-4803-81b6-f7af7df8c60c'} Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e21bed-4810-4803-81b6-f7af7df8c60c could not be found. Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:38.410161 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e21bed-4810-4803-81b6-f7af7df8c60c could not be found. Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e21bed-4810-4803-81b6-f7af7df8c60c could not be found. Sep 13 16:57:38.414168 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:38.418731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e102cd59-fe2a-4da0-852f-1dfb92be9264 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Returning 404 to user: Instance 63e21bed-4810-4803-81b6-f7af7df8c60c could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:38.420040 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e102cd59-fe2a-4da0-852f-1dfb92be9264 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/63e21bed-4810-4803-81b6-f7af7df8c60c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.041493 Sep 13 16:57:38.421166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2797/5661] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Sep 13 16:57:38 2022] GET /compute/v2.1/servers/63e21bed-4810-4803-81b6-f7af7df8c60c/os-instance-actions => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:38.433001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:38.433506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:38.449246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.450001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.450615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.451474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.452086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.452659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.496195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:57:38.674070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32db2cd7-ba1d-48d0-9877-b00b90f50917 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "DELETE /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 204 len: 0 microversion: 2.1 time: 0.245040 Sep 13 16:57:38.677511 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2865/5662] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:38 2022] DELETE /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:57:38.687328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:38.688643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:38.703481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.704255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.704982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.705770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.706346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.706870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.782350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:38.783220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:38.812028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.812825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.816230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:38.817160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:38.817819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:38.821863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:39.220132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:39.239151 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39b750e4-9810-44f1-a41f-e9f9a24e770f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.469407 Sep 13 16:57:39.246335 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2866/5663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:38 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:39.297019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:39.307052 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b481543d-8a08-405f-b3bd-ce37883ccbfb tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1528 microversion: 2.1 time: 0.623511 Sep 13 16:57:39.307967 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2798/5664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:38 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1528 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:39.746699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-803180656", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "dc816a61-d469-4c13-aba5-ab4035a18d82"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:39.898101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] validate_networks() for [('dc816a61-d469-4c13-aba5-ab4035a18d82', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:57:40.269538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:40.270568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:40.284109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:40.293094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:40.297311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:40.298734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:40.300394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:40.302521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:40.694400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:40.705931 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a9841ff-3754-4b57-b984-ca7066245424 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.440573 Sep 13 16:57:40.724180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2799/5665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:40 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:40.731199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:40.731825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:40.751673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:40.752181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:40.755112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:40.756209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:40.756688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:40.757136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:41.032705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:41.046068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0e51cf3-4469-4421-8720-615b484f532a tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1528 microversion: 2.1 time: 0.320667 Sep 13 16:57:41.046954 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2800/5666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:40 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1528 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:41.669504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:57:41.670333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:57:41.670933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:57:41.671584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:57:41.672113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:57:41.699730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:41.711929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:41.714408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:41.715957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:41.717262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:41.718150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:41.731933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:41.732732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:41.751118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:41.751713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:41.752168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:41.752901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:41.753373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:41.753816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:41.771261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Getting quotas for project 8f630b43e85e4ea7a0889957e8316d9a. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:57:41.783552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Getting quotas for user b3e2bbfcdd094f34898d5b3280b2b4f9 and project 8f630b43e85e4ea7a0889957e8316d9a. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:57:41.821189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:57:41.828911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:57:41.960467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-554c8816-903e-4816-aa81-ea480cbfcbdd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.493509 Sep 13 16:57:41.961605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2867/5667] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:57:41.983816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a2795b43-cdc8-4bf7-ae91-92c26448f987 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:41.989503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a2795b43-cdc8-4bf7-ae91-92c26448f987 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:42.091316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:42.107075 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbf41296-53d6-4a54-a98d-6b9217bdf57c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.379047 Sep 13 16:57:42.121852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2801/5668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:41 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:42.121852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:42.122305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:42.137762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:42.140414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:42.141142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:42.145766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:42.148117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:42.149448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:42.172035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a2795b43-cdc8-4bf7-ae91-92c26448f987 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:42.189019 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a2795b43-cdc8-4bf7-ae91-92c26448f987 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1224 microversion: 2.1 time: 0.217448 Sep 13 16:57:42.221966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2868/5669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:41 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1224 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:42.351064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:42.370317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d151df4-526e-4ac1-b18b-13b7e01e58cd tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1486 microversion: 2.1 time: 0.257787 Sep 13 16:57:42.373801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2802/5670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:42 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1486 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:42.519112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-934a753d-5c9e-4662-bcd1-6cae2aeadecb req-cc472da9-0b89-4695-8209-10ec2651ff88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf", "name": "network-vif-deleted", "tag": "d3eb052f-4029-4049-b7e7-2b58da25f867"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:42.551092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-934a753d-5c9e-4662-bcd1-6cae2aeadecb req-cc472da9-0b89-4695-8209-10ec2651ff88 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:42.552647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-934a753d-5c9e-4662-bcd1-6cae2aeadecb req-cc472da9-0b89-4695-8209-10ec2651ff88 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:42.554398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-934a753d-5c9e-4662-bcd1-6cae2aeadecb req-cc472da9-0b89-4695-8209-10ec2651ff88 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:42.579632 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-934a753d-5c9e-4662-bcd1-6cae2aeadecb req-cc472da9-0b89-4695-8209-10ec2651ff88 service nova] Creating event network-vif-deleted:d3eb052f-4029-4049-b7e7-2b58da25f867 for instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf on n-h1-857467-1 Sep 13 16:57:42.588698 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-934a753d-5c9e-4662-bcd1-6cae2aeadecb req-cc472da9-0b89-4695-8209-10ec2651ff88 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083026 Sep 13 16:57:42.619519 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2869/5671] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:43.141667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:43.145510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:43.173034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.173553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.178248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.179453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.181448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.182334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.225466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:43.226577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:43.247235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.247916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.249502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.252448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.253142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.253744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.409613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:43.424884 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6a243e6-f2c7-481e-a4bd-95aa060da375 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1228 microversion: 2.1 time: 0.205927 Sep 13 16:57:43.440465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2870/5672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:43 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1228 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:43.467777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:43.468537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:43.491708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.492211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.492652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.493373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.493852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.507905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.519277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:43.534775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e9da3e0-2c38-41d5-9eaa-12ca9cef1b13 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.401373 Sep 13 16:57:43.549929 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2803/5673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:43 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:43.646612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:43.647428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:43.655781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:43.656252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lazy-loading 'fault' on Instance uuid 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:43.791367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b701d9d0eec04da98436d41bcfe1c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c23a6a694804d418e65ea9a302d116b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:43.799709 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c1bffe15-490d-4bf8-a921-dcfaf9ecc46f tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 200 len: 1315 microversion: 2.1 time: 0.347013 Sep 13 16:57:43.807988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2871/5674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:43 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:44.456299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:44.456955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:44.483555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:44.486665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:44.488541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:44.492432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:44.496721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:44.497664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:44.560263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:44.560887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:44.578786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:44.582838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:44.583322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:44.592368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:44.592885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:44.593340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:44.729661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:44.746230 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-638f6014-d171-40d0-b08f-82dda606d5c3 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1276 microversion: 2.1 time: 0.294970 Sep 13 16:57:44.757732 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2804/5675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:44 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:44.835545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:44.836404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] [instance: 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:44.846373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:44.846891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:44.848253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:44.855568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:44.857153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:44.863188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:44.917476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] HTTP exception thrown: Instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf could not be found. Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Request method failure captured: Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf HTTP/1.1 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILZurDv0-4LW9-JHXFppi720xuimSAKS_osqCDOBSM632XX5ydQAm8XLsurgV5mIH0qmf7lpphQZ3HQP9TmAXnNRTLu6Rg46EiiZo6WQkzfR_XpTD-o7_eF87_DNE8yyfopRlH-JBKl4Ekm5yh1Nh86bAHUnRaR1JyqJLPlxN5cz024 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7c23a6a694804d418e65ea9a302d116b Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c23a6a694804d418e65ea9a302d116b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7c23a6a694804d418e65ea9a302d116b Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1703986762 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-InstanceActionsNegativeTestJSON-1703986762-project Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b701d9d0eec04da98436d41bcfe1c302 Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1703986762-project Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf could not be found. Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf'} Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf could not be found. Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf could not be found. Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:44.919167 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf could not be found. Sep 13 16:57:44.923213 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:44.931143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] Returning 404 to user: Instance 25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:44.932302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6371cb10-4011-45ab-afcb-5d4ed732c080 tempest-InstanceActionsNegativeTestJSON-1703986762 tempest-InstanceActionsNegativeTestJSON-1703986762-project] 10.222.0.61 "GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf" status: 404 len: 111 microversion: 2.1 time: 0.101712 Sep 13 16:57:44.936578 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2805/5676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:44 2022] GET /compute/v2.1/servers/25e465d4-bc7c-4bd5-aa98-e5e3eaa10fdf => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 16:57:45.201721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:45.210598 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00bd0d79-ef19-47a6-ad5a-2266b7b83086 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.654123 Sep 13 16:57:45.213512 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2872/5677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:44 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:45.778520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:45.779152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:45.797792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:45.812957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:45.813423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:45.814206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:45.816266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:45.817355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:45.869536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:46.024764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:46.043436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa73ad74-df02-47cd-8186-c76a490c8c68 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1282 microversion: 2.1 time: 0.275932 Sep 13 16:57:46.046129 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2806/5678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:45 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:46.243998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:46.245141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:46.265482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:46.265953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:46.266405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:46.270362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:46.270874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:46.272385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:46.574361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:46.590589 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-565bf0c8-4076-4fb5-95b3-a6a4280f13f8 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.352895 Sep 13 16:57:46.593178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2873/5679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:46 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:47.084127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:47.084768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:47.106519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:47.112537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:47.114455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:47.116649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:47.119443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:47.121293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:47.622316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:47.634582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:47.654866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:47.659981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:47.660503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:47.660952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:47.664052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:47.664733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:47.668283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:47.674476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13b6047e-db08-41f4-af0d-190450fe1401 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.603653 Sep 13 16:57:47.684381 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2807/5680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:47 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:48.027227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:48.031769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:48.040651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-839f91c4-13fe-4963-8413-96a8fc6fdfc1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.422728 Sep 13 16:57:48.043892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2874/5681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:47 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:48.712955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:48.713869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:48.741180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:48.742077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:48.743437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:48.746706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:48.747426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:48.748605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:49.077962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:49.079765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:49.096447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:49.097655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:49.100003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:49.101678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:49.103795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:49.104592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:49.383518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:49.399855 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-369ea044-f966-4d18-b917-78c7990f37a7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.328197 Sep 13 16:57:49.400498 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2875/5682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:49 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:49.820063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:49.836364 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-797f0bfe-6877-4917-810b-71f9a01d3818 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 1.129815 Sep 13 16:57:49.841517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2808/5683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:48 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:50.429952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:50.431633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:50.446901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-88d68ed7-3c6b-4aed-869b-11eb6c911d05 req-cae38ec8-7f36-45e2-a4e5-8d7b1d4538d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150abdca-eed9-40b3-bdbe-2123e0bdb700", "tag": "0c596af1-beae-4964-b3ad-8fb881ef6c4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:50.471496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:50.481694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:50.492822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:50.497511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:50.503921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:50.510228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88d68ed7-3c6b-4aed-869b-11eb6c911d05 req-cae38ec8-7f36-45e2-a4e5-8d7b1d4538d7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:50.510729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:50.516053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88d68ed7-3c6b-4aed-869b-11eb6c911d05 req-cae38ec8-7f36-45e2-a4e5-8d7b1d4538d7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:50.516918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:50.517668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88d68ed7-3c6b-4aed-869b-11eb6c911d05 req-cae38ec8-7f36-45e2-a4e5-8d7b1d4538d7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:50.577455 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-88d68ed7-3c6b-4aed-869b-11eb6c911d05 req-cae38ec8-7f36-45e2-a4e5-8d7b1d4538d7 service nova] Creating event network-changed:0c596af1-beae-4964-b3ad-8fb881ef6c4b for instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 on n-h2-857467-1 Sep 13 16:57:50.588348 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-88d68ed7-3c6b-4aed-869b-11eb6c911d05 req-cae38ec8-7f36-45e2-a4e5-8d7b1d4538d7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145680 Sep 13 16:57:50.589936 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2809/5684] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:57:50.812465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:50.837326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d7e52f9-80ac-4a9f-b349-5648811d58f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.412099 Sep 13 16:57:50.838893 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2876/5685] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:50 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:50.871483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:50.872257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:50.891412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:50.891940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:50.892389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:50.893509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:50.894167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:50.894610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.274125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:51.285528 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2948cd28-9215-4eaa-8aa1-360a34c31e54 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.420280 Sep 13 16:57:51.286993 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2810/5686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:50 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:51.390773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:51.391284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:51.407268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.408074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.409224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.410373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.410997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.411623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.464871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a50ad7fc-d255-4e3a-9bd1-1323431d22e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/ips" status: 200 len: 150 microversion: 2.1 time: 0.079470 Sep 13 16:57:51.467370 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2877/5687] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:57:51 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:51.481008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "469018a0-4bec-43c6-9542-3e498669eb91"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:51.484282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:51.497458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.498252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.499871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.501026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.501752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.502653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.625311 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Invalid volume: volume 469018a0-4bec-43c6-9542-3e498669eb91 is already attached to instances: e54d3d86-40a0-4e90-8c28-333d854dc2b9 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/os-volume_attachments HTTP/1.1 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 74 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: {"volumeAttachment": {"volumeId": "469018a0-4bec-43c6-9542-3e498669eb91"}} Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid volume: volume 469018a0-4bec-43c6-9542-3e498669eb91 is already attached to instances: e54d3d86-40a0-4e90-8c28-333d854dc2b9 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': '3f18c88e-68df-4252-881b-7bd9c71bec1a', 'body': {'volumeAttachment': {'volumeId': '469018a0-4bec-43c6-9542-3e498669eb91'}}} Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 469018a0-4bec-43c6-9542-3e498669eb91 is already attached to instances: e54d3d86-40a0-4e90-8c28-333d854dc2b9 Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:57:51.629214 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 469018a0-4bec-43c6-9542-3e498669eb91 is already attached to instances: e54d3d86-40a0-4e90-8c28-333d854dc2b9 Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 469018a0-4bec-43c6-9542-3e498669eb91 is already attached to instances: e54d3d86-40a0-4e90-8c28-333d854dc2b9 Sep 13 16:57:51.633231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:51.637690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 400 to user: Invalid volume: volume 469018a0-4bec-43c6-9542-3e498669eb91 is already attached to instances: e54d3d86-40a0-4e90-8c28-333d854dc2b9 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:51.638647 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c310a644-91fa-471f-b1bf-2d3b94a54b18 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.162133 Sep 13 16:57:51.639263 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2811/5688] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 16:57:51 2022] POST /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:57:51.649459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:51.650202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:51.659549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.660566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.661120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.662722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.663328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.663894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.720632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:57:51.869743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:51.870480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:51.897754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.901477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.905699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:51.907804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:51.909940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:51.911295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:52.312497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:52.313669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:52.379320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:52.401302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0d8f110-a327-4715-85c7-68f0f0f42fad tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.536104 Sep 13 16:57:52.421285 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2812/5689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:51 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:52.430177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:52.430825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:52.445321 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed01d7cc-1bfb-4041-ae5e-18f0f6797e66 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 204 len: 0 microversion: 2.1 time: 0.800712 Sep 13 16:57:52.446950 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2878/5690] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:57:51 2022] DELETE /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 0 bytes in 803 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:57:52.453680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:52.456917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:52.457917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:52.458817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:52.460571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:52.461512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:52.462978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:52.466512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:52.469785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:52.472150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:52.473589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:52.475205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:52.478572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:52.479071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:52.671678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:52.685551 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d919a47-4071-46cd-bf9b-9ee221e3edb9 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.261647 Sep 13 16:57:52.691594 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2813/5691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:52 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:52.704608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:52.714958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a867c535-b442-4726-9f42-80ccb8bc0b67 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1683 microversion: 2.1 time: 0.263791 Sep 13 16:57:52.716511 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2879/5692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:52 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1683 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:53.425447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:53.426104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:53.435897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:53.436470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:53.436917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:53.443654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:53.444257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:53.444714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:53.643502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:53.665201 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee2d872f-6080-4824-8e4d-513043f3e264 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.243814 Sep 13 16:57:53.666309 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2814/5693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:53 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:53.716893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:53.719102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:53.729144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:53.729813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:53.730377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:53.731192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:53.732182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:53.732779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:53.743444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:53.744509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:53.765442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:53.771915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:53.772764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:53.773857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:53.774486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:53.775070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:53.945647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:53.958048 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8b62cba-8c81-419b-acb0-118b8f118879 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.250263 Sep 13 16:57:53.977757 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2880/5694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:53 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:53.988900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:54.006484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5febdd3f-7299-4d42-a6e3-c3634fac5c10 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1683 microversion: 2.1 time: 0.269441 Sep 13 16:57:54.008225 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2815/5695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:53 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:54.691995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:54.693103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:54.712961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:54.714994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:54.716186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:54.718152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:54.719796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:54.721339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:54.985487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:54.986324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:55.006288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:55.010226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:55.012426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:55.014466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:55.015130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:55.015786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:55.100733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:55.109573 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-192ccbf7-9cc8-4786-8245-a6d113790397 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1505 microversion: 2.1 time: 0.422879 Sep 13 16:57:55.114980 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2881/5696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:54 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:55.131285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:55.136534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:55.154823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:55.158199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:55.158906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:55.159947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:55.161497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:55.163161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:55.470002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:55.495326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-799395b6-85ac-4b80-900b-608fffe37b0b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1683 microversion: 2.1 time: 0.378750 Sep 13 16:57:55.496386 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2882/5697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:55 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1683 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:55.797058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:55.806826 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c7476cf-7ead-4eac-a715-1585fafd7821 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.826725 Sep 13 16:57:55.819322 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2816/5698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:54 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:56.043675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c620e170-4f25-4a54-b1a6-f18f1d382202 req-7d9d8dee-e66e-4c06-97c1-64fc9d15af83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f18c88e-68df-4252-881b-7bd9c71bec1a", "name": "network-vif-deleted", "tag": "9d007216-438e-4ab3-927d-7e3c5102b0b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:56.078051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c620e170-4f25-4a54-b1a6-f18f1d382202 req-7d9d8dee-e66e-4c06-97c1-64fc9d15af83 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.078588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c620e170-4f25-4a54-b1a6-f18f1d382202 req-7d9d8dee-e66e-4c06-97c1-64fc9d15af83 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.079129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c620e170-4f25-4a54-b1a6-f18f1d382202 req-7d9d8dee-e66e-4c06-97c1-64fc9d15af83 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.101435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1398229446", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:56.118149 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c620e170-4f25-4a54-b1a6-f18f1d382202 req-7d9d8dee-e66e-4c06-97c1-64fc9d15af83 service nova] Creating event network-vif-deleted:9d007216-438e-4ab3-927d-7e3c5102b0b2 for instance 3f18c88e-68df-4252-881b-7bd9c71bec1a on n-h1-857467-1 Sep 13 16:57:56.141384 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c620e170-4f25-4a54-b1a6-f18f1d382202 req-7d9d8dee-e66e-4c06-97c1-64fc9d15af83 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101609 Sep 13 16:57:56.146938 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2817/5699] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:57:56.158838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:56.160635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:56.168479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.169166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.169949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.170847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.171491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.172087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.217105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:57:56.217541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:57:56.218310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:57:56.218822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:57:56.219692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:57:56.246254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.246789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.247238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.248036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.248505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.248946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.284938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Getting quotas for project 2d93b00eed7f4f67a26b31d29ece9c51. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:57:56.293486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Getting quotas for user c2ccb8ec04eb42a2b78aca796e122629 and project 2d93b00eed7f4f67a26b31d29ece9c51. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:57:56.322464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:57:56.325913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:57:56.390097 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f675ed71-c854-40de-b163-32e77a8b2162 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.681031 Sep 13 16:57:56.391443 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2883/5700] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 16:57:56.403238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6eda4a53-dcc6-4033-95a3-c8b73f6670b5 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:56.404160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6eda4a53-dcc6-4033-95a3-c8b73f6670b5 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:56.441861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:56.453969 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-caded2e2-8195-4994-a9f0-98def14841d2 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1505 microversion: 2.1 time: 0.305468 Sep 13 16:57:56.456026 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2818/5701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:56 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:56.503234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6eda4a53-dcc6-4033-95a3-c8b73f6670b5 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:56.521783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:56.522706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:56.528750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6eda4a53-dcc6-4033-95a3-c8b73f6670b5 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:56.532066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6eda4a53-dcc6-4033-95a3-c8b73f6670b5 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:56.547163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.551007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.551753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.553247 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6eda4a53-dcc6-4033-95a3-c8b73f6670b5 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1281 microversion: 2.47 time: 0.153171 Sep 13 16:57:56.554850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.555260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2884/5702] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:57:56 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:57:56.556621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.557788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.613512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.618217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.618761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.619559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'fault' on Instance uuid 3f18c88e-68df-4252-881b-7bd9c71bec1a {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:56.632159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:56.635490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:56.647762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.648277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.648722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.649454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.654084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.655583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.682480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:56.690769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e1a1db7-8fc0-4218-a36f-c5d6f6d3ef53 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1332 microversion: 2.1 time: 0.173439 Sep 13 16:57:56.694031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2819/5703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:56 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1332 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:56.774954 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c05d5761-34f8-4e63-b522-64593f4a85a2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96/action" status: 200 len: 24566 microversion: 2.1 time: 0.146821 Sep 13 16:57:56.776857 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2885/5704] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:57:56 2022] POST /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96/action => generated 24566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:57:56.844571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:56.845953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:56.870658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.872105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.874019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:56.875374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:56.876521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:56.877300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.150096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:57.162826 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abf2b82e-36d9-49b8-b85d-f48f485c0c0f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.323227 Sep 13 16:57:57.163742 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2820/5705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:56 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:57.480527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:57.481406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:57.489493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.491124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.491828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.492626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.493390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.494062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.580504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:57.581108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:57.592182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.592688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.593133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.593847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.596057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.596503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.734511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:57.745253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:57.749807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:57.756205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:57.757777 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-679725a6-6a74-4195-a712-c45aaa84d581 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1285 microversion: 2.47 time: 0.181249 Sep 13 16:57:57.761001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2821/5706] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:57:57 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:57:57.763181 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-123f9fbe-dc1a-4853-b9a9-8bebd13986f0 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1505 microversion: 2.1 time: 0.287097 Sep 13 16:57:57.764551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2886/5707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:57 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:57.792225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:57.797644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:57.821603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.823719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.824171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.826331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.826820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.827272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.867751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:57.868374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:57.868915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:57.869591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'fault' on Instance uuid 3f18c88e-68df-4252-881b-7bd9c71bec1a {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:57:57.922288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:57.931631 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c369fd3d-44a1-4a58-9959-909003593211 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 200 len: 1332 microversion: 2.1 time: 0.164827 Sep 13 16:57:57.933528 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2887/5708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:57 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 1332 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:58.133003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f1549995-313a-4461-be8b-92d7b33167b8 req-02963c85-560d-45f3-b473-4917ba0ea787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2659ee-3df6-4ba8-b11f-c8b526223d40", "name": "network-vif-unplugged", "status": "completed", "tag": "4d557627-d564-46a8-8e97-247256052111"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:57:58.157483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f1549995-313a-4461-be8b-92d7b33167b8 req-02963c85-560d-45f3-b473-4917ba0ea787 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.159971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f1549995-313a-4461-be8b-92d7b33167b8 req-02963c85-560d-45f3-b473-4917ba0ea787 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.160569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f1549995-313a-4461-be8b-92d7b33167b8 req-02963c85-560d-45f3-b473-4917ba0ea787 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.178990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f1549995-313a-4461-be8b-92d7b33167b8 req-02963c85-560d-45f3-b473-4917ba0ea787 service nova] Creating event network-vif-unplugged:4d557627-d564-46a8-8e97-247256052111 for instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 on n-h1-857467-1 Sep 13 16:57:58.187243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:58.188335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:58.201707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.202679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.203400 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f1549995-313a-4461-be8b-92d7b33167b8 req-02963c85-560d-45f3-b473-4917ba0ea787 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073912 Sep 13 16:57:58.204349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2822/5709] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:57:58.205107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.209184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.210046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.212395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.429609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:58.442164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12d817d9-6ed5-460e-a3ec-5699b68a153f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.259481 Sep 13 16:57:58.460971 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2888/5710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:58 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:58.789085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:58.790128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:58.793124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:58.794132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:58.802995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.803795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.805053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.807710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.809140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.809549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.826418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.826929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.829669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.830442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:58.830944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:58.834563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:58.965140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:58.978937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:58.980390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:58.981546 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f910573-4afd-428a-bb00-e558e38d6298 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1333 microversion: 2.47 time: 0.199560 Sep 13 16:57:58.993957 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2823/5711] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:57:58 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1333 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:57:59.005799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:59.013381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:59.024799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.026065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.026721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.028728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.029287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.029785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.047666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a HTTP/1.1 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3f18c88e-68df-4252-881b-7bd9c71bec1a'} Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:57:59.049638 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 16:57:59.055406 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:57:59.058828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:57:59.060604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-959c7b66-1952-42c4-bb46-3a31b21fb2ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 404 len: 111 microversion: 2.1 time: 0.077031 Sep 13 16:57:59.061718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2824/5712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:58 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:57:59.078440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50cc46fe-1eaf-4a91-9f80-75e0ce12bbab tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '.version_select at 0x7fbeb4da9160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:59.112946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50cc46fe-1eaf-4a91-9f80-75e0ce12bbab tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775297187" status: 202 len: 0 microversion: 2.1 time: 0.047032 Sep 13 16:57:59.115129 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2825/5713] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:57:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775297187 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:57:59.124151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:59.134537 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-971fc083-89b5-4ea3-a16d-885e26bc3049 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 200 len: 1508 microversion: 2.1 time: 0.346599 Sep 13 16:57:59.135732 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2889/5714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:58 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:59.162053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:59.162797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:59.173997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.174785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.175379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.176375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.177036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.177851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.204228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:57:59.384373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:59.397732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-896971ea-8c0e-419b-a090-2404931e771d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.242953 Sep 13 16:57:59.420776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2826/5715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:59 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:59.432729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:59.433819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:59.451781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.452854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.467028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.468585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:59.469216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:59.471621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.472317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.478557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.478843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.479359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.479810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.487325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.490155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.490772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.676791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:59.687872 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd11ca42-11e3-45be-a892-660c8764ce2f tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.223059 Sep 13 16:57:59.689016 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2827/5716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:59 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:57:59.843883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:57:59.870185 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d7cf8de-bb2d-43b7-8036-a595bcc05f2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.443430 Sep 13 16:57:59.871317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2890/5717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:59 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:57:59.893334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:57:59.894001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:57:59.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:57:59.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:57:59.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:57:59.913108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.015038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:00.016227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:00.027558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.029803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.031065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.032815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.034167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.035105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.078545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.089660 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4dbd9846-17dc-4e90-a5ea-e51bf51dd306 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.200028 Sep 13 16:58:00.100069 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2828/5718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:57:59 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:00.114361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:00.116074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:00.124712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.125267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.126032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.126843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.127513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.128146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.148019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.164563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:00.168444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.170178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.171382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a27c6a50-f8ba-4c88-bca5-bbc96fe0e64e tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1339 microversion: 2.47 time: 0.162345 Sep 13 16:58:00.171949 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2891/5719] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:00 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:58:00.230062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3c429b7e-36cd-4adc-985d-06e0893e69a4 req-98c67258-ed76-4d09-b5c1-afa85803ac89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150abdca-eed9-40b3-bdbe-2123e0bdb700", "name": "network-vif-plugged", "status": "completed", "tag": "0c596af1-beae-4964-b3ad-8fb881ef6c4b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:00.242304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c429b7e-36cd-4adc-985d-06e0893e69a4 req-98c67258-ed76-4d09-b5c1-afa85803ac89 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.242792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c429b7e-36cd-4adc-985d-06e0893e69a4 req-98c67258-ed76-4d09-b5c1-afa85803ac89 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.243230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3c429b7e-36cd-4adc-985d-06e0893e69a4 req-98c67258-ed76-4d09-b5c1-afa85803ac89 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.259394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3c429b7e-36cd-4adc-985d-06e0893e69a4 req-98c67258-ed76-4d09-b5c1-afa85803ac89 service nova] Creating event network-vif-plugged:0c596af1-beae-4964-b3ad-8fb881ef6c4b for instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 on n-h2-857467-1 Sep 13 16:58:00.265072 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3c429b7e-36cd-4adc-985d-06e0893e69a4 req-98c67258-ed76-4d09-b5c1-afa85803ac89 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041430 Sep 13 16:58:00.270188 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2892/5720] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:00.318352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.328342 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3ec0daf-333d-459e-a7e4-c3c6a6fe6198 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.219134 Sep 13 16:58:00.328932 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2829/5721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:00 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:00.356997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-864a97fc-a76a-446e-9cfa-52ec92b7bc00 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:00.368594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-864a97fc-a76a-446e-9cfa-52ec92b7bc00 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.368951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:00.369299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-864a97fc-a76a-446e-9cfa-52ec92b7bc00 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.369463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:00.369988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-864a97fc-a76a-446e-9cfa-52ec92b7bc00 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.375756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.376470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.377074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.377784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.378282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.378715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.397586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-864a97fc-a76a-446e-9cfa-52ec92b7bc00 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Going to try to stop instance {{(pid=122328) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 16:58:00.467201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-864a97fc-a76a-446e-9cfa-52ec92b7bc00 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.115080 Sep 13 16:58:00.468491 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2893/5722] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:58:00 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:58:00.480304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:00.481285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:00.490929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.492584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.493044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.493931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.494414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.494859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.654901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.664128 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34e97dff-9fed-40ff-aed2-47bf585c6733 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.190923 Sep 13 16:58:00.665042 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2894/5723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:00 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:00.713640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:00.714808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:00.721104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.721605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.722079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.722786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.723284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.723721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.737573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'services' on Instance uuid e54d3d86-40a0-4e90-8c28-333d854dc2b9 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:00.818443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c162cb37-9a6e-4cd1-8c47-9e458c394840 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments/469018a0-4bec-43c6-9542-3e498669eb91" status: 202 len: 0 microversion: 2.1 time: 0.453477 Sep 13 16:58:00.820378 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2830/5724] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 16:58:00 2022] DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments/469018a0-4bec-43c6-9542-3e498669eb91 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:58:00.829409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:00.831788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:00.840000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.840737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.841186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.842005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:00.842406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:00.842840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:00.873206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:00.881567 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff3f76d7-5733-492b-90ee-57736996b72f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056130 Sep 13 16:58:00.882495 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35b22981-ec1d-4b3a-baac-7103e69c20eb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.174360 Sep 13 16:58:00.882648 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2831/5725] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:00 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:00.882796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2895/5726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:00 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:01.201380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:01.202045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:01.210222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.211119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.211735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.212638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.213229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.213678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.292461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:01.300872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:01.303752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:01.305050 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-714adabc-3ee2-43c5-8fd4-4c9a406955b2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1339 microversion: 2.47 time: 0.108986 Sep 13 16:58:01.305680 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2832/5727] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:01 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:01.686693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:01.687595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:01.695002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.695509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.697027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.697991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.698662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.699102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.855707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:01.869593 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-225cb7d0-de96-41d6-94a8-620249140240 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.186455 Sep 13 16:58:01.870471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2896/5728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:01 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:01.894329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:01.897158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:01.904011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.904759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.905397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.906356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.907018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.907538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.908643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:01.909359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:01.920817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.921572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.922130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.923039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:01.923801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:01.924415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:01.942894 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27a814c1-32e6-4e5f-8a79-04868344980d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052133 Sep 13 16:58:01.943836 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2833/5729] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:01 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:02.125385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:02.134921 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7da0f0e-bd52-43bd-8ec4-5f0a125fd694 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1324 microversion: 2.1 time: 0.232593 Sep 13 16:58:02.135893 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2897/5730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:01 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1324 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:02.333660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:02.334440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:02.343360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:02.343877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:02.344329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:02.345058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:02.345530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:02.346002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:02.416796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:02.425899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:02.427997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:02.429283 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ab180a6-98b1-4181-a0e4-8e7560a6add4 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1339 microversion: 2.47 time: 0.100584 Sep 13 16:58:02.429874 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2834/5731] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:02 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:02.897031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:02.897649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:02.906164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:02.906673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:02.907122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:02.907897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:02.908373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:02.908811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:02.955753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:02.958681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:02.965098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:02.965612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:02.966093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:02.966826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:02.967294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:02.967742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.002890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0e1cf116-c9c7-497c-9937-f31546a838fb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051089 Sep 13 16:58:03.003655 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2835/5732] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:02 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:03.100573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:03.121242 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39a01bb0-1802-4870-a17e-312493e411d1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.226562 Sep 13 16:58:03.121912 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2898/5733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:02 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:03.162447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:03.163157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:03.170089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.170891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.171358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.172074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.172797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.173243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.336034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:03.345378 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a5a4fdb-bc8f-4566-be60-036be9dd7dcb tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1521 microversion: 2.1 time: 0.187738 Sep 13 16:58:03.346194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2836/5734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:03 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:03.370829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:03.371336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:03.377382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.377914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.378457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.379017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.379472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.381325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.408919 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] HTTP exception thrown: Instance is not a member of specified network Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Request method failure captured: Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700/ips/invalid HTTP/1.1 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILaDBIoTsbJMxNvK_FHoBXjSMavBzkde1QXzWqjLEFfKsv3WfGO8hh11E7MZ5yt90c2_Rt4OW22snuGR-qXJZBb8hukSad_X94VAFJmbewdKkJVrRh6ilZ037rqebkdp2BWM_5H6Dlt5TctUoN2DNVUM6wvtk53pnWrFs4J3KA6cTOg Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 8f630b43e85e4ea7a0889957e8316d9a Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 8f630b43e85e4ea7a0889957e8316d9a Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerAddressesNegativeTestJSON-643062683-project Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: b3e2bbfcdd094f34898d5b3280b2b4f9 Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-643062683-project Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance is not a member of specified network Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '150abdca-eed9-40b3-bdbe-2123e0bdb700', 'id': 'invalid'} Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 13 16:58:03.415625 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.418829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:03.418829 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2783edc9-340d-4a3e-aaf4-b069e307107a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.051289 Sep 13 16:58:03.422378 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2899/5735] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 16:58:03 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700/ips/invalid => generated 91 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:58:03.427765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-116d348a-408e-4a90-95f5-f2455657c83a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:03.428255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-116d348a-408e-4a90-95f5-f2455657c83a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Failed to fetch instance by id 999 {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 13 16:58:03.428769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-116d348a-408e-4a90-95f5-f2455657c83a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] HTTP exception thrown: Instance 999 could not be found. Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-116d348a-408e-4a90-95f5-f2455657c83a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Request method failure captured: Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILaDBIoTsbJMxNvK_FHoBXjSMavBzkde1QXzWqjLEFfKsv3WfGO8hh11E7MZ5yt90c2_Rt4OW22snuGR-qXJZBb8hukSad_X94VAFJmbewdKkJVrRh6ilZ037rqebkdp2BWM_5H6Dlt5TctUoN2DNVUM6wvtk53pnWrFs4J3KA6cTOg Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 8f630b43e85e4ea7a0889957e8316d9a Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 8f630b43e85e4ea7a0889957e8316d9a Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerAddressesNegativeTestJSON-643062683-project Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b3e2bbfcdd094f34898d5b3280b2b4f9 Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-643062683-project Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 999 could not be found. Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': '999'} Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 13 16:58:03.430558 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:03.434155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-116d348a-408e-4a90-95f5-f2455657c83a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:03.434155 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-116d348a-408e-4a90-95f5-f2455657c83a tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008190 Sep 13 16:58:03.434155 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2837/5736] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 16:58:03 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 16:58:03.441722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:03.443100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:03.450987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.450987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.452034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.452781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.453254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.453820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.457347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:03.459080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:03.467683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.468430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.469041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.469938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.470588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.471166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.492975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:03.555719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:03.566980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:03.570428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:03.572141 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e7a70b5-5271-4480-a55b-0665aedb4f14 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1339 microversion: 2.47 time: 0.119400 Sep 13 16:58:03.573501 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2838/5737] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:03 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:03.613382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a82df83b-f202-4189-8e54-66c4791193fd tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "DELETE /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 204 len: 0 microversion: 2.1 time: 0.175686 Sep 13 16:58:03.618303 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2900/5738] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:03 2022] DELETE /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:03.626184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:03.626831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:03.628880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:03.636074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.636588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.637045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.637770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:03.638312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:03.638725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:03.789853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:03.800669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02fea378-3943-4e4c-ba86-86850d904800 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1527 microversion: 2.1 time: 0.177760 Sep 13 16:58:03.801504 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2839/5739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:03 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:04.018267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:04.021104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:04.031176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.032023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.032646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.033917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.034897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.035714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.138605 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e41cd665-43c0-4e98-9e50-fb9a264842e9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126066 Sep 13 16:58:04.149215 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2901/5740] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:04 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:04.156407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:04.157042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:04.164725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.164834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.165231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.166038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.166498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.166925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.404126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:04.413598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b2cd008-365a-4a7f-866b-12f18a4c9714 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.271875 Sep 13 16:58:04.418353 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2840/5741] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:04 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:04.606497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:04.607261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:04.614098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.615414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.616086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.617002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.617768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.618412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.705064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:04.723437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:04.730369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:04.732704 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-afc8c063-2b2b-4812-b453-d6ea9697213b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1360 microversion: 2.47 time: 0.131268 Sep 13 16:58:04.747646 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2902/5742] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:04 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:04.762450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-368492555"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:04.765042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:04.771949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.772685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.773650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.774587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.775235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.776129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.825465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:04.826586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:04.848457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.849821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.850502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:04.851310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:04.854754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:04.855190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.143944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:05.155104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d79758b-214c-40f9-ac8d-fd123f712aee tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1527 microversion: 2.1 time: 0.334032 Sep 13 16:58:05.156243 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2903/5743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:04 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1527 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:05.176812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:05.179840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:05.189482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.190505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.191317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.193414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.194352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.195086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.200506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d15b5c10-ac14-4df2-8f93-46e22a6334e2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "POST /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f/action" status: 202 len: 52 microversion: 2.47 time: 0.437906 Sep 13 16:58:05.202252 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2841/5744] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:58:04 2022] POST /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f/action => generated 52 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 13 16:58:05.213847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:05.214794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:05.229753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.231773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.232826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.234118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.235932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.238197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.244811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26aa7c21-fcc2-4673-b57f-e3ca7517be28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086758 Sep 13 16:58:05.245880 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2904/5745] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:05 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:05.275687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:05.311918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:05.446191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:05.446983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:05.462216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.463819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.464830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.465655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.467442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.469598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.525218 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b30dea1-f899-4352-a01e-6e5235e7bbb2 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "DELETE /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 204 len: 0 microversion: 2.47 time: 0.315038 Sep 13 16:58:05.527048 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2842/5746] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:58:05 2022] DELETE /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 16:58:05.541099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:05.542338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:05.550794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.551618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.552203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.553112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:05.553956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:05.555136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:05.703514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:05.717062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:05.718580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:05.724860 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d7f098a2-33db-4845-a177-4ef7c0101ad7 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1366 microversion: 2.47 time: 0.191369 Sep 13 16:58:05.725934 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2843/5747] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:05 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:05.755729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:05.765655 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-838f018b-980b-469f-bc95-7627a524024d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.324692 Sep 13 16:58:05.766281 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2905/5748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:05 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:06.179214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:06.180002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:06.187426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.188393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.190021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.196470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.205111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.210175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.231487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fa6b1d9f-7dc5-4ea5-86fd-16bc153ae1b0 req-3edc230c-ef0a-4087-a4fb-caf62f426787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150abdca-eed9-40b3-bdbe-2123e0bdb700", "name": "network-vif-deleted", "tag": "0c596af1-beae-4964-b3ad-8fb881ef6c4b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:06.263409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fa6b1d9f-7dc5-4ea5-86fd-16bc153ae1b0 req-3edc230c-ef0a-4087-a4fb-caf62f426787 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.264325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fa6b1d9f-7dc5-4ea5-86fd-16bc153ae1b0 req-3edc230c-ef0a-4087-a4fb-caf62f426787 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.264928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fa6b1d9f-7dc5-4ea5-86fd-16bc153ae1b0 req-3edc230c-ef0a-4087-a4fb-caf62f426787 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.295240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:06.312842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fa6b1d9f-7dc5-4ea5-86fd-16bc153ae1b0 req-3edc230c-ef0a-4087-a4fb-caf62f426787 service nova] Creating event network-vif-deleted:0c596af1-beae-4964-b3ad-8fb881ef6c4b for instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 on n-h2-857467-1 Sep 13 16:58:06.322766 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fa6b1d9f-7dc5-4ea5-86fd-16bc153ae1b0 req-3edc230c-ef0a-4087-a4fb-caf62f426787 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095721 Sep 13 16:58:06.326258 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2906/5749] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:06.341614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:06.344397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:06.354244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.354952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.355861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.358053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.359016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.359623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.368432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e2bbfcdd094f34898d5b3280b2b4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f630b43e85e4ea7a0889957e8316d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:06.377523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d55caf10-2aaa-45bf-be48-f9a07085928c tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 200 len: 1485 microversion: 2.1 time: 0.202457 Sep 13 16:58:06.384370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:06.400091 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2844/5750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:06 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 1485 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:06.406156 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-307d0a65-86fd-458f-9f12-c8cffeff8d11 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077741 Sep 13 16:58:06.407039 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2907/5751] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:06 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:06.752619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:06.754198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:06.763056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.764032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.764609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.765816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:06.766538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:06.767704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:06.793973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:06.854314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:06.865880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:06.867657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:06.868971 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19f89d6a-d94c-43f9-8a8e-bfb6fb0ad3d1 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1366 microversion: 2.47 time: 0.121704 Sep 13 16:58:06.870111 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2845/5752] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:06 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:07.243394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:07.244155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:07.251007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.251903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.252542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.253331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.253803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.254414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.413680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:07.414157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] [instance: 150abdca-eed9-40b3-bdbe-2123e0bdb700] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:07.423303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.424903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.425520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.426489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.427341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.428192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.450424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:07.456593 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] HTTP exception thrown: Instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 could not be found. Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Request method failure captured: Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 HTTP/1.1 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILaDBIoTsbJMxNvK_FHoBXjSMavBzkde1QXzWqjLEFfKsv3WfGO8hh11E7MZ5yt90c2_Rt4OW22snuGR-qXJZBb8hukSad_X94VAFJmbewdKkJVrRh6ilZ037rqebkdp2BWM_5H6Dlt5TctUoN2DNVUM6wvtk53pnWrFs4J3KA6cTOg Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 8f630b43e85e4ea7a0889957e8316d9a Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f630b43e85e4ea7a0889957e8316d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 8f630b43e85e4ea7a0889957e8316d9a Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-643062683 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerAddressesNegativeTestJSON-643062683-project Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b3e2bbfcdd094f34898d5b3280b2b4f9 Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-643062683-project Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 could not be found. Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '150abdca-eed9-40b3-bdbe-2123e0bdb700'} Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 could not be found. Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 could not be found. Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:07.459843 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 could not be found. Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:07.464062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] Returning 404 to user: Instance 150abdca-eed9-40b3-bdbe-2123e0bdb700 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:07.465213 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7a9e07ab-214e-4460-b255-f9b9b06be921 tempest-ServerAddressesNegativeTestJSON-643062683 tempest-ServerAddressesNegativeTestJSON-643062683-project] 10.222.0.61 "GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700" status: 404 len: 111 microversion: 2.1 time: 0.057802 Sep 13 16:58:07.465886 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2846/5753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:07 2022] GET /compute/v2.1/servers/150abdca-eed9-40b3-bdbe-2123e0bdb700 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:07.468264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e111f4e7-6883-4cc0-b6ba-0605f6e6db7f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.680288 Sep 13 16:58:07.475562 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2908/5754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:06 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:07.488576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:07.495266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:07.514836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.515394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.515853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.516595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.518799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.519271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.608035 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6b0810d4-2226-4c8c-9092-c94524c384eb tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134702 Sep 13 16:58:07.609108 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2847/5755] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:07 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:07.896962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:07.897811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:07.916349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.917137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.917742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:07.918672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:07.919295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:07.919886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:08.027708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:08.039240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:08.043357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:08.045100 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26830b84-dba4-45a1-857d-fad7893f85ff tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1366 microversion: 2.47 time: 0.152546 Sep 13 16:58:08.046366 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2909/5756] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:07 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:08.494472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:08.495113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:08.509735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:08.510254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:08.510697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:08.513143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:08.513668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:08.514150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:08.624889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:08.628150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:08.643361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:08.643932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:08.644374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:08.645101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:08.645722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:08.646483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:08.715652 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef75bd08-f54f-40a8-8f55-3ddb4025fc32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095603 Sep 13 16:58:08.721774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2910/5757] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:08 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:08.734579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:08.753865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93407db9-b3f4-4875-a7fa-ba277c81ba1b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.259963 Sep 13 16:58:08.756072 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2848/5758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:08 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:09.077560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:09.078320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:09.081102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:09.096298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:09.097271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:09.102010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:09.104864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:09.106381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:09.106835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:09.289910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:09.299520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:09.304683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:09.305981 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3cecc72-521c-4b2c-9050-6ed4609ffa64 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1366 microversion: 2.47 time: 0.232335 Sep 13 16:58:09.306569 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2911/5759] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:09 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:09.732999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:09.736662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:09.752475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:09.756447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:09.757163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:09.759119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:09.759806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:09.760766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:09.797871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:09.799530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:09.835141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:09.835660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:09.836116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:09.838093 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fafabafc-1ff8-4259-a7c8-ffdb9f4a73e1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104701 Sep 13 16:58:09.838832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:09.839311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:09.843318 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2849/5760] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:09 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:09.847467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:10.164035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:10.172636 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-edcfb67d-6008-407a-989c-60597b1a5561 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.387464 Sep 13 16:58:10.173976 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2912/5761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:09 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:10.333773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:10.334567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:10.341591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:10.341591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:10.345957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:10.347073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:10.348014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:10.349970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:10.482186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:10.495116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:10.497191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2ccb8ec04eb42a2b78aca796e122629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d93b00eed7f4f67a26b31d29ece9c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:10.498380 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a89d1d34-cc2a-4489-84bd-a08d4a764ce9 tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 200 len: 1366 microversion: 2.47 time: 0.169647 Sep 13 16:58:10.499268 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2850/5762] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:10 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:58:10.853541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:10.857483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:10.866090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:10.866842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:10.867590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:10.868464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:10.869081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:10.869667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:10.912285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2219a42c-8f7c-4b0a-a040-4b2f667fd464 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065159 Sep 13 16:58:10.913088 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2913/5763] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 16:58:10 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:58:10.989756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:10.990868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:10.998169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:10.998901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:10.999488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.000459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.001060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.001653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.037053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:11.195704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7deabccb-5fb8-43a2-a185-4f222acfcd4a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 204 len: 0 microversion: 2.1 time: 0.209825 Sep 13 16:58:11.197802 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2851/5764] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:10 2022] DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:11.202825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:11.203568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:11.213300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:11.214124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:11.217318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.221202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.223341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.225203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.225910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.226600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.243977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.244494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.246144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.246948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.247637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.248197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.486452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:11.498670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25c3fbe9-3636-4b79-bf53-79206b68824e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.306024 Sep 13 16:58:11.499522 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2914/5765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:11 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:11.528765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:11.529482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] [instance: 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:11.538537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.539880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.539880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.540060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:11.540672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:11.541482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:11.561270 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] HTTP exception thrown: Instance 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f could not be found. Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Request method failure captured: Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f HTTP/1.1 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILaTrsU8htuChsk4vcbxC1sQSecBwjofdMZr8N9IlQD_JaB3v2ns8aXVYjapT75jUBHxJDuSDkifOCYNpmYQxZ1bq6QiE8NMsfdarSYLfQ89dWLqbTRVU-0pDbMQaN_OsURxEXG4Il1BZmE0hBqbq752zH82wADXtlMl1HXomqyhzVo Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.47 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 2d93b00eed7f4f67a26b31d29ece9c51 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAaction247Test-528683237 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d93b00eed7f4f67a26b31d29ece9c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d93b00eed7f4f67a26b31d29ece9c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d93b00eed7f4f67a26b31d29ece9c51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d93b00eed7f4f67a26b31d29ece9c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAaction247Test-528683237 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 2d93b00eed7f4f67a26b31d29ece9c51 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAaction247Test-528683237 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAaction247Test-528683237-project Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c2ccb8ec04eb42a2b78aca796e122629 Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAaction247Test-528683237-project Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f could not be found. Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '944c6aca-fe1d-4cf9-8a4f-5c3334045c3f'} Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f could not be found. Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f could not be found. Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:11.563803 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f could not be found. Sep 13 16:58:11.567525 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:11.570552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] Returning 404 to user: Instance 944c6aca-fe1d-4cf9-8a4f-5c3334045c3f could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:11.572026 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf313a40-20ce-453f-805c-548f2bb4829b tempest-ServersAaction247Test-528683237 tempest-ServersAaction247Test-528683237-project] 10.222.0.61 "GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f" status: 404 len: 111 microversion: 2.47 time: 0.047892 Sep 13 16:58:11.573268 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2915/5766] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:58:11 2022] GET /compute/v2.1/servers/944c6aca-fe1d-4cf9-8a4f-5c3334045c3f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 16:58:11.656845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:11.671549 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-828d9aa5-1d8b-43b1-859c-8a4e49ffc4fa tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1683 microversion: 2.1 time: 0.469087 Sep 13 16:58:11.686866 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2852/5767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:11 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1683 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:12.526456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:12.527850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:12.550317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:12.555315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:12.555839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:12.556602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:12.557086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:12.557524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:12.712492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:12.717275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:12.748235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:12.748752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:12.749205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:12.749970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:12.750439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:12.750877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:12.863974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:12.875714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-387d21b8-97f8-471d-ac04-640858ee7876 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1678 microversion: 2.1 time: 0.354175 Sep 13 16:58:12.876624 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2916/5768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:12 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1678 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:12.977216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:12.987279 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6dc86d46-36f8-4b0a-a529-449a1adc7cd9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1683 microversion: 2.1 time: 0.287876 Sep 13 16:58:12.987865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2853/5769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:12 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1683 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:13.905717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:13.906441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:13.939292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:13.939819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:13.943152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:13.944093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:13.944568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:13.947121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:14.012508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:14.014142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:14.024722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:14.032027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:14.034646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:14.036895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:14.038153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:14.040746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:14.234648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:14.247476 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13107c74-3c9d-40f9-b313-0261657c4507 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1655 microversion: 2.1 time: 0.345088 Sep 13 16:58:14.248699 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2917/5770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:13 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1655 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:14.278714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c81477c1-09ff-4a3b-b16e-43ed49bfb0cb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:14.294722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c81477c1-09ff-4a3b-b16e-43ed49bfb0cb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:14.296168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c81477c1-09ff-4a3b-b16e-43ed49bfb0cb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:14.297984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c81477c1-09ff-4a3b-b16e-43ed49bfb0cb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:14.350440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c81477c1-09ff-4a3b-b16e-43ed49bfb0cb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Going to try to start instance {{(pid=122328) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 16:58:14.413542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:14.426920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a8ddac09-25e0-428a-ac73-02e7a8cd673d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1683 microversion: 2.1 time: 0.418749 Sep 13 16:58:14.427755 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2854/5771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:14 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1683 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:14.459941 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c81477c1-09ff-4a3b-b16e-43ed49bfb0cb tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.183282 Sep 13 16:58:14.477008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2918/5772] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:58:14 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:58:14.482351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:14.483013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:14.494707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:14.501914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:14.502656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:14.503603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:14.504268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:14.505077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:14.865372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:14.881881 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-668d1248-2ec2-4f4b-9f45-432374056fb4 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1664 microversion: 2.1 time: 0.396597 Sep 13 16:58:14.882717 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2855/5773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:14 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1664 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:15.079022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-0eadd611-3ce7-464a-aff9-16a08b9f6c8e req-230de77b-cd61-4d19-971f-8a0d29361745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54d3d86-40a0-4e90-8c28-333d854dc2b9", "name": "network-vif-deleted", "tag": "c4ce824e-54d5-45c1-8ef7-f4dc27780125"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:15.094091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0eadd611-3ce7-464a-aff9-16a08b9f6c8e req-230de77b-cd61-4d19-971f-8a0d29361745 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:15.094574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0eadd611-3ce7-464a-aff9-16a08b9f6c8e req-230de77b-cd61-4d19-971f-8a0d29361745 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:15.097639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-0eadd611-3ce7-464a-aff9-16a08b9f6c8e req-230de77b-cd61-4d19-971f-8a0d29361745 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:15.148559 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-0eadd611-3ce7-464a-aff9-16a08b9f6c8e req-230de77b-cd61-4d19-971f-8a0d29361745 service nova] Creating event network-vif-deleted:c4ce824e-54d5-45c1-8ef7-f4dc27780125 for instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 on n-h1-857467-1 Sep 13 16:58:15.162822 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-0eadd611-3ce7-464a-aff9-16a08b9f6c8e req-230de77b-cd61-4d19-971f-8a0d29361745 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085324 Sep 13 16:58:15.167859 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2919/5774] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:15.452341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:15.453595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:15.468204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:15.468921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:15.471777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:15.472751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:15.478915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:15.481379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:15.535773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:15.573978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:15.576095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:15.576645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:15.577975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'fault' on Instance uuid e54d3d86-40a0-4e90-8c28-333d854dc2b9 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:15.727527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:15.737424 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-303e7aac-8ff3-4a00-a083-05827e821cc0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 200 len: 1332 microversion: 2.1 time: 0.290665 Sep 13 16:58:15.746050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2856/5775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:15 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:15.911878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:15.913645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:15.925336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:15.927776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:15.928494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:15.929599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:15.930303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:15.930959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:16.779007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:16.779770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:16.809602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:16.822896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:16.825407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:16.826929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:16.827616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-747a9881-4851-4f5b-961d-d6b6e93e5dd5 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1664 microversion: 2.1 time: 0.924057 Sep 13 16:58:16.828754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:16.829942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:16.830421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2920/5776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:15 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1664 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:16.831168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:16.873714 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 HTTP/1.1 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e54d3d86-40a0-4e90-8c28-333d854dc2b9'} Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:16.877746 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 16:58:16.881493 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:16.888954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:16.890643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36f0f940-6430-4bbc-8a37-a2f586813b9f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 404 len: 111 microversion: 2.1 time: 0.121843 Sep 13 16:58:16.892426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2857/5777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:16 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:16.910458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42ed2156-e59f-4f71-b365-5b45678c795b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '.version_select at 0x7fbeb423cdc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:16.940618 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42ed2156-e59f-4f71-b365-5b45678c795b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828562179" status: 202 len: 0 microversion: 2.1 time: 0.043162 Sep 13 16:58:16.942488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2921/5778] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 16:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828562179 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:58:17.860738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:17.862154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:17.878737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:17.880162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:17.884458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:17.885615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:17.886320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:17.890974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:18.438993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:18.453216 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bbb3c7df-f475-4ff5-bdc8-b90dc5f2c1e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.597799 Sep 13 16:58:18.454574 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2858/5779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:17 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:18.487711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:18.490324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:18.511497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:18.512019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:18.512469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:18.513210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:18.513964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:18.514354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:18.828774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:18.839370 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4132db13-0b0a-4efb-a5bb-44d873cc66c6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.360494 Sep 13 16:58:18.839979 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2922/5780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:18 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:18.869072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:18.870413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:18.883278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:18.887678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:18.888720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:18.891404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:18.892133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:18.893314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:19.399038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:19.417539 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b2d7c789-ad80-479a-aa57-881c6ee459bc tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.551241 Sep 13 16:58:19.420368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2859/5781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:18 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:19.446733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:19.450301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:19.468559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:19.471257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:19.472386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:19.476978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:19.477646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:19.479405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:19.866928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aca2dd16-8e0e-4601-b0f6-e2e58768423b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: .version_select at 0x7fbeb4dbbf70>, body: {"keypair": {"name": "tempest-keypair-1455318672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBFvWhrN03EEllGN7yinnkjjwomBl6QsjKzFbrDVUEl4MjcMiy8sv/Hfl3Trv9wIVMVCAXWxBxuE1lHIrzuIaf/UVDYU6BYH8E18ZPywtuJ9Qo+AtNWI2sPA+SRuJUgpQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:19.890922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-aca2dd16-8e0e-4601-b0f6-e2e58768423b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:58:19.905146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-aca2dd16-8e0e-4601-b0f6-e2e58768423b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:58:19.940691 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aca2dd16-8e0e-4601-b0f6-e2e58768423b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081600 Sep 13 16:58:19.941494 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2860/5782] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:58:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:19.944186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:19.958255 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-521e1ffe-5e3b-4bfc-943e-a4d5996dfae1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.513752 Sep 13 16:58:19.961136 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2923/5783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:19 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:19.995804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:19.996859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:20.007208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:20.008090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:20.008759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:20.009890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:20.010612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:20.011449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:20.546797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:20.557847 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e37b3cc2-8ac2-422a-a45f-1ae3e6480840 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.574351 Sep 13 16:58:20.560232 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2861/5784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:19 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:20.586823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:20.588284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:20.606797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:20.608114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:20.609951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:20.612400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:20.613276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:20.615363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:20.690360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lazy-loading 'flavor' on Instance uuid 103aa645-a414-44d6-8c46-ab3cf2959ea8 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:20.831732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:20.868291 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-763df512-a8e3-496e-b3fa-64602a7e48e9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.287720 Sep 13 16:58:20.875901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2924/5785] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:58:20 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:58:20.881560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:20.882498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:20.899153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:20.900341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:20.901450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:20.902481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:20.903138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:20.903759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:21.470765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:21.480080 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea788af2-b4bc-4f6f-b33a-25f89cc803bd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1676 microversion: 2.1 time: 0.602958 Sep 13 16:58:21.482647 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2862/5786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:20 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1676 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:22.510123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:22.511134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:22.540764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:22.544448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:22.544941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:22.545717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:22.546235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:22.554795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:23.695636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:23.719288 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-85400724-52f1-4c53-b0af-276ea96bce6f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1659 microversion: 2.1 time: 1.217257 Sep 13 16:58:23.727754 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2925/5787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:22 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1659 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:23.756127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:23.758082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:23.772536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:23.773290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:23.777612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:23.778568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:23.779454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:23.780042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:23.908891 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.157180 Sep 13 16:58:23.915412 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2863/5788] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:58:23 2022] POST /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:58:23.919617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:23.920248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:23.933862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:23.934933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:23.936951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:23.938151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:23.939644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:23.945165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:24.701227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:24.722826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:24.724628 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee74c7a4-bcc0-4555-9d70-256f398c1333 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002235 Sep 13 16:58:24.724980 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2864/5789] 10.222.0.61 () {56 vars in 886 bytes} [Tue Sep 13 16:58:24 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 13 16:58:24.791137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc6dbe61-0761-4cf5-9a98-7ab6fc6ce9be tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1665 microversion: 2.1 time: 0.874003 Sep 13 16:58:24.799166 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2926/5790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:23 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1665 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:25.824967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:25.826621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:25.841665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:25.842603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:25.843891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:25.845693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:25.848517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:25.849242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:26.268479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:26.279682 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91c83f06-88a3-43f0-b417-82e783c97bed tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1665 microversion: 2.1 time: 0.459032 Sep 13 16:58:26.304885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2865/5791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:25 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1665 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:26.573413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-908319321", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a782e2f4-354d-45ea-a878-8641bbe8c757"}], "security_groups": [{"name": "tempest-securitygroup--1051266610"}], "key_name": "tempest-keypair-1455318672", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:26.850426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] validate_networks() for [('a782e2f4-354d-45ea-a878-8641bbe8c757', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:58:27.312382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:27.313007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:27.328695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:27.330898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:27.331550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:27.334606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:27.335267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:27.336567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:28.224056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:28.246574 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91486041-ed91-40c0-ac91-7b0e487e8014 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1665 microversion: 2.1 time: 0.938025 Sep 13 16:58:28.247532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2866/5792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:27 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1665 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:28.945423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:58:28.946479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:58:28.947169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:58:28.947792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:58:28.948468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:58:28.967182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:28.968860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:28.969474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:28.970799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:28.972628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:28.974367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:29.030354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:58:29.043127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:58:29.068234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:58:29.075250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:58:29.167103 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8af5dc01-444a-41f3-962c-f4adf62eeb3c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.598056 Sep 13 16:58:29.173093 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2927/5793] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:58:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:58:29.185557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d4f7297-ad8b-4eb2-9e8f-8b3ed780b8e6 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:29.187800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d4f7297-ad8b-4eb2-9e8f-8b3ed780b8e6 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:29.275639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:29.277437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:29.284553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d4f7297-ad8b-4eb2-9e8f-8b3ed780b8e6 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:29.293148 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d4f7297-ad8b-4eb2-9e8f-8b3ed780b8e6 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1241 microversion: 2.1 time: 0.112237 Sep 13 16:58:29.298253 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2867/5794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:29 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:29.298690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:29.299357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:29.299981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:29.301522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:29.302277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:29.302659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:29.693673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:29.704232 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce8cb88a-1add-484d-b204-a4a68a6bf335 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.435024 Sep 13 16:58:29.712806 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2928/5795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:29 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:29.741731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:29.742685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:29.751979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:29.757958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:29.758614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:29.759558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:29.763138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:29.763794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:30.265356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:30.286905 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5251d417-004c-4846-8662-46be49c10fd6 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1668 microversion: 2.1 time: 0.549247 Sep 13 16:58:30.290008 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2868/5796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:29 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1668 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:30.335862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:30.337191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:30.337884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:30.339124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:30.360434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:30.361905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:30.362587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:30.363279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:30.365301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:30.365932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:30.366861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:30.367970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:30.370405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:30.370885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:30.375974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:30.377359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:30.469943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:30.503922 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Working on deleting snapshot 5fe83c5f-dd7b-4282-8f1f-23dc667a2215 from shelved instance... Sep 13 16:58:30.684623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:30.699468 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0cc8caf-b2fb-4647-acdc-486c8c1d2fc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1237 microversion: 2.1 time: 0.378211 Sep 13 16:58:30.706574 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2929/5797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:30 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1237 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:31.730920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:31.731541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:31.749448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:31.749981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:31.750432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:31.751147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:31.751795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:31.752240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:31.771332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Doing local delete in cell 0841d836-33cc-4a39-be55-6b5864390dd5(cell1) {{(pid=122327) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 13 16:58:31.773756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:31.774576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:31.775170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:31.776930 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 13 16:58:31.784985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] deallocate_for_instance() {{(pid=122327) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 13 16:58:31.965041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:31.976712 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e2710e5-fb63-439e-ae08-1f4a849eb0f7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1299 microversion: 2.1 time: 0.250181 Sep 13 16:58:31.994488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2930/5798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:31 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1299 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:32.491899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Updating instance_info_cache with network_info: [] {{(pid=122327) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 13 16:58:32.516261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-03741e4d-11ec-4352-ac75-e3ea742ae808 req-3ab3cce1-c188-4ae8-b0a7-7d30b622a725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2659ee-3df6-4ba8-b11f-c8b526223d40", "name": "network-vif-deleted", "tag": "4d557627-d564-46a8-8e97-247256052111"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:32.550614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-03741e4d-11ec-4352-ac75-e3ea742ae808 req-3ab3cce1-c188-4ae8-b0a7-7d30b622a725 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:32.554781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-03741e4d-11ec-4352-ac75-e3ea742ae808 req-3ab3cce1-c188-4ae8-b0a7-7d30b622a725 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:32.555282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-03741e4d-11ec-4352-ac75-e3ea742ae808 req-3ab3cce1-c188-4ae8-b0a7-7d30b622a725 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:32.590591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.compute.server_external_events [req-03741e4d-11ec-4352-ac75-e3ea742ae808 req-3ab3cce1-c188-4ae8-b0a7-7d30b622a725 service nova] Unable to find a host for instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40. Dropping event network-vif-deleted {{(pid=122328) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 16:58:32.591575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-03741e4d-11ec-4352-ac75-e3ea742ae808 req-3ab3cce1-c188-4ae8-b0a7-7d30b622a725 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.080943 Sep 13 16:58:32.592209 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2931/5799] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 16:58:32.983715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-888375580", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "7d07229f-6e31-4fe8-8213-0c5d62c1516c"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:33.115756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] validate_networks() for [('7d07229f-6e31-4fe8-8213-0c5d62c1516c', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:58:33.216319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:33.295306 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4562910-0020-4e64-82d1-93e16e368a2e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 204 len: 0 microversion: 2.1 time: 2.976246 Sep 13 16:58:33.299014 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2869/5800] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:30 2022] DELETE /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 0 bytes in 2982 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:33.313021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:33.315452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:33.343810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:33.345366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:33.347485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:33.349929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:33.351793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:33.352858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:33.519397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:33.542155 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-11b9c163-3b6f-4ed7-b3fa-11484c211462 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1299 microversion: 2.1 time: 0.241153 Sep 13 16:58:33.543306 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2870/5801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:33 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:33.570497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:33.572813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 9e2659ee-3df6-4ba8-b11f-c8b526223d40] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:33.596471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:33.602666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:33.606158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:33.607084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:33.611223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:33.611922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:33.643412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] HTTP exception thrown: Instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 could not be found. Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Request method failure captured: Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 HTTP/1.1 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILREpgdA0POFKZKOjEeabEg6LNC0o1q1LrmhL-MQDYaKVNdWQ4Qnhea6ugkpyR98ZD11R0cCxeNblnQcfFUHpKEb4h_9XuWpiNHUvsl6Sq6IZDepS8ZtRBtbkJOw_aRBoqE13e647mdXEuAVVMrz0HkT1v2nzME7WbRw1Tdv8Ujgf-g Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_080f8140d40642d9b47f0689e294887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c2c12edf9f8d4b23bd1074facb2fad9d Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 could not be found. Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9e2659ee-3df6-4ba8-b11f-c8b526223d40'} Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 could not be found. Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 could not be found. Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:33.651936 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 could not be found. Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Returning 404 to user: Instance 9e2659ee-3df6-4ba8-b11f-c8b526223d40 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:33.656719 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-248f1fcd-4f46-4840-a5bd-4ebf3d86ab7d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40" status: 404 len: 111 microversion: 2.1 time: 0.109247 Sep 13 16:58:33.658293 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2871/5802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:33 2022] GET /compute/v2.1/servers/9e2659ee-3df6-4ba8-b11f-c8b526223d40 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:33.674214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:33.674736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:33.677410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:33.692746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:33.693330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:33.693916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:33.694698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:33.696385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:33.696877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:33.768842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:33.996065 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d65bc21-be0a-40a3-a091-3f853990c8d3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 204 len: 0 microversion: 2.1 time: 0.336370 Sep 13 16:58:34.000213 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2872/5803] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:33 2022] DELETE /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:34.013767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:34.022668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:34.042702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:34.043780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:34.046079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:34.046882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:34.047367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:34.050435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:34.715050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:34.729796 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f46c8eae-d0eb-436d-a7a7-a1af4ad9fd9f tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1465 microversion: 2.1 time: 0.727980 Sep 13 16:58:34.732606 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2873/5804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:34 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1465 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:34.736983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:34.737630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:34.746062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:34.746661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:34.747177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:34.748149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:34.748692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:34.749197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:35.216673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:35.229543 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f545814d-06f6-4519-95c9-c2af6a084529 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 0.496929 Sep 13 16:58:35.232434 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2874/5805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:34 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:35.764313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:35.765983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:35.778592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:35.781601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:35.782351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:35.786439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:35.786954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:35.787442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:36.131807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:58:36.132608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:58:36.133504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:58:36.137762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:58:36.138324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:58:36.164818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:36.172482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:36.175112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:36.175586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:36.177378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:36.178056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:36.178702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:36.179513 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1378819-d33c-4028-8d54-57602a59065e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1465 microversion: 2.1 time: 0.422557 Sep 13 16:58:36.206368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2875/5806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:35 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1465 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:36.232939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Getting quotas for project a958c00cb3cd4e74a03f8e0891329302. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:58:36.245074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Getting quotas for user 5c2572f275724fe79ad853fd73503614 and project a958c00cb3cd4e74a03f8e0891329302. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:58:36.257675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:36.258910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:36.275626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:36.276811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:36.277506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:36.278515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:36.279355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:36.280027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:36.307594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:58:36.312034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:58:36.439919 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99b02b92-c9e9-46fa-bc2a-1a6b98fee4f6 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.781132 Sep 13 16:58:36.443727 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2932/5807] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:58:36.458462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d7ab90c1-0842-4f8a-85e4-9d2675155855 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:36.459710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d7ab90c1-0842-4f8a-85e4-9d2675155855 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:37.006713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d7ab90c1-0842-4f8a-85e4-9d2675155855 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:37.020976 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d7ab90c1-0842-4f8a-85e4-9d2675155855 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1215 microversion: 2.1 time: 0.568627 Sep 13 16:58:37.074230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2933/5808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:36 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1215 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:37.219350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:37.221587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:37.245794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:37.255653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:37.256248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:37.259409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:37.259928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:37.260483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:37.487465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:37.499860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-868439e1-287e-478f-aedf-be4fe7984f6e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1465 microversion: 2.1 time: 0.285807 Sep 13 16:58:37.504772 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2934/5809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:37 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1465 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:37.835761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1ed28818-357d-4a90-8968-56e059fcb5ac req-b22aa927-a515-4a7f-976b-c7159c5a295b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd499bd3-53af-43f8-8c53-bf4db0b034ed", "name": "network-vif-deleted", "tag": "44d0c5c5-aede-4fdd-80ec-dc1992caae00"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:37.860881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1ed28818-357d-4a90-8968-56e059fcb5ac req-b22aa927-a515-4a7f-976b-c7159c5a295b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:37.860881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1ed28818-357d-4a90-8968-56e059fcb5ac req-b22aa927-a515-4a7f-976b-c7159c5a295b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:37.861258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1ed28818-357d-4a90-8968-56e059fcb5ac req-b22aa927-a515-4a7f-976b-c7159c5a295b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:37.891334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1ed28818-357d-4a90-8968-56e059fcb5ac req-b22aa927-a515-4a7f-976b-c7159c5a295b service nova] Creating event network-vif-deleted:44d0c5c5-aede-4fdd-80ec-dc1992caae00 for instance dd499bd3-53af-43f8-8c53-bf4db0b034ed on n-h2-857467-1 Sep 13 16:58:37.908485 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1ed28818-357d-4a90-8968-56e059fcb5ac req-b22aa927-a515-4a7f-976b-c7159c5a295b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077394 Sep 13 16:58:37.912311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2935/5810] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:38.009515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:38.010749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-67f22c6d-3dd2-46dc-a7fe-1df64cb88df5 req-8261c1ac-8dfd-4424-91ea-2f7f2a84bdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be42671-87d9-4a60-a0cf-bd2b85d8a90a", "tag": "27d9c7fc-ec8b-43e5-baa0-9d092696a366"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:38.032327 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a5bc49e-03e0-41e7-a616-94c34b21b577 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 1.776731 Sep 13 16:58:38.035543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-67f22c6d-3dd2-46dc-a7fe-1df64cb88df5 req-8261c1ac-8dfd-4424-91ea-2f7f2a84bdd7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:38.035823 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2876/5811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:36 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:38.037534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-67f22c6d-3dd2-46dc-a7fe-1df64cb88df5 req-8261c1ac-8dfd-4424-91ea-2f7f2a84bdd7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:38.038090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-67f22c6d-3dd2-46dc-a7fe-1df64cb88df5 req-8261c1ac-8dfd-4424-91ea-2f7f2a84bdd7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:38.066541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-67f22c6d-3dd2-46dc-a7fe-1df64cb88df5 req-8261c1ac-8dfd-4424-91ea-2f7f2a84bdd7 service nova] Creating event network-changed:27d9c7fc-ec8b-43e5-baa0-9d092696a366 for instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a on n-h1-857467-1 Sep 13 16:58:38.076270 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-67f22c6d-3dd2-46dc-a7fe-1df64cb88df5 req-8261c1ac-8dfd-4424-91ea-2f7f2a84bdd7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070280 Sep 13 16:58:38.077517 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2936/5812] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:38.081884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:38.083554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:38.095929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:38.098498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:38.099419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:38.112990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:38.115899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:38.116618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:38.283581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:38.294685 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc90ea79-74f9-4369-9d3a-7a01954a77b8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1267 microversion: 2.1 time: 0.245631 Sep 13 16:58:38.295302 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2877/5813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:38 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:38.309602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a2becb8-b5a1-45be-811c-4cd95b1ecada tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'create', calling method: .version_select at 0x7fbeb4b3bc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1496940420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIChI7w5AOsU15FzCcUd8F8yD0A0zWNr15ToAf5Z6cfTEIxQm80pNcGvnV9jWASvQCRAiMjDE8lA+d5fbf8Bb3LJMz8dGO+bDIwYXKiAANzciU7q2sw2LoEAhyhIhj2s1g=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:38.344355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0a2becb8-b5a1-45be-811c-4cd95b1ecada tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:58:38.361612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-0a2becb8-b5a1-45be-811c-4cd95b1ecada tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for user c57ef3ccd1c74d67b86e8ea75aafd433 and project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:58:38.432802 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a2becb8-b5a1-45be-811c-4cd95b1ecada tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.127687 Sep 13 16:58:38.434285 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2937/5814] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 16:58:38 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:38.532019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:38.532660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:38.545348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:38.547388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:38.548001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:38.557021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:38.557531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:38.558012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:38.661241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:38.662050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:38.663954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:38.664898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lazy-loading 'fault' on Instance uuid dd499bd3-53af-43f8-8c53-bf4db0b034ed {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:38.933893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63a59550-b57a-4f6b-b896-21dd8deba1f6 tempest-ComputeTenantNetworksTest-1940282886 tempest-ComputeTenantNetworksTest-1940282886-project] Calling method '.version_select at 0x7fbeb4579d30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:39.290177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:39.559586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:39.568920 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2bad901f-d049-4cdc-9007-90e0d742c0e7 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 200 len: 1304 microversion: 2.1 time: 1.041685 Sep 13 16:58:39.575747 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2878/5815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:38 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 1304 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:39.580796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:39.585877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:39.602945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:39.612762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:39.613586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:39.614282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:39.614767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:39.615218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:39.687391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63a59550-b57a-4f6b-b896-21dd8deba1f6 tempest-ComputeTenantNetworksTest-1940282886 tempest-ComputeTenantNetworksTest-1940282886-project] 10.222.0.61 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.075627 Sep 13 16:58:39.689178 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2938/5816] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 16:58:38 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:39.694901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:39.697876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:39.718652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:39.728382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:39.730251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:39.730875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:39.736503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:39.738690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:39.740191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:39.904303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:39.916386 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0eaab622-d993-4e45-9d67-0fc513ffc30c tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1273 microversion: 2.1 time: 0.225831 Sep 13 16:58:39.917264 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2939/5817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:39 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:39.932372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7069f28-7e57-4340-af61-5f20cb98d1e0 tempest-ComputeTenantNetworksTest-1940282886 tempest-ComputeTenantNetworksTest-1940282886-project] Calling method '.version_select at 0x7fbeb970e310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:40.088354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:40.101972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-70eee3b9-03a3-43d8-bbc7-27db9117ba12 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 0.524850 Sep 13 16:58:40.102822 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2879/5818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:39 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:40.294563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7069f28-7e57-4340-af61-5f20cb98d1e0 tempest-ComputeTenantNetworksTest-1940282886 tempest-ComputeTenantNetworksTest-1940282886-project] 10.222.0.61 "GET /compute/v2.1/os-tenant-networks/d9cedee4-9a4d-49d3-bb36-44ffaac3d171" status: 200 len: 140 microversion: 2.1 time: 0.375987 Sep 13 16:58:40.295716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2940/5819] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 16:58:39 2022] GET /compute/v2.1/os-tenant-networks/d9cedee4-9a4d-49d3-bb36-44ffaac3d171 => generated 140 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:40.618669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:40.625776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: dd499bd3-53af-43f8-8c53-bf4db0b034ed] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:40.637740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.639217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.639688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.641629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.643347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.647571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.685778 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] HTTP exception thrown: Instance dd499bd3-53af-43f8-8c53-bf4db0b034ed could not be found. Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Request method failure captured: Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed HTTP/1.1 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILREpgdA0POFKZKOjEeabEg6LNC0o1q1LrmhL-MQDYaKVNdWQ4Qnhea6ugkpyR98ZD11R0cCxeNblnQcfFUHpKEb4h_9XuWpiNHUvsl6Sq6IZDepS8ZtRBtbkJOw_aRBoqE13e647mdXEuAVVMrz0HkT1v2nzME7WbRw1Tdv8Ujgf-g Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_080f8140d40642d9b47f0689e294887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c2c12edf9f8d4b23bd1074facb2fad9d Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance dd499bd3-53af-43f8-8c53-bf4db0b034ed could not be found. Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'dd499bd3-53af-43f8-8c53-bf4db0b034ed'} Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd499bd3-53af-43f8-8c53-bf4db0b034ed could not be found. Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd499bd3-53af-43f8-8c53-bf4db0b034ed could not be found. Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:40.687510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd499bd3-53af-43f8-8c53-bf4db0b034ed could not be found. Sep 13 16:58:40.691772 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:40.710980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Returning 404 to user: Instance dd499bd3-53af-43f8-8c53-bf4db0b034ed could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:40.712224 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9de62557-2d70-4a8f-8013-8560674758e3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed" status: 404 len: 111 microversion: 2.1 time: 0.112402 Sep 13 16:58:40.714470 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2880/5820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:40 2022] GET /compute/v2.1/servers/dd499bd3-53af-43f8-8c53-bf4db0b034ed => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:40.732127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:40.733324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:40.742958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.743779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.744531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.746691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.747381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.748673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.795377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:40.930810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fa618ef-4b1c-4752-95cb-5e388df96981 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 204 len: 0 microversion: 2.1 time: 0.212717 Sep 13 16:58:40.933913 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2941/5821] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:40 2022] DELETE /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:58:40.942977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:40.944013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:40.953083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.953761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.954461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.959127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.959854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.960640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.965241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:40.966042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:40.982956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.984410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.985669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:40.986451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:40.987800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:40.989869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:41.261116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:41.275365 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d8ae4101-853f-4dce-bdf1-443632b598c3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1507 microversion: 2.1 time: 0.337247 Sep 13 16:58:41.277027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2881/5822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:40 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:41.284498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:41.286414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:41.295879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:41.296959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:41.297638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:41.298790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:41.299645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:41.300291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:41.728474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:41.746653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fbb0f1e8-e829-4f45-b32c-7cae2d0f23af tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 0.466217 Sep 13 16:58:41.747283 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2882/5823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:41 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:41.757297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-719310444", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:41.877373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:58:42.056988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:42.063900 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd1a66bd-bc21-4656-9e39-527f22099b3e tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1315 microversion: 2.1 time: 1.114434 Sep 13 16:58:42.064785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2942/5824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:40 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:42.305522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:42.306191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:42.318646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:42.319506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:42.320200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:42.320967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:42.321925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:42.322560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:42.471427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:58:42.472128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:58:42.474817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:58:42.475870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:58:42.486985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:58:42.500659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:42.501514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:42.502262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:42.503242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:42.503985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:42.504910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:42.528304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Getting quotas for project f90a49b28bc54c63b6897b8268d86c35. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:58:42.535797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Getting quotas for user b24713c518e34d699bfdafc9ccb8defb and project f90a49b28bc54c63b6897b8268d86c35. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:58:42.553457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:58:42.556271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:58:42.618297 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 16:58:43.074278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:43.084120 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-efa64452-fb3b-4b97-a325-da4e2e21cf6d tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1507 microversion: 2.1 time: 0.783005 Sep 13 16:58:43.085485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2943/5825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:42 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:43.092552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:43.094322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:43.103318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:43.105301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:43.106347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:43.107347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:43.108022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:43.108804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:43.637872 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37318. Sep 13 16:58:43.649226 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb54fae6-b5da-4c16-8065-4961a7beb8d3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900187 Sep 13 16:58:43.653085 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2883/5826] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:58:43.671176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-fcffc02d-acbc-4fac-890e-29598526e540 req-02a55117-dc6b-48a9-83cd-e3238871a3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e28e120-f3b9-4570-83c5-086a40be9aaf", "tag": "52f0930b-07be-4dd9-8a2a-78b4acce5f63"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:43.709099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fcffc02d-acbc-4fac-890e-29598526e540 req-02a55117-dc6b-48a9-83cd-e3238871a3ec service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:43.712460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:43.717016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fcffc02d-acbc-4fac-890e-29598526e540 req-02a55117-dc6b-48a9-83cd-e3238871a3ec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:43.717689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fcffc02d-acbc-4fac-890e-29598526e540 req-02a55117-dc6b-48a9-83cd-e3238871a3ec service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:43.729705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70dd784e-8f88-4ee2-b587-9b092dcb77ed tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 0.642312 Sep 13 16:58:43.730651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2944/5827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:43 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:43.741297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1857184615", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "83f8e1a3-fa6e-4723-bf36-9bcdfddfed86"}], "key_name": "tempest-TestNetworkBasicOps-1496940420", "security_groups": [{"name": "tempest-secgroup-smoke-1152783427"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:43.761520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fcffc02d-acbc-4fac-890e-29598526e540 req-02a55117-dc6b-48a9-83cd-e3238871a3ec service nova] Creating event network-changed:52f0930b-07be-4dd9-8a2a-78b4acce5f63 for instance 3e28e120-f3b9-4570-83c5-086a40be9aaf on n-h2-857467-1 Sep 13 16:58:43.776958 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-fcffc02d-acbc-4fac-890e-29598526e540 req-02a55117-dc6b-48a9-83cd-e3238871a3ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118005 Sep 13 16:58:43.778257 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2884/5828] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:43.799320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:43.800351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:43.820040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:43.822451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:43.823803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:43.825856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:43.827390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:43.828828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:44.204672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] validate_networks() for [('83f8e1a3-fa6e-4723-bf36-9bcdfddfed86', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:58:44.271626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:44.284691 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d76c5014-e7ac-4895-84e6-84c3921c4be8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1315 microversion: 2.1 time: 0.504860 Sep 13 16:58:44.286619 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2885/5829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:43 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:44.314466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c6f77fe5-3d6b-4198-98ce-8e077c782ebc req-e38ea4ad-2534-4c5b-a4e6-a535fc1d7cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48ccbf8-5c47-486b-a6c3-47ace85cb776", "name": "network-vif-deleted", "tag": "ead3dcc2-6be1-4155-aa2d-777fc78dc1f5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:44.350481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c6f77fe5-3d6b-4198-98ce-8e077c782ebc req-e38ea4ad-2534-4c5b-a4e6-a535fc1d7cbc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:44.351831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c6f77fe5-3d6b-4198-98ce-8e077c782ebc req-e38ea4ad-2534-4c5b-a4e6-a535fc1d7cbc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:44.352499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c6f77fe5-3d6b-4198-98ce-8e077c782ebc req-e38ea4ad-2534-4c5b-a4e6-a535fc1d7cbc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:44.357590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:DELETE=2,nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:44.372113 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c6f77fe5-3d6b-4198-98ce-8e077c782ebc req-e38ea4ad-2534-4c5b-a4e6-a535fc1d7cbc service nova] Creating event network-vif-deleted:ead3dcc2-6be1-4155-aa2d-777fc78dc1f5 for instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 on n-h2-857467-1 Sep 13 16:58:44.385123 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c6f77fe5-3d6b-4198-98ce-8e077c782ebc req-e38ea4ad-2534-4c5b-a4e6-a535fc1d7cbc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085123 Sep 13 16:58:44.389525 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2886/5830] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:44.443748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c50b2b9-b645-4096-8786-355a286fbf32 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:44.444496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c50b2b9-b645-4096-8786-355a286fbf32 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:44.602577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c50b2b9-b645-4096-8786-355a286fbf32 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:44.616017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c50b2b9-b645-4096-8786-355a286fbf32 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1214 microversion: 2.1 time: 0.224915 Sep 13 16:58:44.617920 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2887/5831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:44 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:44.637229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:44.638049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:44.646994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:44.647542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:44.648518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:44.649556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:44.650195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:44.650634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:44.703889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:44.704627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:44.705223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:44.705912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lazy-loading 'fault' on Instance uuid c48ccbf8-5c47-486b-a6c3-47ace85cb776 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:44.780216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:44.799225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-deb63ede-b294-46e5-b75a-df5805e1b260 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1305 microversion: 2.1 time: 0.178331 Sep 13 16:58:44.800073 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2888/5832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:44 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:45.092093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ebd87ff-0665-4638-be07-d7920b9ee3b8 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Action: 'create', calling method: .version_select at 0x7fbeb9703af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1038056670", "metadata": {"Type": "work"}}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:45.265361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:58:45.265854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:58:45.266740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:58:45.267163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:58:45.267585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:58:45.283773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.284279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.284726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:45.288776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.299830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.301229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:45.327854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:58:45.335392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for user c57ef3ccd1c74d67b86e8ea75aafd433 and project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:58:45.354029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:58:45.356959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:58:45.433034 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8eb12ec-2cc7-4fb5-ac36-e9514d0fc69b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.699348 Sep 13 16:58:45.434247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2945/5833] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:58:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:58:45.737650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:45.738568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:45.755489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.759139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.760420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:45.768253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.769082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.770264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:45.820508 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ebd87ff-0665-4638-be07-d7920b9ee3b8 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.019309 Sep 13 16:58:45.822155 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2889/5834] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Sep 13 16:58:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1021 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 16:58:45.826737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ab9af3e3-7f16-4393-88f4-5d41900f8772 req-278e4f55-975e-4a3a-8ed3-570fb9f12eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be42671-87d9-4a60-a0cf-bd2b85d8a90a", "name": "network-vif-plugged", "status": "completed", "tag": "27d9c7fc-ec8b-43e5-baa0-9d092696a366"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:45.855388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab9af3e3-7f16-4393-88f4-5d41900f8772 req-278e4f55-975e-4a3a-8ed3-570fb9f12eb8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.857731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab9af3e3-7f16-4393-88f4-5d41900f8772 req-278e4f55-975e-4a3a-8ed3-570fb9f12eb8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.860303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab9af3e3-7f16-4393-88f4-5d41900f8772 req-278e4f55-975e-4a3a-8ed3-570fb9f12eb8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:45.889646 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ab9af3e3-7f16-4393-88f4-5d41900f8772 req-278e4f55-975e-4a3a-8ed3-570fb9f12eb8 service nova] Creating event network-vif-plugged:27d9c7fc-ec8b-43e5-baa0-9d092696a366 for instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a on n-h1-857467-1 Sep 13 16:58:45.905081 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ab9af3e3-7f16-4393-88f4-5d41900f8772 req-278e4f55-975e-4a3a-8ed3-570fb9f12eb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081597 Sep 13 16:58:45.909788 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2890/5835] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:45.928200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:45.931115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:45.957718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.960763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.961442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:45.964246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:45.966366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:45.968271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:46.212915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:46.216514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:46.221633 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d161987a-7687-44a8-b498-ff69db4e8d5c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 0.786061 Sep 13 16:58:46.222941 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2946/5836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:45 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:46.236926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb86fecb-84bf-48d0-a0ba-619a6e6acb97 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:46.237474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb86fecb-84bf-48d0-a0ba-619a6e6acb97 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:46.358775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb86fecb-84bf-48d0-a0ba-619a6e6acb97 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:46.368692 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb86fecb-84bf-48d0-a0ba-619a6e6acb97 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1249 microversion: 2.1 time: 0.144351 Sep 13 16:58:46.370164 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2947/5837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:46 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1249 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:46.377370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:46.378268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:46.397460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:46.398371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:46.399060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:46.413309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:46.418364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:46.421511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:46.614730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:46.631765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9aeff6f-6f21-4fcc-853f-db74d560bf77 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1315 microversion: 2.1 time: 0.718730 Sep 13 16:58:46.633746 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2891/5838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:45 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:46.647361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:46.650106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:46.668194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:46.670142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:46.670848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:46.672532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:46.675259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:46.677010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:46.763988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:46.764760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:46.765439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:46.766364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lazy-loading 'fault' on Instance uuid c48ccbf8-5c47-486b-a6c3-47ace85cb776 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:46.798556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:46.807275 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b117175-aa2b-418d-b690-406c2d3cffa1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1272 microversion: 2.1 time: 0.435751 Sep 13 16:58:46.823096 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2948/5839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:46 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1272 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:46.845124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b06066c6-7aa5-4dbf-8161-bf70689c0d1d tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb54bdd30>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:46.887933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:46.913927 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7240d49b-8a40-4550-9cb8-ad733fbd0a95 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 200 len: 1305 microversion: 2.1 time: 0.276650 Sep 13 16:58:46.932041 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2892/5840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:46 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 1305 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:47.012079 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b06066c6-7aa5-4dbf-8161-bf70689c0d1d tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 200 len: 353 microversion: 2.1 time: 0.181312 Sep 13 16:58:47.014420 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2949/5841] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:46 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 353 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:47.244838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:47.245628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:47.254249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.254868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.255381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.256179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.256714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.257285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.398187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:47.406257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:47.407062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:47.407174 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8862b251-8380-4930-89dc-71d6f52e15b1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1367 microversion: 2.1 time: 0.166328 Sep 13 16:58:47.415032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.415509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.415794 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2893/5842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:47 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:47.415952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.416900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.417373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.417815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.622196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:47.630836 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27076f7c-848f-4444-b841-5a7b8f9875b1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1245 microversion: 2.1 time: 0.228492 Sep 13 16:58:47.631431 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2950/5843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:47 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1245 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:47.658152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:47.659657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:47.669171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.670147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.671108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.704272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.708975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.711052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.836930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:47.837908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:47.847250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.851786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.852659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:47.853642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:47.854382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:47.856245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.018211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:48.061996 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-944bae52-da13-4fa5-a68d-8054a1ec81f5 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1315 microversion: 2.1 time: 0.408902 Sep 13 16:58:48.080105 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2894/5844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:47 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:48.098557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.100181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: c48ccbf8-5c47-486b-a6c3-47ace85cb776] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:48.107024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.108423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.109128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.110370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.111080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.111736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.130153 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] HTTP exception thrown: Instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 could not be found. Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Request method failure captured: Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 HTTP/1.1 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILREpgdA0POFKZKOjEeabEg6LNC0o1q1LrmhL-MQDYaKVNdWQ4Qnhea6ugkpyR98ZD11R0cCxeNblnQcfFUHpKEb4h_9XuWpiNHUvsl6Sq6IZDepS8ZtRBtbkJOw_aRBoqE13e647mdXEuAVVMrz0HkT1v2nzME7WbRw1Tdv8Ujgf-g Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_080f8140d40642d9b47f0689e294887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c2c12edf9f8d4b23bd1074facb2fad9d Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 could not be found. Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c48ccbf8-5c47-486b-a6c3-47ace85cb776'} Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 could not be found. Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 could not be found. Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:48.132275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 could not be found. Sep 13 16:58:48.135920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:48.138013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Returning 404 to user: Instance c48ccbf8-5c47-486b-a6c3-47ace85cb776 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:48.139256 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-322c6141-8111-4798-95b7-84ef4d1e0149 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776" status: 404 len: 111 microversion: 2.1 time: 0.057629 Sep 13 16:58:48.140959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2895/5845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/servers/c48ccbf8-5c47-486b-a6c3-47ace85cb776 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:48.148059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-faae85cb-571d-4f0b-8b27-271fa30f9b47 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb5436e50>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.222565 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-faae85cb-571d-4f0b-8b27-271fa30f9b47 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 200 len: 354 microversion: 2.1 time: 0.079857 Sep 13 16:58:48.223845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2896/5846] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:48.227073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:48.229092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.229611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:48.237138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.237857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.238773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.239615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.240173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.240622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.241897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f00a9622-1a30-4388-83ca-df4d6d147ce1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.409778 Sep 13 16:58:48.255345 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2951/5847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:47 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:48.267828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c5f523f-cc19-4e43-aca8-73b8d6a58d15 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb4683e50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.291941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:48.330949 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c5f523f-cc19-4e43-aca8-73b8d6a58d15 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 200 len: 354 microversion: 2.1 time: 0.074068 Sep 13 16:58:48.341528 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2952/5848] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:48.356908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e32708a-bd68-4640-97fd-99fb3d3b5ef2 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb5351ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.455616 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1764276-9850-4798-ac93-0c60922759a3 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 204 len: 0 microversion: 2.1 time: 0.230315 Sep 13 16:58:48.457750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2897/5849] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:48 2022] DELETE /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:48.464739 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e32708a-bd68-4640-97fd-99fb3d3b5ef2 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 202 len: 0 microversion: 2.1 time: 0.121149 Sep 13 16:58:48.468236 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2953/5850] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 16:58:48 2022] DELETE /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:58:48.469914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.473706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:48.489103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.490989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:48.506028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.506842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.507483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.508407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.509119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.509769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.525682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.526497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.526952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.527690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.540366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.541020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.805946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:48.819400 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc7210d6-46e4-47f4-ba98-1bd19c04742e tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1493 microversion: 2.1 time: 0.349615 Sep 13 16:58:48.821280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2954/5851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1493 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:48.828472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be35550c-39b9-49eb-a2bc-0c213386e9fa tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb4579040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.887391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:48.898615 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3436c387-553e-42c0-8e51-f0eb4078816c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1557 microversion: 2.1 time: 0.439065 Sep 13 16:58:48.899216 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2898/5852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1557 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:48.915312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.915944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:48.922117 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be35550c-39b9-49eb-a2bc-0c213386e9fa tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 200 len: 353 microversion: 2.1 time: 0.099292 Sep 13 16:58:48.923026 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2955/5853] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:48.935613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:48.936122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:48.939684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.942489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.942954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.943712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.944186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.944624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.949205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.949981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.951119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:48.952074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:48.953002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:48.953856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.090591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:49.109541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8843400-de2d-4ba0-b854-2008e2e90be3 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1319 microversion: 2.1 time: 0.203498 Sep 13 16:58:49.110645 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2899/5854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:49.117727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:49.121122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:49.136982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.139765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.140387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.150281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.151286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.151900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.166504 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-402c368b-6522-4f24-9f8c-bf33e296b7c1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234590 Sep 13 16:58:49.167421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2956/5855] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 16:58:48 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:49.179869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-166c3707-041c-4df8-9646-79a0036d2d0f req-c73601b3-5607-402b-a84e-9316f30f6f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e28e120-f3b9-4570-83c5-086a40be9aaf", "name": "network-vif-plugged", "status": "completed", "tag": "52f0930b-07be-4dd9-8a2a-78b4acce5f63"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:49.203644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-166c3707-041c-4df8-9646-79a0036d2d0f req-c73601b3-5607-402b-a84e-9316f30f6f4d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.204469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-166c3707-041c-4df8-9646-79a0036d2d0f req-c73601b3-5607-402b-a84e-9316f30f6f4d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.205767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-166c3707-041c-4df8-9646-79a0036d2d0f req-c73601b3-5607-402b-a84e-9316f30f6f4d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.235088 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-166c3707-041c-4df8-9646-79a0036d2d0f req-c73601b3-5607-402b-a84e-9316f30f6f4d service nova] Creating event network-vif-plugged:52f0930b-07be-4dd9-8a2a-78b4acce5f63 for instance 3e28e120-f3b9-4570-83c5-086a40be9aaf on n-h2-857467-1 Sep 13 16:58:49.242195 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-166c3707-041c-4df8-9646-79a0036d2d0f req-c73601b3-5607-402b-a84e-9316f30f6f4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065932 Sep 13 16:58:49.243052 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2957/5856] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:49.278288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:49.279313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:49.286153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.286897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.287651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.288552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.289805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.290670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.611343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:49.632253 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2449f7a4-d8e5-427d-a5f3-2fe34c73b7de tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1315 microversion: 2.1 time: 0.517431 Sep 13 16:58:49.634663 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2900/5857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:49 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:49.865280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:49.872340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:49.873015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:49.886201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6946d97c-2cae-4082-9a4b-b48ec3776570 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.620988 Sep 13 16:58:49.888560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.889253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.890158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2958/5858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:49 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:49.904349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.909046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:49.910587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:49.911275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:49.939026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b7af51f4-c2a8-41e3-b2e2-62a07ed5d43a tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb96c0af0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:50.000450 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b7af51f4-c2a8-41e3-b2e2-62a07ed5d43a tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 200 len: 353 microversion: 2.1 time: 0.067474 Sep 13 16:58:50.001049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2959/5859] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:49 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:50.134755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:50.135394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:50.145662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:50.146531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:50.147004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:50.147741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:50.148179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:50.148623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:50.359723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:50.375895 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7c1ada6-1aee-42ca-8fd8-03c64954b994 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1493 microversion: 2.1 time: 0.530378 Sep 13 16:58:50.385891 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2901/5860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:49 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1493 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:50.595616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:50.606696 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-da7d03a8-64d1-4dc8-98d0-6506f48bc83d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1307 microversion: 2.1 time: 0.475735 Sep 13 16:58:50.617906 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2960/5861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:50 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1307 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:50.657244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:50.658467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:50.667217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:50.670414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:50.671107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:50.674067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:50.674770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:50.676043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:50.916978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:50.917596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:50.929189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:50.934211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:50.934904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:50.935969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:50.942632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:50.943489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:51.010901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:51.024560 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ebd90ae2-a282-436e-b7b2-851dc42098b9 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1315 microversion: 2.1 time: 0.372163 Sep 13 16:58:51.025176 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2902/5862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:50 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:51.030226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39ef50b9-4d1e-4685-bc3d-68e0dac30106 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb54369d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:51.162277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39ef50b9-4d1e-4685-bc3d-68e0dac30106 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 200 len: 353 microversion: 2.1 time: 0.135397 Sep 13 16:58:51.163795 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2903/5863] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:51 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:51.199221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8090dfee-b274-46f0-9d03-5f2e6f627c4d req-1b3a46e9-99f1-462f-ba18-b1d828f91def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f728c6-f9b2-4b0e-b678-ecd2e173fb8d", "tag": "83760dc9-520c-416e-b1b4-6bebd08be266"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:51.218910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8090dfee-b274-46f0-9d03-5f2e6f627c4d req-1b3a46e9-99f1-462f-ba18-b1d828f91def service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:51.220236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8090dfee-b274-46f0-9d03-5f2e6f627c4d req-1b3a46e9-99f1-462f-ba18-b1d828f91def service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:51.221014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8090dfee-b274-46f0-9d03-5f2e6f627c4d req-1b3a46e9-99f1-462f-ba18-b1d828f91def service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:51.264277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8090dfee-b274-46f0-9d03-5f2e6f627c4d req-1b3a46e9-99f1-462f-ba18-b1d828f91def service nova] Creating event network-changed:83760dc9-520c-416e-b1b4-6bebd08be266 for instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d on n-h1-857467-1 Sep 13 16:58:51.275684 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8090dfee-b274-46f0-9d03-5f2e6f627c4d req-1b3a46e9-99f1-462f-ba18-b1d828f91def service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085323 Sep 13 16:58:51.280031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2904/5864] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:51.403701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:51.404435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:51.414507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:51.417589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:51.419647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:51.420622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:51.424285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:51.425004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:51.720960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:51.733293 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0bbc6373-0dec-4b33-ac09-95356460d60d tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.820373 Sep 13 16:58:51.739469 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2961/5865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:50 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:51.752221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:51.752862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:51.763880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:51.771103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:51.771613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:51.772222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:51.772947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:51.773423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:51.773878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:51.783649 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-606c95e2-189c-4eec-8042-a62e2574088b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 200 len: 1451 microversion: 2.1 time: 0.384937 Sep 13 16:58:51.784425 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2905/5866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:51 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 1451 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:52.048852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:52.049593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:52.063813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:52.067581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:52.068213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:52.069056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:52.072349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:52.073078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:52.300277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:52.328272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5db59a23-4ca8-4382-9475-0feb5866509d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.587558 Sep 13 16:58:52.368541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2962/5867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:51 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:52.376337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e218383-2142-47b8-a8dd-3569afe30096 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Calling method '.version_select at 0x7fbeb980de50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:52.434842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2e218383-2142-47b8-a8dd-3569afe30096 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] HTTP exception thrown: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e218383-2142-47b8-a8dd-3569afe30096 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Request method failure captured: Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f HTTP/1.1 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILbE2v6egViksAfdEvRYOxQ9HtpPG3FKwdgzQfJY-ye5vt2ltVqTy-klPyh8Rwg_fVUrQ_ymuqbBI-lhx4GkYwDP--Rxg6gOMHmSseW5LGioYR-Ac1gfkZRYab9wrFSEgFsQX7etitcoTxGqrhA3csKMrl0Acj-FxkL09lP4hTH6ahs Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: efd0aafd08444b7f8c2789527feeefa2 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesGetTestJSON-2057962527 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/efd0aafd08444b7f8c2789527feeefa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_efd0aafd08444b7f8c2789527feeefa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/efd0aafd08444b7f8c2789527feeefa2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/efd0aafd08444b7f8c2789527feeefa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesGetTestJSON-2057962527 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: efd0aafd08444b7f8c2789527feeefa2 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesGetTestJSON-2057962527 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesGetTestJSON-2057962527-project Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f197eff567d544e2b7bc01c336b087d8 Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesGetTestJSON-2057962527-project Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: exception: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'a792b257-e1a3-4430-b522-aba60feb428f'} Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. (HTTP 404) (Request-ID: req-c71cca33-eb79-4e13-b1f3-284117928a2c) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 16:58:52.457906 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e218383-2142-47b8-a8dd-3569afe30096 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] Returning 404 to user: Volume a792b257-e1a3-4430-b522-aba60feb428f could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e218383-2142-47b8-a8dd-3569afe30096 tempest-VolumesGetTestJSON-2057962527 tempest-VolumesGetTestJSON-2057962527-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f" status: 404 len: 109 microversion: 2.1 time: 0.089543 Sep 13 16:58:52.461627 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2963/5868] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 16:58:52 2022] GET /compute/v2.1/os-volumes/a792b257-e1a3-4430-b522-aba60feb428f => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:52.514277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:52.756900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:52.757528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:52.777256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:52.777758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:52.778232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:52.778953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:52.779418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:52.779850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:52.921524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:52.940301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c8a7f599-ccdb-4186-9062-57e2d9cca071 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1502 microversion: 2.1 time: 0.894825 Sep 13 16:58:52.941996 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2906/5869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:52 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1502 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:52.947639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:52.948375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 6a59874a-c8d0-466a-9ad9-79571f19c221] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:52.955583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:52.956420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:52.957640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:52.958662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:52.959342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:52.960076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:52.965460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:53.034765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] HTTP exception thrown: Instance 6a59874a-c8d0-466a-9ad9-79571f19c221 could not be found. Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Request method failure captured: Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 HTTP/1.1 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILREpgdA0POFKZKOjEeabEg6LNC0o1q1LrmhL-MQDYaKVNdWQ4Qnhea6ugkpyR98ZD11R0cCxeNblnQcfFUHpKEb4h_9XuWpiNHUvsl6Sq6IZDepS8ZtRBtbkJOw_aRBoqE13e647mdXEuAVVMrz0HkT1v2nzME7WbRw1Tdv8Ujgf-g Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_080f8140d40642d9b47f0689e294887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c2c12edf9f8d4b23bd1074facb2fad9d Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 6a59874a-c8d0-466a-9ad9-79571f19c221 could not be found. Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6a59874a-c8d0-466a-9ad9-79571f19c221'} Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a59874a-c8d0-466a-9ad9-79571f19c221 could not be found. Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a59874a-c8d0-466a-9ad9-79571f19c221 could not be found. Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:58:53.037086 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a59874a-c8d0-466a-9ad9-79571f19c221 could not be found. Sep 13 16:58:53.041759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:58:53.047700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Returning 404 to user: Instance 6a59874a-c8d0-466a-9ad9-79571f19c221 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:58:53.048771 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a91c1065-9de8-4390-999f-7c54b6219baa tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221" status: 404 len: 111 microversion: 2.1 time: 0.105508 Sep 13 16:58:53.050006 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2907/5870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:52 2022] GET /compute/v2.1/servers/6a59874a-c8d0-466a-9ad9-79571f19c221 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:58:53.056196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.056942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.064831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:53.067623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.068560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.069252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.070329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.070980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.071745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.162199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:53.172376 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bfd431dd-772c-4136-bac6-636557d08469 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.419993 Sep 13 16:58:53.186425 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2964/5871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:52 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:53.186425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.186826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.194330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.194863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.200714 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8b3f51c4-9e38-4271-a36c-fd8b48ea8455 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.149106 Sep 13 16:58:53.201340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2908/5872] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Sep 13 16:58:53 2022] DELETE /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf/os-server-password => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:53.201719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.202774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.203437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.204050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.211248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.211673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.218071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.218579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.219026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.219740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.220202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.220635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.243850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:53.248828 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39855084-da75-4312-b8ef-84904991d5d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.042244 Sep 13 16:58:53.249959 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2909/5873] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Sep 13 16:58:53 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf/os-server-password => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 16:58:53.260322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.261244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.270524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.271771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.272444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.273470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.274277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.274897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.317534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:58:53.368752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ece0fe66-3643-4ee4-ba63-bb9e193f5a15 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "DELETE /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 204 len: 0 microversion: 2.1 time: 0.189144 Sep 13 16:58:53.370128 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2965/5874] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:53 2022] DELETE /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:53.376669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a59874a-c8d0-466a-9ad9-79571f19c221", "name": "network-vif-deleted", "tag": "2916652f-3ae7-4192-b63a-b871a2c7bc5d"}, {"name": "network-changed", "server_uuid": "8be42671-87d9-4a60-a0cf-bd2b85d8a90a", "tag": "27d9c7fc-ec8b-43e5-baa0-9d092696a366"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:53.393690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.394839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.395272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.426308 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d14ca03c-cfbc-44c5-bbae-bc1e5325ee79 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 204 len: 0 microversion: 2.1 time: 0.167416 Sep 13 16:58:53.428023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2910/5875] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:58:53 2022] DELETE /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:58:53.434313 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] Creating event network-vif-deleted:2916652f-3ae7-4192-b63a-b871a2c7bc5d for instance 6a59874a-c8d0-466a-9ad9-79571f19c221 on n-h2-857467-1 Sep 13 16:58:53.434844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] Creating event network-changed:27d9c7fc-ec8b-43e5-baa0-9d092696a366 for instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a on n-h1-857467-1 Sep 13 16:58:53.440329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.444469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.445393 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a3a1ddb8-0bf4-4b78-84c8-8a9ff0673c5d req-dd19b9e5-bbfe-4f22-9a69-4acd014a9a9b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.073095 Sep 13 16:58:53.446567 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2966/5876] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:53.452061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.452967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.457854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.458546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.459136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.460804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.461564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.462081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.462363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.462762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.463211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.463990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.464474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.464906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.619888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:53.629261 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b76cd57a-eb08-4b93-8e17-1a5f0fb18a29 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1674 microversion: 2.1 time: 0.181406 Sep 13 16:58:53.630890 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2967/5877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:53 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:53.636883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:53.637898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:53.645422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.646307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.646974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.647981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.648642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.649137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.796385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:53.805710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c874859-b127-4e78-bc91-04f2ff8b74e4 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1508 microversion: 2.1 time: 0.172975 Sep 13 16:58:53.806557 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2968/5878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:53 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:53.903811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:53.912102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9ea9844-5c8f-4185-afd9-9ce572d9e6f9 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.481930 Sep 13 16:58:53.912715 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2911/5879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:53 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:53.969070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ea83b2d8-c84d-47aa-aa67-e86b09712dbc req-ae4b4671-b570-4ec0-82ce-7450697842e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1130ee85-e901-45b2-9897-e88dc5377402", "tag": "fc6fea20-f3ec-4010-8cbe-949ed1471365"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:53.979274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ea83b2d8-c84d-47aa-aa67-e86b09712dbc req-ae4b4671-b570-4ec0-82ce-7450697842e8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:53.980141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ea83b2d8-c84d-47aa-aa67-e86b09712dbc req-ae4b4671-b570-4ec0-82ce-7450697842e8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:53.980830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ea83b2d8-c84d-47aa-aa67-e86b09712dbc req-ae4b4671-b570-4ec0-82ce-7450697842e8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:53.995467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ea83b2d8-c84d-47aa-aa67-e86b09712dbc req-ae4b4671-b570-4ec0-82ce-7450697842e8 service nova] Creating event network-changed:fc6fea20-f3ec-4010-8cbe-949ed1471365 for instance 1130ee85-e901-45b2-9897-e88dc5377402 on n-h2-857467-1 Sep 13 16:58:54.001903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ea83b2d8-c84d-47aa-aa67-e86b09712dbc req-ae4b4671-b570-4ec0-82ce-7450697842e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037763 Sep 13 16:58:54.003138 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2969/5880] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:54.198394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:54.199235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:54.209056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:54.209788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:54.210675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:54.212190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:54.212878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:54.213695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:54.423842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:54.453695 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aeac6ff7-ae5e-4725-9564-88d25800c915 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.259628 Sep 13 16:58:54.455075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2912/5881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:54 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:54.655287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:54.655993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:54.668643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:54.669143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:54.669584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:54.672592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:54.674418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:54.676627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:54.832785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:54.833684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:54.835886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=8 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:54.850013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:54.851731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:54.852260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:54.856483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:54.858533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:54.862460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:54.962685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:54.974955 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5455c0c-b57f-4673-a054-89393e9dcacd tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1674 microversion: 2.1 time: 0.325847 Sep 13 16:58:54.975962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2970/5882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:54 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1674 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:54.998529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:54.999502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:55.030102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:55.030612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:55.031072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:55.031802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:55.032272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:55.032711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:55.040321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:55.314254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:55.315908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:55.323737 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7169bcba-0ba4-457d-859d-f1f8976f7130 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1508 microversion: 2.1 time: 0.495467 Sep 13 16:58:55.334901 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2913/5883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:54 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:55.479808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:55.481547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:55.486841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:55.487334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:55.488467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:55.488843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:55.489326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:55.489746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:55.536525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:55.547266 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de81e8b6-53e8-4864-9cc0-4371edaab0dd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.553310 Sep 13 16:58:55.553074 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2971/5884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:54 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:55.905343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:55.918040 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9592ed3-bca5-4469-92d6-b6fbc866a5b1 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.440078 Sep 13 16:58:55.934657 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2914/5885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:55 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:55.975906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-65d8a5fb-bebc-4d3d-8273-e41e204d1bb1 req-8ddf734f-0921-454f-9e9b-9a201a58427d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e28e120-f3b9-4570-83c5-086a40be9aaf", "name": "network-vif-deleted", "tag": "52f0930b-07be-4dd9-8a2a-78b4acce5f63"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:55.999927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-65d8a5fb-bebc-4d3d-8273-e41e204d1bb1 req-8ddf734f-0921-454f-9e9b-9a201a58427d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.001649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-65d8a5fb-bebc-4d3d-8273-e41e204d1bb1 req-8ddf734f-0921-454f-9e9b-9a201a58427d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.003063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-65d8a5fb-bebc-4d3d-8273-e41e204d1bb1 req-8ddf734f-0921-454f-9e9b-9a201a58427d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.015113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:56.016427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:56.024089 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-65d8a5fb-bebc-4d3d-8273-e41e204d1bb1 req-8ddf734f-0921-454f-9e9b-9a201a58427d service nova] Creating event network-vif-deleted:52f0930b-07be-4dd9-8a2a-78b4acce5f63 for instance 3e28e120-f3b9-4570-83c5-086a40be9aaf on n-h2-857467-1 Sep 13 16:58:56.031558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-65d8a5fb-bebc-4d3d-8273-e41e204d1bb1 req-8ddf734f-0921-454f-9e9b-9a201a58427d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067141 Sep 13 16:58:56.037110 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2972/5886] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:58:56.040661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.041648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.042284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.043205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.044227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.044830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.360702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:56.362468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:56.370455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=26 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:56.372981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.373679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.374671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.376196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.376991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.377866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.422049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.422560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.423012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.423476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lazy-loading 'fault' on Instance uuid 3e28e120-f3b9-4570-83c5-086a40be9aaf {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:56.469423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:56.504407 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f1e9b17b-ac5b-4f6f-a56d-0fbbd73422c1 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1674 microversion: 2.1 time: 0.502429 Sep 13 16:58:56.520268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:56.520470 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2915/5887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:55 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1674 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:56.533220 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8258263e-f103-41e1-9caf-1529fdad10f0 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1305 microversion: 2.1 time: 0.176781 Sep 13 16:58:56.537695 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2973/5888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:56 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1305 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:56.576568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:56.577277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:56.589086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.590059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.590822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.601817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.602683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.603403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.919675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:56.929378 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e38268ed-06bd-4459-8d59-cdd1580ad2e0 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.356618 Sep 13 16:58:56.942575 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2916/5889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:56 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:56.943879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:56.944563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:56.955880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.956492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.962005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:56.963733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:56.964276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:56.964813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.416023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:57.425161 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-913e29c0-4097-4699-8182-838c06ba480e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.486167 Sep 13 16:58:57.426587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2974/5890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:56 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:57.541404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:57.542054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:57.549037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.549627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.550156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.551598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.552138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.552645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.565423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:57.566430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:57.575462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.579893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.580551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.581450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.584498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.585212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.651336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.652065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.652904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.655925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lazy-loading 'fault' on Instance uuid 3e28e120-f3b9-4570-83c5-086a40be9aaf {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:57.752874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:57.763577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57c09bb9-35a3-437d-88be-4c8299d79edb tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1305 microversion: 2.1 time: 0.203181 Sep 13 16:58:57.765002 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2975/5891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:57 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1305 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:57.926536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:57.934857 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0483cf63-d992-46ff-b832-4abd51e458f9 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1674 microversion: 2.1 time: 0.397330 Sep 13 16:58:57.935443 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2917/5892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:57 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1674 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:57.959096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:57.960195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:57.966475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.967156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.967606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:57.968319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:57.968781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:57.969242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.322569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:58.330562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db695b5a-9dc2-494f-aeda-3e6176ecc242 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.376313 Sep 13 16:58:58.346642 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2976/5893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:57 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:58.394718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9c52d872-367b-41b2-9f48-867c71bdad52 req-a3972322-3719-4d4b-bd14-475cd67097b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f728c6-f9b2-4b0e-b678-ecd2e173fb8d", "name": "network-vif-plugged", "status": "completed", "tag": "83760dc9-520c-416e-b1b4-6bebd08be266"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:58.413412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c52d872-367b-41b2-9f48-867c71bdad52 req-a3972322-3719-4d4b-bd14-475cd67097b8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.414209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c52d872-367b-41b2-9f48-867c71bdad52 req-a3972322-3719-4d4b-bd14-475cd67097b8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.415945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9c52d872-367b-41b2-9f48-867c71bdad52 req-a3972322-3719-4d4b-bd14-475cd67097b8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.440278 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9c52d872-367b-41b2-9f48-867c71bdad52 req-a3972322-3719-4d4b-bd14-475cd67097b8 service nova] Creating event network-vif-plugged:83760dc9-520c-416e-b1b4-6bebd08be266 for instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d on n-h1-857467-1 Sep 13 16:58:58.449504 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9c52d872-367b-41b2-9f48-867c71bdad52 req-a3972322-3719-4d4b-bd14-475cd67097b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057640 Sep 13 16:58:58.449815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:58.450603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:58.451815 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2918/5894] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:58.460699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.461330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.462292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.464225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.467128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.468327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.791355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:58.792095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:58.804754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.805398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.806167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.806990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.807563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.808510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.872096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.872696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.873416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.874377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lazy-loading 'fault' on Instance uuid 3e28e120-f3b9-4570-83c5-086a40be9aaf {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:58:58.945400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2572f275724fe79ad853fd73503614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a958c00cb3cd4e74a03f8e0891329302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:58.959221 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d7e3007-1233-4af6-a619-5c6fe9e234d8 tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 200 len: 1305 microversion: 2.1 time: 0.173983 Sep 13 16:58:58.960065 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2919/5895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:58 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:58.974380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:58.974380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:58.974607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.975233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.975900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.976619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:58.977116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:58.977550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:58.980370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:58.988924 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7486edfa-e85c-4159-be8c-3d98f218a2e6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.544246 Sep 13 16:58:58.990283 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2977/5896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:58 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:58:59.085689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:59.099253 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-947b10e9-592f-484d-a301-25ba90d9447b tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1606 microversion: 2.1 time: 0.137918 Sep 13 16:58:59.101180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2920/5897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:58 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1606 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:59.183439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-77911548-1093-4fc0-9d3c-de8b6e916af5 req-d327d9f7-a3d5-43b1-8bf2-3d0977a69d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103aa645-a414-44d6-8c46-ab3cf2959ea8", "name": "network-vif-deleted", "tag": "943c2e0b-ce24-4cbd-96b9-b415d4402091"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:58:59.200934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-77911548-1093-4fc0-9d3c-de8b6e916af5 req-d327d9f7-a3d5-43b1-8bf2-3d0977a69d3d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:59.202379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-77911548-1093-4fc0-9d3c-de8b6e916af5 req-d327d9f7-a3d5-43b1-8bf2-3d0977a69d3d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:59.202781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-77911548-1093-4fc0-9d3c-de8b6e916af5 req-d327d9f7-a3d5-43b1-8bf2-3d0977a69d3d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:59.216869 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-77911548-1093-4fc0-9d3c-de8b6e916af5 req-d327d9f7-a3d5-43b1-8bf2-3d0977a69d3d service nova] Creating event network-vif-deleted:943c2e0b-ce24-4cbd-96b9-b415d4402091 for instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 on n-h1-857467-1 Sep 13 16:58:59.229967 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-77911548-1093-4fc0-9d3c-de8b6e916af5 req-d327d9f7-a3d5-43b1-8bf2-3d0977a69d3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053650 Sep 13 16:58:59.231555 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2978/5898] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:58:59.354963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:59.355707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:59.369751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:59.370396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:59.371077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:59.372012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:58:59.372691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:58:59.373359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:58:59.574629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:58:59.584427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ddebe3f0-a893-4e8d-a002-303b16eab6c2 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.233268 Sep 13 16:58:59.596234 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2921/5899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:59 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:58:59.986220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:58:59.987557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] [instance: 3e28e120-f3b9-4570-83c5-086a40be9aaf] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:58:59.990272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:58:59.998967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.001509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.002352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.003786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.004949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.005581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.011369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:00.012526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:00.020403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.025875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.027859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.029818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.032688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.033141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.047951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:00.057313 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] HTTP exception thrown: Instance 3e28e120-f3b9-4570-83c5-086a40be9aaf could not be found. Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Request method failure captured: Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf HTTP/1.1 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILa4qZmX_5tB2vkJfq5EcJA9L5MJM3DmUtY-6vfPVdovHpXtrhB97rvCowQk2CR9FVXvzgsQQlFxRx46zDrbTV7OEyeUEJrDd2JYF1GKnGkHZSd2kcnS2-2YDcXvbpRTEF0DXyxqzRB-QL9GotFQ0eUUHogrhNQCQnRMx8XyRgjJDDM Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a958c00cb3cd4e74a03f8e0891329302 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerPasswordTestJSON-668125221 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a958c00cb3cd4e74a03f8e0891329302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a958c00cb3cd4e74a03f8e0891329302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a958c00cb3cd4e74a03f8e0891329302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a958c00cb3cd4e74a03f8e0891329302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerPasswordTestJSON-668125221 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a958c00cb3cd4e74a03f8e0891329302 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerPasswordTestJSON-668125221 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerPasswordTestJSON-668125221-project Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5c2572f275724fe79ad853fd73503614 Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerPasswordTestJSON-668125221-project Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 3e28e120-f3b9-4570-83c5-086a40be9aaf could not be found. Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3e28e120-f3b9-4570-83c5-086a40be9aaf'} Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e28e120-f3b9-4570-83c5-086a40be9aaf could not be found. Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e28e120-f3b9-4570-83c5-086a40be9aaf could not be found. Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:00.059331 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e28e120-f3b9-4570-83c5-086a40be9aaf could not be found. Sep 13 16:59:00.063636 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:00.065460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] Returning 404 to user: Instance 3e28e120-f3b9-4570-83c5-086a40be9aaf could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:59:00.067102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36a8231a-f12b-4058-b90d-eeb47c7ce57d tempest-ServerPasswordTestJSON-668125221 tempest-ServerPasswordTestJSON-668125221-project] 10.222.0.61 "GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf" status: 404 len: 111 microversion: 2.1 time: 0.086765 Sep 13 16:59:00.068630 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2979/5900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:58:59 2022] GET /compute/v2.1/servers/3e28e120-f3b9-4570-83c5-086a40be9aaf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:59:00.125603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:00.126262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:00.136473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.149995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.151271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.159645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.161010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.165358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.253011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.256439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.259077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.259945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lazy-loading 'fault' on Instance uuid 103aa645-a414-44d6-8c46-ab3cf2959ea8 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:59:00.358871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c12edf9f8d4b23bd1074facb2fad9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080f8140d40642d9b47f0689e294887b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:00.370132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1069609d-6900-47ce-8019-206df3ebce74 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 200 len: 1328 microversion: 2.1 time: 0.247742 Sep 13 16:59:00.386771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2980/5901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:00 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 1328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:00.609347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:00.610039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:00.617293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.617992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.618611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.619521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:00.620359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:00.632241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:00.902755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:00.915423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:00.917270 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-71bab010-6dfd-4244-8db7-60f4fbdf97cc tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.312068 Sep 13 16:59:00.919833 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2981/5902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:00 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:00.939643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b746ede8-8879-4dc3-8cb7-c06958806a9f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1314 microversion: 2.1 time: 0.931991 Sep 13 16:59:00.940553 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2922/5903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:00 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:01.400617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:01.402125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] [instance: 103aa645-a414-44d6-8c46-ab3cf2959ea8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:01.410931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:01.411677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:01.412334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:01.413250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:01.413948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:01.414579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:01.430680 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] HTTP exception thrown: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 could not be found. Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Request method failure captured: Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 HTTP/1.1 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILREpgdA0POFKZKOjEeabEg6LNC0o1q1LrmhL-MQDYaKVNdWQ4Qnhea6ugkpyR98ZD11R0cCxeNblnQcfFUHpKEb4h_9XuWpiNHUvsl6Sq6IZDepS8ZtRBtbkJOw_aRBoqE13e647mdXEuAVVMrz0HkT1v2nzME7WbRw1Tdv8Ujgf-g Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_080f8140d40642d9b47f0689e294887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/080f8140d40642d9b47f0689e294887b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 080f8140d40642d9b47f0689e294887b Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-1135533663 Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c2c12edf9f8d4b23bd1074facb2fad9d Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-1135533663-project Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 could not be found. Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '103aa645-a414-44d6-8c46-ab3cf2959ea8'} Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 could not be found. Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 could not be found. Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:01.432285 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 could not be found. Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Returning 404 to user: Instance 103aa645-a414-44d6-8c46-ab3cf2959ea8 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f17cc78c-8373-4241-9025-e0a99509ce59 tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8" status: 404 len: 111 microversion: 2.1 time: 0.037187 Sep 13 16:59:01.436450 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2982/5904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:01 2022] GET /compute/v2.1/servers/103aa645-a414-44d6-8c46-ab3cf2959ea8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:59:01.443503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0906157-8844-4eb5-81b2-fe31c419074c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] Calling method '.version_select at 0x7fbeb5730550>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:01.474160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0906157-8844-4eb5-81b2-fe31c419074c tempest-ServerActionsTestJSON-1135533663 tempest-ServerActionsTestJSON-1135533663-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454730044" status: 202 len: 0 microversion: 2.1 time: 0.035231 Sep 13 16:59:01.475777 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2923/5905] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Sep 13 16:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454730044 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:59:01.946463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:01.947365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:01.960411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:01.961289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:01.963091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:01.965363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:01.966049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:01.966716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:01.967416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:01.970345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:01.983336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:01.986418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:01.989533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:01.990366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:01.990861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:01.991443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:02.500873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:02.513096 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0314a8f-1f4a-4828-982d-2262ef82ea3e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.572338 Sep 13 16:59:02.514502 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2983/5906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:01 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:02.557866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:02.571764 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca5b7f5f-536d-42d2-8452-7a9841f0e6eb tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1463 microversion: 2.1 time: 0.611738 Sep 13 16:59:02.574287 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2924/5907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:01 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1463 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:02.640685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:02.641468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:02.651574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:02.652303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:02.652908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:02.654507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:02.655155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:02.655757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:02.695703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:59:02.822482 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f00f0920-2dfc-44e6-a72a-6814ca88de7e tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "DELETE /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 204 len: 0 microversion: 2.1 time: 0.186282 Sep 13 16:59:02.825985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2984/5908] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:59:02 2022] DELETE /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:59:02.834551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:02.835178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:02.847693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:02.850457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:02.853983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:02.854946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:02.855591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:02.856220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:03.169980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:03.183548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad81e76b-6792-46b2-accb-50def6e242a7 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1469 microversion: 2.1 time: 0.353500 Sep 13 16:59:03.189178 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2925/5909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:02 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:03.544416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:03.546417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:03.560048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:03.560774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:03.561940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:03.562972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:03.563601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:03.564379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:03.754811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-28dc46e5-43bd-437f-af54-7b5d935aa84d req-43a236e2-891c-43de-aa54-ac95db7cfbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1130ee85-e901-45b2-9897-e88dc5377402", "name": "network-vif-plugged", "status": "completed", "tag": "fc6fea20-f3ec-4010-8cbe-949ed1471365"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:03.808300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28dc46e5-43bd-437f-af54-7b5d935aa84d req-43a236e2-891c-43de-aa54-ac95db7cfbf0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:03.809152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28dc46e5-43bd-437f-af54-7b5d935aa84d req-43a236e2-891c-43de-aa54-ac95db7cfbf0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:03.814574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28dc46e5-43bd-437f-af54-7b5d935aa84d req-43a236e2-891c-43de-aa54-ac95db7cfbf0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:03.844346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-28dc46e5-43bd-437f-af54-7b5d935aa84d req-43a236e2-891c-43de-aa54-ac95db7cfbf0 service nova] Creating event network-vif-plugged:fc6fea20-f3ec-4010-8cbe-949ed1471365 for instance 1130ee85-e901-45b2-9897-e88dc5377402 on n-h2-857467-1 Sep 13 16:59:03.854660 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-28dc46e5-43bd-437f-af54-7b5d935aa84d req-43a236e2-891c-43de-aa54-ac95db7cfbf0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106110 Sep 13 16:59:03.855690 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2926/5910] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:59:04.217680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:04.221863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:04.247898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:04.249730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:04.250461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:04.251901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:04.252626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:04.253854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:04.560965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:04.581077 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71623243-9bdf-4bb0-9b98-4547cb8facf3 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1469 microversion: 2.1 time: 0.369136 Sep 13 16:59:04.583049 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2927/5911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:04 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:04.652878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:04.679215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-15341649-1d65-44f2-a51d-9b57ac3a08fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 1.140028 Sep 13 16:59:04.679858 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2985/5912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:03 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:05.607020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:05.609586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:05.634689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:05.635626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:05.636364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:05.637377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:05.638086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:05.638770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:05.706965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:05.708412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:05.738649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:05.741667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:05.742522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:05.743631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:05.744581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:05.746534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:05.869108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24713c518e34d699bfdafc9ccb8defb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90a49b28bc54c63b6897b8268d86c35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:05.882894 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0e87490-a4a7-4626-923a-13f03b2113a6 tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 200 len: 1427 microversion: 2.1 time: 0.281644 Sep 13 16:59:05.883518 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2928/5913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:05 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 1427 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:05.932879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b503da38-2a47-41b5-935c-9f40d925f5e2 req-88461e3b-9b0b-44cc-8d5d-0d1b18cca9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f728c6-f9b2-4b0e-b678-ecd2e173fb8d", "name": "network-vif-deleted", "tag": "83760dc9-520c-416e-b1b4-6bebd08be266"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:05.975556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b503da38-2a47-41b5-935c-9f40d925f5e2 req-88461e3b-9b0b-44cc-8d5d-0d1b18cca9de service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:05.976057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b503da38-2a47-41b5-935c-9f40d925f5e2 req-88461e3b-9b0b-44cc-8d5d-0d1b18cca9de service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:05.985782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b503da38-2a47-41b5-935c-9f40d925f5e2 req-88461e3b-9b0b-44cc-8d5d-0d1b18cca9de service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:06.036908 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b503da38-2a47-41b5-935c-9f40d925f5e2 req-88461e3b-9b0b-44cc-8d5d-0d1b18cca9de service nova] Creating event network-vif-deleted:83760dc9-520c-416e-b1b4-6bebd08be266 for instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d on n-h1-857467-1 Sep 13 16:59:06.054987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b503da38-2a47-41b5-935c-9f40d925f5e2 req-88461e3b-9b0b-44cc-8d5d-0d1b18cca9de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141809 Sep 13 16:59:06.058900 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2929/5914] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:59:06.311136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:06.323787 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1f701a8-3543-461b-80a6-b981cf97b210 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1375 microversion: 2.1 time: 0.622782 Sep 13 16:59:06.333878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2986/5915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:05 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1375 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:06.908523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:06.910520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] [instance: 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:06.919473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:06.920588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:06.921752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:06.922717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:06.923717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:06.924475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:06.953153 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] HTTP exception thrown: Instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d could not be found. Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Request method failure captured: Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d HTTP/1.1 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILa-VnZLuIPWF7w0xCtXbv9_hMSAKSREVlEC_0_Gd93sL5TFAT5L6pgevxLZxQYKF0mz8FX9NJrUTVK2ghLSh0M2ySjG2vu0bQHamlpdhwQ5k9fAaKGCoLNfecBJv1Y07iR_BvjsI8EyL3d7j29OyDiAcgbYIl7KfdLA64yItk2NeJU Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f90a49b28bc54c63b6897b8268d86c35 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesNegativeTest-9552516 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f90a49b28bc54c63b6897b8268d86c35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f90a49b28bc54c63b6897b8268d86c35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f90a49b28bc54c63b6897b8268d86c35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f90a49b28bc54c63b6897b8268d86c35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesNegativeTest-9552516 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f90a49b28bc54c63b6897b8268d86c35 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesNegativeTest-9552516 Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesNegativeTest-9552516-project Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b24713c518e34d699bfdafc9ccb8defb Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesNegativeTest-9552516-project Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d could not be found. Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '94f728c6-f9b2-4b0e-b678-ecd2e173fb8d'} Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d could not be found. Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d could not be found. Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:06.956062 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d could not be found. Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 16:59:06.960920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] Returning 404 to user: Instance 94f728c6-f9b2-4b0e-b678-ecd2e173fb8d could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:59:06.962297 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d3d5af2-e6c8-46eb-b1eb-2077d43c085f tempest-VolumesNegativeTest-9552516 tempest-VolumesNegativeTest-9552516-project] 10.222.0.61 "GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d" status: 404 len: 111 microversion: 2.1 time: 0.054555 Sep 13 16:59:06.962917 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2930/5916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:06 2022] GET /compute/v2.1/servers/94f728c6-f9b2-4b0e-b678-ecd2e173fb8d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:59:07.354062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:07.355522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:07.382371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:07.383528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:07.383989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:07.390929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:07.391430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:07.391875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:07.726046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:07.729911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:07.735272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9c59e0b-b760-42c8-a08d-d5239674f743 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1548 microversion: 2.1 time: 0.386157 Sep 13 16:59:07.755465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2987/5917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:07 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1548 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:07.778101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:07.779011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:07.797213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:07.802573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:07.804039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:07.806948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:07.812020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:07.812692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:08.365227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:08.375491 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9696adff-2aa3-41ee-8712-4d02b483993d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1548 microversion: 2.1 time: 0.601519 Sep 13 16:59:08.376102 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2931/5918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:07 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1548 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:10.275536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-305104344", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:10.434495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:59:10.434933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:59:10.435420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:59:10.435841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:59:10.436265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:59:10.468196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:10.468196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:10.474728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:10.475580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:10.476132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:10.476522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:10.523084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Getting quotas for project 5811a4c89bfc4b909e1827c64aa94e6b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:59:10.539838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Getting quotas for user fd95340d1ecd4a77a228c3d25053567f and project 5811a4c89bfc4b909e1827c64aa94e6b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:59:10.575413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:59:10.579417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:59:10.691554 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28f6d2f4-e2dd-4228-929e-64a3118bf8eb tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.691744 Sep 13 16:59:10.692849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2988/5919] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:59:10.704794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a22c678-5067-4e04-bc5a-017660889e0f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:10.707080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a22c678-5067-4e04-bc5a-017660889e0f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:10.932011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a22c678-5067-4e04-bc5a-017660889e0f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:10.946812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a22c678-5067-4e04-bc5a-017660889e0f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:10.949428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a22c678-5067-4e04-bc5a-017660889e0f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:10.953160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a22c678-5067-4e04-bc5a-017660889e0f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc" status: 200 len: 1277 microversion: 2.47 time: 0.250002 Sep 13 16:59:10.970907 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2932/5920] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:10 2022] GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:11.093133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-762685155", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:11.211097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:59:11.211923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:59:11.214328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:59:11.215580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:59:11.216160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:59:11.239178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:11.243891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:11.245328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:11.248312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:11.249087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:11.250689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:11.310915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Getting quotas for project 5811a4c89bfc4b909e1827c64aa94e6b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:59:11.327273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Getting quotas for user fd95340d1ecd4a77a228c3d25053567f and project 5811a4c89bfc4b909e1827c64aa94e6b. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:59:11.368891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:59:11.371744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:59:11.490378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4e9fb32-893c-440c-a895-6bfa471ec66f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.401452 Sep 13 16:59:11.492353 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2989/5921] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 16:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 16:59:11.506795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae73ecc5-3d8b-480f-82db-b59ab33a2288 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:11.510067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae73ecc5-3d8b-480f-82db-b59ab33a2288 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:11.655126 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae73ecc5-3d8b-480f-82db-b59ab33a2288 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "PUT /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 991 microversion: 2.47 time: 0.156473 Sep 13 16:59:11.673875 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2933/5922] 10.222.0.61 () {62 vars in 1297 bytes} [Tue Sep 13 16:59:11 2022] PUT /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 991 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 16:59:11.682959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19ec558c-9be7-4f79-bf15-ae5f2d26fe78 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:11.683785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19ec558c-9be7-4f79-bf15-ae5f2d26fe78 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:11.822341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19ec558c-9be7-4f79-bf15-ae5f2d26fe78 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:11.836286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19ec558c-9be7-4f79-bf15-ae5f2d26fe78 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:11.837735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19ec558c-9be7-4f79-bf15-ae5f2d26fe78 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:11.840613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19ec558c-9be7-4f79-bf15-ae5f2d26fe78 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1277 microversion: 2.47 time: 0.162797 Sep 13 16:59:11.842508 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2990/5923] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:11 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:12.882815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:12.884318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:12.915261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:12.915981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:12.916543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:12.917428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:12.921026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:12.922936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:13.726550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:13.738164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:13.740323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:13.743404 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0a4424d-85ef-4c9b-a211-1c113916dcff tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1281 microversion: 2.47 time: 0.877173 Sep 13 16:59:13.744565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2934/5924] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:12 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1281 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:14.773414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:14.774356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:14.794764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:14.810489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:14.813221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:14.814124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:14.818376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:14.825114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:15.279746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:15.291607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:15.306498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:15.308005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c8dcdf6-1a46-412c-a740-9c9c43aa2bf8 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1337 microversion: 2.47 time: 0.540648 Sep 13 16:59:15.309000 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2991/5925] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:14 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1337 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:16.340316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:16.340760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:16.353658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:16.354523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:16.355133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:16.356153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:16.356783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:16.357381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:16.457713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:16.474784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:16.476663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:16.478647 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d81386c4-5b17-4182-8f68-dceab20c64d7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1347 microversion: 2.47 time: 0.143733 Sep 13 16:59:16.479814 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2935/5926] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:16 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1347 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:17.505516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:17.506446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:17.518529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:17.520285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:17.520845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:17.521698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:17.527247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:17.527839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:17.687561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:17.698630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:17.700050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:17.701244 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-afa01a49-d648-468e-9a1b-e7a4871ea07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1335 microversion: 2.47 time: 0.200252 Sep 13 16:59:17.701854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2992/5927] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:17 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1335 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:18.729559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:18.730643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:18.748065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:18.749491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:18.751605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:18.753996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:18.756612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:18.759535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:18.929566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:18.949511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:18.951488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:18.953118 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1fbb6a60-037a-4248-a431-0ffbc8739b89 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1335 microversion: 2.47 time: 0.228248 Sep 13 16:59:18.956855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2936/5928] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:18 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1335 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:19.980676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:19.981391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:20.007960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:20.009301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:20.014689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:20.026678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:20.027418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:20.028235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:20.198525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:20.215079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:20.220143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:20.222590 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-614de62a-bf6a-48ef-8a81-93358adfce03 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1335 microversion: 2.47 time: 0.246330 Sep 13 16:59:20.224224 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2993/5929] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:19 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1335 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:21.257455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:21.258019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:21.275299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:21.281666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:21.282314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:21.283989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:21.284992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:21.286010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:21.286455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:21.560952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:21.577506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:21.580115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:21.581166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abdd482f-30cc-4a77-a8eb-2b86401f6a05 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1335 microversion: 2.47 time: 0.328422 Sep 13 16:59:21.596365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2937/5930] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:21 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1335 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:22.618099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:22.618823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:22.621447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:22.626644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:22.665136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:22.667133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:22.671581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:22.673967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:22.674445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:22.678608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:22.956060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:22.991070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:22.992586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:22.993875 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7d29f17-506e-4bd0-bf89-e3ef55a84221 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1356 microversion: 2.47 time: 0.386256 Sep 13 16:59:22.995862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2994/5931] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:22 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1356 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:23.027132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:23.033244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:23.066656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:23.071102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:23.071802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:23.079073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:23.079503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:23.079960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:23.273326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:23.287585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:59:23.288386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:59:23.289121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:59:23.289754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:59:23.290881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:59:23.435310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:23.451858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:23.453701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:23.454547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:23.457610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:23.460072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:23.460676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:23.546807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fe3340a1-e784-4d94-aaee-14d19256fa54 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "POST /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e/action" status: 202 len: 1078 microversion: 2.47 time: 0.526481 Sep 13 16:59:23.558040 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2938/5932] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 16:59:23 2022] POST /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e/action => generated 1078 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 13 16:59:23.574295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:23.575178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:23.591232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:23.595399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:23.596236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:23.597770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:23.598472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:23.615514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:23.772143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:23.789193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:23.792838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:23.794128 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2fb9f3ac-d038-44d9-83b0-5297b12491e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.226029 Sep 13 16:59:23.802365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2995/5933] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:23 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:24.840259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:24.841223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:24.863043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:24.864720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:24.865271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:24.866167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:24.867596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:24.868211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:25.048859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:25.072846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:25.074803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:25.076194 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94bb1062-ab51-4c99-b619-162b78a53889 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.251330 Sep 13 16:59:25.077218 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2939/5934] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:24 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:25.717382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-163489853", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:25.777676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] validate_networks() for [('8bf13fff-cea1-4558-9dae-1aad6420a676', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 16:59:26.122573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:26.123370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:26.138545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:26.139193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:26.139742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:26.140716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:26.145516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:26.146762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:26.316809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:26.330534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:26.336327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:26.339022 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b2996197-94f3-40c9-bc17-45f1b5503aa7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.220443 Sep 13 16:59:26.340213 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2940/5935] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:26 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:26.693539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 16:59:26.694413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 16:59:26.695319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 16:59:26.696358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 16:59:26.697214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 16:59:26.731139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:26.735906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:26.737671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:26.740508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:26.744379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:26.745341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:26.786199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Getting quotas for project 713153c3d1724f269f58844c6c10c9d4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 16:59:26.793596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Getting quotas for user 7c397be23d6b41e58154d2e8799b71d5 and project 713153c3d1724f269f58844c6c10c9d4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 16:59:26.811967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 16:59:26.815134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 16:59:26.894650 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7938a008-9eeb-4a39-a77d-1f19a2edcbd8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.637163 Sep 13 16:59:26.895641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2996/5936] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 16:59:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 16:59:26.908458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e83d1d5a-6c80-4745-8cda-ca8108f717c0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:26.908653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e83d1d5a-6c80-4745-8cda-ca8108f717c0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:27.042644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e83d1d5a-6c80-4745-8cda-ca8108f717c0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:27.055982 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e83d1d5a-6c80-4745-8cda-ca8108f717c0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1213 microversion: 2.1 time: 0.152377 Sep 13 16:59:27.067783 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2941/5937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:26 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:27.377803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:27.381260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:27.399653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:27.400183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:27.400651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:27.401609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:27.402112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:27.402711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:27.524012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:27.546457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:27.550776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:27.552065 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-65a2e9bf-bac2-4815-90ee-7da71cf209f7 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.184445 Sep 13 16:59:27.553269 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2997/5938] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:27 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:28.079770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:28.080402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:28.095880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:28.096976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:28.097438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:28.100701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:28.101208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:28.101673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:28.325512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:28.333085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:28.345055 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cff08c55-7b68-4a66-b822-0ea751864665 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1209 microversion: 2.1 time: 0.268874 Sep 13 16:59:28.345762 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2942/5939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:28 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1209 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:28.590473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:28.593589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:28.614117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:28.615327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:28.616602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:28.618132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:28.621102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:28.622461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:28.875133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:28.889565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:28.891051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:28.892255 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b039601-053a-4cac-a299-f8d5464be07b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.313790 Sep 13 16:59:28.892831 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2998/5940] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:28 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:29.371036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:29.373027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:29.388849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:29.392082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:29.392730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:29.406198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:29.406708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:29.407177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:29.516644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:29.537429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6d13b1c-d675-4610-b508-a8aabd860fcc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1271 microversion: 2.1 time: 0.170448 Sep 13 16:59:29.542830 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2943/5941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:29 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:29.923582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:29.924232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:29.937705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:29.952671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:29.953181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:29.955454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:29.956042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:29.956494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:30.065843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:30.077211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:30.079684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:30.082116 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c2f616e-778d-4a9c-8196-ead6c61e651a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.163225 Sep 13 16:59:30.082371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 2999/5942] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:29 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:30.566029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:30.566650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:30.581177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:30.582283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:30.582910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:30.583809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:30.590095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:30.590775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:30.774111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:30.799738 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-171df016-af88-4888-8df5-ccc6b95a675f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1271 microversion: 2.1 time: 0.237431 Sep 13 16:59:30.816013 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2944/5943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:30 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:31.109319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:31.111436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:31.115030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:31.139842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:31.141024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:31.143113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:31.145671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:31.146818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:31.148434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:31.350288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:31.376970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:31.379734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:31.385036 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38ae4f97-043a-4eb5-a608-636b202a1380 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.278930 Sep 13 16:59:31.414257 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3000/5944] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:31 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:31.825021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:31.826820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:31.838811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:31.842768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:31.843835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:31.846022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:31.847298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:31.849069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:32.372113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:32.384342 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-823c8286-5300-400c-8de3-46b446a76e65 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.563835 Sep 13 16:59:32.385408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2945/5945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:31 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:32.424989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:32.425750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:32.433888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:32.434922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:32.435596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:32.436625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:32.437322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:32.438014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:32.668846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:32.684061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:32.692292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:32.704212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-582e5305-5ea6-4ca8-a66d-3238d560bb65 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.284273 Sep 13 16:59:32.705105 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3001/5946] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:32 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:32.936833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ecf887a7-6313-4719-8ab1-222b03a68750 req-835d2b04-57fb-4058-a9a1-2d12b5931408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea464788-8e5a-4684-989d-5739fd77a887", "tag": "f34daf22-3fb8-47bb-bc5e-f016d7a6da09"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:32.965140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecf887a7-6313-4719-8ab1-222b03a68750 req-835d2b04-57fb-4058-a9a1-2d12b5931408 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:32.965637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecf887a7-6313-4719-8ab1-222b03a68750 req-835d2b04-57fb-4058-a9a1-2d12b5931408 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:32.966470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ecf887a7-6313-4719-8ab1-222b03a68750 req-835d2b04-57fb-4058-a9a1-2d12b5931408 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:32.979871 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ecf887a7-6313-4719-8ab1-222b03a68750 req-835d2b04-57fb-4058-a9a1-2d12b5931408 service nova] Creating event network-changed:f34daf22-3fb8-47bb-bc5e-f016d7a6da09 for instance ea464788-8e5a-4684-989d-5739fd77a887 on n-h2-857467-1 Sep 13 16:59:32.986170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ecf887a7-6313-4719-8ab1-222b03a68750 req-835d2b04-57fb-4058-a9a1-2d12b5931408 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053341 Sep 13 16:59:32.987879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2946/5947] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:59:33.413554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:33.417262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:33.434847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:33.437427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:33.438717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:33.440358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:33.441254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:33.442083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:33.742415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:33.743120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:33.749717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:33.750236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:33.750679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:33.751387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:33.752086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:33.752799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:33.805367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:33.823445 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee5127b7-8b35-47db-ae18-241adf2b9ed4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.416640 Sep 13 16:59:33.824143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3002/5948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:33 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:33.848788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:33.876884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:33.880146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:33.889845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-67586983-f17a-4057-b30b-4bd5bc592025 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.147233 Sep 13 16:59:33.889845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2947/5949] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:33 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:34.852912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:34.853606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:34.864592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:34.866409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:34.867498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:34.868386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:34.868998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:34.869594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:34.912441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:34.913158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:34.935502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:34.936051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:34.936441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:34.937170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:34.937628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:34.938088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:35.140093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:35.154782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:35.159955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:35.161464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-098b4075-410f-4396-8e32-e195f997fab0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.254142 Sep 13 16:59:35.162164 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2948/5950] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:34 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:35.220045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:35.231052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0111278f-01a9-43b6-aad6-dd5eed7ef1e4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.382323 Sep 13 16:59:35.231663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3003/5951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:34 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:36.192152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:36.193093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:36.218754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:36.219354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:36.219814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:36.220561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:36.225466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:36.226095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:36.257563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:36.257563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:36.289269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:36.290184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:36.303961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:36.309957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:36.310935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:36.311663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:36.429443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:36.438708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:36.451460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:36.456229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b73f6771-ea13-4a9e-833d-350a42a40418 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.268812 Sep 13 16:59:36.458517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2949/5952] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:36 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:36.772533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:36.806178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:36.818797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:36.838660 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c454ade0-7278-485d-b8bc-72a49277ab7d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.588411 Sep 13 16:59:36.857736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3004/5953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:36 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:37.488879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:37.489546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:37.492724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:37.511872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:37.512377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:37.512821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:37.513551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:37.514059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:37.514496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:37.723363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:37.803650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:37.805325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:37.820742 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e329f80-0c4e-4710-b67c-ed66a11ce7ef tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.337053 Sep 13 16:59:37.824407 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2950/5954] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:37 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:37.874090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:37.875910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:37.901918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:37.902648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:37.903276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:37.904390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:37.905026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:37.905696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:38.294058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:38.316131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3a71967-f5ae-4921-9589-1836709dad39 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.442527 Sep 13 16:59:38.316817 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3005/5955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:37 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:38.848797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:38.849420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:38.856840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:38.857593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:38.858757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:38.859657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:38.860118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:38.860717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:39.035389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:39.047504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:39.050265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:39.052009 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fd54ae6-4d3c-47fb-8858-fbc4e63a852f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.207401 Sep 13 16:59:39.074066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2951/5956] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:38 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:39.341208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:39.343631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:39.353093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:39.354109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:39.354790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:39.355758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:39.356697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:39.357364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:39.560748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:39.570223 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d395f9be-284d-49a8-a717-07f495e57a97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.233229 Sep 13 16:59:39.571014 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3006/5957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:39 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:40.083860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:40.084576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:40.101289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:40.101973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:40.102438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:40.105363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:40.105917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:40.106379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:40.275799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:40.298121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:40.300777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:40.302154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e60d2b85-d47c-46c6-8251-5af9d9d73fed tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.224284 Sep 13 16:59:40.319692 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2952/5958] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:40 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:40.601113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:40.601657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:40.626394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:40.626903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:40.627421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:40.629158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:40.631144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:40.632104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:40.635465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:40.844820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:40.853357 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e9a85f9-5c08-46b1-829e-dc4d65fe6fa8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.263133 Sep 13 16:59:40.867479 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3007/5959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:40 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:41.330266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:41.331931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:41.348318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:41.349763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:41.351907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:41.353806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:41.375430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:41.376077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:41.514646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:41.555982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:41.558697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:41.560299 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96df954b-c21b-4364-b38d-ff493bd69138 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.234115 Sep 13 16:59:41.567437 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2953/5960] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:41 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:41.881298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:41.882674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:41.895105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:41.896368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:41.897016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:41.897969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:41.899619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:41.900477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:42.297616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e5b6712d-6770-4039-a809-c67306e34a22 req-a2fd3ce7-0b4f-4400-b0d6-f650a0c3e423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea464788-8e5a-4684-989d-5739fd77a887", "name": "network-vif-plugged", "status": "completed", "tag": "f34daf22-3fb8-47bb-bc5e-f016d7a6da09"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:42.328257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e5b6712d-6770-4039-a809-c67306e34a22 req-a2fd3ce7-0b4f-4400-b0d6-f650a0c3e423 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:42.328891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e5b6712d-6770-4039-a809-c67306e34a22 req-a2fd3ce7-0b4f-4400-b0d6-f650a0c3e423 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:42.329385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e5b6712d-6770-4039-a809-c67306e34a22 req-a2fd3ce7-0b4f-4400-b0d6-f650a0c3e423 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:42.343586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:42.353279 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e73802cf-7dcd-47c1-ade9-820191fc86a7 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.477704 Sep 13 16:59:42.364312 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e5b6712d-6770-4039-a809-c67306e34a22 req-a2fd3ce7-0b4f-4400-b0d6-f650a0c3e423 service nova] Creating event network-vif-plugged:f34daf22-3fb8-47bb-bc5e-f016d7a6da09 for instance ea464788-8e5a-4684-989d-5739fd77a887 on n-h2-857467-1 Sep 13 16:59:42.372131 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3008/5961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:41 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:42.387858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e5b6712d-6770-4039-a809-c67306e34a22 req-a2fd3ce7-0b4f-4400-b0d6-f650a0c3e423 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095339 Sep 13 16:59:42.388804 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2954/5962] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:59:42.589383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:42.590365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:42.601178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:42.601959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:42.602595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:42.605933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:42.606425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:42.607108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:43.251455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:43.267305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:43.271060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:43.272673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0ae9c9f-8eab-4077-bd85-023e7b4091d0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.687644 Sep 13 16:59:43.273976 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3009/5963] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:42 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:43.380399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:43.381394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:43.399863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:43.400341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:43.400780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:43.401990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:43.402458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:43.402892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:43.827590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:43.859505 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a0fb142-9248-4c2d-98b2-451352054ff1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.486508 Sep 13 16:59:43.861705 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2955/5964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:43 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:44.304892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:44.306084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:44.315215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:44.316057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:44.316654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:44.317524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:44.318375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:44.329989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:44.475324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:44.491960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:44.494230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:44.495807 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f26d29ac-d844-4467-889c-8214a4f372fa tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.195111 Sep 13 16:59:44.497972 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3010/5965] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:44 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:44.884419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:44.884824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:44.895109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:44.895614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:44.896055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:44.896796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:44.897241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:44.897669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:45.391460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:45.405207 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3376eef3-9151-48f3-a51a-b7461260d4ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1313 microversion: 2.1 time: 0.524810 Sep 13 16:59:45.406919 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2956/5966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:44 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:45.525298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:45.526532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:45.541361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:45.542012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:45.542668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:45.543382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:45.543851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:45.544284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:45.728087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:45.745671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:45.747202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:45.748453 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-caca4623-65ed-45ac-9a73-5a77cc245999 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.228082 Sep 13 16:59:45.749045 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3011/5967] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:45 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:46.429237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:46.430639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:46.438616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:46.439307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:46.440715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:46.441648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:46.442321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:46.442918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:46.789812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:46.791147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:46.804128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:46.804897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:46.805554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:46.807472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:46.808330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:46.809013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:46.930312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:46.943821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0eba7a11-8215-4c0f-bca5-ade58273c961 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1499 microversion: 2.1 time: 0.518310 Sep 13 16:59:46.944442 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2957/5968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:46 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1499 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:46.975998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:46.978619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:46.994903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:46.996889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:46.997492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:46.998487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:46.999084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:46.999910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.006289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:47.021222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:47.023915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:47.027044 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dbd9a47b-527a-4efe-947d-d76a8f4195c4 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.244173 Sep 13 16:59:47.028475 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3012/5969] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:46 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:47.067708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lazy-loading 'flavor' on Instance uuid ea464788-8e5a-4684-989d-5739fd77a887 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:59:47.161697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:47.177796 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc2d0f5f-3f77-452e-bedb-c0de303a2e76 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "POST /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887/action" status: 200 len: 32 microversion: 2.1 time: 0.209117 Sep 13 16:59:47.185208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2958/5970] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 16:59:46 2022] POST /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 16:59:47.203633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:47.208952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:47.236833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:47.238178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:47.239302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.241090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:47.242788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:47.243315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.388349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:47.388793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:47.405290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:47.406090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:47.409940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.412267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:47.417196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:47.417945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.448305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:59:47.588364 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79455a7e-bfd9-445f-bb5c-f3b220d76d91 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 204 len: 0 microversion: 2.1 time: 0.205345 Sep 13 16:59:47.588971 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2959/5971] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:59:47 2022] DELETE /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 16:59:47.599309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:47.600038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:47.609808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:47.610337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:47.610788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.611547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:47.612021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:47.612471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:47.785005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:47.799177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8110152-b5f5-47f2-bf67-1145a0b04355 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.610009 Sep 13 16:59:47.800008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3013/5972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:47 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:47.871228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:47.885412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d3cc3149-65b7-457e-8187-d927ef59e425 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1554 microversion: 2.1 time: 0.290930 Sep 13 16:59:47.886175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2960/5973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:47 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:48.057416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:48.058204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:48.076727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:48.077242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:48.077691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:48.078450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:48.078917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:48.079357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:48.511702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:48.532392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:48.535924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:48.547575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-953ca591-2354-472e-b904-aa7499b672f1 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.492263 Sep 13 16:59:48.550158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3014/5974] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:48 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:48.824617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:48.825255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:48.844796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:48.845320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:48.855550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:48.856568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:48.857175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:48.857645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:48.914542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:48.915160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:48.933424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:48.934255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:48.934883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:48.935776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:48.936397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:48.936994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:49.068071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:49.083127 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-985fb89f-2e9f-4cfd-a34c-93e2c8d25e80 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.261156 Sep 13 16:59:49.084414 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2961/5975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:48 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:49.394027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:49.412549 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abc750c1-f85e-48f1-b223-958dbef772c1 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1554 microversion: 2.1 time: 0.501532 Sep 13 16:59:49.432674 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3015/5976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:48 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1554 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:49.577803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:49.578719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:49.591419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:49.592421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:49.593024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:49.595993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:49.596771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:49.597637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:49.750749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:49.763493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:49.770118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:49.772821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5ca9755-c739-4cb7-86bb-8951d42539db tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1365 microversion: 2.47 time: 0.198631 Sep 13 16:59:49.811825 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2962/5977] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:49 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:50.109533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:50.112624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:50.148719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.162185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.163125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.168558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.169360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.171750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.441151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:50.443062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:50.456981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.464739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.465542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.469031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.470374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.484890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.537734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:50.552755 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c902a268-26ee-4960-949b-4fc940bff38b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.447618 Sep 13 16:59:50.572295 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3016/5978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:50 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:50.587063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-7721a8fb-b141-4d11-a0e9-71fdc4d3b5a4 req-6c2e10cf-16c0-4ff9-8821-f2a602b1668d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1130ee85-e901-45b2-9897-e88dc5377402", "name": "network-vif-deleted", "tag": "fc6fea20-f3ec-4010-8cbe-949ed1471365"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:50.599020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7721a8fb-b141-4d11-a0e9-71fdc4d3b5a4 req-6c2e10cf-16c0-4ff9-8821-f2a602b1668d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.599863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7721a8fb-b141-4d11-a0e9-71fdc4d3b5a4 req-6c2e10cf-16c0-4ff9-8821-f2a602b1668d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.600527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7721a8fb-b141-4d11-a0e9-71fdc4d3b5a4 req-6c2e10cf-16c0-4ff9-8821-f2a602b1668d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.617000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-7721a8fb-b141-4d11-a0e9-71fdc4d3b5a4 req-6c2e10cf-16c0-4ff9-8821-f2a602b1668d service nova] Creating event network-vif-deleted:fc6fea20-f3ec-4010-8cbe-949ed1471365 for instance 1130ee85-e901-45b2-9897-e88dc5377402 on n-h2-857467-1 Sep 13 16:59:50.624414 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-7721a8fb-b141-4d11-a0e9-71fdc4d3b5a4 req-6c2e10cf-16c0-4ff9-8821-f2a602b1668d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040994 Sep 13 16:59:50.630805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3017/5979] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:59:50.678221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:50.686919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3ecdfb8-cf30-4bb7-922e-668d16b5c29a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 200 len: 1486 microversion: 2.1 time: 0.250174 Sep 13 16:59:50.687571 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2963/5980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:50 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:50.806243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:50.807387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:50.816832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.817411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.817911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.818769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:50.819463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:50.820080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:50.938444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:50.952960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:50.958557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:50.961943 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fdb4dacd-7345-4658-be25-ca183003d304 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1371 microversion: 2.47 time: 0.161336 Sep 13 16:59:50.973870 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3018/5981] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:50 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:51.590298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:51.590819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:51.601510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:51.602100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:51.602537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:51.603448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:51.603921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:51.604360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:51.711788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:51.713266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 1130ee85-e901-45b2-9897-e88dc5377402] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:51.720334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:51.721104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:51.721737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:51.722490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:51.723035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:51.723479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:51.737820 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] HTTP exception thrown: Instance 1130ee85-e901-45b2-9897-e88dc5377402 could not be found. Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Request method failure captured: Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 HTTP/1.1 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILZGIb_eGyWFE9RUnEQP0kTnpQgPhfeaMHwDD2Plx1vls9-pMDiAhEFZyG-mL21fbP4BpAEcOLpeR4BEKLJ3GfgBXiRNJ6c2D9Zv_2VuLlDSLeI4lYEt1VzNpE_l8KxfTpzW0qzL_Y3a63HhwCDsI1uwK1h3A47QUFlVR2qyVuMdrew Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 4078cd72ad974a56943c95afe7ab63f5 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkBasicOps-680274658 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkBasicOps-680274658 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 4078cd72ad974a56943c95afe7ab63f5 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkBasicOps-680274658 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkBasicOps-680274658-project Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c57ef3ccd1c74d67b86e8ea75aafd433 Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkBasicOps-680274658-project Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 1130ee85-e901-45b2-9897-e88dc5377402 could not be found. Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '1130ee85-e901-45b2-9897-e88dc5377402'} Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1130ee85-e901-45b2-9897-e88dc5377402 could not be found. Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1130ee85-e901-45b2-9897-e88dc5377402 could not be found. Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:51.739810 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1130ee85-e901-45b2-9897-e88dc5377402 could not be found. Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Returning 404 to user: Instance 1130ee85-e901-45b2-9897-e88dc5377402 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:59:51.744244 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e180e36a-69c9-41e8-b708-3a00d6f097e5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402" status: 404 len: 111 microversion: 2.1 time: 0.033510 Sep 13 16:59:51.745899 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3019/5982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:51 2022] GET /compute/v2.1/servers/1130ee85-e901-45b2-9897-e88dc5377402 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:59:51.822702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:51.835204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c28df034-56c7-46c0-b3a0-c87df21a7f97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.248869 Sep 13 16:59:51.836238 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2964/5983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:51 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:51.992531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:51.993792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:52.003937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:52.004767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:52.005453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:52.007093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:52.007769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:52.008663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:52.099119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:52.108464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:52.110387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:52.112375 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7556541e-d115-4d3e-a4bb-8fbed08d5f8f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1371 microversion: 2.47 time: 0.126320 Sep 13 16:59:52.113233 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3020/5984] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:51 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:52.129999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c527b0b1-14e8-4ba2-b8c8-e86d7d8a07da tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '.version_select at 0x7fbeb4a69310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:52.173514 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c527b0b1-14e8-4ba2-b8c8-e86d7d8a07da tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1496940420" status: 202 len: 0 microversion: 2.1 time: 0.050490 Sep 13 16:59:52.175059 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2965/5985] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Sep 13 16:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1496940420 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 16:59:52.865673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:52.867002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:52.890555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:52.890555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:52.890555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:52.891292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:52.891790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:52.892773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:53.144384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:53.146331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:53.155582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:53.156515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:53.157039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:53.158160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:53.160214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:53.162136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:53.184835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:53.197735 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-903e2d83-45c1-4962-9b58-da9cba292b03 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.339826 Sep 13 16:59:53.201767 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3021/5986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:52 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:53.349957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:53.358743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:53.366026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:53.367382 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c9ad572-0dab-44f6-b6de-5d73fcbeaa49 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1371 microversion: 2.47 time: 0.229744 Sep 13 16:59:53.369365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2966/5987] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:53 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:54.233230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:54.233919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:54.246784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.247872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.249179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.250138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.250800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.251427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.399013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:54.400215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:54.404568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:54.412104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.413282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.414572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.416001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.416713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.417530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.551656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:54.559804 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-23c95f55-7e0e-48eb-95a7-66a3f1f01317 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.338537 Sep 13 16:59:54.560488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3022/5988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:54 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:54.593055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:54.604787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:54.606981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:54.608977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96849279-edc0-43da-9741-a36590205b3d tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1371 microversion: 2.47 time: 0.214899 Sep 13 16:59:54.614630 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2967/5989] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:54 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:54.799479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:54.800273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:54.807328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.808069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.809048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.810189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-77004203-5bd5-4478-94b3-84544fed7770 req-2163cea9-ae26-41b4-b21f-1ec806012d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4a80a-d5be-48e5-88ba-595109dfaf96", "tag": "83d91a64-6d6d-4caf-8cea-9f62325069c0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:54.810553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.811145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.811589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.824017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-77004203-5bd5-4478-94b3-84544fed7770 req-2163cea9-ae26-41b4-b21f-1ec806012d32 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:54.824865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-77004203-5bd5-4478-94b3-84544fed7770 req-2163cea9-ae26-41b4-b21f-1ec806012d32 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:54.825517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-77004203-5bd5-4478-94b3-84544fed7770 req-2163cea9-ae26-41b4-b21f-1ec806012d32 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:54.842837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:59:54.849298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-77004203-5bd5-4478-94b3-84544fed7770 req-2163cea9-ae26-41b4-b21f-1ec806012d32 service nova] Creating event network-changed:83d91a64-6d6d-4caf-8cea-9f62325069c0 for instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 on n-h2-857467-1 Sep 13 16:59:54.855134 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-77004203-5bd5-4478-94b3-84544fed7770 req-2163cea9-ae26-41b4-b21f-1ec806012d32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048567 Sep 13 16:59:54.855947 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2968/5990] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 16:59:54.914188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:54.986824 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-365b9a63-4194-4d9f-a4e6-a7499faedf1d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 204 len: 0 microversion: 2.1 time: 0.191380 Sep 13 16:59:54.990820 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3023/5991] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 16:59:54 2022] DELETE /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 16:59:54.999353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:55.000167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:55.009407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.009937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.010384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.011148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.011615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.012212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.298403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:55.310631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40ca622e-829d-4ed6-9f9b-af2e904b6812 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1668 microversion: 2.1 time: 0.317499 Sep 13 16:59:55.311859 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2969/5992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:54 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1668 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:55.587459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:55.588285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:55.604831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.606693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.607432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.612820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.613415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.615818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.643850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:55.644548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:55.652279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.653019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.654563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.655457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.657171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.659056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.802279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:55.823685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:55.828085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:55.828882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:55.829398 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65cbf3c4-f061-40b4-a943-edbc8e6052cf tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1356 microversion: 2.47 time: 0.196883 Sep 13 16:59:55.831003 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2970/5993] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:55 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1356 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:55.850161 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6eb5c16-e0fa-439d-b7f4-d8ab986adc01 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.259512 Sep 13 16:59:55.851136 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3024/5994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:55 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:55.872186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:55.878374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:55.879589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Searching by: {'deleted': False, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b'} {{(pid=122327) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 16:59:55.891546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.893274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.893955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:55.894889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:55.895516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:55.896331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.063587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.multi_cell_list [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122327) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 16:59:56.186300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:56.195621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.196363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.196960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.216343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:56.218139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:56.302702 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-976fe9c5-5ca9-4812-a14a-9c7e7f371be2 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.451110 Sep 13 16:59:56.304097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2971/5995] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Sep 13 16:59:55 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 16:59:56.340554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:56.341076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:56.346333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:56.346969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:56.368273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.368694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.369156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.369910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.370387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.370829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.372893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.373525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.374011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.374764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.375235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.375677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.448220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 16:59:56.575463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f929cd74-06d2-4f2f-bc6a-f082d5334961 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 204 len: 0 microversion: 2.47 time: 0.238342 Sep 13 16:59:56.587969 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2972/5996] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 16:59:56 2022] DELETE /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 16:59:56.600829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:56.602134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:56.611222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.611994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.612621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.613544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.614112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.614768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.643413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 16:59:56.657989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:56.666927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-db83f5bd-c882-4d72-b4c3-cc18119fc62d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1668 microversion: 2.1 time: 0.331567 Sep 13 16:59:56.667511 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3025/5997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:56 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:56.876047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:56.877688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:56.885636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.886161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.886646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:56.887370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:56.888024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:56.888473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:57.103256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:57.123835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:57.130566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:57.131850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-43a27f20-0465-4990-88a7-96c42672e19f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1362 microversion: 2.47 time: 0.539743 Sep 13 16:59:57.132439 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2973/5998] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:56 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:57.184906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:57.193807 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-95a1b6e4-9b2c-4f97-96f5-042284a3a495 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.321963 Sep 13 16:59:57.194416 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3026/5999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:56 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:57.691466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:57.692329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:57.699629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:57.700325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:57.701119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:57.701858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:57.702495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:57.702933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:58.068541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:58.083201 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34f3530a-2f3c-4421-91b6-9be0e44f257a tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 200 len: 1549 microversion: 2.1 time: 0.395720 Sep 13 16:59:58.098485 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2974/6000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:57 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 1549 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 16:59:58.159825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:58.160805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:58.173045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:58.176786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:58.177448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:58.178430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:58.179511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:58.180152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:58.217489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:58.220279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:58.233091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:58.233926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:58.235046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:58.239958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:58.243926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:58.243926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:58.281320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:58.295234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:58.297313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:58.299599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef575647-971c-415b-abff-0fd5fb7ee07a tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1362 microversion: 2.47 time: 0.144274 Sep 13 16:59:58.300605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3027/6001] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:58 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:58.330969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-64e5d432-ba38-4434-8fab-f597f91e2e31 req-9f575e5c-120b-4019-b252-db7a5c13a668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da4a80a-d5be-48e5-88ba-595109dfaf96", "name": "network-vif-deleted", "tag": "83d91a64-6d6d-4caf-8cea-9f62325069c0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 16:59:58.374875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-64e5d432-ba38-4434-8fab-f597f91e2e31 req-9f575e5c-120b-4019-b252-db7a5c13a668 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:58.375533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-64e5d432-ba38-4434-8fab-f597f91e2e31 req-9f575e5c-120b-4019-b252-db7a5c13a668 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:58.376032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-64e5d432-ba38-4434-8fab-f597f91e2e31 req-9f575e5c-120b-4019-b252-db7a5c13a668 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:58.397144 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-64e5d432-ba38-4434-8fab-f597f91e2e31 req-9f575e5c-120b-4019-b252-db7a5c13a668 service nova] Creating event network-vif-deleted:83d91a64-6d6d-4caf-8cea-9f62325069c0 for instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 on n-h2-857467-1 Sep 13 16:59:58.406057 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-64e5d432-ba38-4434-8fab-f597f91e2e31 req-9f575e5c-120b-4019-b252-db7a5c13a668 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080740 Sep 13 16:59:58.407479 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3028/6002] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 16:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 16:59:58.613369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:58.631697 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0611d4b7-d0ab-4ed8-9b22-3db26500357e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.417589 Sep 13 16:59:58.647230 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2975/6003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:58 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 16:59:59.116720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:59.117434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 4da4a80a-d5be-48e5-88ba-595109dfaf96] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:59.126592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.127725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.128164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:59.128874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.129339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.129770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:59.147603 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] HTTP exception thrown: Instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 could not be found. Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Request method failure captured: Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 HTTP/1.1 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILZGIb_eGyWFE9RUnEQP0kTnpQgPhfeaMHwDD2Plx1vls9-pMDiAhEFZyG-mL21fbP4BpAEcOLpeR4BEKLJ3GfgBXiRNJ6c2D9Zv_2VuLlDSLeI4lYEt1VzNpE_l8KxfTpzW0qzL_Y3a63HhwCDsI1uwK1h3A47QUFlVR2qyVuMdrew Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 4078cd72ad974a56943c95afe7ab63f5 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkBasicOps-680274658 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkBasicOps-680274658 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 4078cd72ad974a56943c95afe7ab63f5 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkBasicOps-680274658 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkBasicOps-680274658-project Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c57ef3ccd1c74d67b86e8ea75aafd433 Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkBasicOps-680274658-project Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 could not be found. Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '4da4a80a-d5be-48e5-88ba-595109dfaf96'} Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 could not be found. Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 could not be found. Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 16:59:59.149875 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 could not be found. Sep 13 16:59:59.155447 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 16:59:59.156698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Returning 404 to user: Instance 4da4a80a-d5be-48e5-88ba-595109dfaf96 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 16:59:59.158681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92841f93-8415-4a19-b4f6-68b05ddee7a5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96" status: 404 len: 111 microversion: 2.1 time: 0.047217 Sep 13 16:59:59.160527 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3029/6004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:59 2022] GET /compute/v2.1/servers/4da4a80a-d5be-48e5-88ba-595109dfaf96 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 16:59:59.328737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:59.331400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:59.342142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.343123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.343826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:59.344857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.347491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.348269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:59.386435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45bf126b-292f-4e07-9cde-017f80a113b4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '.version_select at 0x7fbeb513c1f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:59.416778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.417329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.418000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:59.418616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lazy-loading 'fault' on Instance uuid 8fc456f2-fd2d-4f4a-8692-981f02a9580e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 16:59:59.454101 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45bf126b-292f-4e07-9cde-017f80a113b4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-901658986" status: 202 len: 0 microversion: 2.1 time: 0.072155 Sep 13 16:59:59.455850 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3030/6005] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Sep 13 16:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-901658986 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 16:59:59.519721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:59.531845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:59.535343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 16:59:59.537059 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f086f83d-aaec-4be4-b96f-821623f6d9e6 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 200 len: 1367 microversion: 2.47 time: 0.213222 Sep 13 16:59:59.548204 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2976/6006] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 16:59:59 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 16:59:59.657287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 16:59:59.657971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 16:59:59.665918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.666692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.667145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 16:59:59.667871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 16:59:59.668544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 16:59:59.669160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.204281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:00.213434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ad916c3-fee5-44c4-9129-fbcfc1de7334 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.560067 Sep 13 17:00:00.214398 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3031/6007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 16:59:59 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:00.566508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:00.567799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 8fc456f2-fd2d-4f4a-8692-981f02a9580e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:00.575715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:00.576217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:00.576666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.577382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:00.577858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:00.578304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.593525 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] HTTP exception thrown: Instance 8fc456f2-fd2d-4f4a-8692-981f02a9580e could not be found. Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Request method failure captured: Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e HTTP/1.1 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILbdh6GI23sGzj9phm3L-w0hGauTj85enh8PV4CLT0xsqVgODgpECr_du5M9uh4NjOy8TswYO6cC57rmOeh723JEECwXjF56ialHLYRmuaaa0O8djpqIW8e-QcasdLAtHyrEggMHSzmgkw07pS7UGc12eWYGHlvcX91s4B2T45SsXkU Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.47 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5811a4c89bfc4b909e1827c64aa94e6b Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerShowV247Test-259434209 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerShowV247Test-259434209 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5811a4c89bfc4b909e1827c64aa94e6b Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerShowV247Test-259434209 Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerShowV247Test-259434209-project Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd95340d1ecd4a77a228c3d25053567f Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerShowV247Test-259434209-project Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8fc456f2-fd2d-4f4a-8692-981f02a9580e could not be found. Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8fc456f2-fd2d-4f4a-8692-981f02a9580e'} Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc456f2-fd2d-4f4a-8692-981f02a9580e could not be found. Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc456f2-fd2d-4f4a-8692-981f02a9580e could not be found. Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:00.596221 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc456f2-fd2d-4f4a-8692-981f02a9580e could not be found. Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Returning 404 to user: Instance 8fc456f2-fd2d-4f4a-8692-981f02a9580e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:00:00.600301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-192c0748-cb37-4068-8158-b7a71f9f091f tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e" status: 404 len: 111 microversion: 2.47 time: 0.037337 Sep 13 17:00:00.606397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:00.606910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:00.610580 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2977/6008] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:00 2022] GET /compute/v2.1/servers/8fc456f2-fd2d-4f4a-8692-981f02a9580e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:00:00.614924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:00.615541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:00.615981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.616875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:00.617336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:00.617769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.649006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:00:00.734657 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68acfaa3-456a-44ff-9558-dd2adabd3c26 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc" status: 204 len: 0 microversion: 2.47 time: 0.131919 Sep 13 17:00:00.735268 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3032/6009] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 17:00:00 2022] DELETE /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 17:00:00.743893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:00.744522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:00.750720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:00.751218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:00.752235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.752951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:00.753425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:00.753892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:00.825376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:00.834474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:00.835946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:00.837163 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7dec12a8-7cb9-4c20-9fa9-6aff3adc7656 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc" status: 200 len: 1362 microversion: 2.47 time: 0.097349 Sep 13 17:00:00.837733 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2978/6010] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:00 2022] GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc => generated 1362 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:01.239443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:01.240222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:01.242307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:01.247814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:01.248317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:01.248763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:01.249479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:01.249974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:01.250410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:01.756825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:01.765249 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d9c99c78-b862-402e-90b2-f7d5cc6fb87f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.530710 Sep 13 17:00:01.766098 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3033/6011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:01 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:01.864105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:01.865335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:01.872387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:01.873161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:01.873541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:01.874282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:01.874747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:01.875174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:01.944140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:01.952756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:01.954365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:01.955804 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-47ca3979-6b51-48f9-af8b-efe6063fe8f0 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc" status: 200 len: 1362 microversion: 2.47 time: 0.096879 Sep 13 17:00:01.956615 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2979/6012] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:01 2022] GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc => generated 1362 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:02.789948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:02.790597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:02.797853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:02.799097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:02.799554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:02.800388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:02.800868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:02.801311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:02.980686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:02.981928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:02.990281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:02.991228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:02.991972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:02.992942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:02.993632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:02.994342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:03.130545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:03.147282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:03.152798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd95340d1ecd4a77a228c3d25053567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5811a4c89bfc4b909e1827c64aa94e6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:03.157477 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-63bb99e4-4e15-4040-ac60-d64fc04bd98b tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc" status: 200 len: 1362 microversion: 2.47 time: 0.179044 Sep 13 17:00:03.159836 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2980/6013] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:02 2022] GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:00:03.257256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:03.274811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b42a3762-757d-4851-94d0-3b153ca0cff2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.488826 Sep 13 17:00:03.275726 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3034/6014] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:02 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:04.185495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:04.187388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] [instance: 2543493c-5b9f-4ad9-b1cc-d81b62775edc] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:04.203574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:04.204476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:04.206449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:04.207601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:04.224760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:04.225498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:04.264994 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] HTTP exception thrown: Instance 2543493c-5b9f-4ad9-b1cc-d81b62775edc could not be found. Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Request method failure captured: Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc HTTP/1.1 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILbdh6GI23sGzj9phm3L-w0hGauTj85enh8PV4CLT0xsqVgODgpECr_du5M9uh4NjOy8TswYO6cC57rmOeh723JEECwXjF56ialHLYRmuaaa0O8djpqIW8e-QcasdLAtHyrEggMHSzmgkw07pS7UGc12eWYGHlvcX91s4B2T45SsXkU Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.47 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5811a4c89bfc4b909e1827c64aa94e6b Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerShowV247Test-259434209 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5811a4c89bfc4b909e1827c64aa94e6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerShowV247Test-259434209 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5811a4c89bfc4b909e1827c64aa94e6b Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerShowV247Test-259434209 Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerShowV247Test-259434209-project Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fd95340d1ecd4a77a228c3d25053567f Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerShowV247Test-259434209-project Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 2543493c-5b9f-4ad9-b1cc-d81b62775edc could not be found. Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '2543493c-5b9f-4ad9-b1cc-d81b62775edc'} Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2543493c-5b9f-4ad9-b1cc-d81b62775edc could not be found. Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2543493c-5b9f-4ad9-b1cc-d81b62775edc could not be found. Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:04.268018 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2543493c-5b9f-4ad9-b1cc-d81b62775edc could not be found. Sep 13 17:00:04.273647 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:04.276589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] Returning 404 to user: Instance 2543493c-5b9f-4ad9-b1cc-d81b62775edc could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:00:04.277705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-808bbc1f-472f-44af-a20d-b19ed1be6112 tempest-ServerShowV247Test-259434209 tempest-ServerShowV247Test-259434209-project] 10.222.0.61 "GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc" status: 404 len: 111 microversion: 2.47 time: 0.096931 Sep 13 17:00:04.278978 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2981/6015] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:04 2022] GET /compute/v2.1/servers/2543493c-5b9f-4ad9-b1cc-d81b62775edc => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:00:04.301959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:04.302768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:04.317745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:04.318290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:04.318740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:04.323443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:04.324164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:04.326787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:04.961497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:04.971542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dda2e132-a2a8-4e1e-ad60-e6b9e857bab4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.674791 Sep 13 17:00:04.987345 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3035/6016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:04 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:05.995632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:05.996892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:06.000703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:06.016653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:06.017764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:06.018309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:06.027203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:06.027727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:06.033373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:06.042385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:06.042894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:06.051520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:06.052083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:06.052542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:06.053673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:06.054188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:06.054635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:06.139434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de011da0-860d-447e-8c13-7a32baab6ea0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/ips" status: 200 len: 149 microversion: 2.1 time: 0.116707 Sep 13 17:00:06.140828 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3036/6017] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 17:00:06 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/ips => generated 149 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:00:06.183591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:06.386978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:06.399457 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5f5a020-e867-408f-b767-db1e076cb17f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.407918 Sep 13 17:00:06.402106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2982/6018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:05 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:07.393981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1366642535", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": "none"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:07.425694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:07.429375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:07.437753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:07.438810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:07.440384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:07.441661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:07.442706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:07.443372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:07.475646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:00:07.476080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:00:07.476566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:00:07.476983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:00:07.477400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:00:07.499681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:07.500460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:07.501452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:07.503374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:07.507696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:07.508377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:07.546406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Getting quotas for project f4b66ad87c9d4705b8f8ff67eca4af1e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:00:07.554293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Getting quotas for user 88756f60384c4ab4ac704cfb856b660a and project f4b66ad87c9d4705b8f8ff67eca4af1e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:00:07.573063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:00:07.576516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:00:07.686350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-394135f9-d7ba-474e-99d1-d7435cf2bb26 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.477843 Sep 13 17:00:07.687071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3037/6019] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 17:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 17:00:07.714869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06f5ebd5-753b-4f97-9676-2a7a79db0b60 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:07.715847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06f5ebd5-753b-4f97-9676-2a7a79db0b60 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:07.899468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:07.914726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec87a29c-d039-4739-a909-2ae47817d748 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.494251 Sep 13 17:00:07.915335 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2983/6020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:07 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:08.012868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06f5ebd5-753b-4f97-9676-2a7a79db0b60 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:08.024249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06f5ebd5-753b-4f97-9676-2a7a79db0b60 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:08.028334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06f5ebd5-753b-4f97-9676-2a7a79db0b60 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:08.031841 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06f5ebd5-753b-4f97-9676-2a7a79db0b60 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1278 microversion: 2.57 time: 0.328679 Sep 13 17:00:08.044795 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3038/6021] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:07 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1278 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:08.946907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:08.947692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cfc8bfb-076f-495e-99fa-8d1d6659e748"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:08.950102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:08.952334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:08.967441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:08.969813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:08.971175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:08.974004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:08.974809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:08.975695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:08.976300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:08.976996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:08.977663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:08.978673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:08.982856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:08.983937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:09.404223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:09.415712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d4391ea-e5c2-4595-8c5e-67a6a9b09996 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.480170 Sep 13 17:00:09.416416 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2984/6022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:08 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:09.444690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:09.446764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:09.463069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:09.463908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:09.465599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:09.467729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:09.468893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:09.470807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:09.599921 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4532c87-add9-430e-9852-a663a5d09471 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662384 Sep 13 17:00:09.600562 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3039/6023] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:00:08 2022] POST /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:09.713028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:09.731111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:09.732594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:09.734027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12e6a6c3-4bc0-467e-a69b-584d331672a9 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1338 microversion: 2.57 time: 0.315621 Sep 13 17:00:09.738626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2985/6024] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:09 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:10.442477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:10.443461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:10.469223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:10.477246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:10.477774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:10.480238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:10.480734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:10.481183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:10.768603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:10.769991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:10.781455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:10.794060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:10.799932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:10.802952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:10.803459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:10.803914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:10.858323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:10.876174 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-031f6dce-30b5-40d2-a0ac-69285dca830e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.439091 Sep 13 17:00:10.889962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3040/6025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:10 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:11.105688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:11.118901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:11.120374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:11.121539 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14233ea4-e9a9-42cd-9ebe-9b3e01422ba5 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1336 microversion: 2.57 time: 0.357668 Sep 13 17:00:11.122146 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2986/6026] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:10 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1336 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:00:11.906084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:11.907246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:11.917814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:11.920872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:11.920872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:11.920872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:11.920872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:11.920872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:12.025871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:12.158544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:12.161167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:12.178957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:12.180000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:12.181995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:12.184990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:12.186118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:12.190561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:12.541286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:12.560216 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f68126e-4e45-47f2-9499-c15399f359c8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.656441 Sep 13 17:00:12.564430 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3041/6027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:11 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:12.689460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:12.700338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:12.703839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:12.706069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5989d1f4-d14a-4804-a12a-905473c93652 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1336 microversion: 2.57 time: 0.560638 Sep 13 17:00:12.707243 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2987/6028] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:12 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1336 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:13.587620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:13.589073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:13.607674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:13.608938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:13.610010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:13.613378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:13.614181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:13.617395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:13.735252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:13.736549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:13.751293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:13.752091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:13.753787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:13.754739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:13.757734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:13.759337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:13.991268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:14.007648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:14.011561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:14.013101 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7be40391-e53f-4c3b-b4ca-9cb454259aa2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1336 microversion: 2.57 time: 0.283709 Sep 13 17:00:14.014462 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2988/6029] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:13 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:14.477798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:14.489281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67aef32e-dc10-4b4f-934f-e46cdd4dad5f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.905743 Sep 13 17:00:14.492947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3042/6030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:13 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:15.046508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:15.047326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:15.058879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:15.094983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:15.095791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:15.096808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:15.097295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:15.097901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:15.519013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:15.519640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:15.554215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:15.554737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:15.555394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:15.555988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:15.556811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:15.557855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:15.652974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:15.681292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:15.683060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:15.684387 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d8950e37-b507-410c-931c-51f3c037a2d0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1357 microversion: 2.57 time: 0.643709 Sep 13 17:00:15.690927 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2989/6031] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:15 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1357 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:15.726310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:15.729767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:15.748345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:15.749163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:15.749783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:15.750825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:15.754037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:15.756430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:15.937882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:15.969811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:15.987761 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8794956-4cf9-49a0-b20c-8486ef3ef84c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.472788 Sep 13 17:00:15.989010 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3043/6032] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:15 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:15.995248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:00:15.995681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:00:15.996165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:00:15.996588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:00:15.997013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:00:16.211120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:16.243829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:16.260327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:16.260797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:16.261566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:16.262083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:16.262519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:16.369007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48985b68-9703-4d99-952f-6ebea6fec569 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "POST /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765/action" status: 202 len: 1138 microversion: 2.57 time: 0.651486 Sep 13 17:00:16.369659 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2990/6033] 10.222.0.61 () {62 vars in 1320 bytes} [Tue Sep 13 17:00:15 2022] POST /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765/action => generated 1138 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 13 17:00:16.398710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:16.399346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:16.414988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:16.415497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:16.415947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:16.436330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:16.437345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:16.438100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:16.664809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:16.677775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:16.682945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:16.684228 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b9d3a2a7-5e79-4cf1-b050-db12a7463d89 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.290127 Sep 13 17:00:16.704673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3044/6034] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:16 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:00:17.018105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:17.018989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:17.036031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:17.036798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:17.038401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:17.039655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:17.040260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:17.040809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:17.505465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:17.524664 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bed07734-5ecf-4a49-a787-5a998896d2af tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1505 microversion: 2.1 time: 0.513626 Sep 13 17:00:17.542513 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2991/6035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:17 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:17.734341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:17.737996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:17.743662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:17.758747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:17.761652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:17.762903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:17.766201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:17.766429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:17.767006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:18.017791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:18.228681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:18.242943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:18.244406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:18.245601 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-033aa33c-4463-4000-a114-283f365cc946 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.524580 Sep 13 17:00:18.250198 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3045/6036] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:17 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:18.557359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:18.558650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:18.571665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:18.574833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:18.575799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:18.578073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:18.578795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:18.581130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:18.954452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:18.975402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-82793e70-e401-414d-af71-e1272a69ab47 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1485 microversion: 2.1 time: 0.422113 Sep 13 17:00:18.979769 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2992/6037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:18 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1485 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:19.189484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1739258575", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:19.278271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:19.279002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:19.293184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:19.293984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:19.294903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:19.297395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:19.300262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:19.300925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:19.342171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] validate_networks() for [('8bf13fff-cea1-4558-9dae-1aad6420a676', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:00:19.465524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:19.480279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:19.481198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:19.483391 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a4fd16b1-56ba-4d58-829e-782920cde527 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.212338 Sep 13 17:00:19.498340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2993/6038] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:19 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:19.516631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91c71cd3-16bc-4944-8494-7e9bd877617f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'create', calling method: .version_select at 0x7fbeb49e8af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-101244245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9okq+LdKdqvRU9krf9HIt2vBF6KwG4cRSkqA01SHXkQwy7W59soAcSvGLu0tLTrdcZ8T7FuwFky65ScQLYmPymLje/Pvg382NItfo4URi/lDy05Cc6PAeary4gmbWatA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:19.541913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-91c71cd3-16bc-4944-8494-7e9bd877617f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:00:19.548667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-91c71cd3-16bc-4944-8494-7e9bd877617f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for user c57ef3ccd1c74d67b86e8ea75aafd433 and project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:00:19.603073 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91c71cd3-16bc-4944-8494-7e9bd877617f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.101996 Sep 13 17:00:19.605523 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2994/6039] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:00:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:20.232529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:00:20.234385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:00:20.235058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:00:20.236165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:00:20.236741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:00:20.269682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:20.270853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:20.271597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:20.272653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:20.274297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:20.274831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:20.300181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Getting quotas for project 713153c3d1724f269f58844c6c10c9d4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:00:20.310929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Getting quotas for user 7c397be23d6b41e58154d2e8799b71d5 and project 713153c3d1724f269f58844c6c10c9d4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:00:20.338080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:00:20.340453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:00:20.435874 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad4d3c05-bffd-4666-9b23-6990357a3692 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.251543 Sep 13 17:00:20.436872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3046/6040] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:00:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:00:20.450582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-45f1d370-8be8-4014-8c95-e6b345cee188 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:20.452151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-45f1d370-8be8-4014-8c95-e6b345cee188 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:20.512253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:20.517594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:20.526524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:20.533864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:20.534650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:20.535466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:20.536028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:20.536562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:20.544965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45f1d370-8be8-4014-8c95-e6b345cee188 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:20.559876 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-45f1d370-8be8-4014-8c95-e6b345cee188 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1214 microversion: 2.1 time: 0.113898 Sep 13 17:00:20.560502 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2995/6041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:20 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:20.710903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:20.733514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:20.738571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:20.743157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2428903-29b2-49b7-8d73-46119caf2cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.234000 Sep 13 17:00:20.745800 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3047/6042] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:20 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:00:21.588824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:21.589778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:21.608054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:21.611252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:21.612458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:21.614195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:21.625259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:21.629620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:21.771501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:21.772411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:21.779807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:21.780517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:21.781166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:21.781922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:21.783239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:21.787226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:21.833184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:21.843373 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9766fc3-fd8b-4e58-8976-2eb0e1de525c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1266 microversion: 2.1 time: 0.258521 Sep 13 17:00:21.854368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2996/6043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:21 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:21.904364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:21.940170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:21.942140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:21.944456 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6cab61d-f4a0-4851-a9a4-dddfcd33783e tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.178078 Sep 13 17:00:21.945560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3048/6044] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:21 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:22.118412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1926253890", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "5ffabb50-00e4-4d8f-ae78-767716fb6b76"}], "key_name": "tempest-TestNetworkBasicOps-101244245", "security_groups": [{"name": "tempest-secgroup-smoke-628960438"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:22.514604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] validate_networks() for [('5ffabb50-00e4-4d8f-ae78-767716fb6b76', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:00:22.870448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:22.871283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:22.878957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:22.879488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:22.879943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:22.880671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:22.881147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:22.881706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:22.956943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:22.965758 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfb6ed48-1a51-40a6-a674-7e5ae1298869 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1272 microversion: 2.1 time: 0.099755 Sep 13 17:00:22.984461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3049/6045] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:22 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:22.996327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:22.997113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:23.005584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:23.006356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:23.007000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:23.007902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:23.008530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:23.009126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:23.121571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:23.134957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:23.136802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:23.138811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44df38a1-a4ef-4140-883d-4abdbdde47fd tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.151767 Sep 13 17:00:23.139774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3050/6046] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:22 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:23.974383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:00:23.975384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:00:23.976043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:00:23.976464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:00:23.976886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:00:23.986922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:23.987686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:23.988133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:23.989001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:23.989781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:23.990251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:24.004045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:24.006144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:24.010965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:00:24.016081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:24.016430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Getting quotas for user c57ef3ccd1c74d67b86e8ea75aafd433 and project 4078cd72ad974a56943c95afe7ab63f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:00:24.017228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:24.018107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:24.019984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:24.020523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:24.021023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:24.031502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:00:24.034356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:00:24.064966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:24.089506 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9280626-baf2-43c3-b280-0e53980530a4 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.974962 Sep 13 17:00:24.097570 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2997/6047] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:00:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:00:24.104002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-070d5dd7-a02f-4279-9b84-51f8f04e8a33 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:24.105424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-070d5dd7-a02f-4279-9b84-51f8f04e8a33 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:24.151669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:24.168670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ab4e3b2-12a9-404a-b39f-1270707ccd6c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1272 microversion: 2.1 time: 0.169983 Sep 13 17:00:24.170496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3051/6048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:23 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:24.184586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:24.187957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:24.197815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:24.198721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:24.199360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:24.200238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:24.200955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:24.201540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:24.221907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-070d5dd7-a02f-4279-9b84-51f8f04e8a33 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:24.268007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-070d5dd7-a02f-4279-9b84-51f8f04e8a33 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1248 microversion: 2.1 time: 0.166596 Sep 13 17:00:24.270202 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2998/6049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:24 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1248 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:24.362297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:24.372287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:24.374185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:24.376567 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f5313829-938d-4939-9b00-14add13d0734 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.204325 Sep 13 17:00:24.377612 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3052/6050] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:24 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:25.197925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:25.198727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:25.213177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.214175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.214979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.216709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.217417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.218335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.295583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:25.305819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:25.320140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.322513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.322987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.323750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.328743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.330666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.605169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:25.639303 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-077bdbab-6806-41fb-9f74-181cfbd1d8ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.444803 Sep 13 17:00:25.640075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 2999/6051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:25 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:25.649587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:25.652402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:25.668684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.674431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.674930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.675674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.676154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.676676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.722639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:25.733778 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e880cfe-0f8b-4806-9073-160039467e62 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1300 microversion: 2.1 time: 0.442801 Sep 13 17:00:25.734846 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3053/6052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:25 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1300 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:25.749287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cfc8bfb-076f-495e-99fa-8d1d6659e748"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:25.753192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:25.763058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.763779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.764417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.765532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:25.766379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:25.767777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:25.856501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:25.876003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:25.879103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:25.884386 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d24dc25-966d-4bcc-a216-d06f3bb05bb4 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.243125 Sep 13 17:00:25.885957 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3000/6053] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:25 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:25.953444 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Invalid volume: volume 7cfc8bfb-076f-495e-99fa-8d1d6659e748 is already attached to instances: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments HTTP/1.1 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 74 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: {"volumeAttachment": {"volumeId": "7cfc8bfb-076f-495e-99fa-8d1d6659e748"}} Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid volume: volume 7cfc8bfb-076f-495e-99fa-8d1d6659e748 is already attached to instances: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '8be42671-87d9-4a60-a0cf-bd2b85d8a90a', 'body': {'volumeAttachment': {'volumeId': '7cfc8bfb-076f-495e-99fa-8d1d6659e748'}}} Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7cfc8bfb-076f-495e-99fa-8d1d6659e748 is already attached to instances: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:00:25.960034 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7cfc8bfb-076f-495e-99fa-8d1d6659e748 is already attached to instances: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7cfc8bfb-076f-495e-99fa-8d1d6659e748 is already attached to instances: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:00:25.964257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 400 to user: Invalid volume: volume 7cfc8bfb-076f-495e-99fa-8d1d6659e748 is already attached to instances: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:00:25.967787 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3ebcfdc-8687-4140-9663-8d00f5ec2c87 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.225653 Sep 13 17:00:25.968169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3054/6054] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:00:25 2022] POST /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 174 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:00:26.062963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:26.063782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:26.082877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.083708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.085103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.089258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.092252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.093589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.289766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'services' on Instance uuid 8be42671-87d9-4a60-a0cf-bd2b85d8a90a {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:00:26.419557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4b955474-73e6-4b63-8afe-4e8cb5cdbd3f req-6ab19977-ef7c-4a52-950b-21742e4ded24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3", "tag": "25d275a3-90a0-446c-9c2a-d054d583608a"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:26.434744 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50640ed2-5a93-43ef-946b-cd9ece217b28 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments/7cfc8bfb-076f-495e-99fa-8d1d6659e748" status: 202 len: 0 microversion: 2.1 time: 0.376982 Sep 13 17:00:26.435974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3001/6055] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:00:26 2022] DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments/7cfc8bfb-076f-495e-99fa-8d1d6659e748 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:00:26.444519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:26.451652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4b955474-73e6-4b63-8afe-4e8cb5cdbd3f req-6ab19977-ef7c-4a52-950b-21742e4ded24 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.452447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4b955474-73e6-4b63-8afe-4e8cb5cdbd3f req-6ab19977-ef7c-4a52-950b-21742e4ded24 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.453569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4b955474-73e6-4b63-8afe-4e8cb5cdbd3f req-6ab19977-ef7c-4a52-950b-21742e4ded24 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.457300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:26.474381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.475228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.481631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.483298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.483972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.486265 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4b955474-73e6-4b63-8afe-4e8cb5cdbd3f req-6ab19977-ef7c-4a52-950b-21742e4ded24 service nova] Creating event network-changed:25d275a3-90a0-446c-9c2a-d054d583608a for instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 on n-h2-857467-1 Sep 13 17:00:26.487008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.491205 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4b955474-73e6-4b63-8afe-4e8cb5cdbd3f req-6ab19977-ef7c-4a52-950b-21742e4ded24 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077154 Sep 13 17:00:26.492413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3055/6056] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:00:26.563081 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-366aa738-dd73-417a-befc-1624c13b46ad tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122625 Sep 13 17:00:26.567132 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3002/6057] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:26 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:26.675021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:26.676307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:26.690614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.692392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.693247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.694909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.695692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.696488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.762034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:26.763009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:26.771130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.772348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.773284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.774841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.774841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.775533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.925149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:26.942695 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-497ff1ce-b48c-41fa-8b0b-a869d33d43fd tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1306 microversion: 2.1 time: 0.184789 Sep 13 17:00:26.945976 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3003/6058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:26 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1306 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:26.963734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:26.964648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:26.980047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.982026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.987100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:26.991111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:26.991906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:26.992592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:27.104196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:27.115718 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f23b1da3-e216-4f37-a0bc-2377f323aa46 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.450916 Sep 13 17:00:27.124090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:27.132671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3056/6059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:26 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:27.159149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:27.176840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:27.182168 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-698a4e17-4bca-45cb-a36b-1062baf88cd8 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.234805 Sep 13 17:00:27.202536 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3004/6060] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:26 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:27.578425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:27.581240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:27.600847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:27.601867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:27.602508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:27.603645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:27.604312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:27.605371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:27.695451 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-adab2664-86ef-4e23-a377-b64ea4d72dc3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122277 Sep 13 17:00:27.696084 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3057/6061] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:27 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:00:27.972032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:27.972601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:27.984669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:27.988128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:27.988588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:27.989340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:27.989815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:27.990270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.136283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:28.158088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:28.158735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:28.166353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-255cb86a-7491-4d80-8b0c-96ee469288cb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1306 microversion: 2.1 time: 0.181307 Sep 13 17:00:28.189846 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3005/6062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:27 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:28.198038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:28.199289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:28.202578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.203593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:28.205173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:28.206480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.218038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:28.218946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:28.248996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:28.250434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:28.256990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.258734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:28.261363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:28.262197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.570979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:28.591380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:28.594339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:28.600054 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68959990-75e5-4678-8ab1-5834f3ab82ec tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.387394 Sep 13 17:00:28.601950 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3006/6063] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:28 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:00:28.698373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:28.708949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:28.711105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:28.711979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4193c3e3-2aec-4d4e-811b-f8f9a6d1e759 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.561205 Sep 13 17:00:28.712968 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3058/6064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:28 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:28.733020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:28.734122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:28.734849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.736987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:28.739951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:28.741109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:28.802587 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fb7d6c3b-86c9-4231-a9d5-e0fa85f65ec7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098869 Sep 13 17:00:28.808056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3007/6065] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:28 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:29.200159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:29.200795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:29.208574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:29.209079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:29.209523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:29.210263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:29.220873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:29.221349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:29.285173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:29.632337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:29.633154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:29.647840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:29.653630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:29.654343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:29.655506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:29.658467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:29.659157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:29.705628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:29.964529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:29.979106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fbcf2a3b-3a35-40f2-9853-00180497827b tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.783286 Sep 13 17:00:29.979733 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3059/6066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:29 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:29.985839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:29.989644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:30.034184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:30.034795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:30.035268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:30.036033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:30.036497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:30.036942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:30.288486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:30.330572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:30.370970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:30.385357 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c616c739-e5ef-4ed5-bf26-c5d18c9f02a4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.400940 Sep 13 17:00:30.389055 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3060/6067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:29 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:30.397687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:30.402661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:30.408313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:30.415243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:30.416711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:30.418058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:30.419093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:30.419764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:30.420424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:30.423623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:30.426020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:30.427463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae3e7099-8512-4a31-9005-51823c1d1b9d tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.799813 Sep 13 17:00:30.428536 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3008/6068] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:29 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:30.483132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cca5348-949d-4c79-87c3-c3e4c0b528e7 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092319 Sep 13 17:00:30.484042 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3061/6069] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:30 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:31.007088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:31.010704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:31.023676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.025097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.027526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.029561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.030107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.031813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.415649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:31.416288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:31.425797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:31.427675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.429974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.434543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.435515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.436153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.436769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.601456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:31.611718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c46c33f-d576-46e8-8d1a-7977456c1bb6 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.608448 Sep 13 17:00:31.612524 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3009/6070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:31 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:31.621026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:31.626556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:31.640386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.648990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.649717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.650657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.651544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.652138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.717379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:31.734828 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31d9325a-8d3d-4c97-af07-e15606fb3a3c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.325113 Sep 13 17:00:31.735526 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3062/6071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:31 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:31.740707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:31.744433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:31.758889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.762919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.763759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.764691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.769026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.769680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:31.791306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:31.802410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:31.803866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:31.805054 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49189b95-2c0b-4976-aad1-0c99c30d093a tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.187968 Sep 13 17:00:31.811314 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3010/6072] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:31 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:31.860499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-59703b8e-76c8-4f08-b720-aec8682272a0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123192 Sep 13 17:00:31.866295 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3063/6073] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:31 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:31.972350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-89422c95-738b-4d82-94ee-c73faa7dd609 req-3fd32a10-a592-4506-b8e3-d38dc4f4fd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f87e9bc-76e7-44f0-9908-403d3ff8e7ae", "tag": "b95aacd3-8255-4fd7-bc34-926bc3d50af3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:31.995920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89422c95-738b-4d82-94ee-c73faa7dd609 req-3fd32a10-a592-4506-b8e3-d38dc4f4fd06 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:31.997393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89422c95-738b-4d82-94ee-c73faa7dd609 req-3fd32a10-a592-4506-b8e3-d38dc4f4fd06 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:31.998183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-89422c95-738b-4d82-94ee-c73faa7dd609 req-3fd32a10-a592-4506-b8e3-d38dc4f4fd06 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:32.026353 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-89422c95-738b-4d82-94ee-c73faa7dd609 req-3fd32a10-a592-4506-b8e3-d38dc4f4fd06 service nova] Creating event network-changed:b95aacd3-8255-4fd7-bc34-926bc3d50af3 for instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae on n-h1-857467-1 Sep 13 17:00:32.036871 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-89422c95-738b-4d82-94ee-c73faa7dd609 req-3fd32a10-a592-4506-b8e3-d38dc4f4fd06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069311 Sep 13 17:00:32.042781 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3011/6074] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:32.639507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:32.642592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:32.657153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:32.659330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:32.662269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:32.663307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:32.670565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:32.671853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:32.763614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:32.764735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:32.776332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:32.777196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:32.779297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:32.780233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:32.780900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:32.781581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:33.029150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:33.035445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:33.052907 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b7b68d3-12df-45c7-af44-fda5d5ead2f8 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.293662 Sep 13 17:00:33.057616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3012/6075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:32 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:33.058293 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa3cb972-4982-4341-b1fa-72e6b439db96 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.415980 Sep 13 17:00:33.059075 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3064/6076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:32 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:33.064929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:33.074499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:33.079706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:33.080839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:33.100951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:33.106100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:33.107436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:33.108252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:33.108994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:33.110549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:33.111234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:33.117066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:33.117479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:33.118344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:33.118779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:33.119947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:33.202831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0988c031-ca31-4e7c-97a1-fd4bb149bfc1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135789 Sep 13 17:00:33.205103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3065/6077] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:33 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:33.367641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:33.378097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:33.379495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:33.380712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e444c398-b6bf-421a-ade4-f0d6c77e6cc6 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.320576 Sep 13 17:00:33.400746 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3013/6078] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:33 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:34.082451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:34.082963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:34.083321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:34.083432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:34.095430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.097044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:34.101057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.102050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.102711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.103004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.103460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.103907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.104188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.104661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.104960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.105103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.106126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.241275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:34.494816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:34.504126 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bc67522-d949-434f-b015-a635ebbc3ff6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.425320 Sep 13 17:00:34.504729 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3014/6079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:34 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:34.510543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:34.513126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:34.520380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.521152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.521813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.522540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.523089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.523568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.567370 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66bffdcc-ac24-4208-8a15-9feceeb1ef89 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061185 Sep 13 17:00:34.568138 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3015/6080] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:34 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:34.573132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-43d60839-2fdb-4f32-83ac-3c7a89af90de req-3ee18df6-7cf9-4a68-9181-6fbee974637c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3", "name": "network-vif-plugged", "status": "completed", "tag": "25d275a3-90a0-446c-9c2a-d054d583608a"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:34.584121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-43d60839-2fdb-4f32-83ac-3c7a89af90de req-3ee18df6-7cf9-4a68-9181-6fbee974637c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.584717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-43d60839-2fdb-4f32-83ac-3c7a89af90de req-3ee18df6-7cf9-4a68-9181-6fbee974637c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.585265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-43d60839-2fdb-4f32-83ac-3c7a89af90de req-3ee18df6-7cf9-4a68-9181-6fbee974637c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.599042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-43d60839-2fdb-4f32-83ac-3c7a89af90de req-3ee18df6-7cf9-4a68-9181-6fbee974637c service nova] Creating event network-vif-plugged:25d275a3-90a0-446c-9c2a-d054d583608a for instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 on n-h2-857467-1 Sep 13 17:00:34.604742 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-43d60839-2fdb-4f32-83ac-3c7a89af90de req-3ee18df6-7cf9-4a68-9181-6fbee974637c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Sep 13 17:00:34.605603 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3016/6081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:34.613218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:34.614103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:34.621321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.622697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.623521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.624714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:34.626245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:34.627048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:34.758389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:34.776345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:34.780417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:34.783016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:34.784578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2a2170f-5efa-4326-94b5-1d7451240a32 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.177599 Sep 13 17:00:34.786762 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3017/6082] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:34 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:34.805653 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-289f811e-852e-4f08-864b-09c3d040b9df tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.717415 Sep 13 17:00:34.805653 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3066/6083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:34 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:35.528356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:35.529328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:35.542802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.543561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.544108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.544937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.545559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.554502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.579913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:35.583348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:35.608151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.609456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.611084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.611840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.612318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.612760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.685384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ea5d871f-b21c-4525-9b54-91b1be5c4fd5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109645 Sep 13 17:00:35.686722 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3067/6084] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:00:35 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 17:00:35.794328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:35.795026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:35.803872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.804565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.809465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.810529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.811230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.811827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.844192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:35.855063 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa2cde08-8074-4be6-b94d-40f361af4e7b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1314 microversion: 2.1 time: 0.331582 Sep 13 17:00:35.855793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:00:35.871583 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3018/6085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:35 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:35.879249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:35.880474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:35.889549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.890674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.891475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:35.892825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:35.893527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:35.894372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:36.006544 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-581afe59-1ada-4474-a1f1-b9eb13ecf78b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 204 len: 0 microversion: 2.1 time: 0.224527 Sep 13 17:00:36.010577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3068/6086] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:00:35 2022] DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:00:36.015671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:36.015879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:36.024225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:36.024820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:36.025365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:36.027336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:36.028147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:36.028664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:36.059789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:36.069928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:36.075499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:36.078280 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bd22138d-22b7-4b0d-8eb2-2f815f1900eb tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.205416 Sep 13 17:00:36.087724 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3019/6087] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:35 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:36.093920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:36.095363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:36.104725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:36.105323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:36.105853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:36.106691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:36.107280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:36.107834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:36.280627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:36.288936 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9b8f829-6fbd-4525-865a-ced409d65bd3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1681 microversion: 2.1 time: 0.199643 Sep 13 17:00:36.289912 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3020/6088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:36 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:36.352054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:36.367089 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e30f612b-fc7d-42f7-9dfa-963b0f39b9c5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.358282 Sep 13 17:00:36.367719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3069/6089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:36 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:36.886885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:36.888210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:36.895280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:36.895862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:36.896390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:36.897196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:36.897867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:36.898312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.057015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:37.068817 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-abd7bfb6-0589-4249-8b5d-3bc163e8b9ee tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1501 microversion: 2.1 time: 0.185696 Sep 13 17:00:37.069558 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3021/6090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:36 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:37.092714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:37.096365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:37.105282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.106083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.106738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.107435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.108077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.108660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.112235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:37.113273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:37.135195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.136323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.137230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.138155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.139024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.139709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lazy-loading 'flavor' on Instance uuid 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:00:37.139889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.222420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:37.247516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:37.249506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:37.251397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-70cd3227-2f39-400b-acb4-f614ab5f34ce tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.146129 Sep 13 17:00:37.256259 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ed96e5b-4b04-4749-a0ea-0b8aa3dddcab tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "POST /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3/action" status: 200 len: 32 microversion: 2.1 time: 0.167194 Sep 13 17:00:37.263587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3070/6091] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:00:37 2022] POST /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 17:00:37.271662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:37.272555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:37.273549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3022/6092] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:37 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:37.283183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.283628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.284328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.286173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.286471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.286899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.326760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:37.331210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:37.339606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.340756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.341212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.351408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.354082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.354726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.635445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:37.648406 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-53672785-c2e6-46ec-a393-81432ee3e574 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1681 microversion: 2.1 time: 0.338766 Sep 13 17:00:37.668163 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3023/6093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:37 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1681 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:37.682324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:37.683242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:37.694275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.695056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.695873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.696765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:37.698245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:37.699744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:37.777308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:37.785867 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0180c5b7-ddbd-4dab-b37f-ff5e35f89095 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.520712 Sep 13 17:00:37.787046 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3071/6094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:37 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:38.281777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:38.283483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:38.295740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:38.299039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:38.300107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:38.307049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:38.307792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:38.308404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:38.360586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:38.451330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:38.473860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:38.474281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:38.478480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:38.480082 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30d7d5a9-c6a5-4858-8805-d4427e17f0b2 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.203745 Sep 13 17:00:38.482621 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb590794-715e-449e-8000-87dfc92cdeac tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.810966 Sep 13 17:00:38.483965 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3072/6095] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:38 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:38.504553 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3024/6096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:37 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:38.682374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:38.683711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:38.696550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:38.697128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:38.697497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:38.698322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:38.698796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:38.699233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:38.809402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:38.809970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:38.824944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:38.825849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:38.826501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:38.830458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:38.831848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:38.832769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.208955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:39.217923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ffd6b71f-b0d2-408f-a585-b9848667ea38 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.412669 Sep 13 17:00:39.218808 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3025/6097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:38 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:39.224608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-fe3fc75c-823d-4e62-8830-6a71db59e74d req-c1706f71-c90a-43fb-8904-c6a6d94961cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f87e9bc-76e7-44f0-9908-403d3ff8e7ae", "name": "network-vif-plugged", "status": "completed", "tag": "b95aacd3-8255-4fd7-bc34-926bc3d50af3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:39.246079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fe3fc75c-823d-4e62-8830-6a71db59e74d req-c1706f71-c90a-43fb-8904-c6a6d94961cf service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:39.246993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fe3fc75c-823d-4e62-8830-6a71db59e74d req-c1706f71-c90a-43fb-8904-c6a6d94961cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:39.247612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fe3fc75c-823d-4e62-8830-6a71db59e74d req-c1706f71-c90a-43fb-8904-c6a6d94961cf service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.263499 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fe3fc75c-823d-4e62-8830-6a71db59e74d req-c1706f71-c90a-43fb-8904-c6a6d94961cf service nova] Creating event network-vif-plugged:b95aacd3-8255-4fd7-bc34-926bc3d50af3 for instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae on n-h1-857467-1 Sep 13 17:00:39.269985 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-fe3fc75c-823d-4e62-8830-6a71db59e74d req-c1706f71-c90a-43fb-8904-c6a6d94961cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048964 Sep 13 17:00:39.270905 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3026/6098] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:39.310528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:39.323236 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd2fe799-a8b0-4929-8bc4-8690c4586113 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1681 microversion: 2.1 time: 0.647005 Sep 13 17:00:39.324139 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3073/6099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:38 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1681 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:39.518301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:39.519523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:39.521639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:39.522905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:39.529433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:39.530191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:39.530592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:39.530817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.531491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:39.531622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:39.532612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.532977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:39.533286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:39.533764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:39.534306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.536418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.542028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:39.627537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:39.636587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:39.638301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:39.639474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1032b00c-c7d2-43bf-a375-f790b51b1bd0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.126578 Sep 13 17:00:39.640170 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3027/6100] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:39 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:39.847608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-86f9b97e-1d60-413a-bad6-f9b4cb132353 req-a9ab7f2f-5950-4b66-8202-8b1410a5ca71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be42671-87d9-4a60-a0cf-bd2b85d8a90a", "name": "network-vif-deleted", "tag": "27d9c7fc-ec8b-43e5-baa0-9d092696a366"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:39.871421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-86f9b97e-1d60-413a-bad6-f9b4cb132353 req-a9ab7f2f-5950-4b66-8202-8b1410a5ca71 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:39.872523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-86f9b97e-1d60-413a-bad6-f9b4cb132353 req-a9ab7f2f-5950-4b66-8202-8b1410a5ca71 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:39.873329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-86f9b97e-1d60-413a-bad6-f9b4cb132353 req-a9ab7f2f-5950-4b66-8202-8b1410a5ca71 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:39.893176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-86f9b97e-1d60-413a-bad6-f9b4cb132353 req-a9ab7f2f-5950-4b66-8202-8b1410a5ca71 service nova] Creating event network-vif-deleted:27d9c7fc-ec8b-43e5-baa0-9d092696a366 for instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a on n-h1-857467-1 Sep 13 17:00:39.899045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-86f9b97e-1d60-413a-bad6-f9b4cb132353 req-a9ab7f2f-5950-4b66-8202-8b1410a5ca71 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059109 Sep 13 17:00:39.904368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3028/6101] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:39.905906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:39.915585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a6b698c3-3d51-42ed-811c-41a031ca272f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.402484 Sep 13 17:00:39.916712 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3074/6102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:39 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:40.247867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:40.248717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:40.263512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.267784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.269522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.273585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.274457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.275119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.349548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:40.350189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:40.361059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.368457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.369145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.370192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.370815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.371406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.468092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.469031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.470732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.472421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'fault' on Instance uuid 8be42671-87d9-4a60-a0cf-bd2b85d8a90a {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:00:40.542645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:40.553747 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47f7a4aa-c763-40d4-8050-9e0ed3b5f03b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1331 microversion: 2.1 time: 0.208418 Sep 13 17:00:40.565948 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3075/6103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:40 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1331 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:40.659076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:40.666878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:40.670620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:40.687507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.688076 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-184c8c0e-8b0f-405b-a9e1-d423b3ee55e1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.444126 Sep 13 17:00:40.688830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.710252 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3029/6104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:40 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:40.711869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.720036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.720568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.721039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.954722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:40.954722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:40.955968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:40.977077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.977523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.978012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.978742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:40.979209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:40.982055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:40.982186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:40.982290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:40.995907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b0a8236-7596-4bfd-b229-014bd92648b3 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.332920 Sep 13 17:00:40.996534 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3076/6105] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:40 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:00:41.343217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:41.364449 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a11d11eb-72fb-4241-b7f7-0f1b242f3e0d tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1373 microversion: 2.1 time: 0.424161 Sep 13 17:00:41.365066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3030/6106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:40 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1373 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:41.582004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:41.582939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:41.594080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:41.594436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:41.594798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:41.595587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:41.596053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:41.598400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:41.691650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:41.692155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:41.692605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:41.697208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'fault' on Instance uuid 8be42671-87d9-4a60-a0cf-bd2b85d8a90a {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:00:41.731883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:41.733616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:41.745802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:41.746489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:41.746948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:41.747677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:41.748311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:41.748634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:41.804690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:41.821699 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25a5a17c-e030-45fa-bc3b-a5fd344be919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 200 len: 1331 microversion: 2.1 time: 0.244670 Sep 13 17:00:41.824426 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3077/6107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:41 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 1331 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:42.028269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:42.029860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:42.041325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.041853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.042309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.043024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.050343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.050872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.150046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:42.162154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9131b7c-abf6-464c-a7d7-ccd487a95089 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.436521 Sep 13 17:00:42.178618 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3031/6108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:41 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:42.200332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:42.210962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:42.213236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:42.214879 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cead3aee-7854-4062-8b5c-3478e9cdd38f tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.192832 Sep 13 17:00:42.215968 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3078/6109] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:42 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:42.387874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:42.389699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:42.400064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.400831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.401778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.402753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.403429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.404705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.671588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:42.682824 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7c41a11-e755-476b-b1a0-8d383d586222 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1545 microversion: 2.1 time: 0.297936 Sep 13 17:00:42.699832 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3032/6110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:42 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1545 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:42.707871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:42.708588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:42.718058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.718860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.721535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.722527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.723831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.724500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.849277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:42.851865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:42.862317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.864773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.865520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.866734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:42.868657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:42.869298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:42.888666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a HTTP/1.1 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8be42671-87d9-4a60-a0cf-bd2b85d8a90a'} Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:42.891127 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:00:42.896034 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:42.898835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:00:42.900043 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d737f660-ee04-408c-b5d7-a19cf828d90d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 404 len: 111 microversion: 2.1 time: 0.057250 Sep 13 17:00:42.901893 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3033/6111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:42 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:00:42.911231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cda32973-ef36-478b-bfef-e4eeac041a01 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '.version_select at 0x7fbeb4c82790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:42.940836 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cda32973-ef36-478b-bfef-e4eeac041a01 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455318672" status: 202 len: 0 microversion: 2.1 time: 0.034256 Sep 13 17:00:42.942379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3034/6112] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 17:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455318672 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 17:00:43.024643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:43.042639 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b37b63ac-34ce-42bc-887e-b31c13e58a9e tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1545 microversion: 2.1 time: 0.339174 Sep 13 17:00:43.043239 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3079/6113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:42 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1545 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:43.188734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:43.189564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:43.201637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:43.202227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:43.202840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:43.204839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:43.205530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:43.206351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:43.242404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:43.243023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:43.258526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:43.259055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:43.259502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:43.262441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:43.262933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:43.263383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:43.477620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:43.482517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:43.491589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:43.494464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:43.496689 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b896e177-0a28-48a9-b5a3-c67a5c1fb353 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1366 microversion: 2.57 time: 0.258457 Sep 13 17:00:43.503999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ffc434c7-9508-43cd-82ad-20cb8524815e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.320828 Sep 13 17:00:43.511605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3080/6114] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:43 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:43.523397 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3035/6115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:43 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:44.535913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:44.536547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:44.540640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:44.541278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:44.550687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:44.551138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:44.551592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:44.552330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:44.552798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:44.553472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:44.553589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:44.554222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:44.555052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:44.555903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:44.556890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:44.557737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:44.948928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:44.964620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:44.970320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:44.973453 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-06f389c2-30fc-45ab-ade8-1a5d95bcda52 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1372 microversion: 2.57 time: 0.442784 Sep 13 17:00:44.974690 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3036/6116] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:44 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:45.155669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:45.166320 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9dcc2beb-f6ff-4326-a6b9-3ab125b17523 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.640230 Sep 13 17:00:45.184539 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3081/6117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:44 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:45.509798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93eea101-dc2e-4bfc-ad9b-83eae26ad9e0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: .version_select at 0x7fbeb45d4940>, body: {"keypair": {"name": "tempest-keypair-2137643880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjTEk9FDPlMn87q+nB/BuiRroICYThpZ0vCYtZxHka0p05b9EGjwnAadl1F5dCkoOtRhY9yZz/lhj5zC4q8wm6v0+oUbmwqCvpU4OhEBefFduflhvQGrmP+K45izXxrFQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:45.535692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-93eea101-dc2e-4bfc-ad9b-83eae26ad9e0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:00:45.542424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-93eea101-dc2e-4bfc-ad9b-83eae26ad9e0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:00:45.575471 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93eea101-dc2e-4bfc-ad9b-83eae26ad9e0 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070471 Sep 13 17:00:45.578071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3037/6118] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:00:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:46.007896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:46.009428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:46.021597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:46.022310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:46.022915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:46.023707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:46.024282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:46.024826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:46.165974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:46.176285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:46.178004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:46.179224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e9279ec-9e8c-4691-ae1e-f2317a2d1800 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1372 microversion: 2.57 time: 0.179662 Sep 13 17:00:46.179797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3082/6119] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:45 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:46.191973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:46.192584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:46.199058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:46.199760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:46.200386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:46.201907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:46.202384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:46.202983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:46.430103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:46.440336 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c976dac7-752f-49d4-89cf-5b0a4f644970 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.252339 Sep 13 17:00:46.441192 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3038/6120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:46 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:47.208541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:47.209330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:47.216828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:47.217470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:47.218057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:47.218883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:47.220583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:47.221217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:47.320671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:47.341402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:47.345477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:47.349865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67237f52-5de9-4fd5-a545-8af277c87bb7 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1372 microversion: 2.57 time: 0.146127 Sep 13 17:00:47.369168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3083/6121] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:47 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:47.466081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:47.466081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:47.468104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:47.482364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:47.483528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:47.484190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:47.494370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:47.495090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a0ba7703-14da-4d54-8d43-ba9f581754b5 req-c08f9f8c-a255-4710-95fa-f6ae5109c8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f87e9bc-76e7-44f0-9908-403d3ff8e7ae", "tag": "b95aacd3-8255-4fd7-bc34-926bc3d50af3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:47.495667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:47.499156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:47.517094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a0ba7703-14da-4d54-8d43-ba9f581754b5 req-c08f9f8c-a255-4710-95fa-f6ae5109c8ce service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:47.518665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a0ba7703-14da-4d54-8d43-ba9f581754b5 req-c08f9f8c-a255-4710-95fa-f6ae5109c8ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:47.519835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a0ba7703-14da-4d54-8d43-ba9f581754b5 req-c08f9f8c-a255-4710-95fa-f6ae5109c8ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:47.561186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a0ba7703-14da-4d54-8d43-ba9f581754b5 req-c08f9f8c-a255-4710-95fa-f6ae5109c8ce service nova] Creating event network-changed:b95aacd3-8255-4fd7-bc34-926bc3d50af3 for instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae on n-h1-857467-1 Sep 13 17:00:47.574906 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a0ba7703-14da-4d54-8d43-ba9f581754b5 req-c08f9f8c-a255-4710-95fa-f6ae5109c8ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084939 Sep 13 17:00:47.576628 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3084/6122] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:00:47.637818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-262970138", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a782e2f4-354d-45ea-a878-8641bbe8c757"}], "security_groups": [{"name": "tempest-securitygroup--718425594"}], "key_name": "tempest-keypair-2137643880", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:47.783051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:47.794771 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f59f33c-ceb4-4095-83fd-8a95972ae792 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.334845 Sep 13 17:00:47.799051 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3039/6123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:47 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:47.835139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] validate_networks() for [('a782e2f4-354d-45ea-a878-8641bbe8c757', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:00:48.382537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:48.383915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:48.393632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:48.394532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:48.395219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:48.396178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:48.396874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:48.397548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:48.543665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:48.557964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:48.559703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:48.561429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00753ebd-a9ba-41d5-b351-c6c96f776fc1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1372 microversion: 2.57 time: 0.182865 Sep 13 17:00:48.562453 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3040/6124] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:48 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:48.824566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:48.825478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:48.832791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:48.833696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:48.834382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:48.835408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:48.836066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:48.836708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:49.179614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:49.191768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b4e021d-a3bf-4a5d-a7f1-44d8d97d6c15 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.370664 Sep 13 17:00:49.193153 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3041/6125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:48 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:49.451334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:00:49.451837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:00:49.452843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:00:49.454095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:00:49.454674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:00:49.473129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:49.473634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:49.474106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:49.479086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:49.480296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:49.481536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:49.541024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:00:49.559555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Getting quotas for user f64beb6d899a4e7188e14ef66163348f and project e856acfabcb741f099a858837e7ccac4. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:00:49.595360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:49.596102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:49.599893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:00:49.636788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:00:49.653245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:49.655284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:49.660405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:49.669156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:49.669852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:49.671469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:49.759269 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b79f71bd-136c-44e8-8590-96a48e188a8a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.126052 Sep 13 17:00:49.760690 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3085/6126] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:00:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:00:49.771989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2fb26706-a302-4670-9d28-7d20c7fc3f64 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:49.773792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2fb26706-a302-4670-9d28-7d20c7fc3f64 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:49.931777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:49.947293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:49.955098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:49.959151 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0aea42a-0da6-4fcc-bff7-7e80129d0b41 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1357 microversion: 2.57 time: 0.373758 Sep 13 17:00:49.964299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3042/6127] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:49 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1357 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:50.006391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:50.006909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:50.015617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:50.017742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:50.022030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:50.022805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:50.023479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:50.024113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:50.043129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2fb26706-a302-4670-9d28-7d20c7fc3f64 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:50.073093 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2fb26706-a302-4670-9d28-7d20c7fc3f64 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1241 microversion: 2.1 time: 0.305232 Sep 13 17:00:50.073866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3086/6128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:49 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1241 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:50.097755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:00:50.223744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:50.224832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:50.245281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:50.246160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:50.247529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:50.252005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:50.253383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:50.254533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:50.281721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-10901568-5071-49d8-b497-6ffb7192c8c0 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "DELETE /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 204 len: 0 microversion: 2.57 time: 0.279807 Sep 13 17:00:50.286152 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3043/6129] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 17:00:49 2022] DELETE /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 17:00:50.292927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:50.295482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:50.306945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:50.308308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:50.309135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:50.311277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:50.312135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:50.316544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:50.508215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:50.525285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1685607-db09-44c7-b69c-0737ff9c88c1 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.309211 Sep 13 17:00:50.527363 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3087/6130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:50 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:50.783998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:50.794569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:50.796863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:50.800938 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-30400c20-2b82-4ba2-a6be-107019415d4c tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1363 microversion: 2.57 time: 0.513270 Sep 13 17:00:50.802382 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3044/6131] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:50 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1363 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:51.107665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:51.108320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:51.128184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:51.129072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:51.129697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:51.130637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:51.131183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:51.131622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:51.217465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:51.228198 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ee4c66e-1a21-43d9-8ced-4c106c75dbf4 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1245 microversion: 2.1 time: 0.131129 Sep 13 17:00:51.229437 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3088/6132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:51 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:51.549715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:51.550559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:51.558065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:51.558566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:51.559005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:51.559727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:51.560363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:51.560989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:51.589117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:51.831424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:51.832205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:51.846664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:51.847198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:51.847852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:51.848667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:51.849223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:51.850692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:51.963025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:51.978406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:51.980250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:51.981681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3fbc342c-8a5b-4fef-9c47-f29c841d3693 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1363 microversion: 2.57 time: 0.154965 Sep 13 17:00:51.982511 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3089/6133] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:51 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:52.171322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:52.181013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60fe6c6d-6037-4d12-8c4e-52acda19e592 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.636258 Sep 13 17:00:52.181899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3045/6134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:51 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:52.253514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:52.254762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:52.267653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:52.268177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:52.268642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:52.269401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:52.274575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:52.275279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:52.389391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:52.394164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:52.407347 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5883f3f-ba6a-4ee6-babd-fb01d854a597 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1293 microversion: 2.1 time: 0.158624 Sep 13 17:00:52.409437 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3090/6135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:52 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:53.009381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:53.010073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:53.030812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.031860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.033205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.034457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.035657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.036187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.122454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.122959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.123409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.123872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lazy-loading 'fault' on Instance uuid 90c78c41-dbd4-46f1-b15a-c7764a426765 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:00:53.207800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:53.209042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:53.218119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.218825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.220347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.225598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.226531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.227168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.230694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:53.243083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:53.246926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88756f60384c4ab4ac704cfb856b660a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b66ad87c9d4705b8f8ff67eca4af1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:53.250990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-afa0c789-28d9-4d1d-9866-213990508c50 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 200 len: 1368 microversion: 2.57 time: 0.243146 Sep 13 17:00:53.253962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3046/6136] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:53 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:00:53.429674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:53.430864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:53.437136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.438206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.439474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.440549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:53.441151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:53.441604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:53.524264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:53.538540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ca67482-393b-41d0-935d-95dd2e073b09 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1299 microversion: 2.1 time: 0.112237 Sep 13 17:00:53.540403 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3047/6137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:53 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:53.545694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:53.558827 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a71ff9f-7759-481b-93a9-ca5dd20cb5f3 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.355655 Sep 13 17:00:53.559906 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3091/6138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:53 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:54.282882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:54.283695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] [instance: 90c78c41-dbd4-46f1-b15a-c7764a426765] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:54.301084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:54.303299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:54.303937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:54.304675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:54.305404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:54.305960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:54.324082 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] HTTP exception thrown: Instance 90c78c41-dbd4-46f1-b15a-c7764a426765 could not be found. Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Request method failure captured: Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 HTTP/1.1 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILcX_CFqfI68RFml6F5ZJNapAgJZeQyaIHoOAJK1aRipen6_w4tQT-MEazD0lOeT6Zfj_NaE9ospyyjt5-6ME6ht5SwQ97PkqOdl7Bwir0rDzoPIj3WCZNMUUX0JrTcFnsIyEUe3I9bM2TVRjPT_Ia60TcgFore9VCoxMJhpqQV6dgk Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.57 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f4b66ad87c9d4705b8f8ff67eca4af1e Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerShowV257Test-1802056549 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4b66ad87c9d4705b8f8ff67eca4af1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4b66ad87c9d4705b8f8ff67eca4af1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4b66ad87c9d4705b8f8ff67eca4af1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4b66ad87c9d4705b8f8ff67eca4af1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerShowV257Test-1802056549 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f4b66ad87c9d4705b8f8ff67eca4af1e Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerShowV257Test-1802056549 Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerShowV257Test-1802056549-project Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 88756f60384c4ab4ac704cfb856b660a Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerShowV257Test-1802056549-project Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 90c78c41-dbd4-46f1-b15a-c7764a426765 could not be found. Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '90c78c41-dbd4-46f1-b15a-c7764a426765'} Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c78c41-dbd4-46f1-b15a-c7764a426765 could not be found. Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c78c41-dbd4-46f1-b15a-c7764a426765 could not be found. Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:00:54.326706 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c78c41-dbd4-46f1-b15a-c7764a426765 could not be found. Sep 13 17:00:54.331437 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:00:54.333199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] Returning 404 to user: Instance 90c78c41-dbd4-46f1-b15a-c7764a426765 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:00:54.334302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8962876d-d158-43ea-8814-fa7310fc2db1 tempest-ServerShowV257Test-1802056549 tempest-ServerShowV257Test-1802056549-project] 10.222.0.61 "GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765" status: 404 len: 111 microversion: 2.57 time: 0.056282 Sep 13 17:00:54.336131 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3048/6139] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:00:54 2022] GET /compute/v2.1/servers/90c78c41-dbd4-46f1-b15a-c7764a426765 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:00:54.566902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:54.567520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:54.579290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:54.582235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:54.582865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:54.585740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:54.586636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:54.590206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:54.590698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:54.591143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:54.614707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:54.615478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:54.616098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:54.617010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:54.618255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:54.619849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:55.010738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:55.020715 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2d4af50-0067-4ec9-89fb-3af5137063ff tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.458084 Sep 13 17:00:55.021330 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3092/6140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:54 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:55.110989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:55.124741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b119f3ba-0433-4223-be27-4eaa0abf563d tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.543706 Sep 13 17:00:55.132668 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3049/6141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:54 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:55.985409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-95b40a02-aa46-4215-98bf-d1da231ae32d req-74417059-28b4-4014-9dc2-40a09007d06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdb7d83-4d8f-400d-b977-b7de90e0c827", "tag": "61331154-abde-4872-8d23-ea3c336a5e4b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:56.022517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-95b40a02-aa46-4215-98bf-d1da231ae32d req-74417059-28b4-4014-9dc2-40a09007d06d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:56.023173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-95b40a02-aa46-4215-98bf-d1da231ae32d req-74417059-28b4-4014-9dc2-40a09007d06d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:56.038676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-95b40a02-aa46-4215-98bf-d1da231ae32d req-74417059-28b4-4014-9dc2-40a09007d06d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:56.045070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:56.045742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:56.057097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:00:56.064327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:56.065035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:56.065650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:56.066782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:56.071906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:56.072423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:56.091024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-95b40a02-aa46-4215-98bf-d1da231ae32d req-74417059-28b4-4014-9dc2-40a09007d06d service nova] Creating event network-changed:61331154-abde-4872-8d23-ea3c336a5e4b for instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 on n-h1-857467-1 Sep 13 17:00:56.099501 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-95b40a02-aa46-4215-98bf-d1da231ae32d req-74417059-28b4-4014-9dc2-40a09007d06d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118003 Sep 13 17:00:56.102177 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3093/6142] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:56.159658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:56.160371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:56.178451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:56.178831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:56.179460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:56.180463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:56.181090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:56.181740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:56.744366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:56.755741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b11613f-3a01-4eb8-b6df-3648ac10b3d9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.714751 Sep 13 17:00:56.756992 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3050/6143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:56 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:57.018023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:57.034500 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2301f9d-b232-485d-b3ef-d4da41ec401e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.879735 Sep 13 17:00:57.038762 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3094/6144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:56 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:57.146749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8318c59d-e69c-49a1-94e2-229c3a9785e4 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Action: 'create', calling method: .version_select at 0x7fbeb4b2a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-22276137"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:57.604209 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8318c59d-e69c-49a1-94e2-229c3a9785e4 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.654803 Sep 13 17:00:57.605533 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3051/6145] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Sep 13 17:00:56 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 657 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 17:00:57.620067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-718f975a-6c31-4602-af9b-2daf3b9eb906 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb50ee430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:57.720518 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-718f975a-6c31-4602-af9b-2daf3b9eb906 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 200 len: 343 microversion: 2.1 time: 0.105427 Sep 13 17:00:57.721358 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3095/6146] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:00:57 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 343 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:57.780476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:57.782284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:57.798861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:57.799478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:57.800176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:57.801706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:57.802229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:57.805041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:58.068001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:58.069301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:58.093087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:58.096581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:58.096804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:58.099675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:58.100178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:58.100629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:58.119441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:58.128572 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f8a0c52-6213-44d6-982a-3d18c9f8393a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.352291 Sep 13 17:00:58.134204 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3052/6147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:57 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:58.348765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:58.362876 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ba7b29f-1617-4c08-932d-06b0a0abfc9a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.301562 Sep 13 17:00:58.365659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3096/6148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:58 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:00:58.736958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a18da6a3-f3ab-4093-a62e-632a3e375577 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb49df310>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:58.837526 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a18da6a3-f3ab-4093-a62e-632a3e375577 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 200 len: 344 microversion: 2.1 time: 0.106253 Sep 13 17:00:58.838317 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3053/6149] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:00:58 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:58.852446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-505207ba-e579-4956-ba97-e67535656a00 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Action: 'create', calling method: .version_select at 0x7fbeb54bde50>, body: {"snapshot": {"volume_id": "f46ca388-2b68-4ea1-8240-a4d98dc93eaa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-119290122"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:00:59.114436 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-505207ba-e579-4956-ba97-e67535656a00 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.266323 Sep 13 17:00:59.115869 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3097/6150] 10.222.0.61 () {60 vars in 1162 bytes} [Tue Sep 13 17:00:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:59.133433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a2589a1-9202-4642-9333-6b9815dff5f3 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb45c6700>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:59.161088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:59.162366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:59.170852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:59.171384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:59.171987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:59.172225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a2589a1-9202-4642-9333-6b9815dff5f3 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 200 len: 286 microversion: 2.1 time: 0.043007 Sep 13 17:00:59.173150 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3054/6151] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:00:59 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:59.173427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:59.173427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:59.173722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:59.188986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91f13bce-e7f1-496b-83b5-129f36060237 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb49df790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:59.230950 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91f13bce-e7f1-496b-83b5-129f36060237 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.046533 Sep 13 17:00:59.231547 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3055/6152] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Sep 13 17:00:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:59.245452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3552be55-e92a-405a-99e9-bddf65d7172b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4ad9c10>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:59.320236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3552be55-e92a-405a-99e9-bddf65d7172b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 200 len: 286 microversion: 2.1 time: 0.078493 Sep 13 17:00:59.320946 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3056/6153] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:00:59 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:00:59.369588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:59.381224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2da59be0-cdd4-4730-a618-c84b34c9af04 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.224062 Sep 13 17:00:59.382202 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3098/6154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:59 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:00:59.393974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:00:59.393974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:00:59.399692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:59.400379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:59.400997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:59.402207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:00:59.402826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:00:59.403473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:00:59.620246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:00:59.638666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d2a8e13-9be9-48c4-9dd3-cef863b51d59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.253145 Sep 13 17:00:59.640556 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3057/6155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:00:59 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:01:00.333471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2e77d34-dee0-405b-ae94-2772205e9e52 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb97e3c10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:00.346673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:00.349982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:00.403163 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2e77d34-dee0-405b-ae94-2772205e9e52 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 200 len: 286 microversion: 2.1 time: 0.073817 Sep 13 17:01:00.404306 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3099/6156] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:01:00 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:00.412157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:00.412805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:00.425579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:00.426110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:00.426552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:00.427271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:00.427744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:00.428169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:00.668834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:00.670159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:00.686896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:00.687534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:00.688148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:00.697030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:00.699315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:00.699315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:00.976008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:01.016206 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aed32155-bf13-402d-8e15-9fcaf3656db2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.614093 Sep 13 17:01:01.016828 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3058/6157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:00 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:01.092276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:01.116072 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9144d1bd-e903-4e90-83b9-70ec1d40279e tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.452126 Sep 13 17:01:01.116804 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3100/6158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:00 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:01:01.416037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7b4f2b9-43cb-430a-bcad-e42022204da1 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb45c6790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:01.448136 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7b4f2b9-43cb-430a-bcad-e42022204da1 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 200 len: 287 microversion: 2.1 time: 0.035994 Sep 13 17:01:01.448743 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3059/6159] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:01:01 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:01:01.462800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eafece4d-65a0-4da6-af27-e9222e056f25 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4970940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:01.533820 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eafece4d-65a0-4da6-af27-e9222e056f25 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 202 len: 0 microversion: 2.1 time: 0.076245 Sep 13 17:01:01.534428 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3101/6160] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Sep 13 17:01:01 2022] DELETE /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:01:01.545439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d085bec1-ffea-451d-80d0-287d3aff35c0 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4c0e1f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:01.587503 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d085bec1-ffea-451d-80d0-287d3aff35c0 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 200 len: 286 microversion: 2.1 time: 0.047387 Sep 13 17:01:01.589032 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3060/6161] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:01:01 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:02.043676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:02.044521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:02.046694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:02.061646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:02.062925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:02.063556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:02.066002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:02.066709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:02.080116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:02.142651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:02.143475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:02.179063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:02.179802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:02.180265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:02.181041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:02.181508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:02.182000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:02.276565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:02.285429 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b6f8547-952b-4703-8666-32fd7b029e5a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.245673 Sep 13 17:01:02.286541 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3102/6162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:02 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:02.601412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d092cf1e-19b5-4e2a-96d9-dc40b0e8c608 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb980de50>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:02.653727 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d092cf1e-19b5-4e2a-96d9-dc40b0e8c608 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 200 len: 286 microversion: 2.1 time: 0.056501 Sep 13 17:01:02.655037 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3103/6163] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:01:02 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:01:02.983729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:02.993807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d64c000c-d3d4-4f3a-8c98-cc872d9c7cf0 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.857141 Sep 13 17:01:03.000323 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3061/6164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:02 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:01:03.313541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:03.314193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:03.331863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:03.332370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:03.332816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:03.333526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:03.334192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:03.334791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:03.514417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:03.525387 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0510fd89-baac-4f00-a0d8-6414feab08fe tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.216458 Sep 13 17:01:03.526917 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3104/6165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:03 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:03.666966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2dfd64a-1035-4cea-9184-70fc654b3134 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4cd7790>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:03.706411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f2dfd64a-1035-4cea-9184-70fc654b3134 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] HTTP exception thrown: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2dfd64a-1035-4cea-9184-70fc654b3134 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Request method failure captured: Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 HTTP/1.1 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILdIwxcwdJphluY8qC01L6oe1EWb6KXzox0DInkt4MFvf3jT8U6hvsKJg4cw4zBen82G-AO-EPdSuyp1HkaR8rShTznOd0CKyeiSu7r4yj-qfZh1cXQBCV2l7QPYbt4OobeNqCEKBB_oWfETtD_1BZRA6VDBNDdoZZXrVQ6e8iqOAck Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b8b56de26f0e4fa2a0a8a1a1452ea145 Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: exception: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '76528c19-2d3e-43b8-90d9-b7a96eb35920'} Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. (HTTP 404) (Request-ID: req-0b0bb069-6842-498b-b5db-aba968006256) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:01:03.718005 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. Sep 13 17:01:03.724819 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:03.732443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2dfd64a-1035-4cea-9184-70fc654b3134 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Returning 404 to user: Snapshot 76528c19-2d3e-43b8-90d9-b7a96eb35920 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:01:03.733663 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2dfd64a-1035-4cea-9184-70fc654b3134 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920" status: 404 len: 111 microversion: 2.1 time: 0.070914 Sep 13 17:01:03.739840 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3062/6166] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:01:03 2022] GET /compute/v2.1/os-snapshots/76528c19-2d3e-43b8-90d9-b7a96eb35920 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:01:03.743550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-107c06ec-c983-4517-9f41-ae767058da86 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4970ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:03.875405 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-107c06ec-c983-4517-9f41-ae767058da86 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 202 len: 0 microversion: 2.1 time: 0.135208 Sep 13 17:01:03.876048 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3105/6167] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 17:01:03 2022] DELETE /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 17:01:03.888239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6c7cf28-9ea2-4964-892b-8c7cc066c252 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4cd7f70>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:03.959797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6c7cf28-9ea2-4964-892b-8c7cc066c252 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 200 len: 343 microversion: 2.1 time: 0.075982 Sep 13 17:01:03.966790 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3063/6168] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:01:03 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 343 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:04.018134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:04.018771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:04.034524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:04.035287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:04.035904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:04.037168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:04.038012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:04.039583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:04.307826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:04.321929 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b9436197-0c27-4705-bfc5-81c5911a800f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.308518 Sep 13 17:01:04.323160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3106/6169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:04 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:04.552462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:04.556228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:04.564147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:04.564975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:04.566050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:04.567028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:04.567720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:04.568381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:04.834332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:04.849478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1e95edc-36f3-4321-9ca5-82e8b0a800f1 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.298181 Sep 13 17:01:04.850242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3064/6170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:04 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:04.977558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4cb66a2f-e02d-432e-9d63-ab93097653f7 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb96c9310>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:05.057853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4cb66a2f-e02d-432e-9d63-ab93097653f7 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 200 len: 343 microversion: 2.1 time: 0.086389 Sep 13 17:01:05.058842 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3107/6171] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:01:04 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 343 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:05.238458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b76a9c81-2b03-43e4-b72d-0a4942e4940a req-bb8ff3c7-d07b-426c-9456-b9a283549093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdb7d83-4d8f-400d-b977-b7de90e0c827", "name": "network-vif-plugged", "status": "completed", "tag": "61331154-abde-4872-8d23-ea3c336a5e4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:05.261878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b76a9c81-2b03-43e4-b72d-0a4942e4940a req-bb8ff3c7-d07b-426c-9456-b9a283549093 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:05.262457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b76a9c81-2b03-43e4-b72d-0a4942e4940a req-bb8ff3c7-d07b-426c-9456-b9a283549093 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:05.262906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b76a9c81-2b03-43e4-b72d-0a4942e4940a req-bb8ff3c7-d07b-426c-9456-b9a283549093 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:05.286532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b76a9c81-2b03-43e4-b72d-0a4942e4940a req-bb8ff3c7-d07b-426c-9456-b9a283549093 service nova] Creating event network-vif-plugged:61331154-abde-4872-8d23-ea3c336a5e4b for instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 on n-h1-857467-1 Sep 13 17:01:05.302525 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b76a9c81-2b03-43e4-b72d-0a4942e4940a req-bb8ff3c7-d07b-426c-9456-b9a283549093 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058169 Sep 13 17:01:05.303539 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3065/6172] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:05.349454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:05.351005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:05.360522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:05.361617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:05.362079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:05.362978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:05.363797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:05.364436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:05.879588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:05.881182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:05.889446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:05.890217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:05.891447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:05.892384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:05.893014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:05.893615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:05.915585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:05.928493 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7da1880-c57b-4427-bf30-c77f7c6e8d4c tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.583422 Sep 13 17:01:05.933379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3108/6173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:05 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:06.072886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d91e7482-0d2e-44b3-8625-72109d2cbc98 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb49a5940>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:06.150568 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d91e7482-0d2e-44b3-8625-72109d2cbc98 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 200 len: 343 microversion: 2.1 time: 0.081655 Sep 13 17:01:06.152113 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3109/6174] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:01:06 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 343 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:01:06.347638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:06.361306 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1948c6ca-5f64-49ce-aece-8e101bea3317 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1366 microversion: 2.1 time: 0.487319 Sep 13 17:01:06.378760 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3066/6175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:05 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1366 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:01:06.959613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:06.960231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:06.967758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:06.968256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:06.969070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:06.970034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:06.970671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:06.971111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:07.167619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10b27232-0b8d-451f-9527-df40b074fa51 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4c0e160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:07.205794 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-10b27232-0b8d-451f-9527-df40b074fa51 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] HTTP exception thrown: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10b27232-0b8d-451f-9527-df40b074fa51 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Request method failure captured: Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa HTTP/1.1 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILdIwxcwdJphluY8qC01L6oe1EWb6KXzox0DInkt4MFvf3jT8U6hvsKJg4cw4zBen82G-AO-EPdSuyp1HkaR8rShTznOd0CKyeiSu7r4yj-qfZh1cXQBCV2l7QPYbt4OobeNqCEKBB_oWfETtD_1BZRA6VDBNDdoZZXrVQ6e8iqOAck Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b8b56de26f0e4fa2a0a8a1a1452ea145 Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: exception: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f46ca388-2b68-4ea1-8240-a4d98dc93eaa'} Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. (HTTP 404) (Request-ID: req-5a0235ad-4283-4c73-bd94-8a30a4d24ba6) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:01:07.208466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10b27232-0b8d-451f-9527-df40b074fa51 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Returning 404 to user: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-10b27232-0b8d-451f-9527-df40b074fa51 tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 404 len: 109 microversion: 2.1 time: 0.049657 Sep 13 17:01:07.214020 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3067/6176] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:01:07 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:01:07.227053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c7ae4d21-72eb-4434-ab66-64ab57db8b6b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4a5f820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:07.258370 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c7ae4d21-72eb-4434-ab66-64ab57db8b6b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] HTTP exception thrown: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c7ae4d21-72eb-4434-ab66-64ab57db8b6b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Request method failure captured: Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa HTTP/1.1 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILdIwxcwdJphluY8qC01L6oe1EWb6KXzox0DInkt4MFvf3jT8U6hvsKJg4cw4zBen82G-AO-EPdSuyp1HkaR8rShTznOd0CKyeiSu7r4yj-qfZh1cXQBCV2l7QPYbt4OobeNqCEKBB_oWfETtD_1BZRA6VDBNDdoZZXrVQ6e8iqOAck Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b8b56de26f0e4fa2a0a8a1a1452ea145 Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: exception: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f46ca388-2b68-4ea1-8240-a4d98dc93eaa'} Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. (HTTP 404) (Request-ID: req-281be182-12c5-4033-a7ff-d937839e0024) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:01:07.260567 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.265415 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.269308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:07.271328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c7ae4d21-72eb-4434-ab66-64ab57db8b6b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Returning 404 to user: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:01:07.271825 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c7ae4d21-72eb-4434-ab66-64ab57db8b6b tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 404 len: 109 microversion: 2.1 time: 0.049898 Sep 13 17:01:07.272962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3068/6177] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 17:01:07 2022] DELETE /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:01:07.283505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8d788c9-5c69-4a9a-b02b-2512b80c033c tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Calling method '.version_select at 0x7fbeb4cfd0d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:07.284612 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ba90811-6122-43cb-8eb1-be1d96f25b97 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.329901 Sep 13 17:01:07.301698 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3110/6178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:06 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:07.331884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-d8d788c9-5c69-4a9a-b02b-2512b80c033c tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] HTTP exception thrown: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8d788c9-5c69-4a9a-b02b-2512b80c033c tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Request method failure captured: Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa HTTP/1.1 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILdIwxcwdJphluY8qC01L6oe1EWb6KXzox0DInkt4MFvf3jT8U6hvsKJg4cw4zBen82G-AO-EPdSuyp1HkaR8rShTznOd0CKyeiSu7r4yj-qfZh1cXQBCV2l7QPYbt4OobeNqCEKBB_oWfETtD_1BZRA6VDBNDdoZZXrVQ6e8iqOAck Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/073f9bd9283441bb9f4170ddbef53bce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 073f9bd9283441bb9f4170ddbef53bce Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437045785 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: b8b56de26f0e4fa2a0a8a1a1452ea145 Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437045785-project Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: exception: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'f46ca388-2b68-4ea1-8240-a4d98dc93eaa'} Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. (HTTP 404) (Request-ID: req-24dfae0e-2492-47a2-b715-ca0f6e6050e2) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:01:07.333864 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d8d788c9-5c69-4a9a-b02b-2512b80c033c tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] Returning 404 to user: Volume f46ca388-2b68-4ea1-8240-a4d98dc93eaa could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:01:07.338300 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d8d788c9-5c69-4a9a-b02b-2512b80c033c tempest-VolumesSnapshotsTestJSON-437045785 tempest-VolumesSnapshotsTestJSON-437045785-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa" status: 404 len: 109 microversion: 2.1 time: 0.058614 Sep 13 17:01:07.347668 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3069/6179] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:01:07 2022] GET /compute/v2.1/os-volumes/f46ca388-2b68-4ea1-8240-a4d98dc93eaa => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:01:07.387082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:07.387982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:07.395123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:07.396048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:07.396823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:07.397713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:07.398354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:07.398960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:07.839128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:07.850592 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31c5652a-080f-4a06-9d22-54b77cc8e6b5 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1556 microversion: 2.1 time: 0.468247 Sep 13 17:01:07.851294 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3111/6180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:07 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1556 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:07.877568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:07.878368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:07.885236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:07.886101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:07.886962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:07.887876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:07.888493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:07.889080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:07.994095 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ee19bb7-7399-4fc6-9bff-f282711ace83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122746 Sep 13 17:01:08.004130 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3070/6181] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 17:01:07 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:08.308000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:08.308614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:08.315882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:08.316598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:08.317212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:08.318166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:08.318806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:08.319412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:08.808932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:08.817865 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a22d71c-bdea-4397-82e9-f2b8ceb6da1f tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1487 microversion: 2.1 time: 0.513873 Sep 13 17:01:08.818662 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3112/6182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:08 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1487 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:08.842373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:08.842905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:08.849535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:08.850073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:08.850540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:08.851219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:08.851677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:08.852135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:08.924473 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-825e7254-2a3a-4750-b7f8-d232261bffa9 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "POST /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3/action" status: 202 len: 0 microversion: 2.1 time: 0.086743 Sep 13 17:01:08.925499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3071/6183] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:01:08 2022] POST /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:01:08.934190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:08.936306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:08.946093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:08.946948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:08.947621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:08.948820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:08.949615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:08.950270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:09.668724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:09.678025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6078645-e132-43c9-a745-f0cf09c2f6ea tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1495 microversion: 2.1 time: 0.748217 Sep 13 17:01:09.679260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3113/6184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:08 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1495 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:10.702130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:10.703914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:10.716701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:10.717494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:10.719626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:10.722028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:10.722527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:10.722967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:10.928292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-635ea127-964e-4350-ae7e-60bfaf017d25 req-28692706-021c-4717-a004-079a8c4b2164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdb7d83-4d8f-400d-b977-b7de90e0c827", "tag": "61331154-abde-4872-8d23-ea3c336a5e4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:10.946826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-635ea127-964e-4350-ae7e-60bfaf017d25 req-28692706-021c-4717-a004-079a8c4b2164 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:10.948656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-635ea127-964e-4350-ae7e-60bfaf017d25 req-28692706-021c-4717-a004-079a8c4b2164 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:10.950511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-635ea127-964e-4350-ae7e-60bfaf017d25 req-28692706-021c-4717-a004-079a8c4b2164 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:10.977283 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-635ea127-964e-4350-ae7e-60bfaf017d25 req-28692706-021c-4717-a004-079a8c4b2164 service nova] Creating event network-changed:61331154-abde-4872-8d23-ea3c336a5e4b for instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 on n-h1-857467-1 Sep 13 17:01:10.987250 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-635ea127-964e-4350-ae7e-60bfaf017d25 req-28692706-021c-4717-a004-079a8c4b2164 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297074 Sep 13 17:01:10.987957 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3072/6185] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:11.082935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:11.102095 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63465bd9-a744-4bd7-b122-58ef781fd71a tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1495 microversion: 2.1 time: 0.403524 Sep 13 17:01:11.103425 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3114/6186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:10 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1495 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:01:12.127283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:12.128764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:12.135419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:12.136279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:12.136984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:12.138004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:12.138916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:12.139576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:12.457741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:12.475459 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35787cbb-898f-4724-9931-8de32f6f73fa tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1501 microversion: 2.1 time: 0.353809 Sep 13 17:01:12.476056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3073/6187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:12 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:12.512681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:12.513257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:12.529688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:12.530239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:12.530691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:12.532332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:12.532819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:12.533261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:12.588069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:01:12.630541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:12.748621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a29d4e51-3235-463a-b767-09a515b04387 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 204 len: 0 microversion: 2.1 time: 0.239640 Sep 13 17:01:12.749623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3115/6188] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:01:12 2022] DELETE /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:01:12.758323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:12.759368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:12.768755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:12.769622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:12.770389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:12.771590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:12.772457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:12.773231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:13.081128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:13.091521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e63f8627-a11e-4f6d-8a1b-abf3b0cde09b tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.337605 Sep 13 17:01:13.092402 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3074/6189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:12 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:14.116843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:14.118340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:14.135352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:14.136024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:14.137602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:14.139806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:14.141235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:14.144693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:14.410842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:14.430468 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d1660b9-1dd0-4386-adaa-2c7321347baf tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.319683 Sep 13 17:01:14.442839 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3116/6190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:14 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:15.459774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:15.461303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:15.493553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:15.495127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:15.497505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:15.500854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:15.508256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:15.509063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:15.551102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:16.221385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:16.239445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-add8df5a-8e23-4aa7-ad6e-49f89e2c8cb4 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1507 microversion: 2.1 time: 0.786434 Sep 13 17:01:16.240998 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3075/6191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:15 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:17.267492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:17.268417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:17.284093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:17.287831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:17.289696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:17.289696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:17.298406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:17.298998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:17.450130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:17.492351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94beefdc-da1e-42cb-befc-f0ff67f676b6 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 200 len: 1465 microversion: 2.1 time: 0.228796 Sep 13 17:01:17.504026 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3117/6192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:17 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 1465 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:17.652467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-34ec46c2-f1e8-4be4-8664-807206c8f52c req-a0b4c51f-38e7-4541-b8b3-f17d3872564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3", "name": "network-vif-deleted", "tag": "25d275a3-90a0-446c-9c2a-d054d583608a"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:17.675666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:17.685512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-34ec46c2-f1e8-4be4-8664-807206c8f52c req-a0b4c51f-38e7-4541-b8b3-f17d3872564d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:17.685784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-34ec46c2-f1e8-4be4-8664-807206c8f52c req-a0b4c51f-38e7-4541-b8b3-f17d3872564d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:17.698091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-34ec46c2-f1e8-4be4-8664-807206c8f52c req-a0b4c51f-38e7-4541-b8b3-f17d3872564d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:17.734802 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-34ec46c2-f1e8-4be4-8664-807206c8f52c req-a0b4c51f-38e7-4541-b8b3-f17d3872564d service nova] Creating event network-vif-deleted:25d275a3-90a0-446c-9c2a-d054d583608a for instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 on n-h2-857467-1 Sep 13 17:01:17.747659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-34ec46c2-f1e8-4be4-8664-807206c8f52c req-a0b4c51f-38e7-4541-b8b3-f17d3872564d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097807 Sep 13 17:01:17.749681 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3076/6193] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:18.529645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:18.531488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:18.549542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:18.550424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:18.550871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:18.551911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:18.555712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:18.557319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:18.590094 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] HTTP exception thrown: Instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 could not be found. Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Request method failure captured: Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 HTTP/1.1 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILbsPH1AD0A0qZ5zHRMS6uj2ds3I-dR5GIbh_QUVBZEY73X23X4Sij1F5reMB3N8UCjAjrd9m24xyx6mTCouS_AOX0An0gp2J5DDMEdtVXwSFa9eqQjQQFFYj5s4jUeOW-LqEtaqS6mqsmkDmxKvHjJTISS8bTjEbxLqPXs0m8FHZ6A Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 713153c3d1724f269f58844c6c10c9d4 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueTestJSON-2086270764 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueTestJSON-2086270764 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 713153c3d1724f269f58844c6c10c9d4 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueTestJSON-2086270764 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueTestJSON-2086270764-project Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7c397be23d6b41e58154d2e8799b71d5 Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueTestJSON-2086270764-project Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 could not be found. Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3'} Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 could not be found. Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 could not be found. Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:18.592023 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 could not be found. Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Returning 404 to user: Instance 2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:01:18.597494 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9999d210-d7e9-4b3e-bbe2-d30f432301e2 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3" status: 404 len: 111 microversion: 2.1 time: 0.071465 Sep 13 17:01:18.604857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:18.605535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:18.610192 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3118/6194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:18 2022] GET /compute/v2.1/servers/2a09acf8-f0e7-47b4-a8fa-eb095c2a18f3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:01:18.615540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:18.616363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:18.616819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:18.617667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:18.618203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:18.618641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:18.659452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:01:18.826231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b33c0321-7189-4331-a5bb-1bd0469a3afc tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 204 len: 0 microversion: 2.1 time: 0.226126 Sep 13 17:01:18.830622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3077/6195] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:01:18 2022] DELETE /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:01:18.841677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:18.844343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:18.879694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:18.880561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:18.881173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:18.885135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:18.886462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:18.888811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:19.304554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:19.315707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79bdc164-c7b4-4835-8fac-92fc75573533 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1491 microversion: 2.1 time: 0.479320 Sep 13 17:01:19.319728 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3119/6196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:18 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1491 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:20.290246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:20.297715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:20.308827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:20.309596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:20.310320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:20.310961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:20.311574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:20.313146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:20.345679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:20.347132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:20.358530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:20.361741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:20.362251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:20.362980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:20.363434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:20.366645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:20.412403 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e1e415e-3ab2-4105-b28c-7b8e7bab1378 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae/action" status: 200 len: 24570 microversion: 2.1 time: 0.128283 Sep 13 17:01:20.415352 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3078/6197] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:01:20 2022] POST /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae/action => generated 24570 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:01:20.607476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:20.638513 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4fbb290-c148-461c-b58d-1b20b547dc59 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1491 microversion: 2.1 time: 0.298276 Sep 13 17:01:20.641306 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3120/6198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:20 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1491 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:01:21.672079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:21.675127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:21.698639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:21.699424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:21.700785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:21.703370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:21.705265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:21.705731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:22.451746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:22.465087 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f66cfa2-0c37-480d-907b-15292ff78adb tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1491 microversion: 2.1 time: 0.800666 Sep 13 17:01:22.466150 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3079/6199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:21 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1491 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:23.122961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-31bede71-4524-4079-a878-b78127982bb0 req-ea76961f-3ae0-4033-9ed6-3be498e423b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea464788-8e5a-4684-989d-5739fd77a887", "name": "network-vif-deleted", "tag": "f34daf22-3fb8-47bb-bc5e-f016d7a6da09"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:23.145806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-31bede71-4524-4079-a878-b78127982bb0 req-ea76961f-3ae0-4033-9ed6-3be498e423b4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:23.146984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-31bede71-4524-4079-a878-b78127982bb0 req-ea76961f-3ae0-4033-9ed6-3be498e423b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:23.148013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-31bede71-4524-4079-a878-b78127982bb0 req-ea76961f-3ae0-4033-9ed6-3be498e423b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:23.186557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-31bede71-4524-4079-a878-b78127982bb0 req-ea76961f-3ae0-4033-9ed6-3be498e423b4 service nova] Creating event network-vif-deleted:f34daf22-3fb8-47bb-bc5e-f016d7a6da09 for instance ea464788-8e5a-4684-989d-5739fd77a887 on n-h2-857467-1 Sep 13 17:01:23.199518 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-31bede71-4524-4079-a878-b78127982bb0 req-ea76961f-3ae0-4033-9ed6-3be498e423b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080318 Sep 13 17:01:23.201721 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3121/6200] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:23.491030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:23.491652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:23.520773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:23.521841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:23.522431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:23.523661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:23.525599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:23.526558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:23.626675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:23.629957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:23.631300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:23.632171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lazy-loading 'fault' on Instance uuid ea464788-8e5a-4684-989d-5739fd77a887 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:01:23.803704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c397be23d6b41e58154d2e8799b71d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713153c3d1724f269f58844c6c10c9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:23.816606 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-59dab42a-3583-42b6-8b87-2f8cff77bae5 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 200 len: 1303 microversion: 2.1 time: 0.329336 Sep 13 17:01:23.817203 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3080/6201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:23 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 1303 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:01:24.848069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:24.849182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] [instance: ea464788-8e5a-4684-989d-5739fd77a887] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:24.864323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:24.866437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:24.867057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:24.868105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:24.868743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:24.869183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:24.891735 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] HTTP exception thrown: Instance ea464788-8e5a-4684-989d-5739fd77a887 could not be found. Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Request method failure captured: Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 HTTP/1.1 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILbsPH1AD0A0qZ5zHRMS6uj2ds3I-dR5GIbh_QUVBZEY73X23X4Sij1F5reMB3N8UCjAjrd9m24xyx6mTCouS_AOX0An0gp2J5DDMEdtVXwSFa9eqQjQQFFYj5s4jUeOW-LqEtaqS6mqsmkDmxKvHjJTISS8bTjEbxLqPXs0m8FHZ6A Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 713153c3d1724f269f58844c6c10c9d4 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerRescueTestJSON-2086270764 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/713153c3d1724f269f58844c6c10c9d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerRescueTestJSON-2086270764 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 713153c3d1724f269f58844c6c10c9d4 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerRescueTestJSON-2086270764 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerRescueTestJSON-2086270764-project Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7c397be23d6b41e58154d2e8799b71d5 Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerRescueTestJSON-2086270764-project Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ea464788-8e5a-4684-989d-5739fd77a887 could not be found. Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ea464788-8e5a-4684-989d-5739fd77a887'} Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea464788-8e5a-4684-989d-5739fd77a887 could not be found. Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea464788-8e5a-4684-989d-5739fd77a887 could not be found. Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:01:24.894533 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea464788-8e5a-4684-989d-5739fd77a887 could not be found. Sep 13 17:01:24.899479 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:01:24.907442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] Returning 404 to user: Instance ea464788-8e5a-4684-989d-5739fd77a887 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:01:24.908611 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7a4a5dab-c965-49a1-a5d6-5fd35352f004 tempest-ServerRescueTestJSON-2086270764 tempest-ServerRescueTestJSON-2086270764-project] 10.222.0.61 "GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887" status: 404 len: 111 microversion: 2.1 time: 0.067719 Sep 13 17:01:24.909940 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3122/6202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:01:24 2022] GET /compute/v2.1/servers/ea464788-8e5a-4684-989d-5739fd77a887 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:01:43.193166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:43.194082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:43.817350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d66b6d4-5821-44e3-a8c0-c893c9126329 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'create', calling method: .version_select at 0x7fbeb4ad9160>, body: {"keypair": {"name": "tempest-keypair-233305202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0TP+TqIWep37wft0+HflxwjIIWj7RDqx46fCrx8ztGsr02EjYC1Jsb6DGSCtPJA22GzPHROa9JpyM5TI3enszlSE3GPKuPydWacm8BxExMvjsgjdN23fyXscU9tKp7vg=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:43.841328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-5d66b6d4-5821-44e3-a8c0-c893c9126329 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for project c890c3a8f01e4c0281f787dc451365bc. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:01:43.847643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-5d66b6d4-5821-44e3-a8c0-c893c9126329 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for user 3373515c917c4188b8e172654ad55668 and project c890c3a8f01e4c0281f787dc451365bc. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:01:43.886278 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d66b6d4-5821-44e3-a8c0-c893c9126329 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.699525 Sep 13 17:01:43.894796 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3081/6203] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 17:01:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 709 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 17:01:48.331774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-797829861", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b91dc9b-3779-4b1f-926e-e09e01f6930b"}], "security_groups": [{"name": "tempest-securitygroup--281533717"}], "key_name": "tempest-keypair-233305202", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:48.379182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:48.381819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:01:48.661166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] validate_networks() for [('1b91dc9b-3779-4b1f-926e-e09e01f6930b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:01:49.897448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:01:49.898033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:01:49.898437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:01:49.899157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:01:49.899804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:01:49.928860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:49.929368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:49.929811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:49.930637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:49.931099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:49.942926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:49.999290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for project c890c3a8f01e4c0281f787dc451365bc. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:01:50.015881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for user 3373515c917c4188b8e172654ad55668 and project c890c3a8f01e4c0281f787dc451365bc. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:01:50.057661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:01:50.068354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:01:50.152175 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ba34e26-4e63-40d9-94cf-78b056f49d33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.824668 Sep 13 17:01:50.158766 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3123/6204] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 17:01:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 17:01:50.170854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fb68c922-975d-4140-9b4e-9d1aa177b728 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:50.172105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fb68c922-975d-4140-9b4e-9d1aa177b728 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:50.286994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb68c922-975d-4140-9b4e-9d1aa177b728 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:50.302400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb68c922-975d-4140-9b4e-9d1aa177b728 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:50.305096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb68c922-975d-4140-9b4e-9d1aa177b728 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:50.307768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fb68c922-975d-4140-9b4e-9d1aa177b728 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1280 microversion: 2.20 time: 0.141207 Sep 13 17:01:50.310529 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3082/6205] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:50 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:01:51.340981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:51.341638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:51.382165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:51.382907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:51.383898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:51.388276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:51.389697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:51.390611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:51.511232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:51.522070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:51.529421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:51.539489 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-88657cff-e4a8-4d3b-8aae-49f4d0969984 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1284 microversion: 2.20 time: 0.203622 Sep 13 17:01:51.540456 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3124/6206] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:51 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:01:52.567791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:52.568415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:52.582658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:52.582658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:52.583086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:52.584049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:52.584737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:52.585377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:52.729716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:52.762721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:52.770492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:52.781310 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-de5daff8-8e8a-4f2b-8073-05fa4a2a06fe tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1338 microversion: 2.20 time: 0.215790 Sep 13 17:01:52.783310 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3083/6207] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:52 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1338 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:01:53.808318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:53.808939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:53.817280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:53.817998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:53.818596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:53.819560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:53.820180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:53.820766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:54.285087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:54.333754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:54.335522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:54.336864 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0db4728f-d2fb-4735-8650-1e9c1f8bb4b9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.532820 Sep 13 17:01:54.337726 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3125/6208] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:53 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:01:54.832817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-eee11605-0ecf-4ecd-9f81-347e64e5fe27 req-af9af89d-a80d-4577-9f62-90b4bcc26b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:54.852599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-eee11605-0ecf-4ecd-9f81-347e64e5fe27 req-af9af89d-a80d-4577-9f62-90b4bcc26b2b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:54.853404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-eee11605-0ecf-4ecd-9f81-347e64e5fe27 req-af9af89d-a80d-4577-9f62-90b4bcc26b2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:54.854068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-eee11605-0ecf-4ecd-9f81-347e64e5fe27 req-af9af89d-a80d-4577-9f62-90b4bcc26b2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:54.868326 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-eee11605-0ecf-4ecd-9f81-347e64e5fe27 req-af9af89d-a80d-4577-9f62-90b4bcc26b2b service nova] Creating event network-changed:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h2-857467-1 Sep 13 17:01:54.874845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-eee11605-0ecf-4ecd-9f81-347e64e5fe27 req-af9af89d-a80d-4577-9f62-90b4bcc26b2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048004 Sep 13 17:01:54.876065 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3084/6209] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:01:55.371703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:55.373794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:55.385552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:55.386442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:55.387074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:55.389559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:55.390410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:55.391022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:55.698918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:55.719186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:55.726167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:55.731093 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d4309a97-2f5e-4ca1-b03e-2bdb7efb0fd3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.365827 Sep 13 17:01:55.733039 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3126/6210] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:55 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:01:56.761356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:56.762384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:56.771633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:56.772725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:56.774320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:56.775345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:56.776053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:56.777002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:56.992142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:57.006695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:57.013662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:57.014623 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-560354ae-5574-4199-99a8-0b006f7064bb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.257003 Sep 13 17:01:57.018056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3085/6211] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:56 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:01:58.046116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:58.047540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:58.057414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:58.058423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:58.059097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:58.060361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:58.061333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:58.066048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:58.301615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:58.323534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:58.325372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:58.326977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66fa3a45-853d-404a-bc91-4f3344011b9a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.287777 Sep 13 17:01:58.328359 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3127/6212] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:58 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:01:59.357250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:01:59.358244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:59.377026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:59.377984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:59.378934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:59.380584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:59.381261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:59.382269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:59.454116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:01:59.456640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:01:59.464546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:59.465123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:59.465572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:59.466314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:01:59.467608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:01:59.468204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:01:59.561052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0aedf79-12c2-484f-89df-105eafd841b5 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "POST /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae/action" status: 200 len: 32647 microversion: 2.1 time: 0.110947 Sep 13 17:01:59.562593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3128/6213] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:01:59 2022] POST /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae/action => generated 32647 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:01:59.693436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:59.733031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:59.737699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:01:59.738924 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-889833e7-2cd0-4b15-85c9-2f52d552d12b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.385539 Sep 13 17:01:59.742280 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3086/6214] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:01:59 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:02:00.776393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:00.778252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:00.797096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:00.802998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:00.807475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:00.814456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:00.815273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:00.816363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:00.817011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:00.823409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.289634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:01.562228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:01.582878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:01.586025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:01.592226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5075eef2-242e-48bd-839f-ea5dffd1a067 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.826040 Sep 13 17:02:01.613969 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3129/6215] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:02:00 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:02:01.620214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:01.627345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:01.635365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:01.636152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:01.637015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.639681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:01.640414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:01.641537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.681468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:02:01.757198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-00151708-e286-44c5-a6b6-780a1aa5a710 req-f306ab88-e10d-42fc-b9f9-c91d3c9cf01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "name": "network-vif-plugged", "status": "completed", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:01.776770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-00151708-e286-44c5-a6b6-780a1aa5a710 req-f306ab88-e10d-42fc-b9f9-c91d3c9cf01f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:01.781176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-00151708-e286-44c5-a6b6-780a1aa5a710 req-f306ab88-e10d-42fc-b9f9-c91d3c9cf01f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:01.781691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-00151708-e286-44c5-a6b6-780a1aa5a710 req-f306ab88-e10d-42fc-b9f9-c91d3c9cf01f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.813536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-00151708-e286-44c5-a6b6-780a1aa5a710 req-f306ab88-e10d-42fc-b9f9-c91d3c9cf01f service nova] Creating event network-vif-plugged:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h2-857467-1 Sep 13 17:02:01.822781 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-00151708-e286-44c5-a6b6-780a1aa5a710 req-f306ab88-e10d-42fc-b9f9-c91d3c9cf01f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.538404 Sep 13 17:02:01.831216 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3087/6216] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:02:01.839056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-35d5d47a-5959-44b3-bfa0-0c5a8357b35a req-36f9abfc-863e-4423-b7c4-3efc79e48fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f87e9bc-76e7-44f0-9908-403d3ff8e7ae", "tag": "b95aacd3-8255-4fd7-bc34-926bc3d50af3"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:01.845859 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc320963-dab4-499d-a04a-905fcde73860 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 204 len: 0 microversion: 2.1 time: 0.229763 Sep 13 17:02:01.847681 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3130/6217] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:02:01 2022] DELETE /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:02:01.868338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-35d5d47a-5959-44b3-bfa0-0c5a8357b35a req-36f9abfc-863e-4423-b7c4-3efc79e48fa0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:01.869067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-35d5d47a-5959-44b3-bfa0-0c5a8357b35a req-36f9abfc-863e-4423-b7c4-3efc79e48fa0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:01.869728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-35d5d47a-5959-44b3-bfa0-0c5a8357b35a req-36f9abfc-863e-4423-b7c4-3efc79e48fa0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.871711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:01.886889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:01.896134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:01.901402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-35d5d47a-5959-44b3-bfa0-0c5a8357b35a req-36f9abfc-863e-4423-b7c4-3efc79e48fa0 service nova] Creating event network-changed:b95aacd3-8255-4fd7-bc34-926bc3d50af3 for instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae on n-h1-857467-1 Sep 13 17:02:01.908157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:01.908634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.910768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:01.912764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:01.916137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:01.918697 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-35d5d47a-5959-44b3-bfa0-0c5a8357b35a req-36f9abfc-863e-4423-b7c4-3efc79e48fa0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085691 Sep 13 17:02:01.919504 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3088/6218] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:02.215319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:02.232032 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d4aef4e-c4a1-4b4d-92ae-e99a0886cb9f tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1670 microversion: 2.1 time: 0.379053 Sep 13 17:02:02.255194 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3131/6219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:01 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:02.624674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:02.625403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:02.636485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:02.636916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:02.638414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:02.641590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:02.643814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:02.646380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:02.921157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:02.945208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:02.956314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:02.961919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae8fe381-e8c1-440a-96d5-886e31609805 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1405 microversion: 2.20 time: 0.345786 Sep 13 17:02:02.963646 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3089/6220] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:02:02 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:02:03.266884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:03.267517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:03.289315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:03.294079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:03.298252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:03.299263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:03.300343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:03.314523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:03.556815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:03.579741 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b0c82e2-95a9-43aa-8410-fa1916397400 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1670 microversion: 2.1 time: 0.318676 Sep 13 17:02:03.586083 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3132/6221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:03 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1670 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:03.994970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:03.996369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:04.006933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.008086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.009567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.010536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.011213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.012058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.399109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:04.408569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:04.410481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:04.411674 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e75b1e1e-531a-4381-84b1-0312a21ab8dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1596 microversion: 2.20 time: 0.423484 Sep 13 17:02:04.412561 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3090/6222] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:02:03 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1596 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:02:04.438399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:04.439880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:04.447924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.448719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.449362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.450370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.451064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.453973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.550000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47995a05-9722-4b9a-8fe3-8849452cd459 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115613 Sep 13 17:02:04.558514 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3133/6223] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 17:02:04 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:02:04.605863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:04.606507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:04.616808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.617324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.617778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.618532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.619021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.619450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.724181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c57ef3ccd1c74d67b86e8ea75aafd433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4078cd72ad974a56943c95afe7ab63f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:04.737345 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a64ddb95-f96a-4867-9c1a-2907d98fb172 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 200 len: 1484 microversion: 2.1 time: 0.135241 Sep 13 17:02:04.750879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3091/6224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:04 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 1484 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:04.802944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-86c08b54-9c7e-4318-95f8-41e9fb1aed0f req-abeee5ff-28fe-4963-8e0a-8e011933f2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f87e9bc-76e7-44f0-9908-403d3ff8e7ae", "name": "network-vif-deleted", "tag": "b95aacd3-8255-4fd7-bc34-926bc3d50af3"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:04.834827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-86c08b54-9c7e-4318-95f8-41e9fb1aed0f req-abeee5ff-28fe-4963-8e0a-8e011933f2ff service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:04.844218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-86c08b54-9c7e-4318-95f8-41e9fb1aed0f req-abeee5ff-28fe-4963-8e0a-8e011933f2ff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:04.847573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-86c08b54-9c7e-4318-95f8-41e9fb1aed0f req-abeee5ff-28fe-4963-8e0a-8e011933f2ff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:04.876860 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-86c08b54-9c7e-4318-95f8-41e9fb1aed0f req-abeee5ff-28fe-4963-8e0a-8e011933f2ff service nova] Creating event network-vif-deleted:b95aacd3-8255-4fd7-bc34-926bc3d50af3 for instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae on n-h1-857467-1 Sep 13 17:02:04.888039 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-86c08b54-9c7e-4318-95f8-41e9fb1aed0f req-abeee5ff-28fe-4963-8e0a-8e011933f2ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088880 Sep 13 17:02:04.892166 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3134/6225] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:05.762902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:05.764716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] [instance: 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:05.777522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:05.788182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:05.788887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:05.790758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:05.794013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:05.797126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:05.842552 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] HTTP exception thrown: Instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae could not be found. Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Request method failure captured: Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae HTTP/1.1 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILZGIb_eGyWFE9RUnEQP0kTnpQgPhfeaMHwDD2Plx1vls9-pMDiAhEFZyG-mL21fbP4BpAEcOLpeR4BEKLJ3GfgBXiRNJ6c2D9Zv_2VuLlDSLeI4lYEt1VzNpE_l8KxfTpzW0qzL_Y3a63HhwCDsI1uwK1h3A47QUFlVR2qyVuMdrew Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 4078cd72ad974a56943c95afe7ab63f5 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestNetworkBasicOps-680274658 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4078cd72ad974a56943c95afe7ab63f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestNetworkBasicOps-680274658 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 4078cd72ad974a56943c95afe7ab63f5 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestNetworkBasicOps-680274658 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestNetworkBasicOps-680274658-project Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c57ef3ccd1c74d67b86e8ea75aafd433 Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestNetworkBasicOps-680274658-project Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae could not be found. Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '0f87e9bc-76e7-44f0-9908-403d3ff8e7ae'} Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae could not be found. Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae could not be found. Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:05.855480 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae could not be found. Sep 13 17:02:05.861691 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:05.864385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Returning 404 to user: Instance 0f87e9bc-76e7-44f0-9908-403d3ff8e7ae could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:02:05.868204 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-baf0d2e7-952f-4922-9123-5f2786e22f49 tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae" status: 404 len: 111 microversion: 2.1 time: 0.110363 Sep 13 17:02:05.869279 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3092/6226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:05 2022] GET /compute/v2.1/servers/0f87e9bc-76e7-44f0-9908-403d3ff8e7ae => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:02:06.422544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e24b8b08-a800-43e1-9fef-faec641aeb98 req-c368316d-4420-485b-a1af-058e4659d590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:06.441138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e24b8b08-a800-43e1-9fef-faec641aeb98 req-c368316d-4420-485b-a1af-058e4659d590 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:06.441602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e24b8b08-a800-43e1-9fef-faec641aeb98 req-c368316d-4420-485b-a1af-058e4659d590 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:06.442084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e24b8b08-a800-43e1-9fef-faec641aeb98 req-c368316d-4420-485b-a1af-058e4659d590 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:06.480201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e24b8b08-a800-43e1-9fef-faec641aeb98 req-c368316d-4420-485b-a1af-058e4659d590 service nova] Creating event network-changed:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h2-857467-1 Sep 13 17:02:06.491170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e24b8b08-a800-43e1-9fef-faec641aeb98 req-c368316d-4420-485b-a1af-058e4659d590 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072858 Sep 13 17:02:06.493079 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3135/6227] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:07.097997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf1780ef-6656-4011-89b2-75a5e2a506fb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] Calling method '.version_select at 0x7fbeb4cd7430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:07.172812 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf1780ef-6656-4011-89b2-75a5e2a506fb tempest-TestNetworkBasicOps-680274658 tempest-TestNetworkBasicOps-680274658-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-101244245" status: 202 len: 0 microversion: 2.1 time: 0.083411 Sep 13 17:02:07.174193 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3093/6228] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Sep 13 17:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-101244245 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:21.726962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:21.727712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:21.963901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1402297686", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "b837f760-be64-4b4a-8688-5fd5ca510cbd"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:22.088708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] validate_networks() for [('b837f760-be64-4b4a-8688-5fd5ca510cbd', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:02:23.667641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:02:23.668184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:02:23.668525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:02:23.668938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:02:23.669423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:02:23.692394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:23.693146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:23.693778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:23.694748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:23.695433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:23.696039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:23.732651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Getting quotas for project 0fa209f1c516485bbfad95602f21d464. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:02:23.752163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Getting quotas for user a27fb504f50044d2bb05063684be48ae and project 0fa209f1c516485bbfad95602f21d464. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:02:23.785609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:02:23.788144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:02:23.965374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53cdfd09-bd17-41af-bcf0-c70a8687a3d7 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.240468 Sep 13 17:02:23.966685 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3136/6229] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:02:23.986418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad637ac5-0d79-4bd7-91b6-f2cd4ea77409 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:23.987987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad637ac5-0d79-4bd7-91b6-f2cd4ea77409 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:24.008376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=44 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:24.016164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:24.220326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad637ac5-0d79-4bd7-91b6-f2cd4ea77409 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:24.229739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad637ac5-0d79-4bd7-91b6-f2cd4ea77409 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1215 microversion: 2.1 time: 0.251209 Sep 13 17:02:24.230903 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3094/6230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:23 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:24.428476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:24.428990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:24.439862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:24.446021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:24.448188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:24.460684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:24.461239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:24.462313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:24.535907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97a98368-e2c3-47ed-8d97-0905d6e65a0c tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/ips" status: 200 len: 150 microversion: 2.1 time: 0.111499 Sep 13 17:02:24.550232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3137/6231] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 17:02:24 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/ips => generated 150 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:25.270170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:25.271951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:25.290486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:25.292574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:25.293855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:25.295480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:25.298288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:25.299209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:25.725883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:25.736645 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bb233bbf-650b-4137-9a25-b13caf130041 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1219 microversion: 2.1 time: 0.470425 Sep 13 17:02:25.741665 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3095/6232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:25 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1219 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:26.768399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:26.769596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:26.789737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:26.790354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:26.790799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:26.791508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:26.791970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:26.792402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:26.938273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:26.959738 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7cd1dd4e-6118-443e-a64d-6263ecd396fd tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1273 microversion: 2.1 time: 0.196762 Sep 13 17:02:26.964205 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3138/6233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:26 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:27.662659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f2edd27-c2f4-4c10-9935-d2875eb57c9a"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:27.666269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:27.672933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:27.673435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:27.673904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:27.675076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:27.675541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:27.675976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:28.000056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:28.002625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:28.022165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:28.023033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:28.024117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:28.026794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:28.028228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:28.031484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:28.150946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbae8568-20cf-4507-9677-58369c68d319 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "POST /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490991 Sep 13 17:02:28.152412 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3096/6234] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:02:27 2022] POST /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:28.415978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:28.436966 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a64f8c1-b84b-4367-8bc3-f88b8c071f52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1273 microversion: 2.1 time: 0.439323 Sep 13 17:02:28.436966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3139/6235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:27 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1273 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:29.463506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:29.464328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:29.490710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:29.491223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:29.491670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:29.500053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:29.501253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:29.501761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:29.775390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:29.785222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d4de6ecb-67f4-4fee-be71-58852a6e9c6c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 0.326788 Sep 13 17:02:29.801812 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3097/6236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:29 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:30.443526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a1fa46cf-ee04-425b-a09a-776b29772251 req-47faaa42-3f7d-46f9-97a9-c4296e6cd6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f61cb3d-4afb-4863-9951-8f50ddcdbc63", "tag": "dadcfac1-cc9b-40a3-bcab-815034fcfd2f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:30.458733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a1fa46cf-ee04-425b-a09a-776b29772251 req-47faaa42-3f7d-46f9-97a9-c4296e6cd6e1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:30.459433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a1fa46cf-ee04-425b-a09a-776b29772251 req-47faaa42-3f7d-46f9-97a9-c4296e6cd6e1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:30.460063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a1fa46cf-ee04-425b-a09a-776b29772251 req-47faaa42-3f7d-46f9-97a9-c4296e6cd6e1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:30.477447 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a1fa46cf-ee04-425b-a09a-776b29772251 req-47faaa42-3f7d-46f9-97a9-c4296e6cd6e1 service nova] Creating event network-changed:dadcfac1-cc9b-40a3-bcab-815034fcfd2f for instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 on n-h1-857467-1 Sep 13 17:02:30.485109 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a1fa46cf-ee04-425b-a09a-776b29772251 req-47faaa42-3f7d-46f9-97a9-c4296e6cd6e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266789 Sep 13 17:02:30.486321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3140/6237] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:30.812172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:30.812882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:30.827870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:30.828583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:30.829026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:30.831403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:30.832073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:30.835459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:30.898784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Calling method '.version_select at 0x7fbeb4aceb80>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:30.902110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:30.903033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:30.903802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:30.938437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:30.939934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:30.940594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:30.965050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:30.965475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:30.966003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:30.975037 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-215e95ab-3d6d-4605-b343-d759fbc0e99c tempest-PortsAdminExtendedAttrsTestJSON-2005311501 tempest-PortsAdminExtendedAttrsTestJSON-2005311501-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.207880 Sep 13 17:02:30.976242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3098/6238] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 17:02:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:31.312236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:31.321028 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7aabc154-f248-4b4f-80fc-287350970ed1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 0.513764 Sep 13 17:02:31.322065 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3141/6239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:30 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:32.344569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:32.345194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:32.352395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:32.353129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:32.353746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:32.354676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:32.356223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:32.357371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:32.623190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:32.635389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fabb9208-c0d9-4609-b664-4b1f4ad5c38e tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 0.294635 Sep 13 17:02:32.651003 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3099/6240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:32 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:33.659910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:33.662548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:33.675062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:33.675850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:33.676445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:33.677444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:33.678252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:33.679638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:33.711366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:33.770595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:34.252088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:34.262303 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e58fd26-42ef-45d4-a8e9-30fc4cfe3a35 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 0.607059 Sep 13 17:02:34.264013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3142/6241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:33 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:35.294669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:35.295848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:35.305934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:35.346555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:35.348859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:35.349878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:35.351041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:35.358886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:35.360021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:36.361792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:36.371520 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34216a2a-aca2-482a-b0de-cfe51adc9d52 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 1.087097 Sep 13 17:02:36.373116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3100/6242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:35 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:37.396954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:37.397563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:37.411274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:37.411833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:37.412285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:37.413005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:37.416640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:37.417115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:37.645960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:37.658280 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7412120-ee4a-4167-a705-7fd234afc451 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 0.265035 Sep 13 17:02:37.663073 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3143/6243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:37 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:38.314975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ce6045c6-e05d-49e9-ac9a-11bd676a523b req-3cd8ae97-c9a6-4b95-be6b-591db3ba3dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61cb3d-4afb-4863-9951-8f50ddcdbc63", "name": "network-vif-plugged", "status": "completed", "tag": "dadcfac1-cc9b-40a3-bcab-815034fcfd2f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:38.338065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ce6045c6-e05d-49e9-ac9a-11bd676a523b req-3cd8ae97-c9a6-4b95-be6b-591db3ba3dc1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:38.338791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ce6045c6-e05d-49e9-ac9a-11bd676a523b req-3cd8ae97-c9a6-4b95-be6b-591db3ba3dc1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:38.339528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ce6045c6-e05d-49e9-ac9a-11bd676a523b req-3cd8ae97-c9a6-4b95-be6b-591db3ba3dc1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:38.357298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ce6045c6-e05d-49e9-ac9a-11bd676a523b req-3cd8ae97-c9a6-4b95-be6b-591db3ba3dc1 service nova] Creating event network-vif-plugged:dadcfac1-cc9b-40a3-bcab-815034fcfd2f for instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 on n-h1-857467-1 Sep 13 17:02:38.366096 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ce6045c6-e05d-49e9-ac9a-11bd676a523b req-3cd8ae97-c9a6-4b95-be6b-591db3ba3dc1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054820 Sep 13 17:02:38.367223 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3101/6244] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:38.683469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:38.685476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:38.699169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:38.700810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:38.701878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:38.703478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:38.704165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:38.704795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:39.064743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:39.077600 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b69589e9-84be-4bda-a72e-882bb54a89d0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1315 microversion: 2.1 time: 0.399100 Sep 13 17:02:39.078386 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3144/6245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:38 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:40.113213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:40.113213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:40.127396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:40.127913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:40.128367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:40.129155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:40.129583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:40.132531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:40.474973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:40.490523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1e822d5-7ed0-4a89-833c-31dfd0c1c801 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1502 microversion: 2.1 time: 0.389999 Sep 13 17:02:40.505897 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3102/6246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:40 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:40.514244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:40.515021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:40.522457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:40.523046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:40.523496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:40.524260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:40.524746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:40.525277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:40.792187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:40.803960 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c111f0ab-4f8c-403b-91fd-8591b2118159 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1502 microversion: 2.1 time: 0.294009 Sep 13 17:02:40.813062 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3145/6247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:40 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:40.840126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:40.841285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:40.859002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:40.862057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:40.864734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:40.868016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:40.869245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:40.874202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:40.916595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lazy-loading 'flavor' on Instance uuid 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:02:41.045565 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9865c31-c031-492f-85d5-860907ae2c48 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action" status: 202 len: 0 microversion: 2.1 time: 0.208101 Sep 13 17:02:41.064552 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3103/6248] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:02:40 2022] POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:41.072444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:41.073280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:41.088777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:41.089567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:41.090507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:41.091469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:41.092215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:41.092902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:41.320476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:41.334453 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e61bb60-481c-4b92-87c5-a5ad85fd59f4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1510 microversion: 2.1 time: 0.265865 Sep 13 17:02:41.337672 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3146/6249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:41 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:41.860015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:41.861156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:41.876343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:41.877142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:41.877777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:41.878685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:41.879296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:41.879881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.051560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lazy-loading 'services' on Instance uuid 9cdb7d83-4d8f-400d-b977-b7de90e0c827 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:02:42.154705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-238a828f-0418-4284-95c3-8b949acebce2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments/7f2edd27-c2f4-4c10-9935-d2875eb57c9a" status: 202 len: 0 microversion: 2.1 time: 0.299774 Sep 13 17:02:42.155849 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3104/6250] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:02:41 2022] DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments/7f2edd27-c2f4-4c10-9935-d2875eb57c9a => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:42.177417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:42.182809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:42.198772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.199280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.199734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.202047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.202422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.202865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.244540 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14c8bf36-24cb-42f6-9ca7-12de418884c2 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082916 Sep 13 17:02:42.245503 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3147/6251] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:42 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:42.365163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:42.366272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:42.375205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.375704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.376153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.376939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.377407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.377896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.573438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1017262475", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "d5968062-8bab-4d97-b099-b537862121f7"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:42.597913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:42.613812 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08c2508e-6589-4402-b419-2e50f668c2cc tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1493 microversion: 2.1 time: 0.252674 Sep 13 17:02:42.614909 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3105/6252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:42 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1493 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:42.641536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:42.644778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:42.651555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] validate_networks() for [('d5968062-8bab-4d97-b099-b537862121f7', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:02:42.664390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.664945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.665396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.667609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.668194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.668665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.792178 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a21b80ec-a426-45af-ac01-8a3cee37da36 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action" status: 202 len: 0 microversion: 2.1 time: 0.154688 Sep 13 17:02:42.798060 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3106/6253] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:02:42 2022] POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:42.813567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:42.814491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:42.833588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.834125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.836026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.838539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:42.841075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:42.841700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:42.894223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:43.213586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:43.237431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-357fe148-b91c-4279-b9ee-741de9480be0 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1499 microversion: 2.1 time: 0.434511 Sep 13 17:02:43.238740 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3107/6254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:42 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1499 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:43.261330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:43.265257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:43.280347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:43.282747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:43.284623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:43.286133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:43.290080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:43.290624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:43.353552 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52498888-5db5-43fe-8595-3931357041ca tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098958 Sep 13 17:02:43.359772 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3108/6255] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:43 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:43.401806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:02:43.402341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:02:43.402719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:02:43.403982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:02:43.404577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:02:43.415785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:43.416501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:43.417113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:43.418052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:43.419383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:43.420010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:43.443985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Getting quotas for project 21f2be1738ad43f1bfd2f9cf4aacdbb9. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:02:43.451595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Getting quotas for user 7d748bc505d9477e872de990c73141ce and project 21f2be1738ad43f1bfd2f9cf4aacdbb9. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:02:43.483357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:02:43.485734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:02:43.543298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0bffed5-e078-45ea-b9c3-540a5f3e5182 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973805 Sep 13 17:02:43.549974 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3148/6256] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:02:43.556133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b1ed044e-5fed-4206-b2a9-84822f295152 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:43.556774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b1ed044e-5fed-4206-b2a9-84822f295152 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:43.953427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b1ed044e-5fed-4206-b2a9-84822f295152 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:43.961285 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b1ed044e-5fed-4206-b2a9-84822f295152 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1214 microversion: 2.1 time: 0.409822 Sep 13 17:02:43.982565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3109/6257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:43 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:44.264967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:44.265605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:44.279093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:44.281539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:44.283180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:44.284229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:44.290722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:44.291567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:44.369308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:44.374021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:44.385145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:44.386068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:44.386745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:44.389516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:44.390247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:44.391384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:44.447027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec360001-3687-4010-b01b-22af1203f31b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083098 Sep 13 17:02:44.455174 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3110/6258] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:44 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:44.619046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:44.631561 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1a9139f-4929-473e-a82e-3b1b8f587414 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1499 microversion: 2.1 time: 0.371466 Sep 13 17:02:44.652649 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3149/6259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:44 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1499 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:44.989858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:44.990524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:44.997528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:45.003124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:45.003987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:45.004499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:45.004978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:45.008317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:45.456109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:45.463866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:45.468598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:45.474577 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0adbc0e-ca11-4433-9708-8f23aa9915a6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1266 microversion: 2.1 time: 0.489635 Sep 13 17:02:45.479693 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3111/6260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:44 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:45.498366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:45.499238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:45.499970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:45.500946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:45.501630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:45.502348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:45.542343 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-348c3e53-b309-458a-b0f9-629ea1299d1a tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084490 Sep 13 17:02:45.543320 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3150/6261] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:45 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:45.659859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:45.660486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:45.670823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:45.671698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:45.673105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:45.675872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:45.676587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:45.679677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:45.977112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:45.998120 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ca46a93-1117-4dc3-b59f-bf0c66dacf51 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1502 microversion: 2.1 time: 0.342276 Sep 13 17:02:46.010720 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3112/6262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:45 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:46.033344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:46.034462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:46.057937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.058942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.061695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.064136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.068054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.070254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.144065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lazy-loading 'flavor' on Instance uuid 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:02:46.267123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c114f1b8-576e-4922-a44c-9ec9abfa1083 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action" status: 202 len: 0 microversion: 2.1 time: 0.243912 Sep 13 17:02:46.268116 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3151/6263] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:02:46 2022] POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:46.282186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:46.286740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:46.298660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.299631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.300368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.307826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.308851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.310186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.502942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:46.503833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:46.519510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.520521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.521250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.524715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.525213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.525970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.566620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:46.575719 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34f02590-7e3b-4795-aae2-b6ebcb2d284f tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1510 microversion: 2.1 time: 0.302841 Sep 13 17:02:46.580429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3113/6264] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:46 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:46.586412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:46.588861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:46.611151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.612669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.613144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.616882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:46.617385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:46.617867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:46.673027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83bc6bad-7884-41f2-a868-b0228288570f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091028 Sep 13 17:02:46.673549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3114/6265] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:46 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:46.708612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:46.724117 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-acd4ba52-8e7c-4e93-8a92-14dec53152f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1272 microversion: 2.1 time: 0.223830 Sep 13 17:02:46.724957 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3152/6266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:46 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:47.600594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:47.601212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:47.613173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.615721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.616399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.620638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.621436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.622905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.686321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:47.689150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:47.703711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.706340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.709050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.711769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.712755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.714070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.769367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:47.790779 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52684300-e799-4b44-b782-086d9cd33ae3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108872 Sep 13 17:02:47.798467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3153/6267] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:47 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:47.814352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:47.816880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:47.832749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.833186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.833635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.834362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.835035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.835634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.904664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:47.916242 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dd9e6498-a1eb-4ce3-b5eb-7e3d9216009a tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1493 microversion: 2.1 time: 0.319479 Sep 13 17:02:47.916854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3115/6268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:47 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1493 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:47.942965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:47.943528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:47.962587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.970598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.971747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:47.974039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:47.975082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:47.976442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.101274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b8d073d-9e29-41e2-8fed-1eb53d318c15 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action" status: 202 len: 0 microversion: 2.1 time: 0.162620 Sep 13 17:02:48.105480 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3116/6269] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:02:47 2022] POST /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:48.123018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:48.124246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:48.144996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:48.146688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:48.148363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.150036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:48.152789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:48.155147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.226747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:48.248983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42154205-a727-402c-aa7b-a405713fc5c9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.441866 Sep 13 17:02:48.249934 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3154/6270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:47 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:48.594548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:48.612854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea6ab2d7-51f6-4f65-ab89-570b15fecadb tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1499 microversion: 2.1 time: 0.502661 Sep 13 17:02:48.613572 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3117/6271] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:48 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1499 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:48.813469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:48.816206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:48.827891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:48.828672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:48.829316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.830252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:48.831078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:48.831512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.867871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-148a0c78-60ed-4cb2-bd98-1d8212593a4b tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066638 Sep 13 17:02:48.875180 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3155/6272] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:02:48 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 17:02:48.946167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:48.946947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:48.955351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:48.957151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:48.957151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.957765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:48.958339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:48.958852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:48.988589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:02:49.078020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2e42c51c-0421-443d-8f28-ed4f1d9d0511 req-6c2239a8-30e4-4fe4-84d9-198863a4c5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5296c60-1c49-44fc-9f03-e8054dde7ed8", "tag": "51e8d924-d89b-49d3-a148-6342175b4399"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:49.094705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2e42c51c-0421-443d-8f28-ed4f1d9d0511 req-6c2239a8-30e4-4fe4-84d9-198863a4c5b9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.095205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2e42c51c-0421-443d-8f28-ed4f1d9d0511 req-6c2239a8-30e4-4fe4-84d9-198863a4c5b9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.095888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2e42c51c-0421-443d-8f28-ed4f1d9d0511 req-6c2239a8-30e4-4fe4-84d9-198863a4c5b9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.121363 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5a03079-752d-406a-be85-53fcc0e240c3 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 204 len: 0 microversion: 2.1 time: 0.178000 Sep 13 17:02:49.123626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3118/6273] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:02:48 2022] DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:02:49.127050 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2e42c51c-0421-443d-8f28-ed4f1d9d0511 req-6c2239a8-30e4-4fe4-84d9-198863a4c5b9 service nova] Creating event network-changed:51e8d924-d89b-49d3-a148-6342175b4399 for instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 on n-h2-857467-1 Sep 13 17:02:49.132686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:49.134199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:49.135757 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2e42c51c-0421-443d-8f28-ed4f1d9d0511 req-6c2239a8-30e4-4fe4-84d9-198863a4c5b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061694 Sep 13 17:02:49.136996 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3156/6274] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:02:49.143562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.144792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.145482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.146484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.147136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.147796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.281854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:49.282742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:49.289700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.290502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.291192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.291976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.292674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.293305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.491563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:49.504112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d0a7b67-70d5-4e1c-bbaf-bbd21bcd08b9 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1681 microversion: 2.1 time: 0.376095 Sep 13 17:02:49.505282 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3119/6275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:49 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1681 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:49.644174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:49.644825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:49.653550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.654123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.654270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:49.654878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.655803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:49.656272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:49.656922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:49.666190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07bf9c31-abdb-42a8-b332-68e0ea921ed9 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.390291 Sep 13 17:02:49.680620 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3157/6276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:49 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:49.820446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:49.829919 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8e20c95-fb58-4038-b4d4-2d4f44a8bce4 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1499 microversion: 2.1 time: 0.196347 Sep 13 17:02:49.831417 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3120/6277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:49 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1499 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:50.528934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:50.529541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:50.541660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:50.542324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:50.543194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:50.544913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:50.545525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:50.546131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:50.692380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:50.693008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:50.702332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:50.702829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:50.703624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:50.704442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:50.704936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:50.706572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:50.751826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:50.773623 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55a493a1-cd50-471d-99b7-4c6a43ff7a32 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1681 microversion: 2.1 time: 0.246428 Sep 13 17:02:50.774456 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3158/6278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:50 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:50.858228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:50.859916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:50.866334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:50.867097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:50.867902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:50.868797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:50.869605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:50.870729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:50.910065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:50.931260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f1db437-737d-4bfe-b78e-79686708e984 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.242755 Sep 13 17:02:50.932770 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3121/6279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:50 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:51.109533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:51.120637 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-56bab5c6-895b-40eb-a31a-38cc9b5ed098 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1499 microversion: 2.1 time: 0.269897 Sep 13 17:02:51.122403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3159/6280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:50 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1499 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:51.798419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:51.799049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:51.805926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:51.806624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:51.807232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:51.808145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:51.809043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:51.809671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:51.838413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:51.956007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:51.956638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:51.959934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:51.964952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:51.965488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:51.965964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:51.966724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:51.968613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:51.972083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:52.206963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64beb6d899a4e7188e14ef66163348f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856acfabcb741f099a858837e7ccac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:52.216670 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a06a5c47-7b3e-4835-966e-b587d321ea84 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 200 len: 1681 microversion: 2.1 time: 0.422321 Sep 13 17:02:52.230117 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3122/6281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:51 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 1681 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:52.247296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:52.248387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:52.262016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:52.263381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:52.264731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:52.265727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:52.266485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:52.267285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:52.290997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:52.303153 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a8d1fef-3f85-4cf3-9d0f-634a54444295 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.351099 Sep 13 17:02:52.303774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3160/6282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:51 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:02:52.495587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2fb10995-a6d5-4682-a1cb-bd946a7eaba2 req-35e4a281-6399-4405-86bb-c124f32617a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdb7d83-4d8f-400d-b977-b7de90e0c827", "name": "network-vif-deleted", "tag": "61331154-abde-4872-8d23-ea3c336a5e4b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:52.522270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2fb10995-a6d5-4682-a1cb-bd946a7eaba2 req-35e4a281-6399-4405-86bb-c124f32617a4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:52.522766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2fb10995-a6d5-4682-a1cb-bd946a7eaba2 req-35e4a281-6399-4405-86bb-c124f32617a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:52.523426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2fb10995-a6d5-4682-a1cb-bd946a7eaba2 req-35e4a281-6399-4405-86bb-c124f32617a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:52.548292 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2fb10995-a6d5-4682-a1cb-bd946a7eaba2 req-35e4a281-6399-4405-86bb-c124f32617a4 service nova] Creating event network-vif-deleted:61331154-abde-4872-8d23-ea3c336a5e4b for instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 on n-h1-857467-1 Sep 13 17:02:52.560743 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2fb10995-a6d5-4682-a1cb-bd946a7eaba2 req-35e4a281-6399-4405-86bb-c124f32617a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072900 Sep 13 17:02:52.561556 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3161/6283] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:53.095934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:53.105114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed85216d-feae-4989-8fde-f33d5cba844c tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1502 microversion: 2.1 time: 0.873704 Sep 13 17:02:53.120210 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3123/6284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:52 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1502 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:53.139339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:53.140731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:53.148786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.149455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.150675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.152235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.153570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.154255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.205797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:02:53.243463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:53.244065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:53.253652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.254076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.254516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.255234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.255684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.258128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.294394 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 HTTP/1.1 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9cdb7d83-4d8f-400d-b977-b7de90e0c827'} Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:53.301438 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:53.306263 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:53.308043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:02:53.309124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2768e3f7-c272-432f-a6de-7114d3c6cf83 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 404 len: 111 microversion: 2.1 time: 0.069862 Sep 13 17:02:53.314012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3124/6285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:53 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:02:53.320317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0c99a11-ef1b-4da9-8482-69144a94a35f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '.version_select at 0x7fbeb4cd74c0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:53.348343 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0c99a11-ef1b-4da9-8482-69144a94a35f tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137643880" status: 202 len: 0 microversion: 2.1 time: 0.032898 Sep 13 17:02:53.350321 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3125/6286] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Sep 13 17:02:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137643880 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:02:53.363169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:53.364061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:53.371661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.373340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.374077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.375555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.376286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.376889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.431214 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4780dee5-fc85-4bc0-94ae-fb18b6089bac tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 204 len: 0 microversion: 2.1 time: 0.302333 Sep 13 17:02:53.432124 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3162/6287] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:02:53 2022] DELETE /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:02:53.438526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:53.444818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:53.445970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:53.457473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.458716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.459438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.460768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:53.462628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:53.463948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:53.497754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:53.638182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:53.649266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ef9326ee-a61c-4355-9034-bb919bcaad34 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.291324 Sep 13 17:02:53.651832 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3126/6288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:53 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:54.211337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:54.234831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b298b5e-b816-44cf-bd97-14188b66ef0b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1508 microversion: 2.1 time: 0.797265 Sep 13 17:02:54.235918 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3163/6289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:53 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1508 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:54.676227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:54.677921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:54.686691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:54.688434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:54.690374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:54.691293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:54.692289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:54.693425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:54.694413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:54.695312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:54.773191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e3743587-ff1c-4bfc-b2d5-f86742384cc0 req-4cc3d682-dad3-46e1-b370-74d1aec22e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5296c60-1c49-44fc-9f03-e8054dde7ed8", "name": "network-vif-plugged", "status": "completed", "tag": "51e8d924-d89b-49d3-a148-6342175b4399"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:54.786496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e3743587-ff1c-4bfc-b2d5-f86742384cc0 req-4cc3d682-dad3-46e1-b370-74d1aec22e33 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:54.787165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e3743587-ff1c-4bfc-b2d5-f86742384cc0 req-4cc3d682-dad3-46e1-b370-74d1aec22e33 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:54.787901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e3743587-ff1c-4bfc-b2d5-f86742384cc0 req-4cc3d682-dad3-46e1-b370-74d1aec22e33 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:54.803022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e3743587-ff1c-4bfc-b2d5-f86742384cc0 req-4cc3d682-dad3-46e1-b370-74d1aec22e33 service nova] Creating event network-vif-plugged:51e8d924-d89b-49d3-a148-6342175b4399 for instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 on n-h2-857467-1 Sep 13 17:02:54.823152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e3743587-ff1c-4bfc-b2d5-f86742384cc0 req-4cc3d682-dad3-46e1-b370-74d1aec22e33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053637 Sep 13 17:02:54.825126 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3164/6290] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:02:55.001334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:55.018101 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bafb71d4-3c5e-4991-b298-078cb711f157 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.343172 Sep 13 17:02:55.019022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3127/6291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:54 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:55.261357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:55.262358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:55.277385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:55.279083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:55.279459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:55.282021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:55.282442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:55.285102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:55.645406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:55.656496 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf0f1109-0897-446c-9253-1148a2f87440 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1508 microversion: 2.1 time: 0.401330 Sep 13 17:02:55.659907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3165/6292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:55 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:56.045783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:56.047730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:56.080847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:56.081642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:56.082298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:56.083308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:56.084113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:56.084748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:56.391571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:56.467095 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6cd17f2c-7038-47d6-afc9-d5f4e124be79 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1314 microversion: 2.1 time: 0.425254 Sep 13 17:02:56.475394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3128/6293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:56 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:56.494431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-06ac7cfa-307e-4be1-8e36-5108247eb831 req-05edf608-c363-424d-a0f6-283cdee6c367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61cb3d-4afb-4863-9951-8f50ddcdbc63", "name": "network-vif-deleted", "tag": "dadcfac1-cc9b-40a3-bcab-815034fcfd2f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:02:56.519743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06ac7cfa-307e-4be1-8e36-5108247eb831 req-05edf608-c363-424d-a0f6-283cdee6c367 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:56.521004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06ac7cfa-307e-4be1-8e36-5108247eb831 req-05edf608-c363-424d-a0f6-283cdee6c367 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:56.525569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-06ac7cfa-307e-4be1-8e36-5108247eb831 req-05edf608-c363-424d-a0f6-283cdee6c367 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:56.546430 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-06ac7cfa-307e-4be1-8e36-5108247eb831 req-05edf608-c363-424d-a0f6-283cdee6c367 service nova] Creating event network-vif-deleted:dadcfac1-cc9b-40a3-bcab-815034fcfd2f for instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 on n-h1-857467-1 Sep 13 17:02:56.560838 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-06ac7cfa-307e-4be1-8e36-5108247eb831 req-05edf608-c363-424d-a0f6-283cdee6c367 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069853 Sep 13 17:02:56.564516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3166/6294] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:02:56.683340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:56.684960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:56.691822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:56.692641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:56.693304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:56.694222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:56.694852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:56.695572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:56.780449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:56.780963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:56.781412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:56.781900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lazy-loading 'fault' on Instance uuid 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:02:56.904139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27fb504f50044d2bb05063684be48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa209f1c516485bbfad95602f21d464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:56.913745 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2114bb4-7ddf-4307-a862-452fd9956ee1 tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 200 len: 1305 microversion: 2.1 time: 0.234407 Sep 13 17:02:56.917956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3129/6295] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:56 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:57.495096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:57.500898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:57.513897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:57.514581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:57.516712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:57.517599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:57.519108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:57.521081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:57.880069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:57.894873 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b62d5b6-a451-42a3-8a06-3403034b647c tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1497 microversion: 2.1 time: 0.403949 Sep 13 17:02:57.895477 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3167/6296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:57 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1497 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:02:57.944814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:57.948566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] [instance: 6f61cb3d-4afb-4863-9951-8f50ddcdbc63] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:57.967822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:57.971268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:57.972014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:57.972989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:57.974796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:57.975465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:58.009566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] HTTP exception thrown: Instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 could not be found. Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Request method failure captured: Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 HTTP/1.1 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILeaV3506tkXKCiangPSztiZti5mfVtokPLtCdRQ1xKbHulB_SGpPGoe0FxRONIeU1sgAhEbKqVoEHRhmlXQXcqwhb2Q12MUo-Z16LkQWZI4Mhs6LXiON22tf2wTwI6NECPkKrUxaFhoZhwHtVyuN-EytQIbSwYECr2XBRD-RE3GW2A Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 0fa209f1c516485bbfad95602f21d464 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestServerAdvancedOps-1243959531 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0fa209f1c516485bbfad95602f21d464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0fa209f1c516485bbfad95602f21d464"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0fa209f1c516485bbfad95602f21d464"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0fa209f1c516485bbfad95602f21d464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestServerAdvancedOps-1243959531 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 0fa209f1c516485bbfad95602f21d464 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestServerAdvancedOps-1243959531 Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestServerAdvancedOps-1243959531-project Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a27fb504f50044d2bb05063684be48ae Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestServerAdvancedOps-1243959531-project Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 could not be found. Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '6f61cb3d-4afb-4863-9951-8f50ddcdbc63'} Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 could not be found. Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 could not be found. Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:58.013735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 could not be found. Sep 13 17:02:58.018735 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:02:58.026707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] Returning 404 to user: Instance 6f61cb3d-4afb-4863-9951-8f50ddcdbc63 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:02:58.028375 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00e655f9-7fcf-4c8e-91ec-b67b279c1b1b tempest-TestServerAdvancedOps-1243959531 tempest-TestServerAdvancedOps-1243959531-project] 10.222.0.61 "GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63" status: 404 len: 111 microversion: 2.1 time: 0.092005 Sep 13 17:02:58.029500 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3130/6297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:57 2022] GET /compute/v2.1/servers/6f61cb3d-4afb-4863-9951-8f50ddcdbc63 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:02:58.670946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:58.672039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:58.679178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:58.679701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:58.680142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:58.680861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:58.681545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:58.682204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:58.747823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:02:58.904074 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60769b1e-d265-410e-98cb-1065bde5b98e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 204 len: 0 microversion: 2.1 time: 0.235522 Sep 13 17:02:58.906277 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3168/6298] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:02:58 2022] DELETE /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:02:58.917908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:58.919821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:58.929427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:58.931161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:58.932800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:58.935552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:58.937748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:58.942400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:59.413194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:59.413757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:59.425326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:59.425901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:59.426290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:59.427003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:59.427436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:59.427838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:59.432502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:02:59.462638 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 HTTP/1.1 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9cdb7d83-4d8f-400d-b977-b7de90e0c827'} Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:02:59.467867 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:02:59.472811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e810898-b2b3-4e81-b857-0bf1124f8497 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 404 len: 111 microversion: 2.1 time: 0.060427 Sep 13 17:02:59.482212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3169/6299] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:02:59 2022] DELETE /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:02:59.487492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:02:59.488111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 9cdb7d83-4d8f-400d-b977-b7de90e0c827] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:02:59.507620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:59.508382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:59.508989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:59.509912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:02:59.510622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:02:59.511217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:02:59.527411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 HTTP/1.1 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9cdb7d83-4d8f-400d-b977-b7de90e0c827'} Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:02:59.547834 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. Sep 13 17:02:59.553064 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:02:59.554347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 9cdb7d83-4d8f-400d-b977-b7de90e0c827 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:02:59.555599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dae5ad82-0f95-484a-8054-711969412919 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827" status: 404 len: 111 microversion: 2.1 time: 0.072121 Sep 13 17:02:59.556341 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3170/6300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:59 2022] GET /compute/v2.1/servers/9cdb7d83-4d8f-400d-b977-b7de90e0c827 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:02:59.660254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:02:59.702112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-693f4402-20a4-4d6f-9f6b-db75ae082d60 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1503 microversion: 2.1 time: 0.791025 Sep 13 17:02:59.709000 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3131/6301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:02:58 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1503 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:00.733712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:00.735320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:00.753895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:00.754740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:00.756303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:00.762594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:00.764215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:00.764899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:01.353279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:01.365226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f0257083-4f33-433e-868e-9cd5dd2b4ebe tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1503 microversion: 2.1 time: 0.637919 Sep 13 17:03:01.367535 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3171/6302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:00 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1503 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:02.184668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-dd5ed8d5-2cfc-4c74-9448-43f678535f7e req-32f5d898-2d85-4bb2-8863-fb697ec76df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5296c60-1c49-44fc-9f03-e8054dde7ed8", "name": "network-vif-deleted", "tag": "51e8d924-d89b-49d3-a148-6342175b4399"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:02.202095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dd5ed8d5-2cfc-4c74-9448-43f678535f7e req-32f5d898-2d85-4bb2-8863-fb697ec76df2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:02.202958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dd5ed8d5-2cfc-4c74-9448-43f678535f7e req-32f5d898-2d85-4bb2-8863-fb697ec76df2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:02.203661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dd5ed8d5-2cfc-4c74-9448-43f678535f7e req-32f5d898-2d85-4bb2-8863-fb697ec76df2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:02.221190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-dd5ed8d5-2cfc-4c74-9448-43f678535f7e req-32f5d898-2d85-4bb2-8863-fb697ec76df2 service nova] Creating event network-vif-deleted:51e8d924-d89b-49d3-a148-6342175b4399 for instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 on n-h2-857467-1 Sep 13 17:03:02.227915 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-dd5ed8d5-2cfc-4c74-9448-43f678535f7e req-32f5d898-2d85-4bb2-8863-fb697ec76df2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050120 Sep 13 17:03:02.229210 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3132/6303] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:02.392255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:02.393437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:02.412686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:02.422181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:02.430887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:02.434020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:02.434757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:02.435385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:02.564720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:02.567468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:02.568108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:02.570339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lazy-loading 'fault' on Instance uuid b5296c60-1c49-44fc-9f03-e8054dde7ed8 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:03:02.728098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:02.739323 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62e06e68-745c-4d16-a8f0-60832b14478a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 200 len: 1304 microversion: 2.1 time: 0.350917 Sep 13 17:03:02.753885 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3172/6304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:02 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 1304 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:03.770249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:03.771821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: b5296c60-1c49-44fc-9f03-e8054dde7ed8] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:03.783053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:03.783914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:03.784458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:03.785648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:03.786356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:03.787277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:03.804376 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] HTTP exception thrown: Instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 could not be found. Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Request method failure captured: Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 HTTP/1.1 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILevy_JKaXAmDapqnQnw2OKHuoodIvDMPPwJn-ONeJtGlMMGlhgLLQ3Kvy9iR0lKIXxyYOrjSfYfR8jHujiDw4RwHHHNoKc4qYkUKscGj-qk3vI6keFMTujXExQ0iGKYlyFlPkbiFpK62Am7G4PLF3GFLUNOMtaTeq9x2mm-BhHQ_D4 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 21f2be1738ad43f1bfd2f9cf4aacdbb9 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesActionsTest-367469504 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesActionsTest-367469504 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 21f2be1738ad43f1bfd2f9cf4aacdbb9 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesActionsTest-367469504 Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesActionsTest-367469504-project Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 7d748bc505d9477e872de990c73141ce Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesActionsTest-367469504-project Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 could not be found. Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'b5296c60-1c49-44fc-9f03-e8054dde7ed8'} Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 could not be found. Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 could not be found. Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:03.806198 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 could not be found. Sep 13 17:03:03.811212 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:03.813495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Returning 404 to user: Instance b5296c60-1c49-44fc-9f03-e8054dde7ed8 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:03.814668 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b13d42a-35f3-46d3-9ee2-4c83b8b75d2d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8" status: 404 len: 111 microversion: 2.1 time: 0.051426 Sep 13 17:03:03.827050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3133/6305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:03 2022] GET /compute/v2.1/servers/b5296c60-1c49-44fc-9f03-e8054dde7ed8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:03.953653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-270037982", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "d5968062-8bab-4d97-b099-b537862121f7"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:04.072749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] validate_networks() for [('d5968062-8bab-4d97-b099-b537862121f7', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:03:04.154762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:04.155197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:04.166774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.167574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.168857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.170124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.170871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.171535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.188827 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a HTTP/1.1 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8be42671-87d9-4a60-a0cf-bd2b85d8a90a'} Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:04.191421 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.195559 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.197574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:04.198578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88d53f50-81a8-4a0b-8761-9679a0857eae tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 404 len: 111 microversion: 2.1 time: 0.049039 Sep 13 17:03:04.199537 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3134/6306] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:03:04 2022] DELETE /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:03:04.209455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:04.210165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 8be42671-87d9-4a60-a0cf-bd2b85d8a90a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:04.217811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.218455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.218981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.219720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.220284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.220800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.236986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a HTTP/1.1 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '8be42671-87d9-4a60-a0cf-bd2b85d8a90a'} Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.238588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 8be42671-87d9-4a60-a0cf-bd2b85d8a90a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:04.242849 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b86b923-2948-4eeb-8fa4-990c54ece392 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a" status: 404 len: 111 microversion: 2.1 time: 0.036032 Sep 13 17:03:04.244136 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3135/6307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:04 2022] GET /compute/v2.1/servers/8be42671-87d9-4a60-a0cf-bd2b85d8a90a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:04.249505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:04.249969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:04.256508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.257017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.257473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.258233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.258706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.259149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.275329 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a HTTP/1.1 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3f18c88e-68df-4252-881b-7bd9c71bec1a'} Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:04.277185 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91a3fd04-df0e-4e3d-b0ea-9f0a5275a581 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 404 len: 111 microversion: 2.1 time: 0.034020 Sep 13 17:03:04.283288 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3136/6308] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:03:04 2022] DELETE /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:04.289614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:04.290284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: 3f18c88e-68df-4252-881b-7bd9c71bec1a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:04.300912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.301421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.301903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.302878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:04.303561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:04.304209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:04.319553 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a HTTP/1.1 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3f18c88e-68df-4252-881b-7bd9c71bec1a'} Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:04.321588 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. Sep 13 17:03:04.325932 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:04.328106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance 3f18c88e-68df-4252-881b-7bd9c71bec1a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:04.329163 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-877d8270-89d5-439e-a0ee-53bffd22b99d tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a" status: 404 len: 111 microversion: 2.1 time: 0.044852 Sep 13 17:03:04.329799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3137/6309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:04 2022] GET /compute/v2.1/servers/3f18c88e-68df-4252-881b-7bd9c71bec1a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:05.296477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:03:05.297024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:03:05.297282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:03:05.297703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:03:05.298156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:03:05.315582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:05.316280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:05.320150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:05.321220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:05.321915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:05.322798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:05.379390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Getting quotas for project 21f2be1738ad43f1bfd2f9cf4aacdbb9. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:03:05.400583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Getting quotas for user 7d748bc505d9477e872de990c73141ce and project 21f2be1738ad43f1bfd2f9cf4aacdbb9. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:03:05.427448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:03:05.429873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:03:05.566149 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6fe2faa-5e35-40f3-b064-8d910eff8285 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613616 Sep 13 17:03:05.567360 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3173/6310] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:03:05.579812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5a2e8a82-8a6c-4188-b64f-fc94d791b48e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:05.580752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5a2e8a82-8a6c-4188-b64f-fc94d791b48e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:05.727138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5a2e8a82-8a6c-4188-b64f-fc94d791b48e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:05.752260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5a2e8a82-8a6c-4188-b64f-fc94d791b48e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1213 microversion: 2.1 time: 0.169327 Sep 13 17:03:05.755269 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3138/6311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:05 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:06.782502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:06.783866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:06.802209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:06.804376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:06.807601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:06.810332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:06.812336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:06.812969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:07.113715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:07.129664 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d18aad6b-80c3-485a-856d-f189dcb04fe1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1209 microversion: 2.1 time: 0.351267 Sep 13 17:03:07.145476 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3174/6312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:06 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1209 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:08.153909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:08.154549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:08.169417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:08.170682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:08.171929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:08.176519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:08.177330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:08.178067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:08.339527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:08.353673 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d02525f-05ac-449b-a551-b2de11623686 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1271 microversion: 2.1 time: 0.202537 Sep 13 17:03:08.358022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3139/6313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:08 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:09.387606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:09.388287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:09.400477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:09.400983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:09.401800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:09.402603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:09.410718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:09.411567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:09.554782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:09.586964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7e365c9-068f-4b1f-ac8f-28d534daa6b3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1271 microversion: 2.1 time: 0.204894 Sep 13 17:03:09.587596 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3175/6314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:09 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:10.086914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:10.089400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:10.100146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:10.105229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:10.106629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:10.107559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:10.108193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:10.109440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:10.143352 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 HTTP/1.1 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e54d3d86-40a0-4e90-8c28-333d854dc2b9'} Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:10.144600 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:10.149700 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b25dc536-ef49-4a32-8da5-2f96c65474f8 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 404 len: 111 microversion: 2.1 time: 0.063702 Sep 13 17:03:10.155560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:10.156192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] [instance: e54d3d86-40a0-4e90-8c28-333d854dc2b9] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:10.164448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:10.164977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:10.165414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:10.177366 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3140/6315] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:03:10 2022] DELETE /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:10.177918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:10.180259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:10.180741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:10.224400 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] HTTP exception thrown: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Request method failure captured: Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 HTTP/1.1 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILWYrkl2oDpK3Vvx18tjw46i5rd8V-vwaZu14MzA-cg7KCLy5sNvDUhHnUwhiuxCYjBIhkag0vFyGF0XZca48_JlQ3abbifhSDc3lHhCiFPxEWz5DTBusAKmEmEE_CDvl9y5E79YJ3Q_e7n-97p6pAk2NsbGgTbohkj3At0G5PwF-9Y Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e856acfabcb741f099a858837e7ccac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e856acfabcb741f099a858837e7ccac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: e856acfabcb741f099a858837e7ccac4 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1616401296 Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f64beb6d899a4e7188e14ef66163348f Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeNegativeTest-1616401296-project Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e54d3d86-40a0-4e90-8c28-333d854dc2b9'} Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:10.226067 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] Returning 404 to user: Instance e54d3d86-40a0-4e90-8c28-333d854dc2b9 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:10.231901 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-49b58586-3bea-4ce2-be05-9c4b09c1aa31 tempest-AttachVolumeNegativeTest-1616401296 tempest-AttachVolumeNegativeTest-1616401296-project] 10.222.0.61 "GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9" status: 404 len: 111 microversion: 2.1 time: 0.076901 Sep 13 17:03:10.244634 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3176/6316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:10 2022] GET /compute/v2.1/servers/e54d3d86-40a0-4e90-8c28-333d854dc2b9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:10.616666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:10.617459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:10.628174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:10.628560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:10.628998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:10.629745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:10.630244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:10.630691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:11.337135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:11.359537 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40e23bfd-9a5b-42c8-95af-a84d238e6fd2 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.747864 Sep 13 17:03:11.374230 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3141/6317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:10 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:12.387325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:12.388618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:12.396542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:12.397324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:12.397990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:12.398879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:12.399513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:12.400330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:12.864554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:12.880067 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-40046b90-70f0-4dc0-8793-b5143ecfe77f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.496612 Sep 13 17:03:12.898143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3177/6318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:12 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:13.587583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a9a265c4-9e46-46cd-af2a-717db3250f7f req-5cb22918-da36-4552-a586-198df6837231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737a1d0b-13af-4b18-9e36-565f4d2abac1", "tag": "d1326d84-5d0c-40bc-b338-69dcb84ab932"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:13.619851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a9a265c4-9e46-46cd-af2a-717db3250f7f req-5cb22918-da36-4552-a586-198df6837231 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:13.620347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a9a265c4-9e46-46cd-af2a-717db3250f7f req-5cb22918-da36-4552-a586-198df6837231 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:13.621740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a9a265c4-9e46-46cd-af2a-717db3250f7f req-5cb22918-da36-4552-a586-198df6837231 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:13.669114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a9a265c4-9e46-46cd-af2a-717db3250f7f req-5cb22918-da36-4552-a586-198df6837231 service nova] Creating event network-changed:d1326d84-5d0c-40bc-b338-69dcb84ab932 for instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 on n-h1-857467-1 Sep 13 17:03:13.678038 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a9a265c4-9e46-46cd-af2a-717db3250f7f req-5cb22918-da36-4552-a586-198df6837231 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092029 Sep 13 17:03:13.696925 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3142/6319] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:13.906424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:13.907166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:13.915747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:13.916609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:13.917255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:13.920710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:13.921361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:13.921997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:14.506163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:14.527746 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b822b0c0-af44-4848-acf8-ae1befe50b46 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.623734 Sep 13 17:03:14.557371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3178/6320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:13 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:15.557365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:15.558111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:15.573611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:15.578038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:15.578564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:15.579331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:15.579813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:15.580246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:15.744954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:15.852167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:15.863106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36a71a99-6f6d-41c5-90f4-a1322d3b52d5 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.311568 Sep 13 17:03:15.866464 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3143/6321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:15 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:16.899383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:16.900646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:16.909795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:16.911045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:16.945708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:16.946239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:16.946685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:16.947406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:16.947869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:16.948298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:17.742942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:17.764687 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11f2e8e1-b7f7-4b08-a622-bea718e7004a tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.869041 Sep 13 17:03:17.765497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3179/6322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:16 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:18.789018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:18.790262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:18.806897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:18.813856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:18.814620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:18.816024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:18.821136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:18.822443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:19.667392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:19.677478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ccfde1bb-cecb-4829-ad3b-e805dd1c8e3d tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.892404 Sep 13 17:03:19.678125 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3144/6323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:18 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:20.708283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:20.711614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:20.744348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:20.750186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:20.782212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:20.783110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:20.783613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:20.784068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:21.144712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:21.155068 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2608e106-56fb-4fbe-a308-5eb354ded7f3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.457230 Sep 13 17:03:21.162909 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3180/6324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:20 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:21.322219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:21.323913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:21.342041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:21.346072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:21.346559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:21.350911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:21.353003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:21.353469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:21.407839 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea56042c-c0e4-442f-b690-2bcd02ada2b1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/ips" status: 200 len: 150 microversion: 2.20 time: 0.089374 Sep 13 17:03:21.415565 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3145/6325] 10.222.0.61 () {60 vars in 1289 bytes} [Tue Sep 13 17:03:21 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:03:22.186462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:22.187322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:22.199462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:22.208119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:22.208677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:22.209133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:22.209898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:22.210406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:22.211308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:22.764732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:22.773483 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a5dca7bb-c82c-4795-a629-9d0ff807646e tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.591741 Sep 13 17:03:22.779987 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3181/6326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:22 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:23.625099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-28d9b332-13ad-4edc-9afb-8fe81f9d8746 req-c827cc16-38e0-43a5-b38a-4bbb386e61ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a1d0b-13af-4b18-9e36-565f4d2abac1", "name": "network-vif-plugged", "status": "completed", "tag": "d1326d84-5d0c-40bc-b338-69dcb84ab932"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:23.639989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28d9b332-13ad-4edc-9afb-8fe81f9d8746 req-c827cc16-38e0-43a5-b38a-4bbb386e61ae service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:23.640849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28d9b332-13ad-4edc-9afb-8fe81f9d8746 req-c827cc16-38e0-43a5-b38a-4bbb386e61ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:23.641488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28d9b332-13ad-4edc-9afb-8fe81f9d8746 req-c827cc16-38e0-43a5-b38a-4bbb386e61ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:23.646477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=89 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:23.658195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-28d9b332-13ad-4edc-9afb-8fe81f9d8746 req-c827cc16-38e0-43a5-b38a-4bbb386e61ae service nova] Creating event network-vif-plugged:d1326d84-5d0c-40bc-b338-69dcb84ab932 for instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 on n-h1-857467-1 Sep 13 17:03:23.673474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-28d9b332-13ad-4edc-9afb-8fe81f9d8746 req-c827cc16-38e0-43a5-b38a-4bbb386e61ae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053396 Sep 13 17:03:23.675854 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3146/6327] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:23.805121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:23.806756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:23.826547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:23.829382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:23.829921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:23.830788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:23.831219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:23.836274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:24.591481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:24.602510 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19a75a53-9ebf-4cb7-841b-6b6ee3606a29 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.803509 Sep 13 17:03:24.613788 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3182/6328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:23 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:24.617430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1699001140", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:24.707534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:03:24.734608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:24.735493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:24.759055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:24.760450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:24.761457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:24.763022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:24.763684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:24.764520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:24.873223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lazy-loading 'flavor' on Instance uuid 29d909e3-38da-446a-aa1b-43996bce9ea1 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:03:25.434258 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-677751b2-4de8-4d9d-ad5f-f9a25211e845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/action" status: 202 len: 0 microversion: 2.20 time: 0.704324 Sep 13 17:03:25.436818 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3183/6329] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 17:03:24 2022] POST /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 17:03:25.478402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:25.485278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:25.520682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:25.520996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:25.525644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:25.529492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:25.530539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:25.533592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:25.592460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:03:25.595074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:03:25.596377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:03:25.597275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:03:25.598002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:03:25.601577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=46 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:25.613801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:25.614873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:25.615594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:25.616703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:25.617411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:25.618171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:25.639589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Getting quotas for project 1e2a6ee2b5314869bcc98310ba968fa4. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:03:25.650859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Getting quotas for user 855ac971408747b4a606c7b30c85781f and project 1e2a6ee2b5314869bcc98310ba968fa4. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:03:25.675048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:03:25.678070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:03:25.748578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c848237b-6c19-40ee-97c3-dc845b78bcb1 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135436 Sep 13 17:03:25.754411 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3147/6330] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:03:25.765957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:25.767608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:25.780258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:25.781489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:25.782401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:25.783589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:25.784302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:25.784954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:26.033366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:26.050033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:26.054831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:26.056432 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-56a93f46-c9ce-47fb-942b-7c3832667757 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.602431 Sep 13 17:03:26.077318 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3184/6331] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:25 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:26.087137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-72b8f76a-ea96-4fd5-a220-738d5c73c786 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:26.101283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-72b8f76a-ea96-4fd5-a220-738d5c73c786 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:26.153727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:26.164569 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20ffc1bc-1dff-4bb4-a8d9-7cba781b3d5f tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1313 microversion: 2.1 time: 0.407451 Sep 13 17:03:26.178449 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3148/6332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:25 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:26.654192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-72b8f76a-ea96-4fd5-a220-738d5c73c786 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:26.664573 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-72b8f76a-ea96-4fd5-a220-738d5c73c786 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1214 microversion: 2.1 time: 0.585690 Sep 13 17:03:26.680667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3185/6333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:26 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1214 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:27.088141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:27.090118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:27.101423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:27.106142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:27.108626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:27.111564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:27.112428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:27.115076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:27.191633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:27.193090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:27.223202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:27.224036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:27.224500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:27.236051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:27.236581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:27.237045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:27.750008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:27.764783 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dbea2c9c-f139-410e-8ca5-32165fccf6f6 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1497 microversion: 2.1 time: 0.579499 Sep 13 17:03:27.771091 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3186/6334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:27 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1497 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:27.795329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:27.799594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:27.802157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:27.826994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:27.827661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:27.828294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:27.828846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:27.829312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:27.834771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:27.845944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:27.857058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:27.865222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f60a6a8f-b473-441a-ab5c-4b389dbacf06 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.778814 Sep 13 17:03:27.873434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:27.879601 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3149/6335] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:27 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:28.041070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:28.063917 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ece8224a-5e6a-4f87-bec0-59dfdb200129 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1284 microversion: 2.1 time: 0.284791 Sep 13 17:03:28.067137 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3187/6336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:27 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1284 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:28.777819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:28.778489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:28.792066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:28.793138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:28.793602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:28.794376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:28.794845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:28.800336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:28.866485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:03:28.894553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:28.895527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:28.912247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:28.913593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:28.914100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:28.914857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:28.918608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:28.919193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:29.101027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e04fabec-9200-4ac7-9603-2d52345b2f11 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "DELETE /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 204 len: 0 microversion: 2.1 time: 0.327454 Sep 13 17:03:29.102136 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3150/6337] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:03:28 2022] DELETE /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:03:29.111535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:29.115747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:29.130741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:29.131487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:29.132359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:29.135135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:29.136815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:29.138304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:29.554554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:29.564161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:29.565756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:29.575382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ac675b9-03fb-48e8-bbbe-fd0f8c88902f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.685327 Sep 13 17:03:29.578935 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3188/6338] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:28 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:29.594448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:29.595339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:29.610015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:29.610552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:29.610977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:29.611711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:29.616710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:29.617206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:29.670874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:29.686795 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6256e9f-ab7f-4eaf-bf97-9f0033680fdc tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1272 microversion: 2.1 time: 0.582935 Sep 13 17:03:29.700887 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3151/6339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:29 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1272 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:30.005439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:30.031923 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6fb1903d-0127-41ac-983c-083dbf13d4a1 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1503 microversion: 2.1 time: 0.449634 Sep 13 17:03:30.032626 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3189/6340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:29 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1503 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:30.602387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:30.603020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:30.618254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:30.618862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:30.619539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:30.621231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:30.622006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:30.622973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:30.714410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:30.715326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:30.724863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:30.730771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:30.737478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:30.738369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:30.738868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:30.739313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:31.214095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:31.223910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b408a75-2f40-43cf-80b0-6434a3611311 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.515544 Sep 13 17:03:31.225142 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3190/6341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:30 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:31.233046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:31.234129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:31.248077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:31.249058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:31.249706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:31.250689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:31.253510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:31.254422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:31.539923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:31.557813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:31.561366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:31.563955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ccfa20d3-119a-4ae2-87a1-068b3a93880d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.965585 Sep 13 17:03:31.583529 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3152/6342] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:30 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:31.766212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d748bc505d9477e872de990c73141ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f2be1738ad43f1bfd2f9cf4aacdbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:31.774437 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc618c14-b8bf-44df-bfe3-9bcf33ed67cb tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 200 len: 1503 microversion: 2.1 time: 0.547984 Sep 13 17:03:31.780417 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3191/6343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:31 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 1503 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:32.273452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ab82af80-e874-4f27-940c-e7e829dcc21a req-8dd5813a-2ba3-4859-b828-6da540eb2922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737a1d0b-13af-4b18-9e36-565f4d2abac1", "name": "network-vif-deleted", "tag": "d1326d84-5d0c-40bc-b338-69dcb84ab932"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:32.275678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:32.277692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:32.325742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:32.331987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:32.335991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:32.336152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ab82af80-e874-4f27-940c-e7e829dcc21a req-8dd5813a-2ba3-4859-b828-6da540eb2922 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:32.336658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ab82af80-e874-4f27-940c-e7e829dcc21a req-8dd5813a-2ba3-4859-b828-6da540eb2922 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:32.336784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:32.337625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ab82af80-e874-4f27-940c-e7e829dcc21a req-8dd5813a-2ba3-4859-b828-6da540eb2922 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:32.341772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:32.342555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:32.382186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ab82af80-e874-4f27-940c-e7e829dcc21a req-8dd5813a-2ba3-4859-b828-6da540eb2922 service nova] Creating event network-vif-deleted:d1326d84-5d0c-40bc-b338-69dcb84ab932 for instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 on n-h1-857467-1 Sep 13 17:03:32.391701 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ab82af80-e874-4f27-940c-e7e829dcc21a req-8dd5813a-2ba3-4859-b828-6da540eb2922 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134168 Sep 13 17:03:32.395891 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3192/6344] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:32.602284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:32.603560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:32.624464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:32.624982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:32.625427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:32.635766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:32.637916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:32.638386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:33.208998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:33.223507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:33.225544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:33.227632 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f291d694-2658-444f-810c-edbddc3d6e12 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.630409 Sep 13 17:03:33.228156 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3193/6345] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:32 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:33.248743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:33.249376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] [instance: 737a1d0b-13af-4b18-9e36-565f4d2abac1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:33.255669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:33.256521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:33.257196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:33.258210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:33.258906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:33.259829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:33.272896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:33.282560 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f77ca5f-c158-42cb-bc1e-523661fd2124 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 1.026692 Sep 13 17:03:33.298251 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] HTTP exception thrown: Instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 could not be found. Sep 13 17:03:33.299742 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3153/6346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:32 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Request method failure captured: Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 HTTP/1.1 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILevy_JKaXAmDapqnQnw2OKHuoodIvDMPPwJn-ONeJtGlMMGlhgLLQ3Kvy9iR0lKIXxyYOrjSfYfR8jHujiDw4RwHHHNoKc4qYkUKscGj-qk3vI6keFMTujXExQ0iGKYlyFlPkbiFpK62Am7G4PLF3GFLUNOMtaTeq9x2mm-BhHQ_D4 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 21f2be1738ad43f1bfd2f9cf4aacdbb9 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesActionsTest-367469504 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/21f2be1738ad43f1bfd2f9cf4aacdbb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesActionsTest-367469504 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 21f2be1738ad43f1bfd2f9cf4aacdbb9 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesActionsTest-367469504 Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesActionsTest-367469504-project Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7d748bc505d9477e872de990c73141ce Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesActionsTest-367469504-project Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 could not be found. Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '737a1d0b-13af-4b18-9e36-565f4d2abac1'} Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 could not be found. Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 could not be found. Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:03:33.299943 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 could not be found. Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] Returning 404 to user: Instance 737a1d0b-13af-4b18-9e36-565f4d2abac1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a55520eb-318c-4808-a073-fe09176318c3 tempest-VolumesActionsTest-367469504 tempest-VolumesActionsTest-367469504-project] 10.222.0.61 "GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1" status: 404 len: 111 microversion: 2.1 time: 0.072922 Sep 13 17:03:33.304438 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3194/6347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:33 2022] GET /compute/v2.1/servers/737a1d0b-13af-4b18-9e36-565f4d2abac1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:03:33.601121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-280932bc-0c42-4eb6-a89b-7088eee6922e req-a01165ef-a5a0-483a-be69-a5e979d24a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155a7ff9-ca8c-44a9-bffa-3c6c7432f26f", "tag": "37bdd25d-c147-4c59-9d10-316bc2440e38"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:33.685433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-280932bc-0c42-4eb6-a89b-7088eee6922e req-a01165ef-a5a0-483a-be69-a5e979d24a52 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:33.690648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-280932bc-0c42-4eb6-a89b-7088eee6922e req-a01165ef-a5a0-483a-be69-a5e979d24a52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:33.691334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-280932bc-0c42-4eb6-a89b-7088eee6922e req-a01165ef-a5a0-483a-be69-a5e979d24a52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:33.717995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-280932bc-0c42-4eb6-a89b-7088eee6922e req-a01165ef-a5a0-483a-be69-a5e979d24a52 service nova] Creating event network-changed:37bdd25d-c147-4c59-9d10-316bc2440e38 for instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f on n-h2-857467-1 Sep 13 17:03:33.723512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-280932bc-0c42-4eb6-a89b-7088eee6922e req-a01165ef-a5a0-483a-be69-a5e979d24a52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126538 Sep 13 17:03:33.724470 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3195/6348] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:34.258349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:34.259180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:34.278463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:34.279832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:34.281492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:34.282189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:34.285766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:34.286414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:34.319198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:34.320041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:34.347733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:34.350991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:34.354658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:34.355627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:34.359069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:34.359804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:34.772589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:34.788826 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de0f5ec5-bc5d-44c8-8820-2e3fa33cb400 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.469553 Sep 13 17:03:34.790520 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3196/6349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:34 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:03:34.848361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:34.871109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:34.878781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:34.896892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb6b560e-a56d-479b-9962-7bf520b72adb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.642262 Sep 13 17:03:34.915916 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3154/6350] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:34 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:35.820483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:35.822519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:35.842061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:35.846200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:35.847284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:35.850437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:35.851505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:35.854145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:35.924626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:35.925935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:35.936343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:35.938953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:35.957408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:35.965569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:35.966198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:35.970948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:35.974012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:35.976871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:36.374607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:36.387009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f68cd299-d78f-47e0-9047-13005f82a586 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.571559 Sep 13 17:03:36.389159 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3197/6351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:35 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:36.563942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:36.575126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:36.580632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:36.584255 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a814fd84-3afc-4a04-82a4-95a6acdc2267 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.661563 Sep 13 17:03:36.584970 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3155/6352] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:35 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:37.415981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:37.418530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:37.430623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:37.435113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:37.439302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:37.439971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:37.440922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:37.442390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:37.446526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:37.625682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:37.626988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:37.637385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:37.643681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:37.644448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:37.645401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:37.648957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:37.649659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:37.926076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:37.938692 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c91af4c1-b708-4591-9966-3f2a952ed6ab tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.526815 Sep 13 17:03:37.939853 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3198/6353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:37 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:38.623988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:38.663066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:38.668570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:38.676521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1269164d-f2ee-4be8-b2f3-db3b30f687a0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 1.063879 Sep 13 17:03:38.681464 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3156/6354] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:37 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:38.968338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:38.969034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:38.990428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:38.990938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:38.991386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:38.996271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:38.999130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:39.000384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:39.546781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:39.565212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec5f6adc-287e-48c7-b813-5ddfc95158ae tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.602124 Sep 13 17:03:39.571049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3199/6355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:38 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:39.719766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:39.720403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:39.750445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:39.751597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:39.752119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:39.789815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:39.791622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:39.798377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:40.597997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:40.599488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:40.611842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:40.613378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:40.618005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:40.619153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:40.620041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:40.621284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:40.914024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:40.927687 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3fce768-24bb-470c-99b8-0df438be7d89 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.335246 Sep 13 17:03:40.929017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3200/6356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:40 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:41.211490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-beff7313-921b-429f-8c4d-826c7190c919 req-8fa0ec94-504b-4aa1-8464-a6b9e109b2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155a7ff9-ca8c-44a9-bffa-3c6c7432f26f", "name": "network-vif-plugged", "status": "completed", "tag": "37bdd25d-c147-4c59-9d10-316bc2440e38"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:41.226586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-beff7313-921b-429f-8c4d-826c7190c919 req-8fa0ec94-504b-4aa1-8464-a6b9e109b2a0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:41.227085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-beff7313-921b-429f-8c4d-826c7190c919 req-8fa0ec94-504b-4aa1-8464-a6b9e109b2a0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:41.230162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-beff7313-921b-429f-8c4d-826c7190c919 req-8fa0ec94-504b-4aa1-8464-a6b9e109b2a0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:41.251193 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-beff7313-921b-429f-8c4d-826c7190c919 req-8fa0ec94-504b-4aa1-8464-a6b9e109b2a0 service nova] Creating event network-vif-plugged:37bdd25d-c147-4c59-9d10-316bc2440e38 for instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f on n-h2-857467-1 Sep 13 17:03:41.264787 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-beff7313-921b-429f-8c4d-826c7190c919 req-8fa0ec94-504b-4aa1-8464-a6b9e109b2a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058111 Sep 13 17:03:41.268637 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3201/6357] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:41.417521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:41.429781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:41.431571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:41.434934 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8dfb6d1c-62f5-41fb-a61b-0d9f79bc06b6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 1.727477 Sep 13 17:03:41.435897 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3157/6358] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:39 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:41.960642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:41.961682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:41.969679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:41.970668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:41.971495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:41.973219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:41.974094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:41.976801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:42.472105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:42.475008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:42.503953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:42.505737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:42.506507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:42.507880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:42.509403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:42.512977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:42.621684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:42.634020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f160e22-ed82-42d5-95fc-28653c520f94 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1314 microversion: 2.1 time: 0.681829 Sep 13 17:03:42.637481 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3202/6359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:41 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:42.929937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:42.945600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:42.949324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:42.953519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75b6dee9-38b9-4551-b21d-a4afdf13a2d6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.492907 Sep 13 17:03:42.955855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3158/6360] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:42 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:43.673617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:43.674608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:43.700272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:43.702256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:43.703225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:43.704729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:43.707379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:43.708024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:43.979077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:43.984422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:43.984972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:44.009780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:44.010310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:44.010782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:44.015698 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b08b289d-7602-406a-ad69-dc93484f10ad tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1464 microversion: 2.1 time: 0.346931 Sep 13 17:03:44.016974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:44.020698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:44.022199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:44.031294 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3203/6361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:03:43 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1464 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:03:44.055770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fec4e6ce-6c9c-416f-b5c3-c19380bd688e", "device": "/dev/sdb"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:44.067347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:44.107166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:44.107785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:44.111815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:44.115800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:44.118255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:44.123473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:44.702890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:44.735230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:44.741242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:44.746576 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eeb2938f-cba3-4d79-b856-ca407506a59a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1741 microversion: 2.20 time: 0.765299 Sep 13 17:03:44.748507 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3159/6362] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:43 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1741 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:44.854155 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf3b9809-7f63-4109-9dfa-bc3bb93b9ae2 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "POST /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811829 Sep 13 17:03:44.876311 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3204/6363] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:03:44 2022] POST /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:03:45.781259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:45.783238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:45.814640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:45.822187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:45.826590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:45.827452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:45.832328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:45.832849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:46.462737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:46.475466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:46.482466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:46.486053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-87e4a500-6b58-4912-be03-8cdd9078b09f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1741 microversion: 2.20 time: 0.711425 Sep 13 17:03:46.509870 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3160/6364] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:45 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1741 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:47.534981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:47.536738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:47.577760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:47.581720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:47.585059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:47.588348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:47.590927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:47.594653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:47.605271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e79bd88c-a11f-4a58-b5db-7a1f7e7f78c8 req-ca2cfdfd-9310-4c6f-afe4-bad50c12e6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "name": "network-vif-plugged", "status": "completed", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:03:47.636861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e79bd88c-a11f-4a58-b5db-7a1f7e7f78c8 req-ca2cfdfd-9310-4c6f-afe4-bad50c12e6ee service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:47.637448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e79bd88c-a11f-4a58-b5db-7a1f7e7f78c8 req-ca2cfdfd-9310-4c6f-afe4-bad50c12e6ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:47.652863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e79bd88c-a11f-4a58-b5db-7a1f7e7f78c8 req-ca2cfdfd-9310-4c6f-afe4-bad50c12e6ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:47.726479 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e79bd88c-a11f-4a58-b5db-7a1f7e7f78c8 req-ca2cfdfd-9310-4c6f-afe4-bad50c12e6ee service nova] Creating event network-vif-plugged:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h2-857467-1 Sep 13 17:03:47.739951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:47.753610 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e79bd88c-a11f-4a58-b5db-7a1f7e7f78c8 req-ca2cfdfd-9310-4c6f-afe4-bad50c12e6ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152043 Sep 13 17:03:47.754316 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3161/6365] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:03:48.171241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:48.196428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:48.198151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:48.199608 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef1e2edd-3a6a-418a-9185-8fd96dc0a8c0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1741 microversion: 2.20 time: 0.673141 Sep 13 17:03:48.203021 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3205/6366] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:47 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1741 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:49.232975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:49.233806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:49.248163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:49.248687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:49.249121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:49.258290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:49.258902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:49.259423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:49.636899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:49.661918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:49.663731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:49.665258 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-574ba5bb-60a7-46a1-83ef-1f3a82ed4835 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.438292 Sep 13 17:03:49.667695 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3162/6367] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:49 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:50.717789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:50.722086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:50.763164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:50.763860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:50.765247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:50.766495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:50.768435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:50.769210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:51.240133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:51.257637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:51.266708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:51.268013 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6878f9c-7028-4497-9b7b-7125cb1752ad tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.561655 Sep 13 17:03:51.277987 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3206/6368] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:50 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:52.298738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:52.300041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:52.314788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:52.315590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:52.324312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:52.325492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:52.326189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:52.326820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:52.331722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:52.855444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:52.864771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:52.867448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:52.875463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-196a8643-a579-4143-8890-7ca2a4b3a495 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.580551 Sep 13 17:03:52.876606 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3163/6369] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:52 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:53.906427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:53.907053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:53.917049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=54 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:53.918703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:53.927962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:53.929611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:53.931592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:53.934987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:53.935649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:54.255709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:54.272149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:54.274650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:54.277557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d8430ca-ebb4-4194-a1af-1725de55bc30 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.374115 Sep 13 17:03:54.294006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3207/6370] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:53 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:55.306594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:55.307384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:55.325481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:55.329127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:55.331320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:55.332095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:55.338236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:55.343258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:56.622559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:56.645079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:56.660779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:56.671338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d01492dd-bc02-4cc9-8d55-e8942f2517ff tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 1.361501 Sep 13 17:03:56.676973 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3164/6371] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:55 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:57.700396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:57.702220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:57.718163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:57.720566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:57.722887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:57.723810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:57.727626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:57.728306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:57.890114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:57.900844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:57.903947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:57.905468 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b694b6d-7bac-4cc6-983a-498fddee65ed tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.210525 Sep 13 17:03:57.906666 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3208/6372] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:57 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:03:58.934459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:03:58.935183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:03:58.953320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:03:58.956386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:58.956891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:58.957336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:58.965272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:03:58.965884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:03:58.966352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:03:59.455226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:59.467655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:59.469532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:03:59.473416 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-792581ea-7464-4f80-be72-4cbef113dc1e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.543946 Sep 13 17:03:59.475321 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3165/6373] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:03:58 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:00.559182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:00.559939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:00.613902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:00.615123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:00.615814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:00.617419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:00.618708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:00.619317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:01.051056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:01.062397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:01.064239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:01.065640 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-736822cc-221c-40cb-aeeb-8cf966d22c4e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.560360 Sep 13 17:04:01.066880 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3209/6374] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:00 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:02.092674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:02.093564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:02.118006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:02.119742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:02.123044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:02.127576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:02.128138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:02.129412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:02.503058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:02.517564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:02.520189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:02.521521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc7d0e6b-69f6-443b-b0c0-48b25d8acbcc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.433305 Sep 13 17:04:02.522484 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3166/6375] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:02 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:03.550835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:03.551463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:03.564033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:03.565157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:03.566564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:03.567799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:03.569318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:03.570312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:04.325337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:04.409673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:04.409673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:04.409673 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dda62cbf-f81d-4817-824c-557976079c52 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.796886 Sep 13 17:04:04.409673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3210/6376] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:03 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:05.452215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:05.453531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:05.468308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:05.469314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:05.471365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:05.472943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:05.474964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:05.488532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:06.038425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:06.070881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:06.085210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:06.095648 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4fe58e55-5b81-4420-956d-4e25a71c692d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.643122 Sep 13 17:04:06.098242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3167/6377] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:05 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:07.155899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:07.159610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:07.198326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:07.201126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:07.202045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:07.205323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:07.207382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:07.227835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:07.600145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:07.610148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:07.633705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:07.640261 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2631b85-9416-4172-9e01-df5fc18c7f2f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.492298 Sep 13 17:04:07.641255 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3211/6378] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:07 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:08.679519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:08.680803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:08.692732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:08.693534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:08.699516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:08.700844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:08.701506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:08.702139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:09.062534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:09.082200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:09.089285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:09.092987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62839e72-0c5e-4b8a-b5f1-bed2205a153e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.415391 Sep 13 17:04:09.094063 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3168/6379] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:08 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:10.123376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:10.124156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:10.133650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:10.134598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:10.137436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:10.138520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:10.139820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:10.140978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:10.550704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:10.563103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:10.566278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:10.571499 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2dfe0949-d1a0-43a6-913d-d94dc787996b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.455421 Sep 13 17:04:10.594080 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3212/6380] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:10 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:11.612528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:11.614232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:11.635963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:11.636740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:11.651081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:11.652511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:11.653218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:11.653936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:11.912040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:11.929779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:11.945537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:11.946836 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6cd4fab9-84bc-4633-97f2-98eceee066c7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.340373 Sep 13 17:04:11.951082 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3169/6381] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:11 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:12.974975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:12.976448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:12.989557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:12.993121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:12.993862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:12.995550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:12.999573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:13.000289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:13.707891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:13.722709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:13.734453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:13.738668 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f601b91-9336-4f12-a690-871f8c311fb1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.768087 Sep 13 17:04:13.768570 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3213/6382] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:12 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:14.780793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:14.782518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:14.802802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:14.805422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:14.812693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:14.816351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:14.827239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:14.827876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:15.337155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:15.350875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:15.354936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:15.358580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3f342010-3c60-48ab-bebc-64ddd01536f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.586590 Sep 13 17:04:15.376373 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3170/6383] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:14 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:16.389964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:16.390594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:16.405166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:16.405665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:16.406130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:16.406841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:16.407309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:16.407738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:17.357776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:17.371763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:17.373577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:17.375380 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cf88398-547d-40c4-95cb-3c9c205b9e1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.990463 Sep 13 17:04:17.392061 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3214/6384] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:16 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:18.405103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:18.406447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:18.430750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:18.435350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:18.436047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:18.436990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:18.449114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:18.457931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:19.129432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:19.147928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:19.149403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:19.156041 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00d7576e-e65d-4fa2-a8a0-aa788f31cd1f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.754826 Sep 13 17:04:19.156577 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3171/6385] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:18 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:20.183847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:20.185282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:20.202158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:20.203703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:20.204430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:20.208911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:20.209716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:20.214606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:20.308614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=59 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:21.122531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:21.132907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:21.144622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:21.147360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f89cd2c3-75a1-4345-a284-1bbbddb5148a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.968837 Sep 13 17:04:21.171758 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3215/6386] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:20 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:04:22.184775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:22.186062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:22.193558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:22.194579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:22.195262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:22.196733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:22.198103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:22.200421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:22.729673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:22.732061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=58 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:22.741337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:22.743083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:22.760231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-412c4bdb-6fb8-49c8-b225-ce33469a9224 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.584815 Sep 13 17:04:22.762283 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3172/6387] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:22 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:23.790270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:23.792588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:23.825894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:23.833459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:23.835264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:23.839993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:23.840740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:23.841442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:24.296523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:24.312020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:24.314018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:24.315454 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-528e6bbc-21e9-4b31-8e6a-3b30438a57f1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.529074 Sep 13 17:04:24.330179 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3216/6388] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:23 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:25.360874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:25.362331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:25.375947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:25.376976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:25.377676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:25.379037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:25.379767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:25.380467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:25.958118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:25.983648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:25.991942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:25.996120 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8117ca8e-0d9b-47d2-a24e-9a7031c3e5c8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.640801 Sep 13 17:04:26.014488 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3173/6389] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:25 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:27.026794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:27.027426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:27.031440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:27.048211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:27.051816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:27.054244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:27.055247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:27.055900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:27.056747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:27.381967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:27.395947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:27.403038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:27.410600 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70b4993c-1011-4c99-bf94-02076116e82e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.388768 Sep 13 17:04:27.420182 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3217/6390] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:27 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:28.447764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:28.449184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:28.481980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:28.484132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:28.486311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:28.487380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:28.490638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:28.491355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:28.859081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:28.868731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:28.876135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:28.877401 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6370bfc2-6956-454c-8927-0b909ee3ea4a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.435459 Sep 13 17:04:28.898038 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3174/6391] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:28 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:29.910357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:29.911671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:29.938261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:29.942685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:29.943653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:29.944632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:29.946065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:29.967231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:30.394165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:30.408443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:30.427046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:30.444429 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6c4eda9-acb5-41ad-b617-cbc6a58566f7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1736 microversion: 2.20 time: 0.542850 Sep 13 17:04:30.446160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3218/6392] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:29 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1736 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:31.477400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:31.478817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:31.499613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=20 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:31.505250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:31.509894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:31.513479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:31.519430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:31.522640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:31.523327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:31.912718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:31.926136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:31.935328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:31.947669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db911a56-8d21-4114-9586-4a03755b66e1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1718 microversion: 2.20 time: 0.464072 Sep 13 17:04:31.969922 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3175/6393] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:31 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1718 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:32.980256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:32.981058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:33.006055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:33.007640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:33.009868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:33.018155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:33.020682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:33.023351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:33.423461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2da97cd7-006f-4642-b602-2b7541972865 req-f4c260fc-1bc5-4474-8329-9956394bc646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "name": "network-vif-unplugged", "status": "completed", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:04:33.483328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2da97cd7-006f-4642-b602-2b7541972865 req-f4c260fc-1bc5-4474-8329-9956394bc646 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:33.485378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2da97cd7-006f-4642-b602-2b7541972865 req-f4c260fc-1bc5-4474-8329-9956394bc646 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:33.488655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2da97cd7-006f-4642-b602-2b7541972865 req-f4c260fc-1bc5-4474-8329-9956394bc646 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:33.542843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:33.551741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:33.553270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:33.554566 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1809a40-b1c6-4aa9-b05e-a4f1ed1b8b2a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1718 microversion: 2.20 time: 0.578755 Sep 13 17:04:33.555166 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3219/6394] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:32 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1718 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:33.583100 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2da97cd7-006f-4642-b602-2b7541972865 req-f4c260fc-1bc5-4474-8329-9956394bc646 service nova] Creating event network-vif-unplugged:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h2-857467-1 Sep 13 17:04:33.592530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2da97cd7-006f-4642-b602-2b7541972865 req-f4c260fc-1bc5-4474-8329-9956394bc646 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180285 Sep 13 17:04:33.604898 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3176/6395] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 13 17:04:34.590171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:34.590774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:34.605328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:34.605919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:34.606334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:34.607066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:34.607537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:34.607968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:35.089538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:35.104496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:35.106165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:35.107433 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc829094-6c02-400c-bdb0-f16b861d687a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1661 microversion: 2.20 time: 0.521652 Sep 13 17:04:35.115213 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3220/6396] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:34 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1661 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:35.142371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4614ba25-c1e0-4977-9d00-b899bdd254dc"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:04:35.146264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:35.159112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:35.161605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:35.162688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:35.163566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:35.164348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:35.164906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:35.870748 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c72615e7-d19c-491e-9ba1-2159beb791be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.735483 Sep 13 17:04:35.877555 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3177/6397] 10.222.0.61 () {62 vars in 1364 bytes} [Tue Sep 13 17:04:35 2022] POST /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 188 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:04:36.235487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:04:36.236650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:36.262292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:36.263167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:36.263961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:36.265231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:36.274331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:36.275147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:36.383154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122328) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 17:04:36.491307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f95effbf-dd6d-48f5-a158-c8a51434ebbb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/action" status: 202 len: 0 microversion: 2.20 time: 0.266314 Sep 13 17:04:36.492879 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3221/6398] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 17:04:36 2022] POST /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:04:36.508517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:36.510139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:36.544484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:36.545190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:36.549022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:36.552602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:36.554020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:36.558901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:37.371828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:37.407838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:37.416722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:37.421302 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69f3790c-bc67-4373-a302-04e27a9c7e33 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1747 microversion: 2.20 time: 0.919302 Sep 13 17:04:37.426932 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3178/6399] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:36 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1747 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:04:38.461872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:38.465373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:38.492066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:38.492886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:38.493038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:38.506361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:38.514637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:38.515109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:39.190191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:39.207382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:39.216439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:39.219385 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f213533-8938-4f57-8926-44969cf70216 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1747 microversion: 2.20 time: 0.767867 Sep 13 17:04:39.220986 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3222/6400] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:38 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1747 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:40.248074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:40.249393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:40.266004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:40.267313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:40.268736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:40.270249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:40.271233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:40.273916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:40.626919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:40.642742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:40.645653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:40.646915 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8d850a4a-bc1f-4646-a7bb-8c164c5f903e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.405043 Sep 13 17:04:40.671538 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3179/6401] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:40 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:41.682299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:41.684421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:41.698111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:41.698563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:41.699018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:41.706640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:41.707200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:41.707738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:42.028266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:42.038071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:42.044356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:42.048752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e3d75d45-a0c1-4bff-9f00-3c63f98a258c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.371274 Sep 13 17:04:42.073031 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3223/6402] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:41 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:43.076684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:43.077297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:43.088786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:43.089283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:43.089731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:43.090478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:43.090941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:43.091375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:43.404498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:43.428544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:43.434411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:43.437706 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c3a7a44-ab62-4f2b-8c90-e59e953eb21d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.365108 Sep 13 17:04:43.440932 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3180/6403] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:43 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:44.472068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:44.473615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:44.495826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:44.496680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:44.497291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:44.498794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:44.506654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:44.518668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:45.510909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:45.531661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:45.536696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:45.543181 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee8a2fd6-cd8e-4ad8-82b1-9f6151900834 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 1.072338 Sep 13 17:04:45.544322 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3224/6404] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:44 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:46.574566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:46.577682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:46.599194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:46.599816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:46.605655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:46.606510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:46.607196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:46.608589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:47.202495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:47.230355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:47.231852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:47.237592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-92b217ef-d5d0-4c54-a34f-e376ea1b372a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.666765 Sep 13 17:04:47.238436 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3181/6405] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:46 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:48.266839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:48.267911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:48.285959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:48.286853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:48.287721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:48.292992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:48.293679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:48.296138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:49.564409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:49.576008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:49.583560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:49.584820 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a39321e-a6e6-4f60-ab69-5792808a5e7a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 1.322011 Sep 13 17:04:49.603117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3225/6406] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:48 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:50.618525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:50.619509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:50.631448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:50.634136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:50.635190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:50.641074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:50.642046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:50.642762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:51.391963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:51.405934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:51.416597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:51.418196 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29599359-2627-4c33-80ac-f4c1d34bd510 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.804081 Sep 13 17:04:51.419851 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3182/6407] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:50 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:52.451267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:52.452467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:52.480254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:52.481063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:52.481529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:52.482347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:52.483689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:52.484186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:52.514606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:52.804068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:52.817324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:52.819214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:52.820887 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7450e755-fa7d-434a-be7b-030d3385b3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.374785 Sep 13 17:04:52.822833 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3226/6408] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:52 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:53.851427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:53.852059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:53.863153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:53.863662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:53.864108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:53.867121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:53.867926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:53.873425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:53.885543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:54.300107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:54.338211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:54.351435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:54.382222 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-018d2465-f992-4045-a8ce-affee2f1c798 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.528518 Sep 13 17:04:54.395634 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3183/6409] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:53 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:55.415601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:55.416929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:55.426850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:55.435272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:55.435978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:55.442815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:55.443581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:55.444255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:55.808110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:55.823189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:55.824693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:55.825984 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-513d1936-38d4-4cd4-8160-bb3bec96eaf9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.415205 Sep 13 17:04:55.840591 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3227/6410] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:55 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:56.862425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:56.863972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:56.878983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:56.882142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:56.884848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:56.886358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:56.890718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:56.892336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:57.553254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:57.566746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:57.579265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:57.580533 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88a8402c-ec5c-4120-b947-d9399eae966e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1749 microversion: 2.20 time: 0.723557 Sep 13 17:04:57.595407 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3184/6411] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:56 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1749 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:04:58.609414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:04:58.610071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:04:58.622222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:04:58.638856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:58.640403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:58.642472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:58.644120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:04:58.644603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:04:58.645054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:04:59.220531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:59.257317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:59.264932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:04:59.272969 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27280d51-21b3-4b02-9a95-301129a7c088 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.667520 Sep 13 17:04:59.276696 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3228/6412] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:04:58 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:00.304664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:00.307036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:00.355211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:00.355933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:00.369927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:00.371297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:00.373551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:00.377512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:01.289529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:01.306977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:01.313427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:01.314846 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f030731c-95c7-4f63-8135-463394d9adfc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 1.014413 Sep 13 17:05:01.317076 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3185/6413] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:00 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:02.347265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:02.348126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:02.395913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:02.396448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:02.396902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:02.397642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:02.398135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:02.398572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:02.998396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-69830ad3-95a3-4874-8019-021da2c23f8f req-9ce1738a-53d9-4122-8f7d-b49a3331e622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:05:03.017939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=22 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:05:03.020277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-69830ad3-95a3-4874-8019-021da2c23f8f req-9ce1738a-53d9-4122-8f7d-b49a3331e622 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:03.020775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-69830ad3-95a3-4874-8019-021da2c23f8f req-9ce1738a-53d9-4122-8f7d-b49a3331e622 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:03.021211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-69830ad3-95a3-4874-8019-021da2c23f8f req-9ce1738a-53d9-4122-8f7d-b49a3331e622 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:03.028954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:03.043912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:03.047843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:03.049070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5567c135-aff3-4ebe-abeb-cf683ecc047c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.705965 Sep 13 17:05:03.049354 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-69830ad3-95a3-4874-8019-021da2c23f8f req-9ce1738a-53d9-4122-8f7d-b49a3331e622 service nova] Creating event network-changed:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h1-857467-1 Sep 13 17:05:03.053677 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3229/6414] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:02 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:03.063973 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-69830ad3-95a3-4874-8019-021da2c23f8f req-9ce1738a-53d9-4122-8f7d-b49a3331e622 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070805 Sep 13 17:05:03.064883 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3186/6415] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:05:04.076740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:04.077352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:04.100693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:04.101302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:04.101769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:04.103109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:04.103568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:04.112887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:04.723472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:04.748888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:04.750886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:04.752613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b375e05-d269-4ec7-b083-631674dbe8b0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.679686 Sep 13 17:05:04.769509 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3230/6416] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:04 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:05.802305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:05.804100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:05.814334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:05.815417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:05.817535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:05.819036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:05.819964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:05.821606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:06.542801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:06.565235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:06.566761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:06.567984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8df5e04-0507-4aa0-9ac7-d9ad8b6024a2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.788281 Sep 13 17:05:06.570944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3187/6417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:05 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:07.602366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:07.602994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:07.620265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:07.622204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:07.626201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:07.638080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:07.640549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:07.641198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:08.067729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:08.086089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:08.094483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:08.095976 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d9f5bac-0fae-46c1-aedd-021e7a8bc4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.498137 Sep 13 17:05:08.096954 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3231/6418] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:07 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:09.126125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:09.127022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:09.157466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:09.158122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:09.158725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:09.159851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:09.160536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:09.161075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:09.848924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:09.873382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:09.874936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:09.887343 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dced1ec2-e861-4d3a-9569-9ef8cacbb0e3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.755949 Sep 13 17:05:09.888016 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3188/6419] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:09 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:10.932561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:10.933951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:10.951532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:10.954015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:10.955372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:10.956461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:10.956938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:10.962213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:11.521479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:11.551136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:11.559082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:11.572700 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed926fc1-09cc-4724-be96-e3e1dc247a66 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.644706 Sep 13 17:05:11.574812 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3232/6420] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:10 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:12.624728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:12.625337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:12.648125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:12.653994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:12.655877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:12.663003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:12.666196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:12.670891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:13.090434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:13.116859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:13.123397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:13.131721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2dea08b1-d18c-4653-ac21-2762afe11e73 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.508388 Sep 13 17:05:13.134072 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3189/6421] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:12 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:14.170210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:14.171957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:14.204568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:14.205966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:14.208219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:14.209188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:14.211037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:14.217674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:15.218069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Calling method '.version_select at 0x7fbeaffb3940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:15.218600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:15.219866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:15.220367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:15.220814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:15.230997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:15.235082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:15.238928 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3a0b71f-55d4-4395-839b-f7fdf0cdebe5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 1.077428 Sep 13 17:05:15.239796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3233/6422] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:14 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:15.290384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:15.290384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:15.290384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:15.354435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:15.355147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:15.355402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:15.374497 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-148c35eb-decc-481c-beca-4aecb92b9c32 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703605822-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.440866 Sep 13 17:05:15.380055 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3190/6423] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 17:05:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:05:16.270592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:16.271380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:16.285545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:16.291915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:16.294366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:16.295563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:16.299049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:16.300544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:17.799370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:17.835155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:17.838355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:17.840795 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c9cffc66-cfc8-44f3-afe2-fc2d30043119 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 1.574377 Sep 13 17:05:17.852972 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3234/6424] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:16 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:18.880764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:18.881729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:18.893984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:18.901007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:18.906257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:18.910478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:18.912399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:18.914924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:19.524278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:19.534331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:19.550294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:19.552209 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4c3bcb5-b4a1-4dbe-b620-adb5d854bbdc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.675740 Sep 13 17:05:19.557276 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3191/6425] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:18 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:20.589849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:20.591179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:20.611261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:20.614795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:20.616077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:20.618826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:20.620152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:20.622459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:21.768970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:21.785706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:21.787302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:21.792767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e492cf35-55c5-4b1a-8f42-a10d0774abd0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 1.204419 Sep 13 17:05:21.795009 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3235/6426] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:20 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:22.820955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:22.822206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:22.833295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:22.840713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:22.841439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:22.842420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:22.843086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:22.843716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:23.522218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:23.545280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:23.547754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:23.551463 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e703af6b-55d5-414d-b794-9dc730f0f58c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.734451 Sep 13 17:05:23.556056 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3192/6427] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:22 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:24.581038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:24.583621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:24.605026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:24.605758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:24.606435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:24.608837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:24.610403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:24.611502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:24.627922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=60 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:05:24.993253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:25.004847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:25.011523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:25.012996 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35103bc2-c5c3-4c9b-a321-9c2b8d95b3b7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.435856 Sep 13 17:05:25.016251 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3236/6428] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:24 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:26.049932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:26.058642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:26.075394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:26.075978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:26.076516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:26.077326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:26.081238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:26.081794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:26.088443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=56 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:05:26.592992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:26.634312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:26.644789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:26.650410 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-91b96b84-8425-4b6e-9586-51a7ced175ef tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.610018 Sep 13 17:05:26.675524 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3193/6429] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:26 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:27.707599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:27.708514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:27.742771 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:05:27.743084 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 (ip 10.222.0.61) !!! Sep 13 17:05:27.759764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:27.760272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:27.762940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:27.763690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:27.764164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:27.764608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:28.353168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:28.388356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:28.397203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:28.404937 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76143f80-1680-4d10-b196-3c9f2309d937 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.701828 Sep 13 17:05:28.413363 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3237/6430] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:27 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:29.448400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:29.451046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:29.523603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:29.537273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:29.537273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:29.537273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:29.537273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:29.537273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:29.892541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:29.917192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:29.924016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:29.931397 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-291d24c2-a473-4f96-ba1d-addbe3b22e2d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.494585 Sep 13 17:05:29.938859 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3194/6431] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:29 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:30.999503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:31.000143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:31.032959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=20 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:05:31.050728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:31.051528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:31.052469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:31.056015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:31.059587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:31.061367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:31.553501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:31.583410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:31.588863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:31.593871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb3a67b4-a264-486f-9a5d-25ab0b413496 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.599072 Sep 13 17:05:31.597765 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3238/6432] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:30 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:32.635778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:32.637084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:32.656826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:32.657793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:32.658704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:32.659836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:32.660540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:32.662046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:33.112854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:33.122589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:33.129996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:33.131435 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-920ecd9d-c3b9-403b-bdc4-6527e2981c29 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.508281 Sep 13 17:05:33.152596 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3195/6433] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:32 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:34.160513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:34.161115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:34.177261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:34.177770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:34.178260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:34.179580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:34.180072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:34.180508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:34.605119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:34.632314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:34.634827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:34.636449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bdd56442-b9a4-459e-9433-d141622761dc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.479726 Sep 13 17:05:34.637232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3239/6434] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:34 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:05:35.665914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:35.666535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:35.675288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=22 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:05:35.681627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:35.682936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:35.686192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:35.687146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:35.687829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:35.688567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:36.637500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:36.649955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:36.667812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:36.669046 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0706339-9964-4b2b-8135-c571c89f1680 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 1.007516 Sep 13 17:05:36.669628 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3196/6435] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:35 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:37.705480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:37.706271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:37.746692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:37.747185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:37.747644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:37.748397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:37.753293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:37.754519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:38.062184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a5180c25-5e87-4e33-9d99-6b7eb04439be req-4b0acc6f-9d40-4603-9008-c13b4d0ddc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "name": "network-vif-plugged", "status": "completed", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:05:38.096345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5180c25-5e87-4e33-9d99-6b7eb04439be req-4b0acc6f-9d40-4603-9008-c13b4d0ddc7c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:38.096960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5180c25-5e87-4e33-9d99-6b7eb04439be req-4b0acc6f-9d40-4603-9008-c13b4d0ddc7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:38.097256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5180c25-5e87-4e33-9d99-6b7eb04439be req-4b0acc6f-9d40-4603-9008-c13b4d0ddc7c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:38.125042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a5180c25-5e87-4e33-9d99-6b7eb04439be req-4b0acc6f-9d40-4603-9008-c13b4d0ddc7c service nova] Creating event network-vif-plugged:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h1-857467-1 Sep 13 17:05:38.133358 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a5180c25-5e87-4e33-9d99-6b7eb04439be req-4b0acc6f-9d40-4603-9008-c13b4d0ddc7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075344 Sep 13 17:05:38.134632 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3197/6436] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:05:38.144275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:38.174524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:38.176682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:38.177896 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d5eca6d-8775-4b63-af72-cbe905b4a864 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.479380 Sep 13 17:05:38.184422 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3240/6437] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:37 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:39.218784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:39.219557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:39.231805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:39.239027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:39.239588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:39.240372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:39.240860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:39.241309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:39.686816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:39.705122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:39.706633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:39.708069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec8ef83d-00b9-48bc-8722-5454522cefc7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.501545 Sep 13 17:05:39.708655 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3198/6438] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:39 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:40.754337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:40.755951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:40.782544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:40.783264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:40.784810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:40.785795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:40.787099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:40.787715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:41.571498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:41.583520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:41.589010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:41.591938 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96817268-0fd5-42fc-85bd-e62df6151165 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1805 microversion: 2.20 time: 0.847450 Sep 13 17:05:41.594995 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3241/6439] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:40 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1805 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:05:42.624842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:05:42.625465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:05:42.644457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:42.645662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:42.649686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:42.662303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:05:42.666389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:05:42.666990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:05:43.110176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:43.124993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:43.128781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:05:43.135991 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-254fdaa7-005d-46f7-bbbe-39fb49e0bc94 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1792 microversion: 2.20 time: 0.515245 Sep 13 17:05:43.177930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3199/6440] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:05:42 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1792 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:06:01.733880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:01.736023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:01.739456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:01.742892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=35 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:01.754649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:01.755559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:01.757591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:01.761373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:01.762138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:01.765188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:01.936189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lazy-loading 'services' on Instance uuid 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:06:02.060572 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90acf740-aad6-45cb-ac4b-c681a22137d4 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f/os-volume_attachments/fec4e6ce-6c9c-416f-b5c3-c19380bd688e" status: 202 len: 0 microversion: 2.1 time: 0.330925 Sep 13 17:06:02.064549 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3242/6441] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:06:01 2022] DELETE /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f/os-volume_attachments/fec4e6ce-6c9c-416f-b5c3-c19380bd688e => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:06:11.286227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:11.287905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:11.290571 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:06:11.293702 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f (ip 10.222.0.61) !!! Sep 13 17:06:11.295113 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:06:11.295436 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f (ip 10.222.0.61) !!! Sep 13 17:06:11.296521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:11.299549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=37 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:11.331285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:11.335980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:11.339559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:11.341066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:11.342778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:11.346781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:11.404257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:06:11.578341 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a04ba8d4-5e25-45b5-9596-c58ea1f1b663 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 204 len: 0 microversion: 2.1 time: 0.300856 Sep 13 17:06:11.581275 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3200/6442] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:06:11 2022] DELETE /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:06:11.590393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:11.591109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:11.605278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:11.605790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:11.608740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:11.609484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:11.609993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:11.610436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:12.035236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:12.078613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-611b918e-1c8c-42c9-b888-cce15c0c8b85 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1470 microversion: 2.1 time: 0.482276 Sep 13 17:06:12.079485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3243/6443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:06:11 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1470 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:06:13.105464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:13.107534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:13.125640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:13.130656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:13.133542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:13.134672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:13.135358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:13.136857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:13.484109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:13.499853 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc4ecdd8-3a37-4bdc-9954-fc9f3ebff677 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1470 microversion: 2.1 time: 0.399691 Sep 13 17:06:13.502131 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3201/6444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:06:13 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1470 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:06:14.529260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:14.530874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:14.542092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:14.546599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:14.548952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:14.549885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:14.554016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:14.554774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:14.868947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:14.877682 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-646af1a8-c942-4686-a03a-95bfb0fd29ac tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1470 microversion: 2.1 time: 0.356606 Sep 13 17:06:14.886748 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3244/6445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:06:14 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:06:15.691516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8f33577c-abf3-490e-b704-05bdd4c9969d req-8a783ea6-22d9-48e2-bb4c-33ee125de26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155a7ff9-ca8c-44a9-bffa-3c6c7432f26f", "name": "network-vif-deleted", "tag": "37bdd25d-c147-4c59-9d10-316bc2440e38"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:06:15.745523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8f33577c-abf3-490e-b704-05bdd4c9969d req-8a783ea6-22d9-48e2-bb4c-33ee125de26c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:15.746950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8f33577c-abf3-490e-b704-05bdd4c9969d req-8a783ea6-22d9-48e2-bb4c-33ee125de26c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:15.748520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8f33577c-abf3-490e-b704-05bdd4c9969d req-8a783ea6-22d9-48e2-bb4c-33ee125de26c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:15.784412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8f33577c-abf3-490e-b704-05bdd4c9969d req-8a783ea6-22d9-48e2-bb4c-33ee125de26c service nova] Creating event network-vif-deleted:37bdd25d-c147-4c59-9d10-316bc2440e38 for instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f on n-h2-857467-1 Sep 13 17:06:15.796909 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8f33577c-abf3-490e-b704-05bdd4c9969d req-8a783ea6-22d9-48e2-bb4c-33ee125de26c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109985 Sep 13 17:06:15.803696 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3202/6446] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:06:15.907131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:15.911459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:15.935596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:15.936163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:15.936617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:15.937376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:15.937918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:15.947271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:16.050006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:16.050539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:16.050982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:16.051446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lazy-loading 'fault' on Instance uuid 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:06:16.139946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '855ac971408747b4a606c7b30c85781f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a6ee2b5314869bcc98310ba968fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:16.159577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-49d9de5c-e22b-4552-941d-0dddacb8ac5f tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 200 len: 1304 microversion: 2.1 time: 0.258482 Sep 13 17:06:16.176862 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3245/6447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:06:15 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 1304 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:06:17.195842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:17.197202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] [instance: 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:17.223340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:17.231437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:17.232162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:17.233168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:17.233871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:17.234509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:17.270133 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] HTTP exception thrown: Instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f could not be found. Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Request method failure captured: Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f HTTP/1.1 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILfZOvYQ72ZMrI3QyukYkRSwN0It6eiUvyol7ahmc6s_TYpTRUbvNuSsFH7iJaadAbxyOad_hozBo2XMYixbj2mPWE3Z2kPgQUDTVwq-9OiMOBLV10IBcwOpunA_ri6GmXO5u4fXjy8vYvZBWCwllAfQ71DKxRbfmYUV7JZUrK1xKWg Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 1e2a6ee2b5314869bcc98310ba968fa4 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesBackupsTest-1876585427 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2a6ee2b5314869bcc98310ba968fa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2a6ee2b5314869bcc98310ba968fa4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2a6ee2b5314869bcc98310ba968fa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2a6ee2b5314869bcc98310ba968fa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesBackupsTest-1876585427 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 1e2a6ee2b5314869bcc98310ba968fa4 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesBackupsTest-1876585427 Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesBackupsTest-1876585427-project Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 855ac971408747b4a606c7b30c85781f Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesBackupsTest-1876585427-project Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f could not be found. Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '155a7ff9-ca8c-44a9-bffa-3c6c7432f26f'} Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f could not be found. Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f could not be found. Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:06:17.277980 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f could not be found. Sep 13 17:06:17.281165 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:06:17.283379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] Returning 404 to user: Instance 155a7ff9-ca8c-44a9-bffa-3c6c7432f26f could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:06:17.284496 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b1b1103-95d7-4563-842e-db0bf8748720 tempest-VolumesBackupsTest-1876585427 tempest-VolumesBackupsTest-1876585427-project] 10.222.0.61 "GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f" status: 404 len: 111 microversion: 2.1 time: 0.099224 Sep 13 17:06:17.285616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3203/6448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:06:17 2022] GET /compute/v2.1/servers/155a7ff9-ca8c-44a9-bffa-3c6c7432f26f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:06:47.007231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=10 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:47.008472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:47.433124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:47.433862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:47.444624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:47.452933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:47.453691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:47.454831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:47.455572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:47.456338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:47.547710 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-552def68-7f6a-456f-a5f5-0e75de76fd43 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments/4614ba25-c1e0-4977-9d00-b899bdd254dc" status: 200 len: 194 microversion: 2.20 time: 0.538657 Sep 13 17:06:47.567684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3246/6449] 10.222.0.61 () {60 vars in 1454 bytes} [Tue Sep 13 17:06:46 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments/4614ba25-c1e0-4977-9d00-b899bdd254dc => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:47.709243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:47.709840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:47.712225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:47.712882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:06:47.726438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:47.727197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:47.729674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:47.730646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:47.732991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:47.733644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:47.941631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lazy-loading 'services' on Instance uuid 29d909e3-38da-446a-aa1b-43996bce9ea1 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:06:48.092262 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-00fb494b-75e4-4333-aa86-25a790a24a3f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments/4614ba25-c1e0-4977-9d00-b899bdd254dc" status: 202 len: 0 microversion: 2.20 time: 0.387019 Sep 13 17:06:48.093573 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3204/6450] 10.222.0.61 () {60 vars in 1457 bytes} [Tue Sep 13 17:06:47 2022] DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments/4614ba25-c1e0-4977-9d00-b899bdd254dc => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:06:48.103216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:48.124058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:48.141134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:48.141644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:48.142116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:48.142838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:48.143297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:48.156994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:48.226194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c3825a9-bac4-437f-8cbe-fee3625db91e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126598 Sep 13 17:06:48.228565 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3247/6451] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:48 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:49.244598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:49.247029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:49.272405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:49.273447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:49.274441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:49.275199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:49.275836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:49.276550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:49.348134 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b24ff87f-ebc8-4326-a494-295281baf533 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108511 Sep 13 17:06:49.351507 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3205/6452] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:49 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:50.363023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:50.367431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:50.381582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:50.386241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:50.386881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:50.387772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:50.390654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:50.391274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:50.473449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a166e57-4adb-431e-ad30-c994ea13bc62 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110975 Sep 13 17:06:50.486590 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3248/6453] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:50 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:51.488143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:51.491344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:51.518712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:51.519228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:51.519694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:51.529440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:51.530426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:51.534023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:51.615106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a89704d-dca3-4b59-ba70-55d2a1d0064f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.131135 Sep 13 17:06:51.616169 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3206/6454] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:51 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:06:52.632149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:52.635101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:52.654357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:52.654877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:52.655330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:52.659740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:52.660326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:52.664381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:52.777605 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-263c7f3c-da29-4b24-b551-ca7e65e9403e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150988 Sep 13 17:06:52.778252 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3249/6455] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:52 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:53.793164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:53.795615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:53.817387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:53.818295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:53.818774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:53.819506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:53.819981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:53.820419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:53.918923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b7ab0d0-1f87-4171-a7d5-134b69c8ce74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129810 Sep 13 17:06:53.927802 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3207/6456] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:53 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:54.931233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:54.933429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:54.957488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:54.958618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:54.959066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:54.959797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:54.960264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:54.960702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:55.084253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eed79751-2900-4a08-9085-fbd8821d389f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156672 Sep 13 17:06:55.090460 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3250/6457] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:54 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:56.098911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:56.101319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:56.113895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:56.115856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:56.118738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:56.119645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:56.121083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:56.121720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:56.196937 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71e82c9f-664e-439d-ad16-3b2469c038be tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102723 Sep 13 17:06:56.203623 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3208/6458] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:56 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:57.211787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:57.214550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:57.230850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:57.231583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:57.232197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:57.233103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:57.233730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:57.246019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:57.305331 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-30f0f83e-c39e-42bf-8136-d5392c52813b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097839 Sep 13 17:06:57.306232 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3251/6459] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:57 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:06:58.319383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:58.323282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:58.331926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:58.332446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:58.333012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:58.334479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:58.334974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:58.335428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:58.387726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9c1c845-ed44-4c80-be48-3196b9719ff9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073325 Sep 13 17:06:58.388999 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3209/6460] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:58 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:06:59.401678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:59.404662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:59.413646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:59.414267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:59.415056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:59.416252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:59.417063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:59.417722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:59.469028 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4c7d8b8c-4570-4427-927f-558ed02887e9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071309 Sep 13 17:06:59.490213 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3252/6461] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:06:59 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:06:59.590610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:59.591895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:59.602016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:59.602807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:59.603408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:59.604448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:59.605075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:59.605675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:59.638971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:06:59.778149 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0982f6ec-df1c-4ab9-9a42-4bf0631acf9c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 204 len: 0 microversion: 2.20 time: 0.194174 Sep 13 17:06:59.782549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3210/6462] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 17:06:59 2022] DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 17:06:59.790791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:06:59.791842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:06:59.799771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:59.800733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:59.801411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:59.803016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:06:59.803750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:06:59.804458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:06:59.981084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:59.994309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:59.996100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:06:59.997685 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd1c0e81-9906-4220-ac47-14f82696c18b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.213784 Sep 13 17:06:59.998864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3253/6463] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:06:59 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:01.024385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:01.025795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:01.034220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:01.035055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:01.035770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:01.037238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:01.038078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:01.038521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:01.187149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:01.196395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:01.199059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:01.200420 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99be4ad3-0523-425d-9202-70ad8e8a6568 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.180516 Sep 13 17:07:01.216714 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3211/6464] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:01 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:02.227956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:02.228609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:02.244565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:02.245424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:02.246121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:02.247469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:02.247809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:02.248255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:02.687212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:02.715720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:02.720753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:02.732381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6af499f-3ad2-4625-9a73-3d541aaf8404 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1720 microversion: 2.20 time: 0.509076 Sep 13 17:07:02.734208 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3254/6465] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:02 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1720 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:03.519671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-28ab58ca-40fa-41b2-b673-7033bc6f4f13 req-1f438691-2e8c-4b5f-b89b-c8dee31d9a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d909e3-38da-446a-aa1b-43996bce9ea1", "name": "network-vif-deleted", "tag": "c2616a32-0b96-4526-a463-893b08375c22"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:03.536943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28ab58ca-40fa-41b2-b673-7033bc6f4f13 req-1f438691-2e8c-4b5f-b89b-c8dee31d9a0b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:03.537455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28ab58ca-40fa-41b2-b673-7033bc6f4f13 req-1f438691-2e8c-4b5f-b89b-c8dee31d9a0b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:03.537932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-28ab58ca-40fa-41b2-b673-7033bc6f4f13 req-1f438691-2e8c-4b5f-b89b-c8dee31d9a0b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:03.570875 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-28ab58ca-40fa-41b2-b673-7033bc6f4f13 req-1f438691-2e8c-4b5f-b89b-c8dee31d9a0b service nova] Creating event network-vif-deleted:c2616a32-0b96-4526-a463-893b08375c22 for instance 29d909e3-38da-446a-aa1b-43996bce9ea1 on n-h1-857467-1 Sep 13 17:07:03.584074 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-28ab58ca-40fa-41b2-b673-7033bc6f4f13 req-1f438691-2e8c-4b5f-b89b-c8dee31d9a0b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501190 Sep 13 17:07:03.585568 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3212/6466] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:07:03.765767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:03.766755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:03.776579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:03.777072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:03.777567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:03.778321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:03.778786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:03.779443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:03.912716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:03.914470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:03.916127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:03.917091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lazy-loading 'fault' on Instance uuid 29d909e3-38da-446a-aa1b-43996bce9ea1 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:07:04.025322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:04.042331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:04.045138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:04.046759 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33db43b0-81b1-4f47-906e-96017117aca7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 200 len: 1370 microversion: 2.20 time: 0.288847 Sep 13 17:07:04.074023 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3255/6467] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:03 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:05.076357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:05.077188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:05.084765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:05.085420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:05.085985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:05.086777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:05.087324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:05.087839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:05.102641 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] HTTP exception thrown: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Request method failure captured: Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 HTTP/1.1 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILd3cyAHeSsZHiHnCWcgc1xPs16F068VQo5jyL_QCk1gI9WRNxM5Bkw_GZkASMaGTgQ0P4ov8JbVvywMYwFZXYwx2mDTHqdZnq5TkER-x6M-nawXpV1IRq9xF8r61f7OQ3y21bljZ9vn0jRwe8GtSmXrPI9TBkAg5A9Wb2UNbx89DZ4 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3373515c917c4188b8e172654ad55668 Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '29d909e3-38da-446a-aa1b-43996bce9ea1'} Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:07:05.104618 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:07:05.108829 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:07:05.110194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Returning 404 to user: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:07:05.111219 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f325b9da-255d-4bfa-b6ae-49e2538f1653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 404 len: 111 microversion: 2.20 time: 0.040177 Sep 13 17:07:05.111942 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3213/6468] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:05 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:07:05.120806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-70cf8e5f-b6ce-40bc-8466-a23f339dac70 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '.version_select at 0x7fbeb414ddc0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:05.147076 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-70cf8e5f-b6ce-40bc-8466-a23f339dac70 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233305202" status: 204 len: 0 microversion: 2.20 time: 0.030039 Sep 13 17:07:05.150691 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3256/6469] 10.222.0.61 () {60 vars in 1259 bytes} [Tue Sep 13 17:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233305202 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 17:07:06.308128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f38749e-e39b-482b-bd98-d104420bb4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'create', calling method: .version_select at 0x7fbeb4c1a5e0>, body: {"keypair": {"name": "tempest-keypair-362054959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQb63fOX5r/J4Y7/oqIUfq6NjPDiHfGV7jw/6ezzO2DlBywKbMMcnHs0A+P3zZBlLaE1Z4r/3Fd2Je/oVHI5RCIhWRaaMeTWFLZk1MkXKVrOuGxILidQV93rLEOrf6F4w=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:06.344017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4f38749e-e39b-482b-bd98-d104420bb4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for project c890c3a8f01e4c0281f787dc451365bc. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:07:06.360659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4f38749e-e39b-482b-bd98-d104420bb4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for user 3373515c917c4188b8e172654ad55668 and project c890c3a8f01e4c0281f787dc451365bc. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:07:06.422501 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f38749e-e39b-482b-bd98-d104420bb4cc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.118218 Sep 13 17:07:06.423309 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3214/6470] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Sep 13 17:07:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 17:07:09.613614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1157757013", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b91dc9b-3779-4b1f-926e-e09e01f6930b"}], "security_groups": [{"name": "tempest-securitygroup--1573475015"}], "key_name": "tempest-keypair-362054959", "user_data": "}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:09.834658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] validate_networks() for [('1b91dc9b-3779-4b1f-926e-e09e01f6930b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:07:10.760404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:07:10.760969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:07:10.761311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:07:10.761733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:07:10.762416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:07:10.771860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:10.772756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:10.773385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:10.774348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:10.774969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:10.775564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:10.832043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for project c890c3a8f01e4c0281f787dc451365bc. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:07:10.848805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Getting quotas for user 3373515c917c4188b8e172654ad55668 and project c890c3a8f01e4c0281f787dc451365bc. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:07:10.891538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:07:10.905380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:07:11.011395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e211d302-9add-447a-95bd-d5785dfbfdf8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.402251 Sep 13 17:07:11.021764 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3257/6471] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Sep 13 17:07:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 17:07:11.029742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76b7dee1-a740-4aea-a540-e939c94175cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:11.031570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76b7dee1-a740-4aea-a540-e939c94175cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:11.269137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76b7dee1-a740-4aea-a540-e939c94175cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:11.292394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76b7dee1-a740-4aea-a540-e939c94175cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:11.295628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76b7dee1-a740-4aea-a540-e939c94175cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:11.326284 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76b7dee1-a740-4aea-a540-e939c94175cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1281 microversion: 2.20 time: 0.293740 Sep 13 17:07:11.331687 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3215/6472] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:11 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:12.360303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6d266df9-d6fc-4d0d-b9f6-142c474e486b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:12.362199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6d266df9-d6fc-4d0d-b9f6-142c474e486b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:12.572717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6d266df9-d6fc-4d0d-b9f6-142c474e486b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:12.597155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6d266df9-d6fc-4d0d-b9f6-142c474e486b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:12.600313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6d266df9-d6fc-4d0d-b9f6-142c474e486b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:12.604961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6d266df9-d6fc-4d0d-b9f6-142c474e486b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1281 microversion: 2.20 time: 0.252780 Sep 13 17:07:12.609081 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3258/6473] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:12 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:13.644663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:13.646212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:13.658868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:13.659665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:13.661572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:13.662601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:13.663744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:13.664476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:13.923200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:13.939588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:13.944221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:13.945592 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6d5eee8c-3cf6-4661-ace3-eda795a91d79 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1341 microversion: 2.20 time: 0.306623 Sep 13 17:07:13.963001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3216/6474] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:13 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1341 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:14.979358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:14.980134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:15.004751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:15.005357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:15.016881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:15.024361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:15.025223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:15.026912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:15.508664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:15.523732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:15.525152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:15.529389 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-989f6b39-2967-4237-8a00-8ece5af4eb8a tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 0.554301 Sep 13 17:07:15.546413 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3259/6475] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:14 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:16.572960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:16.574466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:16.633107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:16.637011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:16.641919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:16.642998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:16.648642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:16.654036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:17.640201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:17.649463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:17.653991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:17.673143 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4675710b-4429-47ee-adaf-09d43e5dc2c9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 1.111802 Sep 13 17:07:17.698933 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3217/6476] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:16 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:18.316176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f99a2685-01fc-410f-b2aa-c50adda23574 req-ca847f78-4fe1-4364-b187-320a57217802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:18.351693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:18.376385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f99a2685-01fc-410f-b2aa-c50adda23574 req-ca847f78-4fe1-4364-b187-320a57217802 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:18.377401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f99a2685-01fc-410f-b2aa-c50adda23574 req-ca847f78-4fe1-4364-b187-320a57217802 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:18.379207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f99a2685-01fc-410f-b2aa-c50adda23574 req-ca847f78-4fe1-4364-b187-320a57217802 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:18.389045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=71 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:18.404219 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f99a2685-01fc-410f-b2aa-c50adda23574 req-ca847f78-4fe1-4364-b187-320a57217802 service nova] Creating event network-changed:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h2-857467-1 Sep 13 17:07:18.412763 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f99a2685-01fc-410f-b2aa-c50adda23574 req-ca847f78-4fe1-4364-b187-320a57217802 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099710 Sep 13 17:07:18.414106 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3260/6477] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:18.706715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:18.709053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:18.714785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:18.740888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:18.745280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:18.748380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:18.749184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:18.749664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:18.750243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:18.773485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:19.163181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:19.196851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:19.198534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:19.219477 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1bd4beb6-054e-48ca-ba11-211d7bf17782 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 0.514405 Sep 13 17:07:19.240501 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3218/6478] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:18 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:20.259817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:20.261127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:20.286097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:20.292803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:20.294350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:20.295672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:20.296306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:20.296899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:20.578251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:20.587756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:20.589217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:20.606223 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e25a24f-7902-454a-a115-5f693d828579 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 0.356005 Sep 13 17:07:20.609572 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3261/6479] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:20 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:21.640537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:21.641293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:21.650602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:21.681498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:21.686893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:21.687359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:21.688114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:21.702930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:21.706212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:22.376302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:22.396136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:22.403396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:22.405001 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33d12787-39e2-480b-b88b-2ced0f9f719d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 0.768389 Sep 13 17:07:22.407239 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3219/6480] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:21 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:23.435858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:23.436467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:23.476851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:23.481915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:23.488295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:23.489237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:23.493391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:23.494598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:23.495232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:23.495887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:23.855097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:23.867612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:23.871874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:23.875852 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cc10b3d5-ea8a-4dd0-a922-d248e1466abb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 0.443689 Sep 13 17:07:23.876484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3262/6481] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:23 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:24.219032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1ad29d15-deb8-4154-805f-b40f7fae7d91 req-b2b8f13c-49a6-404b-bf97-420fbd549a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "name": "network-vif-plugged", "status": "completed", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:24.234554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1ad29d15-deb8-4154-805f-b40f7fae7d91 req-b2b8f13c-49a6-404b-bf97-420fbd549a8e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:24.238709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1ad29d15-deb8-4154-805f-b40f7fae7d91 req-b2b8f13c-49a6-404b-bf97-420fbd549a8e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:24.239446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1ad29d15-deb8-4154-805f-b40f7fae7d91 req-b2b8f13c-49a6-404b-bf97-420fbd549a8e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:24.268769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1ad29d15-deb8-4154-805f-b40f7fae7d91 req-b2b8f13c-49a6-404b-bf97-420fbd549a8e service nova] Creating event network-vif-plugged:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h2-857467-1 Sep 13 17:07:24.281786 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1ad29d15-deb8-4154-805f-b40f7fae7d91 req-b2b8f13c-49a6-404b-bf97-420fbd549a8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370378 Sep 13 17:07:24.282445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3220/6482] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:07:24.903221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:24.904502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:24.916561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:24.917614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:24.922763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:24.923715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:24.924357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:24.925114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:25.221163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:25.232366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:25.234431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:25.235847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b9eeb62-5b54-48d5-bdb2-13e951a0af91 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1407 microversion: 2.20 time: 0.336758 Sep 13 17:07:25.237168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3263/6483] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:24 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:26.263693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:26.264408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:26.276900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:26.277397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:26.277888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:26.291522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:26.292031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:26.292484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:26.598737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:26.611721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:26.613919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:26.615648 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8897cac9-3709-4f1c-a0c0-1397a8d468fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1598 microversion: 2.20 time: 0.356364 Sep 13 17:07:26.616740 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3221/6484] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:07:26 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1598 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:07:26.645842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:26.646935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:26.655737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:26.656497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:26.657553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:26.658489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:26.659113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:26.659705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:26.810040 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7414d2f9-7ab7-4bd2-8c4e-b713048b44d9 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.168789 Sep 13 17:07:26.818651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3264/6485] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Sep 13 17:07:26 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:07:29.684048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9e88f090-84bd-4b6d-9ac1-d07d3ec80f06 req-295ab4dc-efc2-4ed1-ac0a-a18cdb7796fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:29.704965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9e88f090-84bd-4b6d-9ac1-d07d3ec80f06 req-295ab4dc-efc2-4ed1-ac0a-a18cdb7796fd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:29.705462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9e88f090-84bd-4b6d-9ac1-d07d3ec80f06 req-295ab4dc-efc2-4ed1-ac0a-a18cdb7796fd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:29.705938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9e88f090-84bd-4b6d-9ac1-d07d3ec80f06 req-295ab4dc-efc2-4ed1-ac0a-a18cdb7796fd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:29.736019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9e88f090-84bd-4b6d-9ac1-d07d3ec80f06 req-295ab4dc-efc2-4ed1-ac0a-a18cdb7796fd service nova] Creating event network-changed:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h2-857467-1 Sep 13 17:07:29.746542 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9e88f090-84bd-4b6d-9ac1-d07d3ec80f06 req-295ab4dc-efc2-4ed1-ac0a-a18cdb7796fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066220 Sep 13 17:07:29.747784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3222/6486] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:42.046589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=9 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:42.047965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=23 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:42.056201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a091db7-ff8b-40e2-b816-962c50f703a8 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Action: 'create', calling method: .version_select at 0x7fbeb95cd1f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1089343238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZp8u0KMRzn1QiaFhQkpZpAaOXm2r8SOZ+3V0PwcHQA/Clgf5ylard+lK1wfbzXGRUxjTzqefjuQZqpVdIU6eUnoIF1b2oMTa/S7DhVWAJNixjJ8U1RDYszX+w23MWQqw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:42.100217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6a091db7-ff8b-40e2-b816-962c50f703a8 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Getting quotas for project bdb0d328d1be4291ac58f808835e8d21. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:07:42.146709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6a091db7-ff8b-40e2-b816-962c50f703a8 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Getting quotas for user 5afbe2c5a8de4698bc6be2a80729b2e4 and project bdb0d328d1be4291ac58f808835e8d21. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:07:42.216863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a091db7-ff8b-40e2-b816-962c50f703a8 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.171446 Sep 13 17:07:42.234345 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3265/6487] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:07:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:45.232974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=9 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:45.233727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=21 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:45.239181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1357019689", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ca4d5f0-6364-4ca4-a459-dc5224e1fc5a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1089343238", "security_groups": [{"name": "tempest-secgroup-smoke-1282747877"}], "networks": [{"uuid": "b88a5a39-fa3e-4dde-b1a3-da13f1da4bda"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:45.604811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] validate_networks() for [('b88a5a39-fa3e-4dde-b1a3-da13f1da4bda', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:07:46.700656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:07:46.701338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:07:46.701995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:07:46.702422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:07:46.702840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:07:46.731013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:46.731715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:46.732338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:46.733359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:46.734020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:46.734679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:46.756448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Getting quotas for project bdb0d328d1be4291ac58f808835e8d21. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:07:46.762983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Getting quotas for user 5afbe2c5a8de4698bc6be2a80729b2e4 and project bdb0d328d1be4291ac58f808835e8d21. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:07:46.913468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:07:46.915907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ca4d5f0-6364-4ca4-a459-dc5224e1fc5a',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:07:47.210615 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc890620-b216-4cab-af7a-626111a01058 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.979979 Sep 13 17:07:47.211775 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3223/6488] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:07:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:07:47.223341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01cf4a11-4933-4204-bfad-298e6eafa1ba tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:47.224592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-01cf4a11-4933-4204-bfad-298e6eafa1ba tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:47.362055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-01cf4a11-4933-4204-bfad-298e6eafa1ba tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:47.374110 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-01cf4a11-4933-4204-bfad-298e6eafa1ba tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1099 microversion: 2.1 time: 0.154609 Sep 13 17:07:47.375430 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3266/6489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:47 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1099 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:48.404019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:48.404649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:48.426156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:48.426670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:48.430436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:48.431380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:48.433774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:48.434424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:48.602492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:48.618395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e86ff7ae-ef28-45b8-8920-1c7e26f40af3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1149 microversion: 2.1 time: 0.219333 Sep 13 17:07:48.619249 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3224/6490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:48 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1149 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:49.642592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:49.643321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:49.670739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:49.676280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:49.677081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:49.678639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:49.679287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:49.681463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:50.090646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:50.108579 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66561350-b079-4d4f-89bd-d89eda3dee95 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1215 microversion: 2.1 time: 0.469884 Sep 13 17:07:50.109505 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3267/6491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:49 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:51.133339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:51.134658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:51.147162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:51.162404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:51.167906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:51.169044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:51.170523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:51.183096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:51.447346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:51.465684 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e23b4b4-34f1-4729-aefa-e437cc8cc4c1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1215 microversion: 2.1 time: 0.333649 Sep 13 17:07:51.469503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3225/6492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:51 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:52.507227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:52.508478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:52.519701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:52.545315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:52.546396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:52.547395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:52.552067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:52.552756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:53.080720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:53.094892 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b054820e-d1e5-4429-bd01-13edfa4b2446 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1283 microversion: 2.1 time: 0.598953 Sep 13 17:07:53.100713 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3268/6493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:52 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1283 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:54.134550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:54.136563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:54.151452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:54.153625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:54.154852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:54.157559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:54.170337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:54.171157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:54.888394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:54.897612 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7f339b75-4ec1-4757-bd52-215d7fc23319 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1283 microversion: 2.1 time: 0.770806 Sep 13 17:07:54.917359 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3226/6494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:54 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1283 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:55.029099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3225311f-f03f-461e-9bdb-fedaa06b6401 req-4e9d725e-2e29-4dc6-b2e3-6c3518b5b4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:55.057241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3225311f-f03f-461e-9bdb-fedaa06b6401 req-4e9d725e-2e29-4dc6-b2e3-6c3518b5b4ce service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:55.061385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3225311f-f03f-461e-9bdb-fedaa06b6401 req-4e9d725e-2e29-4dc6-b2e3-6c3518b5b4ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:55.061987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3225311f-f03f-461e-9bdb-fedaa06b6401 req-4e9d725e-2e29-4dc6-b2e3-6c3518b5b4ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:55.109314 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3225311f-f03f-461e-9bdb-fedaa06b6401 req-4e9d725e-2e29-4dc6-b2e3-6c3518b5b4ce service nova] Creating event network-changed:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:07:55.125577 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3225311f-f03f-461e-9bdb-fedaa06b6401 req-4e9d725e-2e29-4dc6-b2e3-6c3518b5b4ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100758 Sep 13 17:07:55.126244 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3269/6495] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:55.940700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:55.941693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:55.962213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:55.962730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:55.966726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:55.970307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:55.970908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:55.972513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:56.678898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:56.688971 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a3aeffb-4660-4f7a-9881-11d673ffb9fa tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1283 microversion: 2.1 time: 0.754897 Sep 13 17:07:56.691458 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3227/6496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:55 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1283 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:57.711859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:57.716530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:57.717558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:57.738207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:57.750631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:57.751252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:57.753350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:57.754000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:57.754539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:58.049147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:58.062212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06189716-6a57-4879-af7b-56f4ef2697bb tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1283 microversion: 2.1 time: 0.350637 Sep 13 17:07:58.063465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3270/6497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:57 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1283 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:58.820214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:58.821734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:07:59.100902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:59.102793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:07:59.131022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a445c39f-ae8b-40d5-8aba-d41b878ab1dd tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-423923408", "availability_zone": "foo_zone"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:59.139176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.aggregate [None req-a445c39f-ae8b-40d5-8aba-d41b878ab1dd tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Generated uuid ac21605e-1813-49f7-a39b-06695d35967b for aggregate {{(pid=122327) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 13 17:07:59.147370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:59.147966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:59.148425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:59.158900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:59.158900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:59.158900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:59.236982 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a445c39f-ae8b-40d5-8aba-d41b878ab1dd tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.421381 Sep 13 17:07:59.238226 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3228/6498] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Sep 13 17:07:58 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:59.256589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77a92faf-d6b1-414d-ab3a-99260afd4ae3 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:59.312578 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77a92faf-d6b1-414d-ab3a-99260afd4ae3 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.066415 Sep 13 17:07:59.314004 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3229/6499] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 17:07:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:59.326867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:59.335957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:59.336957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:59.337578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:59.338587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:59.343597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:59.344278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:07:59.400430 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3caa2075-0706-42e0-818e-e13fb549de7b tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066136 Sep 13 17:07:59.407718 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3230/6500] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Sep 13 17:07:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:07:59.423909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c758b0b-5074-4bff-b7af-8ac18febb2bf tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:07:59.449864 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c758b0b-5074-4bff-b7af-8ac18febb2bf tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.039107 Sep 13 17:07:59.450448 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3231/6501] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Sep 13 17:07:59 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:07:59.473903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d6e4d30-f48e-499a-b270-f1c00652e23e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-857467-1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:07:59.489313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:07:59.497563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c41f7f5d-8066-4f70-b55c-aaf2f8159af4 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1283 microversion: 2.1 time: 0.410419 Sep 13 17:07:59.502285 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3271/6502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:07:59 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1283 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:07:59.509413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d6e4d30-f48e-499a-b270-f1c00652e23e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:07:59.510249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d6e4d30-f48e-499a-b270-f1c00652e23e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:07:59.510814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d6e4d30-f48e-499a-b270-f1c00652e23e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:00.004638 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d6e4d30-f48e-499a-b270-f1c00652e23e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.542033 Sep 13 17:08:00.006379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3232/6503] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 17:07:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:08:00.019776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92995e61-2cf8-473b-ae33-1a39189cee51 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:00.038195 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92995e61-2cf8-473b-ae33-1a39189cee51 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.024516 Sep 13 17:08:00.041361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3272/6504] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 17:08:00 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:00.054155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a3d30aa2-973b-4db4-baff-a84e45ca585e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1981270710", "availability_zone": "foo_zone"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:00.182411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a3d30aa2-973b-4db4-baff-a84e45ca585e tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.132860 Sep 13 17:08:00.192338 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3233/6505] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Sep 13 17:08:00 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:00.196958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2d16f2c-d58a-4a57-917c-4d1b6986c2e9 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:00.254980 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2d16f2c-d58a-4a57-917c-4d1b6986c2e9 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.062445 Sep 13 17:08:00.255984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3273/6506] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 17:08:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:08:00.269342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ad35791-53e9-469f-808a-ba695757ac22 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:00.286622 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ad35791-53e9-469f-808a-ba695757ac22 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.022451 Sep 13 17:08:00.298357 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3234/6507] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Sep 13 17:08:00 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:00.310256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b103f91-c84a-4156-ab1f-d6455998e37c tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-857467-1"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:00.326237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b103f91-c84a-4156-ab1f-d6455998e37c tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:00.338611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b103f91-c84a-4156-ab1f-d6455998e37c tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:00.339304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b103f91-c84a-4156-ab1f-d6455998e37c tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:00.528264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:00.528984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:00.542071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:00.542720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:00.544510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:00.546775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:00.547569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:00.549908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:00.716582 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b103f91-c84a-4156-ab1f-d6455998e37c tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.410236 Sep 13 17:08:00.718237 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3274/6508] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Sep 13 17:08:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:00.730312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-941d0666-b725-432a-8176-e51e2b803678 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:00.794646 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-941d0666-b725-432a-8176-e51e2b803678 tempest-TestAggregatesBasicOps-839819457 tempest-TestAggregatesBasicOps-839819457-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.066769 Sep 13 17:08:00.797125 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3275/6509] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 17:08:00 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 13 17:08:00.872249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:00.880944 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e19e6e55-c424-4ade-8f7c-2fa719567f53 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1287 microversion: 2.1 time: 0.357624 Sep 13 17:08:00.883006 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3235/6510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:00 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1287 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:01.912677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:01.913301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:01.923204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:01.923900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:01.924347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:01.925346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:01.925814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:01.926375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:02.173651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:02.183896 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fad04122-b044-44cc-8227-0cfcf9a8ea91 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.277752 Sep 13 17:08:02.202299 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3276/6511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:01 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:03.216965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:03.218610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:03.267877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:03.269457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:03.271707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:03.275252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:03.277582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:03.285094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:04.374868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:04.383854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4cbd706f-a6b4-4d49-b602-eba6d54ed8dd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 1.172821 Sep 13 17:08:04.392493 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3236/6512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:03 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:05.434518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:05.436439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:05.454366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:05.455153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:05.456761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:05.463880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:05.466787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:05.467482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:05.819892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:05.833790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97bc21d7-8e1a-40a9-8939-f67c5eaa3269 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.400989 Sep 13 17:08:05.835229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3277/6513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:05 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:06.862950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:06.865237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:06.926353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:06.928559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:06.929503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:06.930475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:06.931391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:06.933154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:07.616765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:07.628829 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e436fe56-6d64-4f7d-ab10-423bdd500cda tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.771558 Sep 13 17:08:07.630080 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3237/6514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:06 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:08.656677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:08.657305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:08.673881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:08.674515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:08.674970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:08.675702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:08.676166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:08.676603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:09.592084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:09.602397 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b87ae20b-8cd9-46d9-85fd-23da546e2dcd tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.950470 Sep 13 17:08:09.603106 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3278/6515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:08 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:10.626090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:10.626782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:10.631488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:10.636796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:10.649176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:10.651330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:10.658969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:10.660403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:10.661068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:11.339872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:11.373729 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d3358a7-562a-4c8e-95d5-16ede2d8d68b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.746539 Sep 13 17:08:11.374431 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3238/6516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:10 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:12.044853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-46c6aa9d-a4b0-48a8-9dd3-a1d3784cd3d6 req-61e88796-dbac-41c7-a4bd-03caf871b862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "name": "network-vif-plugged", "status": "completed", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:12.060927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-46c6aa9d-a4b0-48a8-9dd3-a1d3784cd3d6 req-61e88796-dbac-41c7-a4bd-03caf871b862 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:12.067725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-46c6aa9d-a4b0-48a8-9dd3-a1d3784cd3d6 req-61e88796-dbac-41c7-a4bd-03caf871b862 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:12.068380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-46c6aa9d-a4b0-48a8-9dd3-a1d3784cd3d6 req-61e88796-dbac-41c7-a4bd-03caf871b862 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:12.123959 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-46c6aa9d-a4b0-48a8-9dd3-a1d3784cd3d6 req-61e88796-dbac-41c7-a4bd-03caf871b862 service nova] Creating event network-vif-plugged:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:08:12.135452 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-46c6aa9d-a4b0-48a8-9dd3-a1d3784cd3d6 req-61e88796-dbac-41c7-a4bd-03caf871b862 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094237 Sep 13 17:08:12.140460 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3279/6517] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:12.403205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:12.403838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:12.430522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:12.431071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:12.431532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:12.432292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:12.432765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:12.433204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:12.862075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:12.870826 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-085a81e7-163c-463a-921e-cdf5985159d7 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.471637 Sep 13 17:08:12.875520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3239/6518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:12 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:13.897906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:13.900655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:13.915541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:13.936456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:13.937068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:13.940457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:13.941590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:13.942291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:13.946042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:13.976587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=51 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:14.468333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:14.492483 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f8a2227-0d66-4f9a-9aa5-bb2305bac85a tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1271 microversion: 2.1 time: 0.599429 Sep 13 17:08:14.493183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3280/6519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:13 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1271 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:15.520989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:15.521622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:15.524585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:15.530399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:15.531302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:15.531919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:15.532829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:15.533293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:15.534490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:15.538295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=63 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:15.731856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:15.758039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6f69dc07-bad8-4594-a278-96af2e961620 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1460 microversion: 2.1 time: 0.227268 Sep 13 17:08:15.760331 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3240/6520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:15 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1460 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:15.782923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:15.785016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:15.792508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:15.793474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:15.800033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:15.801012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:15.802075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:15.802722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:16.023774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:16.037333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-702f4c18-67e4-420b-8dee-77b17a3c5035 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1460 microversion: 2.1 time: 0.257084 Sep 13 17:08:16.040461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3281/6521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:15 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1460 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:18.959865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96f5d160-27a7-4e41-b34c-742c8321a232 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: .version_select at 0x7fbeaff33670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-848108569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjSILyEYl6mSzGP5J8Ej0i0DIPPrc6Q9b48wtMHdxue15X4Atrmytmt+UE4gN0VkOMiSGnExhm1NeCVd6kkSUAa33BhV77dbHjOzQHQ0uYAlLe2qzSb51Np7BHiezykfw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:18.982413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-96f5d160-27a7-4e41-b34c-742c8321a232 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:08:18.989573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-96f5d160-27a7-4e41-b34c-742c8321a232 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:08:19.022729 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96f5d160-27a7-4e41-b34c-742c8321a232 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.445433 Sep 13 17:08:19.024031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3241/6522] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:08:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:19.651698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-db1a7dc0-130a-4efb-8bba-5a976d515276 req-ca43c23a-0b90-4a41-9d90-e2d2f0fe4b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:19.683606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db1a7dc0-130a-4efb-8bba-5a976d515276 req-ca43c23a-0b90-4a41-9d90-e2d2f0fe4b46 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:19.685569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db1a7dc0-130a-4efb-8bba-5a976d515276 req-ca43c23a-0b90-4a41-9d90-e2d2f0fe4b46 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:19.686214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db1a7dc0-130a-4efb-8bba-5a976d515276 req-ca43c23a-0b90-4a41-9d90-e2d2f0fe4b46 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:19.722009 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-db1a7dc0-130a-4efb-8bba-5a976d515276 req-ca43c23a-0b90-4a41-9d90-e2d2f0fe4b46 service nova] Creating event network-changed:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:08:19.733376 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-db1a7dc0-130a-4efb-8bba-5a976d515276 req-ca43c23a-0b90-4a41-9d90-e2d2f0fe4b46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212959 Sep 13 17:08:19.737855 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3282/6523] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:08:21.755700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}, {"name": "network-changed", "server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:21.771161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:21.777731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:21.778393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:21.810063 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] Creating event network-changed:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:08:21.810949 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] Creating event network-changed:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:08:21.818978 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-da3069ab-b645-4450-bf17-66afcd07a943 req-14207e1e-a959-42ff-b537-eee3f2c09dc8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066193 Sep 13 17:08:21.821195 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3242/6524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:32.164328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:32.165091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=13 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:32.170945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1535742021", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "4bad9ced-01de-4134-9e27-b8b974a1b64b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-848108569", "security_groups": [{"name": "tempest-secgroup-smoke-755302329"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:32.311830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] validate_networks() for [('4bad9ced-01de-4134-9e27-b8b974a1b64b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:08:32.938042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:08:32.938822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:08:32.940004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:08:32.940503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:08:32.941433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:08:32.953888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:32.954605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:32.955276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:32.956187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:32.956814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:32.957435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:32.978294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:08:32.984782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:08:33.001928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:08:33.006489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:08:33.101562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c6ed6d9-3e74-48c0-aceb-ac5085e7d29f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.939598 Sep 13 17:08:33.103980 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3283/6525] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:08:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 17:08:33.113553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:33.114553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:33.115317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=7 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:33.119956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d1694ee8-86fd-4038-a8cc-460b650c044b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:33.120682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d1694ee8-86fd-4038-a8cc-460b650c044b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:33.217959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d1694ee8-86fd-4038-a8cc-460b650c044b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:33.227653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d1694ee8-86fd-4038-a8cc-460b650c044b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1266 microversion: 2.1 time: 0.115916 Sep 13 17:08:33.229116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3243/6526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:33 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:08:34.000207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:34.001382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:34.011865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:34.012611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:34.014646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:34.015713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:34.016340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:34.017014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:34.059436 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e58eaeb7-8070-4357-bac2-e2fc8f8c23cf tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/ips" status: 200 len: 151 microversion: 2.20 time: 0.062087 Sep 13 17:08:34.068071 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3284/6527] 10.222.0.61 () {60 vars in 1289 bytes} [Tue Sep 13 17:08:33 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:08:34.257136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:34.257752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:34.281807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:34.282338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:34.282842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:34.299730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:34.302246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:34.304177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:34.615913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:34.628428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5027b378-d852-45da-8a0f-7ed5b3856fd8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1318 microversion: 2.1 time: 0.379498 Sep 13 17:08:34.649985 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3244/6528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:34 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:35.685162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:35.685818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:35.711413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:35.712357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:35.712995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:35.716809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:35.728468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:35.729310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:36.080176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:36.119706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10fcd92e-423c-4525-81b2-397b472c0e63 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1324 microversion: 2.1 time: 0.434067 Sep 13 17:08:36.120706 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3285/6529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:35 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:37.155546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:37.156837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:37.185456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:37.186187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:37.186876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:37.191640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:37.192920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:37.193652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:37.529677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:37.546387 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-087b7a35-a0fa-4148-9501-f2494b8d3add tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.400734 Sep 13 17:08:37.549117 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3245/6530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:37 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:37.597712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:37.598268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:37.607524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:37.608025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:37.608468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:37.609184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:37.609640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:37.610094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:37.688357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lazy-loading 'flavor' on Instance uuid 7727f00e-cc39-47eb-8a10-bcae96e85e24 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:08:38.136791 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34a01d27-b288-44df-b083-14f588af75df tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/action" status: 202 len: 0 microversion: 2.20 time: 0.543438 Sep 13 17:08:38.146805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:38.147428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:38.157155 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3286/6531] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 17:08:37 2022] POST /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:08:38.161366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:38.162619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:38.164532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:38.167615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:38.169631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:38.171069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:38.419662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:38.437455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-581c4424-a884-4441-853a-de320001a189 req-8288b1aa-1b17-4968-9b9d-846731ebd579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:38.440691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:38.444828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:38.448859 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ddcb419-5745-440f-b502-f7099507c83e tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.304837 Sep 13 17:08:38.449984 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3246/6532] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:38 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:38.486948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-581c4424-a884-4441-853a-de320001a189 req-8288b1aa-1b17-4968-9b9d-846731ebd579 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:38.495046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-581c4424-a884-4441-853a-de320001a189 req-8288b1aa-1b17-4968-9b9d-846731ebd579 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:38.495726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-581c4424-a884-4441-853a-de320001a189 req-8288b1aa-1b17-4968-9b9d-846731ebd579 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:38.515226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-581c4424-a884-4441-853a-de320001a189 req-8288b1aa-1b17-4968-9b9d-846731ebd579 service nova] Creating event network-changed:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h2-857467-1 Sep 13 17:08:38.520378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-581c4424-a884-4441-853a-de320001a189 req-8288b1aa-1b17-4968-9b9d-846731ebd579 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101503 Sep 13 17:08:38.521773 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3287/6533] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:38.582248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:38.582955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:38.594439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:38.595038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:38.597433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:38.598469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:38.598920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:38.599450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:38.891004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:38.904507 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58951bf8-1469-4be5-9868-8e8c39302d17 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.329010 Sep 13 17:08:38.918280 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3247/6534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:38 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:39.483835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:39.484852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:39.515238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:39.519796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:39.520721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:39.527637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:39.528120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:39.528577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:39.878753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:39.900136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:39.903458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:39.907131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7020224a-7f73-4db4-a6f0-94d14411c5ce tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.429523 Sep 13 17:08:39.911585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3288/6535] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:39 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:39.933251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:39.933984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:39.950411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:39.951052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:39.951590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:39.952393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:39.952940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:39.953450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:40.380365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-371511473", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "5bc3b562-e0b7-4105-a243-659e611b9d98"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:40.443868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:40.448310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] validate_networks() for [('5bc3b562-e0b7-4105-a243-659e611b9d98', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:08:40.455376 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0620d39c-8982-4816-a82d-0c93b3b3d515 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.526090 Sep 13 17:08:40.470792 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3248/6536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:39 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:40.944845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:40.948095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:08:40.948500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:08:40.948983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:08:40.949390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:08:40.949802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:08:40.950383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:40.959509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:40.960263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:40.960861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:40.961763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:40.962441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:40.963032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:40.966699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:40.967335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:40.970917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:40.972092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:40.972687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:40.974356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:40.989605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Getting quotas for project 683610271550498db921cba35a54c137. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:08:40.996609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Getting quotas for user 4acdbedfa10646fdae3304874424115f and project 683610271550498db921cba35a54c137. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:08:41.035447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:08:41.038479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:08:41.095353 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a39f9ce-fd3e-4a39-972b-39ed54c70bd3 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901271 Sep 13 17:08:41.102969 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3289/6537] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:08:41.109915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6df8a022-aa79-416a-8b20-d6fced9cbe62 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:41.110824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6df8a022-aa79-416a-8b20-d6fced9cbe62 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:41.212108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6df8a022-aa79-416a-8b20-d6fced9cbe62 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:41.234080 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6df8a022-aa79-416a-8b20-d6fced9cbe62 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1213 microversion: 2.1 time: 0.127896 Sep 13 17:08:41.247667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3290/6538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:41 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:41.480404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:41.481092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:41.500576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:41.504943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:41.518971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:41.520084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:41.520989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:41.523390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:41.525490 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f45e21d6-4364-4794-a548-04edc6a47c2b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.587984 Sep 13 17:08:41.527943 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3249/6539] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:40 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:41.528508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:41.529047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:41.529501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:41.832399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:41.842463 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0ca29379-dad2-42b9-aec1-32f8b79071bb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.366972 Sep 13 17:08:41.844360 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3291/6540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:41 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:42.270230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:42.275221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:42.295785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:42.297015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:42.297916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:42.299325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:42.301020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:42.301703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:42.522607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:42.540583 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cde4892a-0441-4ba9-9618-02953bf010fb tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1265 microversion: 2.1 time: 0.284375 Sep 13 17:08:42.560687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:42.562667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:42.567184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3250/6541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:42 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:42.575367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:42.576577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:42.577698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:42.581503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:42.582412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:42.584220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:42.873100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:42.873273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:42.874092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:42.894677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:42.895356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:42.895488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:42.896105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:42.897360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:42.898054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:42.898381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:42.899808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:42.901850 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2cd962df-0d1f-4182-a669-d4d37dda5aa8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.350317 Sep 13 17:08:42.904186 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3292/6542] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:42 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:43.227309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:43.346711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:43.359436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-815ff7dc-2a4f-448d-8308-1fa5d15adaba tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.491333 Sep 13 17:08:43.361769 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3251/6543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:42 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:43.572125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:43.572850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:43.590443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:43.591593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:43.592235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:43.600102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:43.600656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:43.601459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:43.753614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:43.763001 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-381473ae-2215-4e6c-a965-bb7de73bc477 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1271 microversion: 2.1 time: 0.195454 Sep 13 17:08:43.763460 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3293/6544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:43 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:43.934392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:43.935749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:43.947794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:43.949268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:43.950305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:43.951852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:43.952681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:43.953318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:44.149303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:44.164506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:44.167721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:44.169847 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88af59a7-546a-4140-90f1-56d1fa88d3d2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.242592 Sep 13 17:08:44.170977 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3252/6545] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:43 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:44.415301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:44.415948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:44.440955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:44.441940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:44.443925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:44.444687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:44.447650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:44.449847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:44.652278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b844b08c-65b8-483b-954f-161666a28f27 req-70f2ff5d-1aa7-4034-a39a-1ee622e7cc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "name": "network-vif-plugged", "status": "completed", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:44.680011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b844b08c-65b8-483b-954f-161666a28f27 req-70f2ff5d-1aa7-4034-a39a-1ee622e7cc6b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:44.684728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b844b08c-65b8-483b-954f-161666a28f27 req-70f2ff5d-1aa7-4034-a39a-1ee622e7cc6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:44.688201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b844b08c-65b8-483b-954f-161666a28f27 req-70f2ff5d-1aa7-4034-a39a-1ee622e7cc6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:44.739092 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b844b08c-65b8-483b-954f-161666a28f27 req-70f2ff5d-1aa7-4034-a39a-1ee622e7cc6b service nova] Creating event network-vif-plugged:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h2-857467-1 Sep 13 17:08:44.749726 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b844b08c-65b8-483b-954f-161666a28f27 req-70f2ff5d-1aa7-4034-a39a-1ee622e7cc6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107035 Sep 13 17:08:44.754441 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3253/6546] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:08:44.794901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:44.796352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:44.816751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:44.818384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:44.819869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:44.821938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:44.823481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:44.824310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:44.968444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:44.981302 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bff26d57-5fe0-4222-a18a-f07d1504f35a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.591860 Sep 13 17:08:44.981959 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3294/6547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:44 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:45.205410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:45.207147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:45.266011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:45.274339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:45.275127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:45.283304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:45.287977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:45.288644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:45.323654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:45.340514 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f1b53a7-9a2f-4b61-b8a0-8eabc0f5782e tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.553842 Sep 13 17:08:45.390280 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3254/6548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:44 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:46.008529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:46.009145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:46.022175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:46.022682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:46.023123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:46.030956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:46.033752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:46.034429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:46.197309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:46.223729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:46.223729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:46.223729 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6a93f4d-a7e8-407f-aa61-82ab8f26488f tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 1.022316 Sep 13 17:08:46.225923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3295/6549] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:45 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:08:46.377574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:46.378802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:46.391287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:46.394365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:46.396436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:46.399231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:46.399953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:46.402393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:46.421777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:46.434903 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49bfd815-f001-4761-9d5c-7cc244fd9114 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1391 microversion: 2.1 time: 0.430295 Sep 13 17:08:46.436379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3255/6550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:46 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1391 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:46.598508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e24a4d60-65f2-4d7f-b753-13b932ad1f1c req-93d7793a-ae79-4981-a3b1-a5fae67e5a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4", "tag": "7762a6bb-4e51-4f4b-bf7d-7ec51028d8b6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:46.615733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e24a4d60-65f2-4d7f-b753-13b932ad1f1c req-93d7793a-ae79-4981-a3b1-a5fae67e5a13 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:46.616564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e24a4d60-65f2-4d7f-b753-13b932ad1f1c req-93d7793a-ae79-4981-a3b1-a5fae67e5a13 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:46.617160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e24a4d60-65f2-4d7f-b753-13b932ad1f1c req-93d7793a-ae79-4981-a3b1-a5fae67e5a13 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:46.638705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e24a4d60-65f2-4d7f-b753-13b932ad1f1c req-93d7793a-ae79-4981-a3b1-a5fae67e5a13 service nova] Creating event network-changed:7762a6bb-4e51-4f4b-bf7d-7ec51028d8b6 for instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 on n-h1-857467-1 Sep 13 17:08:46.647409 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e24a4d60-65f2-4d7f-b753-13b932ad1f1c req-93d7793a-ae79-4981-a3b1-a5fae67e5a13 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053274 Sep 13 17:08:46.648700 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3256/6551] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:08:46.834411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:46.853500 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bde690a-1409-465a-a505-d1edff4317b5 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.481647 Sep 13 17:08:46.854659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3296/6552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:46 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:08:47.250121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:47.252227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:47.260031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:47.260527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:47.261112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:47.262055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:47.262527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:47.262958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:47.463649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:47.464317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:47.476844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:47.477374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:47.478197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:47.478948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:47.480873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:47.481407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:47.729517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:47.739178 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7afbadd-f511-422f-a798-0c62b7773a0e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1562 microversion: 2.1 time: 0.280998 Sep 13 17:08:47.740617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3297/6553] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:47 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1562 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:47.765322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:47.766320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:47.774950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:47.776285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:47.777122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:47.778142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:47.778983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:47.779583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:47.957270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:47.967012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:47.967455 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d9fdb85-51ab-45da-b0e9-66488bbecf62 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1562 microversion: 2.1 time: 0.206263 Sep 13 17:08:47.983946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:47.986427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:47.988023 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1567a89d-b0b2-479a-8e80-5a3d48b91e54 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.742721 Sep 13 17:08:47.989991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3298/6554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:47 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:47.996065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:47.996839 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3257/6555] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:47 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:47.997277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:48.009432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:48.010232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:48.010846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:48.014906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:48.015674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:48.016290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:48.297468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:48.309143 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66d1f9f1-8528-4f94-93d1-567ec7157aff tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.317650 Sep 13 17:08:48.314402 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3299/6556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:47 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:49.026206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:49.028073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:49.035916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:49.036696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:49.037480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:49.038545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:49.039240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:49.039888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:49.294186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:49.309065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:49.315155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:49.316665 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a6c83629-4ad9-4e54-9e4d-f21467b8d1e2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.294627 Sep 13 17:08:49.317372 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3258/6557] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:49 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:49.341492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:49.342481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:49.356718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:49.359945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:49.362524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:49.364461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:49.366538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:49.366927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:49.770464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:49.774829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:49.787497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7b65fad-dfa7-4206-8138-1e90f6f5b921 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.453960 Sep 13 17:08:49.809207 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3300/6558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:49 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:50.348652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:50.350008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:50.366446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:50.367503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:50.368141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:50.371205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:50.372161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:50.372977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:50.649567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:50.664756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:50.668753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:50.672837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0b26327-0413-4338-a710-e5950e486900 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1744 microversion: 2.20 time: 0.328444 Sep 13 17:08:50.676796 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3259/6559] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:50 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1744 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:50.817196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:50.818457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:50.833579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:50.834369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:50.834970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:50.836633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:50.839686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:50.844249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:50.978397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:51.228251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:51.458745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:51.469206 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2aca559-3a2b-42ca-b2a1-f27bfa88228a tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.656502 Sep 13 17:08:51.475175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3301/6560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:50 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:51.707581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:51.708210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:51.714149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:51.715507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:51.725079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:51.725581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:51.726050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:51.729712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:51.730246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:51.730686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:51.731763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:51.732697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:51.733347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:51.734022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:51.734615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:51.735232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:51.957058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:51.975511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:51.977411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:51.981005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-babdccd4-3ee3-45e3-9ff9-dab8bb8977e8 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1744 microversion: 2.20 time: 0.277680 Sep 13 17:08:51.982101 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3302/6561] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:51 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1744 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:51.995516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-84f9e47d-35eb-452b-a588-b3784b392bb3 req-c6019570-c021-4c17-ade6-00023148217f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:52.023495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-84f9e47d-35eb-452b-a588-b3784b392bb3 req-c6019570-c021-4c17-ade6-00023148217f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:52.024278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-84f9e47d-35eb-452b-a588-b3784b392bb3 req-c6019570-c021-4c17-ade6-00023148217f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:52.024991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-84f9e47d-35eb-452b-a588-b3784b392bb3 req-c6019570-c021-4c17-ade6-00023148217f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:52.037529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:52.050106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f14084e-e3c9-49dc-8a65-1654fcea7d3c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1562 microversion: 2.1 time: 0.357964 Sep 13 17:08:52.074613 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3260/6562] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:51 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1562 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:52.074822 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-84f9e47d-35eb-452b-a588-b3784b392bb3 req-c6019570-c021-4c17-ade6-00023148217f service nova] Creating event network-changed:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h2-857467-1 Sep 13 17:08:52.085339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-84f9e47d-35eb-452b-a588-b3784b392bb3 req-c6019570-c021-4c17-ade6-00023148217f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098091 Sep 13 17:08:52.086605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3303/6563] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:52.544838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:52.546170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:52.575100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:52.582875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:52.583716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:52.588227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:52.589171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:52.593899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:52.848967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3fab3859-1244-4564-be21-9b0ecc7c5ceb req-1d5f661b-2cac-48a3-a49f-9d076ed2d80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "name": "network-vif-plugged", "status": "completed", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:52.885883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3fab3859-1244-4564-be21-9b0ecc7c5ceb req-1d5f661b-2cac-48a3-a49f-9d076ed2d80e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:52.889469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3fab3859-1244-4564-be21-9b0ecc7c5ceb req-1d5f661b-2cac-48a3-a49f-9d076ed2d80e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:52.890579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3fab3859-1244-4564-be21-9b0ecc7c5ceb req-1d5f661b-2cac-48a3-a49f-9d076ed2d80e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:52.947479 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3fab3859-1244-4564-be21-9b0ecc7c5ceb req-1d5f661b-2cac-48a3-a49f-9d076ed2d80e service nova] Creating event network-vif-plugged:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h2-857467-1 Sep 13 17:08:52.957224 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3fab3859-1244-4564-be21-9b0ecc7c5ceb req-1d5f661b-2cac-48a3-a49f-9d076ed2d80e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114949 Sep 13 17:08:52.958999 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3304/6564] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:53.019340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:53.020320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:53.036421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:53.036906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:53.037350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:53.039927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:53.040396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:53.040829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:53.144796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:53.156119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:08:53.159807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed3d72c3-9bcb-44a1-a356-66280939dc41 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.653995 Sep 13 17:08:53.180977 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3261/6565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:52 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:53.469396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:53.490205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:53.495987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:53.497512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c31bc7c3-1cba-423b-9135-3d0a81a30ca1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1744 microversion: 2.20 time: 0.483211 Sep 13 17:08:53.498673 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3305/6566] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:53 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1744 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:54.190056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:54.190764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:54.209909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.211069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.213189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:54.215628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.217645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.218495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:54.420279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:54.430003 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d0f0cc45-914a-4290-ab19-7844f4c39550 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.245124 Sep 13 17:08:54.431148 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3262/6567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:54 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:54.525586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:54.526701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:54.533874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.539876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.540498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:54.541464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.542166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.542871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:54.870270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:54.870721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:54.893388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:54.903517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.904034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.906683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:54.908970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.909463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.912929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:54.916525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:54.918111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:54.919842 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e59a5f4-6d34-4ba6-826a-3a7aec276846 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.399593 Sep 13 17:08:54.920495 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3306/6568] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:54 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:54.951032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3eb16e64-9c10-4cc4-88fd-603318b82167 req-fd193713-ac3d-4d56-aa0f-ff29d3ac9fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:54.977193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:08:54.981174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3eb16e64-9c10-4cc4-88fd-603318b82167 req-fd193713-ac3d-4d56-aa0f-ff29d3ac9fd6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:54.981731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3eb16e64-9c10-4cc4-88fd-603318b82167 req-fd193713-ac3d-4d56-aa0f-ff29d3ac9fd6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:54.982202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3eb16e64-9c10-4cc4-88fd-603318b82167 req-fd193713-ac3d-4d56-aa0f-ff29d3ac9fd6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.007445 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3eb16e64-9c10-4cc4-88fd-603318b82167 req-fd193713-ac3d-4d56-aa0f-ff29d3ac9fd6 service nova] Creating event network-changed:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:08:55.019670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3eb16e64-9c10-4cc4-88fd-603318b82167 req-fd193713-ac3d-4d56-aa0f-ff29d3ac9fd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097916 Sep 13 17:08:55.024160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3307/6569] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:55.034536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f9ff8b19-7029-4424-acce-436ba16ceab2 req-a0889e62-031c-436d-a704-2e62d59338f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4", "name": "network-vif-plugged", "status": "completed", "tag": "7762a6bb-4e51-4f4b-bf7d-7ec51028d8b6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:55.068727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9ff8b19-7029-4424-acce-436ba16ceab2 req-a0889e62-031c-436d-a704-2e62d59338f4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.069717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9ff8b19-7029-4424-acce-436ba16ceab2 req-a0889e62-031c-436d-a704-2e62d59338f4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.072835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9ff8b19-7029-4424-acce-436ba16ceab2 req-a0889e62-031c-436d-a704-2e62d59338f4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.098061 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f9ff8b19-7029-4424-acce-436ba16ceab2 req-a0889e62-031c-436d-a704-2e62d59338f4 service nova] Creating event network-vif-plugged:7762a6bb-4e51-4f4b-bf7d-7ec51028d8b6 for instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 on n-h1-857467-1 Sep 13 17:08:55.107665 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f9ff8b19-7029-4424-acce-436ba16ceab2 req-a0889e62-031c-436d-a704-2e62d59338f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080993 Sep 13 17:08:55.112922 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0cc698b-d027-477d-bdf2-2e206273be1b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 204 len: 0 microversion: 2.1 time: 0.251667 Sep 13 17:08:55.116035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3263/6570] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:08:54 2022] DELETE /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:08:55.117103 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3308/6571] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:08:55.124297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:55.124837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:55.144632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.145144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.145655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.146583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.147126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.147573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.349467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:55.365417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2d0671b9-53ed-487c-8d13-a32004fc06ab tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1585 microversion: 2.1 time: 0.245712 Sep 13 17:08:55.366798 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3264/6572] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:55 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1585 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:08:55.457283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:55.460285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:55.472735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.474856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.475304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.476765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.478648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.479268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.775016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:55.786354 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7bf8affc-9406-4a99-b3f0-7c40bd640df0 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.334380 Sep 13 17:08:55.787152 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3309/6573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:55 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:55.952678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:55.953465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:55.961817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.962344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.962895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:55.963826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:55.964299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:55.964721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:56.233528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:56.244955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:56.247150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:56.248640 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-81a4378e-7af0-451f-a715-43249f4f87a4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.303899 Sep 13 17:08:56.249889 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3265/6574] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:55 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:56.395527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:56.396158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:56.408660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:56.409176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:56.414611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:56.415669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:56.416514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:56.417223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:56.645553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:56.654735 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-443ddba4-460e-46eb-90f6-e6ac4e9c91bc tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1585 microversion: 2.1 time: 0.263190 Sep 13 17:08:56.677655 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3310/6575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:56 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1585 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:56.812662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:56.817854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:56.827785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:56.828496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:56.829217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:56.830337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:56.831485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:56.832088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:57.010598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:57.026305 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2e5ff6f6-6168-46eb-b298-acfe175aac5f tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.217753 Sep 13 17:08:57.027205 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3266/6576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:56 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:57.280176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:57.280941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:57.288228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:57.288994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:57.289791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:57.291107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:57.291829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:57.292510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:57.460628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:57.474579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:57.477395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:57.479105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9d68006-1e56-48c1-aec0-c7de4f769795 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.203134 Sep 13 17:08:57.479805 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3311/6577] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:57 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:57.786917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:57.788739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:57.806859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:57.807361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:57.807808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:57.808529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:57.808997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:57.809432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:58.052411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:58.053583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:58.080660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:58.085381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:58.085861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:58.087753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:58.088646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:58.093104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:58.093958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:58.098737 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-87b4c8fd-21c7-4ae4-acdc-5bd0e2023b80 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1466 microversion: 2.1 time: 0.322970 Sep 13 17:08:58.100022 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3267/6578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:57 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1466 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:58.471850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:58.482048 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a61b3ab-233e-4b0b-a824-7b71694b7a0b tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1313 microversion: 2.1 time: 0.435327 Sep 13 17:08:58.483904 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3312/6579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:58 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:58.509913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:58.511001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:58.523962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:58.524654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:58.525479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:58.526734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:58.527473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:58.529920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:58.706637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6e69ac52-e397-4225-81da-965e41fe4b6f req-95d232de-8cec-47fc-829d-ce75ea77be0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d513b8e6-ecfb-4b6a-9ba2-f2546025790b", "name": "network-vif-deleted", "tag": "7bef32b7-562e-4f95-b7b1-80e5493d2278"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:08:58.737616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e69ac52-e397-4225-81da-965e41fe4b6f req-95d232de-8cec-47fc-829d-ce75ea77be0a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:58.738144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e69ac52-e397-4225-81da-965e41fe4b6f req-95d232de-8cec-47fc-829d-ce75ea77be0a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:58.739232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e69ac52-e397-4225-81da-965e41fe4b6f req-95d232de-8cec-47fc-829d-ce75ea77be0a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:58.762439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6e69ac52-e397-4225-81da-965e41fe4b6f req-95d232de-8cec-47fc-829d-ce75ea77be0a service nova] Creating event network-vif-deleted:7bef32b7-562e-4f95-b7b1-80e5493d2278 for instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b on n-h1-857467-1 Sep 13 17:08:58.765816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:58.777673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:58.779449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:58.779641 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6e69ac52-e397-4225-81da-965e41fe4b6f req-95d232de-8cec-47fc-829d-ce75ea77be0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079499 Sep 13 17:08:58.780601 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3313/6580] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:08:58.781428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ebfedc18-64fc-4003-a509-eb05c0ebdc6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.276311 Sep 13 17:08:58.795085 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3268/6581] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:58 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:08:59.124433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:59.125142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:59.132558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:59.133097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:59.133603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:59.134630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:59.135100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:59.135572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:59.260221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:59.271029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce4546e5-5661-4143-a259-d05787f92984 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1230 microversion: 2.1 time: 0.151646 Sep 13 17:08:59.271789 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3314/6582] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:59 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1230 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:59.512510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:59.513059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:59.522491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:59.523095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:59.523659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:59.524552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:59.525130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:59.525676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:59.729104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:08:59.747933 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a25ffbd5-9b3b-40e1-bcbe-2dabc0fd3c58 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1498 microversion: 2.1 time: 0.238873 Sep 13 17:08:59.749944 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3269/6583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:08:59 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:08:59.815271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:08:59.818166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:08:59.843875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:59.845475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:59.846240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:08:59.847196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:08:59.847860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:08:59.848493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:00.097065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:00.107590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:00.109153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:00.110970 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d3c1dac-4369-4629-aeae-482b4630bcc6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.304914 Sep 13 17:09:00.111898 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3315/6584] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:08:59 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:00.296895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:00.299192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:00.309136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:00.309558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:00.310360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:00.312841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:00.314013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:00.314534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:00.415124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:00.424538 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-290c8fd3-fcfc-440f-82e6-dfc9613dcf58 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1230 microversion: 2.1 time: 0.133057 Sep 13 17:09:00.426505 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3270/6585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:00 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1230 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:01.149584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:01.151234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:01.159470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:01.161748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:01.163060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:01.163792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:01.164805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:01.165637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:01.166259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:01.405240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:01.416816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:01.426431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:01.427688 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dbdd48c0-35d8-42ca-9293-74d258a58269 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.287482 Sep 13 17:09:01.428595 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3316/6586] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:01 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:01.456423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:01.458021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:01.471313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:01.472045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:01.472661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:01.473923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:01.474556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:01.475170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:01.564424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:01.575701 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c51730bb-59df-4829-b301-a5c32f87ec5f tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1230 microversion: 2.1 time: 0.125232 Sep 13 17:09:01.576602 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3271/6587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:01 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:02.459333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:02.460843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:02.470129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:02.471549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:02.472244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:02.473224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:02.473948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:02.474604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:02.600757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:02.602231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:02.610992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:02.611920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:02.612645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:02.613596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:02.614511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:02.615222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:02.713007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:02.726316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-587ff3f9-2dcb-436d-97c7-3894a4ef54f1 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1230 microversion: 2.1 time: 0.130374 Sep 13 17:09:02.727173 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3272/6588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:02 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1230 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:02.759193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:02.770221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:02.772074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:02.773697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebaabe31-64f0-4c57-85cf-429c401cd2d5 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.318286 Sep 13 17:09:02.774947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3317/6589] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:02 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:09:03.752760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:03.754512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:03.757736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:03.770605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:03.771320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:03.773176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:03.774844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:03.775414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:03.777800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:03.805687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:03.806916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:03.826564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:03.827266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:03.830921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:03.831970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:03.832631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:03.833239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:04.087936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:04.090089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:04.112395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:04.113985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:04.115221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b5650972-1355-48c3-a94f-a8edc665493c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.313962 Sep 13 17:09:04.115803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3318/6590] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:03 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:04.116723 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b4df0d1-a5a3-45db-8bd2-0e66591a7d20 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1230 microversion: 2.1 time: 0.368280 Sep 13 17:09:04.124942 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3273/6591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:03 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1230 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:05.148031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:05.148566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:05.148991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:05.150471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:05.158380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:05.159181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:05.159825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:05.160773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:05.161435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:05.162084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:05.163198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:05.166099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:05.166575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:05.167471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:05.167956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:05.170396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:05.273726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:05.287057 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-158ccb28-b71e-46ed-b484-1458b8be61e3 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1230 microversion: 2.1 time: 0.142348 Sep 13 17:09:05.289720 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3274/6592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:05 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1230 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:05.440784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:05.451178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:05.453653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:05.454986 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5001d144-9c33-4925-9b7b-7351cd98ce14 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.313856 Sep 13 17:09:05.455954 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3319/6593] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:05 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:05.860911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:05.861721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:05.868800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:05.869540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:05.870077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:05.870986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:05.871613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:05.872205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:05.902401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:09:05.948569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:06.021846 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d298c4d1-989a-491e-b704-35f0cbfceb06 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 204 len: 0 microversion: 2.1 time: 0.164497 Sep 13 17:09:06.023539 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3275/6594] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:09:05 2022] DELETE /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:09:06.034943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:06.035831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:06.043471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.044005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.044658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.045534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.046197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.046834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.260544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:06.271103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:06.275639 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-65b6ff24-9c5d-48a2-ad19-54721e195ec2 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1504 microversion: 2.1 time: 0.247671 Sep 13 17:09:06.277049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3320/6595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:06 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:06.319636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:06.320350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:06.328269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.329435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.330464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.331369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.332002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.332602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.375656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.377101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.378226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.379295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lazy-loading 'fault' on Instance uuid d513b8e6-ecfb-4b6a-9ba2-f2546025790b {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:09:06.427800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afbe2c5a8de4698bc6be2a80729b2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d328d1be4291ac58f808835e8d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:06.436594 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-84a485bf-37c6-4634-8beb-009eb063f43c tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 200 len: 1235 microversion: 2.1 time: 0.121170 Sep 13 17:09:06.437551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3276/6596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:06 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 1235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:06.484111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:06.484830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:06.492171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.492875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.493506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.494426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:06.495050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:06.495647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:06.651455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:06.662637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:06.664509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:06.666152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2bf56075-28d1-460c-a215-3a5260d8ab48 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.186327 Sep 13 17:09:06.667373 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3321/6597] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:06 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:07.301396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:07.302193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:07.312582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:07.315008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:07.315710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:07.316643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:07.317289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:07.317921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:07.461477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:07.462894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] [instance: d513b8e6-ecfb-4b6a-9ba2-f2546025790b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:07.478658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:07.481359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:07.482036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:07.486048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:07.486821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:07.487568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:07.498767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:07.515245 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c079263c-54dc-4f2b-9d75-c8301b290381 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1504 microversion: 2.1 time: 0.219075 Sep 13 17:09:07.523793 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] HTTP exception thrown: Instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b could not be found. Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Request method failure captured: Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b HTTP/1.1 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILfWOlXTWGkPH4CrJtYmzVsyTsLtkJNIVGGwHsmjtCgADBNS3ImiyWVR3EClZY6G2rFdhdp97rGfkwQFI8_XpN4Fks4I0JFolkN61u8H-k8ygkrjjGGk6gP4DW0RIfjSyi_M_EI7NjHeE-N2RZMsIJ8x7gJdS1_0tyxH8SUSQNhZWRI Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: bdb0d328d1be4291ac58f808835e8d21 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBackupRestore-836746061 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bdb0d328d1be4291ac58f808835e8d21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bdb0d328d1be4291ac58f808835e8d21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bdb0d328d1be4291ac58f808835e8d21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bdb0d328d1be4291ac58f808835e8d21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBackupRestore-836746061 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: bdb0d328d1be4291ac58f808835e8d21 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBackupRestore-836746061 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBackupRestore-836746061-project Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 5afbe2c5a8de4698bc6be2a80729b2e4 Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBackupRestore-836746061-project Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b could not be found. Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'd513b8e6-ecfb-4b6a-9ba2-f2546025790b'} Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b could not be found. Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b could not be found. Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:09:07.528988 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b could not be found. Sep 13 17:09:07.533177 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:07.534966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3277/6598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:07 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:07.536730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Returning 404 to user: Instance d513b8e6-ecfb-4b6a-9ba2-f2546025790b could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:09:07.538395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7960b853-4fed-45fd-b9e7-c39545ca45b0 tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b" status: 404 len: 111 microversion: 2.1 time: 0.081257 Sep 13 17:09:07.539007 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3322/6599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:07 2022] GET /compute/v2.1/servers/d513b8e6-ecfb-4b6a-9ba2-f2546025790b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:09:07.695872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:07.696491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:07.714980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:07.715537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:07.715987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:07.716711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:07.717178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:07.717721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:07.865799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a705e87b-2b9d-4bb3-a0d9-fcecdb41c54b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] Calling method '.version_select at 0x7fbeb5843670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:07.903351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a705e87b-2b9d-4bb3-a0d9-fcecdb41c54b tempest-TestVolumeBackupRestore-836746061 tempest-TestVolumeBackupRestore-836746061-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1089343238" status: 202 len: 0 microversion: 2.1 time: 0.041388 Sep 13 17:09:07.903959 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3323/6600] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 17:09:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1089343238 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:09:07.961956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:07.978398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:07.983554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:07.986331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fedde122-00ac-4fd5-b693-a7b5ac00181d tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.293359 Sep 13 17:09:08.004352 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3278/6601] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:07 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:08.540638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:08.541419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:08.565269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:08.565940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:08.566399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:08.567124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:08.577266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:08.583781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:08.665118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2fc78461-64c1-40cf-87ab-bd7b58a9f6f2 req-0e30d0c1-eb23-4cca-9d76-dd9620d11640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4", "name": "network-vif-deleted", "tag": "7762a6bb-4e51-4f4b-bf7d-7ec51028d8b6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:08.693076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2fc78461-64c1-40cf-87ab-bd7b58a9f6f2 req-0e30d0c1-eb23-4cca-9d76-dd9620d11640 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:08.697402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2fc78461-64c1-40cf-87ab-bd7b58a9f6f2 req-0e30d0c1-eb23-4cca-9d76-dd9620d11640 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:08.698380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2fc78461-64c1-40cf-87ab-bd7b58a9f6f2 req-0e30d0c1-eb23-4cca-9d76-dd9620d11640 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:08.717409 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2fc78461-64c1-40cf-87ab-bd7b58a9f6f2 req-0e30d0c1-eb23-4cca-9d76-dd9620d11640 service nova] Creating event network-vif-deleted:7762a6bb-4e51-4f4b-bf7d-7ec51028d8b6 for instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 on n-h1-857467-1 Sep 13 17:09:08.726514 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2fc78461-64c1-40cf-87ab-bd7b58a9f6f2 req-0e30d0c1-eb23-4cca-9d76-dd9620d11640 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066700 Sep 13 17:09:08.727784 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3279/6602] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:09:08.746687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acdbedfa10646fdae3304874424115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683610271550498db921cba35a54c137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:08.759215 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-879d9cbd-62ef-4193-af31-75ff917e5cba tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 200 len: 1462 microversion: 2.1 time: 0.223440 Sep 13 17:09:08.760708 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3324/6603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:08 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 1462 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:09.016658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:09.018019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:09.026176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:09.026911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:09.027363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:09.028083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:09.028597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:09.028981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:09.236307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:09.250511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:09.253790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:09.255310 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d37ab3b1-4f51-4767-8532-fb3d4b95e5ec tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1739 microversion: 2.20 time: 0.243246 Sep 13 17:09:09.262775 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3280/6604] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:09 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:09.783529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:09.784733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] [instance: 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:09.793432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:09.794103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:09.794728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:09.795908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:09.797312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:09.798478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:09.818660 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] HTTP exception thrown: Instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 could not be found. Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Request method failure captured: Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 HTTP/1.1 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILkTj_UHbTFz7L4u6VWlz3FL-2AVGAXGM35sq_7POz9XqcZgi-92CXT8sAyNfnFspFc1orLz7hsfTho4nMioer4XXPMfgq4flWQolQlcNgXPovZqkn5cF3-9giSGKcjyRpvajqTZi_C2E5RC1FjQw_LxMH2AKlImlfJ0WjW36RQvziA Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 683610271550498db921cba35a54c137 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesActionsTest-1024818384 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/683610271550498db921cba35a54c137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_683610271550498db921cba35a54c137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/683610271550498db921cba35a54c137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/683610271550498db921cba35a54c137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesActionsTest-1024818384 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 683610271550498db921cba35a54c137 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesActionsTest-1024818384 Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesActionsTest-1024818384-project Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 4acdbedfa10646fdae3304874424115f Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesActionsTest-1024818384-project Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 could not be found. Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4'} Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 could not be found. Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 could not be found. Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:09:09.820852 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 could not be found. Sep 13 17:09:09.825504 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:09:09.826770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] Returning 404 to user: Instance 6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:09:09.827787 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3191ae28-eaa0-402c-80a5-1c807dbe8038 tempest-VolumesActionsTest-1024818384 tempest-VolumesActionsTest-1024818384-project] 10.222.0.61 "GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4" status: 404 len: 111 microversion: 2.1 time: 0.049113 Sep 13 17:09:09.829442 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3325/6605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:09 2022] GET /compute/v2.1/servers/6b2d0ab6-ed9f-4707-9b8b-1ec43bed26e4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:09:10.287781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:10.287781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:10.307530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:10.308285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:10.311353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:10.312297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:10.314969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:10.315608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:10.899891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:10.920621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:10.928193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:10.930029 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-190a4e09-bfa8-4416-b3a9-530780de03c3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1721 microversion: 2.20 time: 0.648003 Sep 13 17:09:10.949282 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3281/6606] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:10 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1721 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:11.970668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:11.972532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:11.985562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:11.986114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:11.986539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:11.987474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:11.989141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:11.989673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:12.159989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:12.173568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:12.176010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:12.177483 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1866e552-c76e-445b-af31-897bc5db7ef2 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1721 microversion: 2.20 time: 0.212814 Sep 13 17:09:12.192702 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3326/6607] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:11 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:12.545526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b53993de-5e34-4731-aa50-5b3ea8917d7c req-fe485e95-0096-443e-a42e-02ff123c78f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "name": "network-vif-unplugged", "status": "completed", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:12.582159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b53993de-5e34-4731-aa50-5b3ea8917d7c req-fe485e95-0096-443e-a42e-02ff123c78f0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:12.582646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b53993de-5e34-4731-aa50-5b3ea8917d7c req-fe485e95-0096-443e-a42e-02ff123c78f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:12.583079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b53993de-5e34-4731-aa50-5b3ea8917d7c req-fe485e95-0096-443e-a42e-02ff123c78f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:12.633274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b53993de-5e34-4731-aa50-5b3ea8917d7c req-fe485e95-0096-443e-a42e-02ff123c78f0 service nova] Creating event network-vif-unplugged:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h2-857467-1 Sep 13 17:09:12.669710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b53993de-5e34-4731-aa50-5b3ea8917d7c req-fe485e95-0096-443e-a42e-02ff123c78f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128806 Sep 13 17:09:12.673184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3282/6608] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:09:13.206790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:13.208006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:13.215882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:13.216779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:13.217395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:13.218311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:13.220105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:13.220743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:13.495809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:13.516946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:13.522603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:13.526664 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce29e109-c004-4e22-b086-9a0bdc0cf010 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1724 microversion: 2.20 time: 0.323003 Sep 13 17:09:13.527720 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3327/6609] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:13 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:13.553817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa7abfc7-2b6b-44ce-bbf9-0f9952870a99"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:13.556934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:13.564863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:13.565639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:13.566424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:13.567394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:13.568069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:13.568768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:14.137315 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02703dc9-4ff0-4dba-ab86-19eeba85c935 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.587771 Sep 13 17:09:14.138304 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3283/6610] 10.222.0.61 () {62 vars in 1364 bytes} [Tue Sep 13 17:09:13 2022] POST /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-volume_attachments => generated 188 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:09:14.316094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:14.317277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:14.324478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:14.324969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:14.325407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:14.326130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:14.326589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:14.327015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:14.619015 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8153a449-5475-4b77-acc5-16fb06a09380 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-volume_attachments/fa7abfc7-2b6b-44ce-bbf9-0f9952870a99" status: 202 len: 0 microversion: 2.20 time: 0.308011 Sep 13 17:09:14.622494 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3328/6611] 10.222.0.61 () {60 vars in 1457 bytes} [Tue Sep 13 17:09:14 2022] DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-volume_attachments/fa7abfc7-2b6b-44ce-bbf9-0f9952870a99 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:09:14.728316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:14.729085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:14.739003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:14.739764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:14.740360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:14.741247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:14.742637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:14.743237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:14.801071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122327) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 17:09:14.908225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d0c02d8-cdea-4810-9c5e-e78943fe16fc tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "POST /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/action" status: 202 len: 0 microversion: 2.20 time: 0.182312 Sep 13 17:09:14.913794 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3284/6612] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Sep 13 17:09:14 2022] POST /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:09:14.919938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:14.920878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:14.932871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:14.934715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:14.936383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:14.937248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:14.938031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:14.939191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:15.193328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:15.202371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:15.215410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:15.219472 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-331e7db1-7658-44e9-9928-2f3bdb225b87 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1672 microversion: 2.20 time: 0.304536 Sep 13 17:09:15.221785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3329/6613] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:14 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1672 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:16.249645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:16.251356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:16.265452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:16.267105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:16.267545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:16.268293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:16.268760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:16.269206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:16.776381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:16.819550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:16.821043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:16.822279 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-165d708c-bfcb-4213-9b89-38fa411a9446 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1672 microversion: 2.20 time: 0.577499 Sep 13 17:09:16.832311 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3285/6614] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:16 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1672 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:17.856900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:17.861444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:17.878441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:17.883069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:17.883835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:17.885036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:17.885719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:17.886428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:18.268907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:18.285155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:18.290994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:18.294201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-34d2d49f-f757-41fe-98c5-9d9641b82cb3 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.445652 Sep 13 17:09:18.294870 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3330/6615] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:17 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:19.329493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:19.330298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:19.337333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:19.342447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:19.344128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:19.346436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:19.347732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:19.348427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:19.393421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2995e7b7-8c17-49d5-a50c-ea72befc2a52 req-6ac648e8-1f37-4d82-988c-bab6bc89f355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:19.407660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2995e7b7-8c17-49d5-a50c-ea72befc2a52 req-6ac648e8-1f37-4d82-988c-bab6bc89f355 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:19.419348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2995e7b7-8c17-49d5-a50c-ea72befc2a52 req-6ac648e8-1f37-4d82-988c-bab6bc89f355 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:19.420185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2995e7b7-8c17-49d5-a50c-ea72befc2a52 req-6ac648e8-1f37-4d82-988c-bab6bc89f355 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:19.502460 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2995e7b7-8c17-49d5-a50c-ea72befc2a52 req-6ac648e8-1f37-4d82-988c-bab6bc89f355 service nova] Creating event network-changed:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h1-857467-1 Sep 13 17:09:19.539823 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2995e7b7-8c17-49d5-a50c-ea72befc2a52 req-6ac648e8-1f37-4d82-988c-bab6bc89f355 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153533 Sep 13 17:09:19.540463 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3331/6616] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:09:19.713398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:19.724424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:19.727698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:19.729989 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c7a3e54-53a4-4e89-b804-e7fd9e652677 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.405320 Sep 13 17:09:19.731287 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3286/6617] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:19 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:20.759777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:20.760474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:20.772292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:20.772798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:20.773271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:20.773992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:20.774451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:20.775063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:21.236706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:21.260823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:21.262671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:21.272524 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b1581a5-3cd8-49c8-9959-00d98f15ea18 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.516220 Sep 13 17:09:21.275039 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3332/6618] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:20 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:22.323410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:22.325785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:22.361791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:22.365286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:22.366723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:22.369270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:22.373538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:22.379208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:22.767478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:22.795007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:22.796649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:22.803694 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-97d767bd-4cd3-479f-8098-bc6b1e4de643 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.500505 Sep 13 17:09:22.814653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3287/6619] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:22 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:23.843272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:23.844749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:23.861818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:23.866548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:23.867556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:23.868689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:23.871370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:23.872133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:24.597232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:24.629332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:24.647047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:24.655676 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2580b9ed-1d5a-4b3a-bba7-c783edac7ec1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.816122 Sep 13 17:09:24.657196 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3333/6620] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:23 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:25.686569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:25.687440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:25.713544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:25.714306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:25.715865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:25.716962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:25.719776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:25.726942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:26.123149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:26.150634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:26.159695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:26.160952 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6422abc2-3d41-4afa-b601-c8f2f8a127f6 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.480005 Sep 13 17:09:26.161543 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3288/6621] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:25 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:09:26.721875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:26.725442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:26.740990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:26.746158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:26.746950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:26.750674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:26.751554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:26.752264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:26.908350 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a5571dc-4dbc-45b6-b387-b38072462d6e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action" status: 200 len: 24557 microversion: 2.1 time: 0.191335 Sep 13 17:09:26.916226 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3334/6622] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:09:26 2022] POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action => generated 24557 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:09:27.194680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:27.196061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:27.208732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:27.209628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:27.210444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:27.211541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:27.212291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:27.212967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:27.218649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:27.547089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:27.569140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:27.578937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:27.583277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b28b74c-8d06-4612-a660-9529684481c4 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.391880 Sep 13 17:09:27.587923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3289/6623] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:27 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:28.617301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:28.618112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:28.627301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:28.628147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:28.628809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:28.629803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:28.630510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:28.631153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:28.940470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:28.952903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:28.956416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:28.957912 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bb6c04fd-2921-4e97-ac84-c2c7aa626409 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.344929 Sep 13 17:09:28.960022 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3335/6624] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:28 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:29.986394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:29.987031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:30.001346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:30.001954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:30.002404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:30.006133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:30.006636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:30.007231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:31.129533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:31.147470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:31.149450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:31.154243 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd5bcd78-d0b0-443d-b358-d1e4cd401f6b tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 1.172266 Sep 13 17:09:31.157218 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3290/6625] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:29 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:32.189086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:32.190498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:32.206700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:32.212207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:32.213087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:32.213778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:32.214862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:32.215562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:32.217542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:32.695264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:32.718126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:32.721346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:32.743130 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a000a4e0-3e49-41c6-8054-0dcc01eb0da7 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.559214 Sep 13 17:09:32.758395 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3336/6626] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:32 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:33.776274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:33.778621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:33.785929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:33.786687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:33.788193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:33.789156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:33.790051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:33.791006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:33.970385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:33.980225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:33.982359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:33.984702 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c9a9fe1-6f58-45f7-88b3-eaed0d3fc8fa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.214002 Sep 13 17:09:34.006367 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3291/6627] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:33 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:35.014976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:35.017023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:35.028332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:35.030416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:35.031287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:35.035062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:35.035916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:35.036943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:35.424558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:35.454846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:35.457140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:35.458658 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9a43b577-8509-4bed-a329-807547a6f061 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.449343 Sep 13 17:09:35.474561 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3337/6628] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:35 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:36.496787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:36.497413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:36.512983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:36.527952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:36.528462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:36.528907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:36.535982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:36.536553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:36.537021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:36.733081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:36.745365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:36.747246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:36.748632 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ecb4782-0fa6-4009-90c6-bd82b4f67779 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.260864 Sep 13 17:09:36.750410 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3292/6629] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:36 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:37.777605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:37.778958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:37.797282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:37.798104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:37.798730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:37.799624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:37.800248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:37.800840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:37.829955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:38.188188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:38.197055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:38.209096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:38.210621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4cc23e7-9868-4a52-8f41-ba6b35806738 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.437737 Sep 13 17:09:38.232849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3338/6630] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:37 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:39.243815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:39.258039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:39.258039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:39.258039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:39.258039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:39.258534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:39.258870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:39.259316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:39.624492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:39.634003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:39.635475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:39.636658 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c5c48f0-379c-4e83-96ed-f87ffd951eae tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.398759 Sep 13 17:09:39.637234 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3293/6631] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:39 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:40.677546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:40.679631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:40.698200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:40.699949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:40.700572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:40.701507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:40.702367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:40.703463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:40.734398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3887282a-0c83-465f-a961-012363a3b95c req-fa76515c-6729-4580-8fe6-86fa8ddeec11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "name": "network-vif-plugged", "status": "completed", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:40.759565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3887282a-0c83-465f-a961-012363a3b95c req-fa76515c-6729-4580-8fe6-86fa8ddeec11 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:40.765121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3887282a-0c83-465f-a961-012363a3b95c req-fa76515c-6729-4580-8fe6-86fa8ddeec11 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:40.766449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3887282a-0c83-465f-a961-012363a3b95c req-fa76515c-6729-4580-8fe6-86fa8ddeec11 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:40.967945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:41.001189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:41.013245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:41.021167 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a716acf-c759-4ff2-af06-b04e37478002 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.352095 Sep 13 17:09:41.026210 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3339/6632] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:40 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:41.201630 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3887282a-0c83-465f-a961-012363a3b95c req-fa76515c-6729-4580-8fe6-86fa8ddeec11 service nova] Creating event network-vif-plugged:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h1-857467-1 Sep 13 17:09:41.209106 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3887282a-0c83-465f-a961-012363a3b95c req-fa76515c-6729-4580-8fe6-86fa8ddeec11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.487290 Sep 13 17:09:41.210246 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3294/6633] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:09:42.052318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:42.053529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:42.084033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:42.090372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:42.091256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:42.098173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:42.098860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:42.100358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:42.492247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:42.502271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:42.507852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:42.509123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35cc9245-2a58-4efe-bec7-e11404db75a1 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.460744 Sep 13 17:09:42.509716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3340/6634] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:42 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:09:43.539200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:43.540102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:43.564741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:43.566079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:43.575363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:43.581155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:43.582632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:43.585904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:44.286726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:44.321918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:44.325856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:44.337780 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c69ea7b8-c51e-4ae2-ac4f-6f7abea21a41 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1730 microversion: 2.20 time: 0.800568 Sep 13 17:09:44.341517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3295/6635] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:43 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1730 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:45.377993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:45.378645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:45.397136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:45.406078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:45.406732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:45.407526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:45.408018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:45.408465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:46.131320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:46.141495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:46.143032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:46.144261 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa211457-4912-470d-a495-0b08a6e09d74 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1717 microversion: 2.20 time: 0.772515 Sep 13 17:09:46.156461 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3341/6636] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:09:45 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1717 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:09:50.442056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1105313569", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dd4dde8d-b8d8-45b2-b710-05a9f8a0b6ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:50.556176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:09:51.110261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:09:51.111937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:09:51.112621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:09:51.113046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:09:51.113471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:09:51.124646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:51.125416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:51.125891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:51.127223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:51.127713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:51.128154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:51.152119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:09:51.158808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:09:51.230506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:09:51.234709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd4dde8d-b8d8-45b2-b710-05a9f8a0b6ad',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:09:51.432228 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-093578ee-a178-4a85-b243-87d4064dfeb7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997313 Sep 13 17:09:51.439809 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3296/6637] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:09:51.445790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5a5066d-502d-40ec-911a-0e0b36424bba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:51.446443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5a5066d-502d-40ec-911a-0e0b36424bba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:51.583435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c5a5066d-502d-40ec-911a-0e0b36424bba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:51.594232 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5a5066d-502d-40ec-911a-0e0b36424bba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1057 microversion: 2.1 time: 0.152148 Sep 13 17:09:51.597013 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3342/6638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:51 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1057 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:52.624349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:52.626383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:52.634405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:52.635944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:52.636736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:52.639039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:52.642748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:52.651831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:52.761341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:52.770692 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72edcf88-c679-4eeb-884a-feefeac18664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1155 microversion: 2.1 time: 0.154150 Sep 13 17:09:52.771283 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3297/6639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:52 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1155 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:53.796583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:53.798150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:53.813451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:53.814532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:53.817188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:53.818740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:53.819659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:53.820361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:54.055895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:54.068402 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0fe52b08-54cb-40a9-af9e-3b5c3d39e033 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1173 microversion: 2.1 time: 0.277158 Sep 13 17:09:54.071925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3343/6640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:53 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1173 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:55.099217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:55.099860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:55.107197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:55.107952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:55.110021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:55.111304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:55.112081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:55.113242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:55.320601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:55.331254 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7aefdeda-ff0d-46ea-a018-64d40a82cc73 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1215 microversion: 2.1 time: 0.236518 Sep 13 17:09:55.347385 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3298/6641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:55 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:09:55.906722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-78c88404-cd72-4647-bbb0-eaa349ceebb3 req-808d9897-75a8-465b-9506-60e304155675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2118378b-81fa-4585-91b4-9e89be86f974", "tag": "2d7a4015-a652-4a31-9df4-f4cb8396d237"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:55.925555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-78c88404-cd72-4647-bbb0-eaa349ceebb3 req-808d9897-75a8-465b-9506-60e304155675 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:55.926081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-78c88404-cd72-4647-bbb0-eaa349ceebb3 req-808d9897-75a8-465b-9506-60e304155675 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:55.926516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-78c88404-cd72-4647-bbb0-eaa349ceebb3 req-808d9897-75a8-465b-9506-60e304155675 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:55.980542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-78c88404-cd72-4647-bbb0-eaa349ceebb3 req-808d9897-75a8-465b-9506-60e304155675 service nova] Creating event network-changed:2d7a4015-a652-4a31-9df4-f4cb8396d237 for instance 2118378b-81fa-4585-91b4-9e89be86f974 on n-h1-857467-1 Sep 13 17:09:55.988216 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-78c88404-cd72-4647-bbb0-eaa349ceebb3 req-808d9897-75a8-465b-9506-60e304155675 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087080 Sep 13 17:09:55.989792 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3344/6642] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:09:56.356104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:56.357518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:56.364355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:56.364847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:56.371931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:56.374792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:56.376920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:56.381297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:56.732458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:56.750502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-442d433d-cd4a-42a4-a597-d062ce7047d3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1215 microversion: 2.1 time: 0.397022 Sep 13 17:09:56.758446 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3299/6643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:56 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:57.183791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:57.184524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:57.196651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:57.197297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:57.197896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:57.198676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:57.198996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:57.199639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:57.660381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2ab3f9e5-8748-4454-8ee3-fa98508a62e6 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1832 microversion: 2.1 time: 0.481060 Sep 13 17:09:57.662250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3345/6644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:57 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1832 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:57.690230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:57.690867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:57.698260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:57.699281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:57.704453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:57.705493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:57.706290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:57.706796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:57.713657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=57 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:09:57.783805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:57.784757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:57.793706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:57.794354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:57.794701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:57.795423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:57.796066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:57.796378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:58.070085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:58.084566 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33b6b34b-831d-4113-83af-f2fef6a9af70 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1215 microversion: 2.1 time: 0.305292 Sep 13 17:09:58.085719 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3346/6645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:57 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:58.265130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:58.274481 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ed62801-23bb-4ce2-8f8a-256ce156fabe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1681 microversion: 2.1 time: 0.588945 Sep 13 17:09:58.275196 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3300/6646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:57 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1681 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:58.383197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:58.385613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:58.393072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:58.393736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:58.394363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:58.395760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:58.396450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:58.397104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:58.472264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe6f1ae2-292b-4927-8d2b-7232991e6bde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action" status: 200 len: 32635 microversion: 2.1 time: 0.097574 Sep 13 17:09:58.473125 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3347/6647] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:09:58 2022] POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action => generated 32635 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:09:58.623152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:09:58.624757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:58.631139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:58.634064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:58.634563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:58.635282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:58.635754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:58.636195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:58.680673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f059164e383840eabe6dbee6706e00a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c734da404449b9b6b50125f7310aef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:58.681390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] flavor_id is None. Assuming migration. {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 13 17:09:58.681953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:09:58.815009 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ed0f771-af4b-4cb7-91ac-5e7acf5aa4af tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action" status: 202 len: 0 microversion: 2.1 time: 0.195977 Sep 13 17:09:58.824683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:58.825400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:58.830089 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3301/6648] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:09:58 2022] POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:09:58.834366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:58.834942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:58.835304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:58.836317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:58.836940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:58.837540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:59.044700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:59.056165 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b35e8ebb-558a-47ff-b13d-57b0f038be0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1690 microversion: 2.1 time: 0.235962 Sep 13 17:09:59.066713 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3348/6649] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:58 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1690 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:09:59.109847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:09:59.110587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:09:59.121496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:59.122115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:59.122713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:59.123684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:09:59.125003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:09:59.125589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:09:59.324555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:09:59.336745 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-67c9e14c-34cd-45e1-b3b0-aedfab7295bd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1215 microversion: 2.1 time: 0.233060 Sep 13 17:09:59.337347 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3302/6650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:09:59 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:00.080676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:00.081298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:00.094973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:00.095746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:00.096394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:00.097157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:00.097626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:00.098109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:00.288765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:00.297795 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b918f3e1-8c17-46de-8389-f438d7c51bf6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1690 microversion: 2.1 time: 0.221061 Sep 13 17:10:00.298553 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3349/6651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:00 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:00.364849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:00.365475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:00.372936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:00.373422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:00.374463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:00.375182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:00.378531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:00.379418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:00.542306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:00.551239 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf39121e-cb6c-451f-b796-09ed2330ea95 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1215 microversion: 2.1 time: 0.190629 Sep 13 17:10:00.551816 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3303/6652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:00 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:01.323876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:01.324662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:01.332539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:01.333137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:01.333683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:01.334635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:01.335345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:01.336103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:01.497655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:01.505933 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d3abcfa-5a75-46da-82cd-4d3f3045b327 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1690 microversion: 2.1 time: 0.186611 Sep 13 17:10:01.506518 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3350/6653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:01 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:01.580324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:01.581015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:01.587392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:01.588756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:01.600835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:01.601369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:01.601856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:01.602613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:01.603084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:01.603527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:01.756243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:01.764601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-18cf6d3f-be48-4646-b796-1925bd11151b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.192094 Sep 13 17:10:01.765276 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3304/6654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:01 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:02.530366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:02.532495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:02.534837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:02.536751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=32 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:02.550768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:02.551572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:02.554112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:02.555045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:02.556427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:02.558978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:02.776714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:02.788823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:02.789451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:02.790156 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-68976692-5363-4f52-8efc-0ee417ed307f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1690 microversion: 2.1 time: 0.262997 Sep 13 17:10:02.791839 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3351/6655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:02 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1690 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:02.814051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:02.814862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:02.815482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:02.816375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:02.817004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:02.817604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:02.997684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:03.010850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a08f65cb-8e37-427d-85b8-56a1dfa2d131 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.226098 Sep 13 17:10:03.011817 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3305/6656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:02 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:03.814400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:03.815025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:03.822179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:03.822673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:03.823114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:03.823824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:03.824286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:03.824713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:03.969736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:03.978541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd5c39e5-5d31-437a-ab74-435009f828c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.168347 Sep 13 17:10:03.979188 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3352/6657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:03 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:04.035230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:04.035868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:04.043265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:04.043999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:04.044544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:04.045340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:04.046314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:04.046442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:04.218071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:04.229540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-906c6296-9676-49a6-94f1-696cbe858105 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.198262 Sep 13 17:10:04.230151 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3306/6658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:04 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:05.004013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:05.005433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:05.013376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:05.014179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:05.015195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:05.016121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:05.017460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:05.018109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:05.167454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:05.176474 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9348675-14e7-438c-98a9-ae241c448496 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.177691 Sep 13 17:10:05.177053 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3353/6659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:04 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:05.254147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:05.254765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:05.261744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:05.262349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:05.262784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:05.263486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:05.264006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:05.264503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:05.404158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:05.413141 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03338c65-d90e-4cd3-890f-3e8aa0cf417b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.162804 Sep 13 17:10:05.413735 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3307/6660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:05 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:06.200479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:06.201439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:06.209579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:06.210193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:06.210780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:06.211588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:06.212136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:06.212640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:06.359784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:06.368115 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c23fecb9-369d-4d7c-90e1-ac99319e6b0c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.171396 Sep 13 17:10:06.368721 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3354/6661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:06 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:06.437707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:06.438620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:06.445753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:06.446592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:06.447046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:06.447785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:06.448262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:06.448873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:06.627331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:06.636020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bba39792-780d-42c1-bcb8-d7a8d9cad5ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.202968 Sep 13 17:10:06.640393 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3308/6662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:06 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:07.392655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:07.393474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:07.402012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:07.402711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:07.403162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:07.404902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:07.405376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:07.405815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:07.570586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:07.580990 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0c436ba-dc1e-4ca3-aa35-5b5d19127344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.193013 Sep 13 17:10:07.581942 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3355/6663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:07 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:07.666603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:07.667230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:07.670142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:07.675975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:07.676475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:07.676916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:07.677628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:07.678288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:07.678724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:07.890079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:07.901671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fa9f1f7-cfb1-4076-b229-e86de401be30 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.238956 Sep 13 17:10:07.915756 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3309/6664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:07 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:08.605083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:08.605674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:08.613562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:08.614094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:08.614544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:08.615259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:08.615727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:08.616162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:08.620188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:08.803880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:08.811927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fa19da7-39a2-498e-ba58-29336d582546 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.210851 Sep 13 17:10:08.812508 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3356/6665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:08 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:08.928025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:08.929368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:08.935776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:08.936307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:08.936783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:08.937519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:08.938213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:08.938875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:09.138000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:09.148236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3c650ad-7fcb-4110-bff2-e325d482265b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.225158 Sep 13 17:10:09.148853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3310/6666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:08 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:09.836229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:09.836860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:09.845020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:09.845519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:09.845994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:09.846725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:09.847187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:09.847614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:09.990540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:09.998540 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-004b8e54-c3b5-4e29-af92-ee48b6bf7417 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.166318 Sep 13 17:10:09.999137 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3357/6667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:09 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:10.171775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:10.172417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:10.179307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:10.179779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:10.180217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:10.180913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:10.181373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:10.181805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:10.328008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:10.336226 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-639c6bbf-d8a7-40c9-abfa-18cc4d062ac8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.168366 Sep 13 17:10:10.336817 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3311/6668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:10 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:11.022334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:11.022970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:11.030873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:11.031447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:11.031880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:11.032567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:11.033030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:11.033469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:11.182230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:11.190642 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e279641-2ad3-417b-a524-84cbbfecde30 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.172088 Sep 13 17:10:11.191254 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3358/6669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:11 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:11.359061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:11.359805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:11.366636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:11.367167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:11.367623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:11.368338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:11.368809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:11.369250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:11.507359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:11.516033 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d12f5888-3155-4404-b575-098b0c7779a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.161054 Sep 13 17:10:11.516613 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3312/6670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:11 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:12.215050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:12.215671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:12.223225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:12.223726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:12.224217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:12.225360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:12.225972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:12.226522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:12.374698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:12.385516 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f7c6d01-90d0-4130-a650-7b480d65d596 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.174165 Sep 13 17:10:12.386455 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3359/6671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:12 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:12.394792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-fa1f78d1-02fe-4616-baf7-d82057d5122c req-409dc265-1a34-4680-9fc0-b48ab5cd48c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2118378b-81fa-4585-91b4-9e89be86f974", "name": "network-vif-plugged", "status": "completed", "tag": "2d7a4015-a652-4a31-9df4-f4cb8396d237"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:12.410614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fa1f78d1-02fe-4616-baf7-d82057d5122c req-409dc265-1a34-4680-9fc0-b48ab5cd48c7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:12.411223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fa1f78d1-02fe-4616-baf7-d82057d5122c req-409dc265-1a34-4680-9fc0-b48ab5cd48c7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:12.411635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fa1f78d1-02fe-4616-baf7-d82057d5122c req-409dc265-1a34-4680-9fc0-b48ab5cd48c7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:12.423688 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fa1f78d1-02fe-4616-baf7-d82057d5122c req-409dc265-1a34-4680-9fc0-b48ab5cd48c7 service nova] Creating event network-vif-plugged:2d7a4015-a652-4a31-9df4-f4cb8396d237 for instance 2118378b-81fa-4585-91b4-9e89be86f974 on n-h1-857467-1 Sep 13 17:10:12.429355 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-fa1f78d1-02fe-4616-baf7-d82057d5122c req-409dc265-1a34-4680-9fc0-b48ab5cd48c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038465 Sep 13 17:10:12.430292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3313/6672] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:10:12.539628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:12.540778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:12.551273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:12.552185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:12.554247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:12.555280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:12.556042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:12.556693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:12.709279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:12.717530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-622fed03-3a30-40e5-ae8c-fecb3b1fafd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.181850 Sep 13 17:10:12.718816 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3360/6673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:12 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:13.411960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:13.412581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:13.418884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:13.419373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:13.419850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:13.421250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:13.421722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:13.422260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:13.565252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:13.573152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac619532-9608-4f2a-8383-4763074e53b4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.166438 Sep 13 17:10:13.573734 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3314/6674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:13 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:13.740921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:13.741641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:13.749465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:13.749987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:13.750435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:13.751141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:13.751608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:13.752044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:13.897355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:13.905613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82a92c57-c0fc-4ea6-a1e7-71cc306bc71c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1203 microversion: 2.1 time: 0.168507 Sep 13 17:10:13.906229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3361/6675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:13 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:14.597369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:14.598047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:14.604906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:14.605396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:14.605868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:14.606574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:14.607034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:14.607467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:14.746103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:14.748511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:14.758127 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-75d5789e-577d-4024-af6c-4fa214667e1b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.164533 Sep 13 17:10:14.759501 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3315/6676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:14 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:14.928611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:14.929342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:14.936737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:14.937245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:14.937693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:14.938439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:14.938909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:14.939348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.069533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:15.078102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bffd0b74-29f6-4669-82fe-8ce88ce5fcb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1391 microversion: 2.1 time: 0.153543 Sep 13 17:10:15.078694 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3362/6677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:14 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:15.101320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:15.102041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:15.109230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.109756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.110246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.110964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.111487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.111963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.253482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:15.261431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e044d920-9a19-4334-880b-60763558a3ba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1391 microversion: 2.1 time: 0.164493 Sep 13 17:10:15.262032 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3316/6678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:15 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:15.285329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:15.286122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:15.292276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.292762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.293199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.293911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.294371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.294795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.431263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:15.440755 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e594ee6-6cbc-45da-acdb-a4bf2bfbe7e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1391 microversion: 2.1 time: 0.159225 Sep 13 17:10:15.441659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3363/6679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:15 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:15.463897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:15.464407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:15.470859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.471351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.471794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.472498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.472961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.473392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.498999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:10:15.578417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7d6c81e-c0bc-4c09-b888-ea81c42a551a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 204 len: 0 microversion: 2.1 time: 0.118004 Sep 13 17:10:15.579995 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3317/6680] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:10:15 2022] DELETE /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:10:15.587890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:15.588507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:15.594878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.595366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.595801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.596489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.596946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.597369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.735246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:15.744144 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8c56860f-340f-49bd-b9a9-f112d8c190d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1397 microversion: 2.1 time: 0.159997 Sep 13 17:10:15.744745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3364/6681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:15 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:15.783897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:15.785426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:15.793672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.794180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.795031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.796534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:15.796993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:15.797582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:15.933226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:15.941261 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c922dd07-76f8-482e-ad6e-195f1f677d4b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.162430 Sep 13 17:10:15.942048 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3318/6682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:15 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:16.769016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:16.769669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:16.776853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:16.777345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:16.777786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:16.778517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:16.779113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:16.779678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:16.923213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:16.931084 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0674a1fb-6ab9-4405-8c7e-e6c627372368 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1397 microversion: 2.1 time: 0.167052 Sep 13 17:10:16.932317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3365/6683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:16 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1397 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:16.963987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:16.964731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:16.972473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:16.973047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:16.973600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:16.974507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:16.974981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:16.975422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:17.125428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:17.133570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-22b3d6f1-9c17-4248-bf8f-e2f0e81d4dde tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.173540 Sep 13 17:10:17.134185 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3319/6684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:16 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:17.956015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:17.956796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:17.964470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:17.965213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:17.965654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:17.971087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:17.971867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:17.972501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:17.978836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b6e5bcf0-c01d-4da1-812b-b2e6c2df9e40 req-cc0622ab-f868-4dea-a953-b8f40553a09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2118378b-81fa-4585-91b4-9e89be86f974", "name": "network-vif-deleted", "tag": "2d7a4015-a652-4a31-9df4-f4cb8396d237"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:17.990098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b6e5bcf0-c01d-4da1-812b-b2e6c2df9e40 req-cc0622ab-f868-4dea-a953-b8f40553a09e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:17.990597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b6e5bcf0-c01d-4da1-812b-b2e6c2df9e40 req-cc0622ab-f868-4dea-a953-b8f40553a09e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:17.991045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b6e5bcf0-c01d-4da1-812b-b2e6c2df9e40 req-cc0622ab-f868-4dea-a953-b8f40553a09e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:18.003532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b6e5bcf0-c01d-4da1-812b-b2e6c2df9e40 req-cc0622ab-f868-4dea-a953-b8f40553a09e service nova] Creating event network-vif-deleted:2d7a4015-a652-4a31-9df4-f4cb8396d237 for instance 2118378b-81fa-4585-91b4-9e89be86f974 on n-h1-857467-1 Sep 13 17:10:18.008851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b6e5bcf0-c01d-4da1-812b-b2e6c2df9e40 req-cc0622ab-f868-4dea-a953-b8f40553a09e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Sep 13 17:10:18.009474 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3320/6685] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:10:18.049436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:18.063747 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-58d4b739-4639-4614-a63e-22331755b10c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1355 microversion: 2.1 time: 0.112691 Sep 13 17:10:18.064703 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3366/6686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:17 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:18.158635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:18.159346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:18.176086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:18.176591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:18.177108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:18.177981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:18.178875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:18.179781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:18.342301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:18.350602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7b7416d-c715-4490-aa14-791b2800dcdb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.197338 Sep 13 17:10:18.351304 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3321/6687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:18 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:19.088770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:19.089392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:19.097210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:19.097714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:19.098193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:19.099049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:19.099521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:19.099957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:19.167478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:19.176250 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-733230c2-1ebc-48ce-8253-06fd5cafc83c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1188 microversion: 2.1 time: 0.091478 Sep 13 17:10:19.176861 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3367/6688] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:19 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:19.387116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:19.388035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:19.395736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:19.396323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:19.396858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:19.397674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:19.398247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:19.398761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:19.548655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:19.561452 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6eda533-220a-421a-8a30-9b5bc7faa8ef tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1695 microversion: 2.1 time: 0.177464 Sep 13 17:10:19.571995 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3322/6689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:19 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:20.199873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:20.202268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:20.222651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:20.223159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:20.223627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:20.224327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:20.224790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:20.225221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:20.315936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:20.328695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45546ec9-c08f-43e9-a94e-eebe5733ec1d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1188 microversion: 2.1 time: 0.132647 Sep 13 17:10:20.330423 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3368/6690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:20 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:20.466830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "name": "network-vif-unplugged", "status": "completed", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:20.480427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:20.481082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:20.481747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:20.499051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] Creating event network-vif-unplugged:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h1-857467-1 Sep 13 17:10:20.505786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:10:20.527118 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4532665b-a4f5-43b5-ab13-6bdac103b32e req-8f257b80-32b4-4c3f-87ab-cea52f338043 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065246 Sep 13 17:10:20.528364 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3323/6691] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:10:20.590769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:20.593329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:20.603920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:20.604691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:20.605243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:20.606054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:20.606630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:20.609567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:21.179646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:21.191280 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-124cd362-52d0-4a2b-8e8d-bba931808396 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1694 microversion: 2.1 time: 0.607773 Sep 13 17:10:21.192592 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3369/6692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:20 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1694 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:21.353767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:21.355297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:21.362889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:21.363678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:21.364468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:21.365373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:21.366103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:21.366910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:21.466688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:21.475736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bfc34ff-fd9e-4893-b5c8-d9a6ec7fcf71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1188 microversion: 2.1 time: 0.126781 Sep 13 17:10:21.476650 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3324/6693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:21 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:22.215803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:22.216363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:22.228186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:22.228684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:22.229125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:22.229865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:22.230316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:22.230746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:22.391258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:22.400064 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e2e2583-0172-4ce3-90cc-adcd32fa7e75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1692 microversion: 2.1 time: 0.188055 Sep 13 17:10:22.401314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3370/6694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:22 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:22.502082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:22.502820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:22.510707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:22.511294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:22.511820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:22.512621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:22.513160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:22.514376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:22.558736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:22.568886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:22.569457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:22.570020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:22.585813 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] Creating event network-changed:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h1-857467-1 Sep 13 17:10:22.592965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:22.600958 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94ec498f-e9d5-414f-a242-a446d1a96442 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1188 microversion: 2.1 time: 0.103636 Sep 13 17:10:22.601546 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3325/6695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:22 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:22.604446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:10:22.616432 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-71d04f2a-2281-49fb-94d6-938d894c5197 req-c279cd0b-b552-44a1-8a7f-5397d489e9ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061501 Sep 13 17:10:22.617150 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3371/6696] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:10:23.426122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:23.426747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:23.432669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:23.433160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:23.433702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:23.434648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:23.435117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:23.436063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:23.576136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:23.584757 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a17076cc-e0da-437e-b1e2-1b69c1872984 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1692 microversion: 2.1 time: 0.162697 Sep 13 17:10:23.585344 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3326/6697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:23 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:23.625336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:23.626222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:23.633925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:23.634426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:23.634856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:23.635591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:23.636091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:23.636511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:23.703143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:23.711423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-431cb8c8-39c5-4880-9f35-ea47a25f0112 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1188 microversion: 2.1 time: 0.090944 Sep 13 17:10:23.712012 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3372/6698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:23 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:24.608696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:24.609405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:24.616537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:24.617033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:24.617640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:24.618434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:24.618807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:24.619340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:24.749791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:24.750464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:24.764554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:24.765083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:24.765514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:24.766270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:24.766911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:24.767352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:24.770943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:24.803400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:24.803901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:24.804574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:24.805203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lazy-loading 'fault' on Instance uuid 2118378b-81fa-4585-91b4-9e89be86f974 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:10:24.838728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:24.848017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35653b1a-78e2-4b32-a03d-dfa1aeafaa2e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1692 microversion: 2.1 time: 0.243991 Sep 13 17:10:24.849112 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3327/6699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:24 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1692 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:24.850460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:24.858992 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e0d7744-9ffc-44b5-ae75-dd243488a725 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 200 len: 1193 microversion: 2.1 time: 0.129050 Sep 13 17:10:24.859644 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3373/6700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:24 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:25.872095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:25.872815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:25.879910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:25.880482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:25.881001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:25.881779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:25.882333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:25.882437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:25.882848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:25.883304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2118378b-81fa-4585-91b4-9e89be86f974] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:25.891716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:25.892300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:25.892816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:25.893885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:25.894428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:25.894928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:25.909783 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 2118378b-81fa-4585-91b4-9e89be86f974 could not be found. Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 HTTP/1.1 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 2118378b-81fa-4585-91b4-9e89be86f974 could not be found. Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '2118378b-81fa-4585-91b4-9e89be86f974'} Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2118378b-81fa-4585-91b4-9e89be86f974 could not be found. Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2118378b-81fa-4585-91b4-9e89be86f974 could not be found. Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:25.911559 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2118378b-81fa-4585-91b4-9e89be86f974 could not be found. Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 2118378b-81fa-4585-91b4-9e89be86f974 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:10:25.916719 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf7c3ce7-08fb-4c15-819c-e36437f7f03f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974" status: 404 len: 111 microversion: 2.1 time: 0.037085 Sep 13 17:10:25.918143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3374/6701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:25 2022] GET /compute/v2.1/servers/2118378b-81fa-4585-91b4-9e89be86f974 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:10:26.030366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:26.046596 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-10a09d3d-e24e-49e7-b9b6-61dafa46bcdc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1689 microversion: 2.1 time: 0.178261 Sep 13 17:10:26.061888 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3328/6702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:25 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:26.069216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:26.070050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:26.077053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:26.077547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:26.078043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:26.078756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:26.079214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:26.079644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:26.146249 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7bba3edb-8555-4b7a-a5bb-cdb8a95f4636 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action" status: 204 len: 0 microversion: 2.1 time: 0.080537 Sep 13 17:10:26.147009 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3375/6703] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:10:26 2022] POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:10:26.156471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:26.157440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:26.164242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:26.165089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:26.166072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:26.167117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:26.167768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:26.168471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:26.465967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:26.477294 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d565d530-d559-4732-87fa-3db84b86a266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1689 microversion: 2.1 time: 0.325467 Sep 13 17:10:26.478930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3329/6704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:26 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:27.504203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:27.505114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:27.511924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:27.512410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:27.512846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:27.513590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:27.514136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:27.514570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:27.662020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:27.671377 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52a1af52-d858-4a1f-860a-456bb26c5370 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1689 microversion: 2.1 time: 0.173183 Sep 13 17:10:27.671982 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3376/6705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:27 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:28.445767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f08437f0-55be-487e-a31e-28ded907bd1b req-5fba714b-2446-43b7-b87f-af404bdc8dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "name": "network-vif-plugged", "status": "completed", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:28.459542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f08437f0-55be-487e-a31e-28ded907bd1b req-5fba714b-2446-43b7-b87f-af404bdc8dd7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:28.460196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f08437f0-55be-487e-a31e-28ded907bd1b req-5fba714b-2446-43b7-b87f-af404bdc8dd7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:28.460888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f08437f0-55be-487e-a31e-28ded907bd1b req-5fba714b-2446-43b7-b87f-af404bdc8dd7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:28.476681 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f08437f0-55be-487e-a31e-28ded907bd1b req-5fba714b-2446-43b7-b87f-af404bdc8dd7 service nova] Creating event network-vif-plugged:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h1-857467-1 Sep 13 17:10:28.484483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f08437f0-55be-487e-a31e-28ded907bd1b req-5fba714b-2446-43b7-b87f-af404bdc8dd7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043378 Sep 13 17:10:28.485504 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3330/6706] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:10:28.695873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:28.696500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:28.705042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:28.705541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:28.706027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:28.706740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:28.707207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:28.707642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:29.105065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:29.113737 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9ff04c71-2342-4383-9720-dff72318171b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1681 microversion: 2.1 time: 0.421664 Sep 13 17:10:29.114560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3377/6707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:28 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1681 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:31.083335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-505878663", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a6602209-0ab8-4092-bb3b-0703b4aedd56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:31.143461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:10:31.534463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:10:31.534893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:10:31.535371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:10:31.535789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:10:31.536200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:10:31.546743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:31.547242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:31.547888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:31.548626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:31.549091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:31.549527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:31.570317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:10:31.581964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:10:31.642050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:10:31.644214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6602209-0ab8-4092-bb3b-0703b4aedd56',volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:10:31.776330 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b68d7983-c045-49e5-936a-ee8f73b18e0c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698034 Sep 13 17:10:31.777331 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3331/6708] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:10:31.788882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53b802d8-0988-4ef4-a737-553d20079e62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:31.789857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53b802d8-0988-4ef4-a737-553d20079e62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:31.851909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53b802d8-0988-4ef4-a737-553d20079e62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:31.861188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53b802d8-0988-4ef4-a737-553d20079e62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1056 microversion: 2.1 time: 0.076196 Sep 13 17:10:31.862058 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3378/6709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:31 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1056 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:32.896003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:32.897370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:32.908086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:32.909007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:32.909735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:32.910772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:32.911802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:32.913856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:32.996012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:33.006379 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33d98def-b9cc-4eeb-bfc4-630dbf00411a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1162 microversion: 2.1 time: 0.114717 Sep 13 17:10:33.010065 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3332/6710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:32 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1162 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:34.029542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:34.031212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:34.038585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=60 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:34.040786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:34.041618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:34.042390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:34.043341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:34.044044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:34.044938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:34.228378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:34.238967 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-57043942-f1f2-4204-8f03-749e05a297f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1214 microversion: 2.1 time: 0.214051 Sep 13 17:10:34.239568 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3379/6711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:34 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:34.432528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9b06987b-5ece-4c2b-9df7-00b9814fee1b req-f2989e00-9739-4347-a6c6-3635366ee92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec781cc-447a-4819-a4c8-70a197bca7e7", "tag": "bd64ab64-56dd-41f5-ad7a-e0da3970eee0"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:34.451395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9b06987b-5ece-4c2b-9df7-00b9814fee1b req-f2989e00-9739-4347-a6c6-3635366ee92e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:34.452183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9b06987b-5ece-4c2b-9df7-00b9814fee1b req-f2989e00-9739-4347-a6c6-3635366ee92e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:34.452814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9b06987b-5ece-4c2b-9df7-00b9814fee1b req-f2989e00-9739-4347-a6c6-3635366ee92e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:34.457094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:34.473689 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9b06987b-5ece-4c2b-9df7-00b9814fee1b req-f2989e00-9739-4347-a6c6-3635366ee92e service nova] Creating event network-changed:bd64ab64-56dd-41f5-ad7a-e0da3970eee0 for instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 on n-h2-857467-1 Sep 13 17:10:34.490530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9b06987b-5ece-4c2b-9df7-00b9814fee1b req-f2989e00-9739-4347-a6c6-3635366ee92e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063980 Sep 13 17:10:34.491520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3333/6712] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:10:35.267697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:35.268572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:35.277286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:35.278021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:35.278758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:35.280121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:35.280694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:35.281445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:35.454033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:35.464600 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca9a1251-345e-4856-bf8d-3f4c6bc2c727 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1214 microversion: 2.1 time: 0.202379 Sep 13 17:10:35.465632 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3380/6713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:35 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:36.490832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:36.491983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:36.510711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:36.511211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:36.511652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:36.512372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:36.512831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:36.513320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:36.760078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:36.769821 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37df78b2-4d36-4059-a64b-3e1d5bc9d37c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1214 microversion: 2.1 time: 0.284259 Sep 13 17:10:36.770933 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3334/6714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:36 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:37.795250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:37.796055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:37.804327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:37.804902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:37.805412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:37.806224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:37.806750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:37.807288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:37.954615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:37.963580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a37ba57d-e331-4ce9-a369-b49f187ead45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1214 microversion: 2.1 time: 0.172756 Sep 13 17:10:37.977485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3381/6715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:37 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:38.988138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:38.988800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:38.991478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:38.997183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:38.999676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:39.000138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:39.000871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:39.001597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:39.001766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:39.137810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:39.147026 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-352868bb-e04c-4b49-9722-c6529443d939 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.163325 Sep 13 17:10:39.147611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3335/6716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:38 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:40.171602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:40.172224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:40.179147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:40.179636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:40.180073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:40.180773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:40.181228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:40.181656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:40.314018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:40.322070 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f5a4836-3be8-4231-a5f0-72721fd96313 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.155146 Sep 13 17:10:40.322659 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3382/6717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:40 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:41.345428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:41.346001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:41.353296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:41.353794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:41.354264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:41.354982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:41.355442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:41.355877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:41.491238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:41.499900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-defb02e3-a146-471a-ba2d-8a866d6c48da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.159113 Sep 13 17:10:41.500479 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3336/6718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:41 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:42.523364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:42.523975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:42.528224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:42.534190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:42.534743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:42.535254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:42.536077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:42.536572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:42.537101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:42.666275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:42.674641 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd79cbb5-1c9b-42d3-9bd9-7db4580b9069 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.155477 Sep 13 17:10:42.675355 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3383/6719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:42 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:43.699306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:43.699840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:43.702248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:43.702967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:43.709998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:43.710502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:43.710951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:43.711665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:43.712168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:43.712605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:43.861422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:43.873176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bcec364-4c54-4719-b357-10ac5d4fbf21 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.177851 Sep 13 17:10:43.874006 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3337/6720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:43 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:44.903017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:44.904691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:44.913164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:44.913671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:44.914174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:44.914910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:44.915383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:44.915827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:45.064153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:45.072597 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4278115d-530b-42c3-9895-f586ab94eb8b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.175538 Sep 13 17:10:45.073196 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3384/6721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:44 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:46.096787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:46.097529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:46.104676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:46.105582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:46.106755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:46.108607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:46.109572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:46.110514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:46.248199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:46.256532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7aa00e6-da93-4eda-a8d4-3eb9cca6b49a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.163873 Sep 13 17:10:46.257125 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3338/6722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:46 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:47.281651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:47.282308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:47.289488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:47.290351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:47.290803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:47.291530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:47.292325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:47.292428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:47.437144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:47.445557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab0365cf-908b-4418-9e68-849e1fd5f42f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.168991 Sep 13 17:10:47.446192 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3385/6723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:47 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:48.468913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:48.469554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:48.476629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:48.477129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:48.477579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:48.478326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:48.478799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:48.479247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:48.619753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:48.632750 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0485fa96-56ac-4a79-8b2b-c33ede4f3561 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.166693 Sep 13 17:10:48.633733 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3339/6724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:48 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:48.954554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ece178b7-b9b0-4b80-9232-f64a853dd3e5 req-1ee07e39-cfe0-4959-8b7c-b62b92e4bc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec781cc-447a-4819-a4c8-70a197bca7e7", "name": "network-vif-plugged", "status": "completed", "tag": "bd64ab64-56dd-41f5-ad7a-e0da3970eee0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:48.966026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ece178b7-b9b0-4b80-9232-f64a853dd3e5 req-1ee07e39-cfe0-4959-8b7c-b62b92e4bc0f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:48.966272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ece178b7-b9b0-4b80-9232-f64a853dd3e5 req-1ee07e39-cfe0-4959-8b7c-b62b92e4bc0f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:48.966968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ece178b7-b9b0-4b80-9232-f64a853dd3e5 req-1ee07e39-cfe0-4959-8b7c-b62b92e4bc0f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:48.979963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ece178b7-b9b0-4b80-9232-f64a853dd3e5 req-1ee07e39-cfe0-4959-8b7c-b62b92e4bc0f service nova] Creating event network-vif-plugged:bd64ab64-56dd-41f5-ad7a-e0da3970eee0 for instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 on n-h2-857467-1 Sep 13 17:10:48.985308 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ece178b7-b9b0-4b80-9232-f64a853dd3e5 req-1ee07e39-cfe0-4959-8b7c-b62b92e4bc0f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035823 Sep 13 17:10:48.986040 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3386/6725] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:10:49.657772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:49.658443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:49.665458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:49.665991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:49.666441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:49.667143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:49.667611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:49.668048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:49.804123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:49.812985 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-509a94d5-a13d-40a7-b3fb-cb575377ef27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1202 microversion: 2.1 time: 0.159952 Sep 13 17:10:49.813603 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3340/6726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:49 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:50.342558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:50.345143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:50.351418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.351985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.352497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.353202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.353814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.354276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.385819 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3933614f-3ed2-4e32-b8ba-a37188316707 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049194 Sep 13 17:10:50.386582 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3387/6727] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Sep 13 17:10:50 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:50.460356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:50.460787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:50.467390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.467882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.468324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.469023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.469482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.469940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.495589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:10:50.583183 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bfcf3ccb-0056-4077-991a-008444c99653 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 204 len: 0 microversion: 2.20 time: 0.126238 Sep 13 17:10:50.583795 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3341/6728] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 17:10:50 2022] DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 17:10:50.601470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:50.602293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:50.614625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.615221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.615884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.616671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.617208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.617731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.875379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:50.875379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:50.875379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:50.875379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-49696258-8f14-4069-a3f7-d5b0cae0b845 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.189427 Sep 13 17:10:50.875379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3388/6729] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:10:50 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:50.879046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:50.992989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.001443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b60fb95-daf7-439d-9c00-64f82f341c2a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1389 microversion: 2.1 time: 0.169078 Sep 13 17:10:51.002066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3342/6730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:50 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:51.024403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:51.025154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:51.033435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.033974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.034427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.035140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.035604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.036035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.174812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.182670 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be3d024f-8003-4db1-89fe-479c284698a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1389 microversion: 2.1 time: 0.162287 Sep 13 17:10:51.183266 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3389/6731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:51 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:51.205407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:51.206101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:51.212250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.212745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.213200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.214069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.214545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.214989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.365913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.375310 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ef61e72-7c21-44df-b69e-bd556fe947ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1389 microversion: 2.1 time: 0.173743 Sep 13 17:10:51.375926 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3343/6732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:51 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1389 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:51.398389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:51.398996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:51.405902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.406431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.406875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.407587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.408025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.408454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.431591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:51.439606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:10:51.522519 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80c9f1e1-d820-4747-9a85-4163ac656d0d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 204 len: 0 microversion: 2.1 time: 0.127476 Sep 13 17:10:51.526708 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3390/6733] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:10:51 2022] DELETE /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:10:51.532445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:51.533133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:51.539612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.540123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.540705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.541454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.542128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.542564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.687506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.695721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f322ef5-f94e-43b6-9129-6e8dae285246 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1395 microversion: 2.1 time: 0.167653 Sep 13 17:10:51.696403 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3344/6734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:51 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:51.805367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:51.806175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:51.812371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.812840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.813305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.814029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:51.814486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:51.814913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:51.960268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.969170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.970795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:51.972071 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee53a535-3921-4fce-8ad1-deb92df3c585 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.171080 Sep 13 17:10:51.972733 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3391/6735] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:10:51 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:10:52.721979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:52.722608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:52.730169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:52.730880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:52.732085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:52.733046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:52.733528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:52.734007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:52.997003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:52.998896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:53.006753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:53.007573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:53.008022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:53.008807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:53.009470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:53.009939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:53.186263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:53.195962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:53.197689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:53.199307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9990654f-1387-488a-b2ab-23a4ac1a67e0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1723 microversion: 2.20 time: 0.206366 Sep 13 17:10:53.199945 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3392/6736] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:10:52 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 17:10:53.416348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:53.425288 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bf195f7-14d1-4eb8-a314-b43a6a9bf91e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1395 microversion: 2.1 time: 0.707342 Sep 13 17:10:53.425910 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3345/6737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:52 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1395 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:10:53.876734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4578ef60-6f4f-4fea-b9f7-0fd802bc6bac req-620c9d08-8581-48eb-8646-66f0c5bd6bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7727f00e-cc39-47eb-8a10-bcae96e85e24", "name": "network-vif-deleted", "tag": "b5941a78-df74-4365-98be-98198180be44"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:53.897075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4578ef60-6f4f-4fea-b9f7-0fd802bc6bac req-620c9d08-8581-48eb-8646-66f0c5bd6bb6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:53.897484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4578ef60-6f4f-4fea-b9f7-0fd802bc6bac req-620c9d08-8581-48eb-8646-66f0c5bd6bb6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:53.898439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4578ef60-6f4f-4fea-b9f7-0fd802bc6bac req-620c9d08-8581-48eb-8646-66f0c5bd6bb6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:53.923105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4578ef60-6f4f-4fea-b9f7-0fd802bc6bac req-620c9d08-8581-48eb-8646-66f0c5bd6bb6 service nova] Creating event network-vif-deleted:b5941a78-df74-4365-98be-98198180be44 for instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 on n-h1-857467-1 Sep 13 17:10:53.929031 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4578ef60-6f4f-4fea-b9f7-0fd802bc6bac req-620c9d08-8581-48eb-8646-66f0c5bd6bb6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055794 Sep 13 17:10:53.929660 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3393/6738] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:10:54.232388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:54.233539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:54.253855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:54.255229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:54.255854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:54.256775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:54.257415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:54.258088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:54.331314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:54.332065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:54.332938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:54.333619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lazy-loading 'fault' on Instance uuid 7727f00e-cc39-47eb-8a10-bcae96e85e24 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:10:54.394144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:54.405862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:54.408047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3373515c917c4188b8e172654ad55668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c890c3a8f01e4c0281f787dc451365bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:54.409519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b0b6c11c-04c3-4064-8d2a-7f83121876d0 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 200 len: 1371 microversion: 2.20 time: 0.184206 Sep 13 17:10:54.410612 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3346/6739] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:10:54 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 17:10:54.450902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:54.452248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:54.460115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:54.460711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:54.461380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:54.462351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:54.463020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:54.463917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:54.543337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:54.551953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-401da95e-0cf3-45f0-9d1c-1553b97a956e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1187 microversion: 2.1 time: 0.106666 Sep 13 17:10:54.566949 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3394/6740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:54 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:55.441462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:55.442684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:55.451826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:55.452496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:55.452960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:55.453689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:55.454373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:55.454815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:55.473653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] HTTP exception thrown: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Request method failure captured: Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 HTTP/1.1 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILd3cyAHeSsZHiHnCWcgc1xPs16F068VQo5jyL_QCk1gI9WRNxM5Bkw_GZkASMaGTgQ0P4ov8JbVvywMYwFZXYwx2mDTHqdZnq5TkER-x6M-nawXpV1IRq9xF8r61f7OQ3y21bljZ9vn0jRwe8GtSmXrPI9TBkAg5A9Wb2UNbx89DZ4 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3373515c917c4188b8e172654ad55668 Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7727f00e-cc39-47eb-8a10-bcae96e85e24'} Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:55.475391 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Returning 404 to user: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b4f4b50-00d7-4549-9e0d-97d71a75dcfa tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 404 len: 111 microversion: 2.20 time: 0.040995 Sep 13 17:10:55.480313 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3347/6741] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:10:55 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:10:55.488454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c80813a1-80b9-4eda-963f-d3ef5aad9734 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '.version_select at 0x7fbeb407e790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:55.513536 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c80813a1-80b9-4eda-963f-d3ef5aad9734 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362054959" status: 204 len: 0 microversion: 2.20 time: 0.029164 Sep 13 17:10:55.515588 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3395/6742] 10.222.0.61 () {60 vars in 1259 bytes} [Tue Sep 13 17:10:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362054959 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 17:10:55.577728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:55.578429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:55.587875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:55.589866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:55.590325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:55.592145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:55.592621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:55.593063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:55.701368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:55.712591 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-972ce768-ead2-432f-8632-f9cd5d9adb2e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1187 microversion: 2.1 time: 0.139724 Sep 13 17:10:55.713622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3348/6743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:55 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:55.952387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-7275baf8-c49d-4674-b677-4be876cf23c6 req-3dcfbb15-c57b-47a5-b7ac-2465ec7d378c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec781cc-447a-4819-a4c8-70a197bca7e7", "name": "network-vif-deleted", "tag": "bd64ab64-56dd-41f5-ad7a-e0da3970eee0"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:55.962691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7275baf8-c49d-4674-b677-4be876cf23c6 req-3dcfbb15-c57b-47a5-b7ac-2465ec7d378c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:55.963521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7275baf8-c49d-4674-b677-4be876cf23c6 req-3dcfbb15-c57b-47a5-b7ac-2465ec7d378c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:55.964201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7275baf8-c49d-4674-b677-4be876cf23c6 req-3dcfbb15-c57b-47a5-b7ac-2465ec7d378c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:55.976406 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-7275baf8-c49d-4674-b677-4be876cf23c6 req-3dcfbb15-c57b-47a5-b7ac-2465ec7d378c service nova] Creating event network-vif-deleted:bd64ab64-56dd-41f5-ad7a-e0da3970eee0 for instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 on n-h2-857467-1 Sep 13 17:10:55.982425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-7275baf8-c49d-4674-b677-4be876cf23c6 req-3dcfbb15-c57b-47a5-b7ac-2465ec7d378c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Sep 13 17:10:55.984160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3396/6744] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:10:56.737533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:56.738205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:56.749661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:56.756798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:56.757520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:56.758535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:56.759195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:56.759858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:56.768084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:10:56.928296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:56.938114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b3504e9-7be4-4442-875c-89d58f4ef1fd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1187 microversion: 2.1 time: 0.204777 Sep 13 17:10:56.941496 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3349/6745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:56 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1187 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:57.330364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:10:57.334025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:57.344245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:57.345017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:57.345715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:57.346943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:57.347628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:57.348387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:57.423804 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-547f8d1b-8d57-4553-95ee-5a9a0c21d11d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action" status: 200 len: 24572 microversion: 2.1 time: 0.097448 Sep 13 17:10:57.430844 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3397/6746] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:10:57 2022] POST /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551/action => generated 24572 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:10:57.962091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:57.963529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:57.974032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:57.974884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:57.975431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:57.976246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:57.977356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:57.978095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:58.069466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:58.079062 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ab88bba-63e5-4472-b523-1e4b11db61fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1187 microversion: 2.1 time: 0.120837 Sep 13 17:10:58.080348 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3350/6747] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:57 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:59.103905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:59.105680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:59.114570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.115506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.116181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.116981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.117512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.118045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.155970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.156550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.157074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.157603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lazy-loading 'fault' on Instance uuid 9ec781cc-447a-4819-a4c8-70a197bca7e7 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:10:59.213037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:10:59.221337 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b94c3672-b808-4711-a666-82a55479f7b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 200 len: 1192 microversion: 2.1 time: 0.122247 Sep 13 17:10:59.222262 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3398/6748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:10:59 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 1192 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:10:59.737145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:59.737665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:59.747301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.747818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.748261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.749536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.750530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.751123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.775317 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] HTTP exception thrown: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Request method failure captured: Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 HTTP/1.1 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILd3cyAHeSsZHiHnCWcgc1xPs16F068VQo5jyL_QCk1gI9WRNxM5Bkw_GZkASMaGTgQ0P4ov8JbVvywMYwFZXYwx2mDTHqdZnq5TkER-x6M-nawXpV1IRq9xF8r61f7OQ3y21bljZ9vn0jRwe8GtSmXrPI9TBkAg5A9Wb2UNbx89DZ4 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3373515c917c4188b8e172654ad55668 Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7727f00e-cc39-47eb-8a10-bcae96e85e24'} Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:10:59.777178 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Returning 404 to user: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-720da3a4-1067-4929-ad7b-ede6807ea16c tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 404 len: 111 microversion: 2.20 time: 0.047347 Sep 13 17:10:59.783217 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3351/6749] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 17:10:59 2022] DELETE /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:10:59.790815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:10:59.791443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 7727f00e-cc39-47eb-8a10-bcae96e85e24] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:10:59.798934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.799455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.799905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.800621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:10:59.801118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:10:59.801554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:10:59.818988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] HTTP exception thrown: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Request method failure captured: Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 HTTP/1.1 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILd3cyAHeSsZHiHnCWcgc1xPs16F068VQo5jyL_QCk1gI9WRNxM5Bkw_GZkASMaGTgQ0P4ov8JbVvywMYwFZXYwx2mDTHqdZnq5TkER-x6M-nawXpV1IRq9xF8r61f7OQ3y21bljZ9vn0jRwe8GtSmXrPI9TBkAg5A9Wb2UNbx89DZ4 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 3373515c917c4188b8e172654ad55668 Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '7727f00e-cc39-47eb-8a10-bcae96e85e24'} Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.821095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. Sep 13 17:10:59.825588 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:10:59.827098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Returning 404 to user: Instance 7727f00e-cc39-47eb-8a10-bcae96e85e24 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:10:59.828363 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d9f1477-e4b7-4d9e-af52-2f16ec6370eb tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24" status: 404 len: 111 microversion: 2.20 time: 0.041613 Sep 13 17:10:59.829906 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3399/6750] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:10:59 2022] GET /compute/v2.1/servers/7727f00e-cc39-47eb-8a10-bcae96e85e24 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:11:00.245488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:00.246489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 9ec781cc-447a-4819-a4c8-70a197bca7e7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:00.253721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:00.254413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:00.254995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:00.255840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:00.256694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:00.257237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:00.274907 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 could not be found. Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 HTTP/1.1 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 could not be found. Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9ec781cc-447a-4819-a4c8-70a197bca7e7'} Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 could not be found. Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 could not be found. Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:00.277098 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 could not be found. Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 9ec781cc-447a-4819-a4c8-70a197bca7e7 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4dcaa9e3-a86c-46d7-8a21-aa8cb347f59a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7" status: 404 len: 111 microversion: 2.1 time: 0.037213 Sep 13 17:11:00.281593 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3352/6751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:00 2022] GET /compute/v2.1/servers/9ec781cc-447a-4819-a4c8-70a197bca7e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:11:03.161709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:03.162698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:03.169863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:03.170369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:03.170810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:03.172225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:03.173056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:03.173655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:03.189304 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] HTTP exception thrown: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Request method failure captured: Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 HTTP/1.1 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILd3cyAHeSsZHiHnCWcgc1xPs16F068VQo5jyL_QCk1gI9WRNxM5Bkw_GZkASMaGTgQ0P4ov8JbVvywMYwFZXYwx2mDTHqdZnq5TkER-x6M-nawXpV1IRq9xF8r61f7OQ3y21bljZ9vn0jRwe8GtSmXrPI9TBkAg5A9Wb2UNbx89DZ4 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 3373515c917c4188b8e172654ad55668 Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '29d909e3-38da-446a-aa1b-43996bce9ea1'} Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:11:03.191166 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Returning 404 to user: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:03.195921 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e1c9169-9edc-43ff-8588-9356fbba1860 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 404 len: 111 microversion: 2.20 time: 0.035113 Sep 13 17:11:03.197524 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3400/6752] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Sep 13 17:11:03 2022] DELETE /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:11:03.203419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:03.203893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] [instance: 29d909e3-38da-446a-aa1b-43996bce9ea1] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:03.213444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:03.214048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:03.214965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:03.215925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:03.216409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:03.216858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:03.234346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] HTTP exception thrown: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Request method failure captured: Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 HTTP/1.1 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILd3cyAHeSsZHiHnCWcgc1xPs16F068VQo5jyL_QCk1gI9WRNxM5Bkw_GZkASMaGTgQ0P4ov8JbVvywMYwFZXYwx2mDTHqdZnq5TkER-x6M-nawXpV1IRq9xF8r61f7OQ3y21bljZ9vn0jRwe8GtSmXrPI9TBkAg5A9Wb2UNbx89DZ4 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c890c3a8f01e4c0281f787dc451365bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: c890c3a8f01e4c0281f787dc451365bc Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2028946619 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 3373515c917c4188b8e172654ad55668 Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2028946619-project Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '29d909e3-38da-446a-aa1b-43996bce9ea1'} Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.236543 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] Returning 404 to user: Instance 29d909e3-38da-446a-aa1b-43996bce9ea1 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33831011-d6c3-4739-b74a-843ea5d5c316 tempest-AttachVolumeShelveTestJSON-2028946619 tempest-AttachVolumeShelveTestJSON-2028946619-project] 10.222.0.61 "GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1" status: 404 len: 111 microversion: 2.20 time: 0.039547 Sep 13 17:11:03.241230 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3353/6753] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Sep 13 17:11:03 2022] GET /compute/v2.1/servers/29d909e3-38da-446a-aa1b-43996bce9ea1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:11:10.087972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd1ea3d6-bf16-4c2e-80f4-d2f7dd23fa59 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb40a99d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:10.144873 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd1ea3d6-bf16-4c2e-80f4-d2f7dd23fa59 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f24bd198-bf4e-4e65-8f73-7761e75f98c6" status: 200 len: 351 microversion: 2.1 time: 0.061020 Sep 13 17:11:10.145463 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3401/6754] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:11:10 2022] GET /compute/v2.1/os-volumes/f24bd198-bf4e-4e65-8f73-7761e75f98c6 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:11.570834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd06488a-0bae-406e-8775-590f4fe31d2f tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeafe870d0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:11.625098 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd06488a-0bae-406e-8775-590f4fe31d2f tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/63f76109-3ee0-4687-b454-344445ca7c76" status: 200 len: 350 microversion: 2.1 time: 0.058242 Sep 13 17:11:11.626031 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3354/6755] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:11:11 2022] GET /compute/v2.1/os-volumes/63f76109-3ee0-4687-b454-344445ca7c76 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:13.026320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f4085af-e2b6-4a20-a490-8cd6f7b9b9cd tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb40ae5e0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.117609 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f4085af-e2b6-4a20-a490-8cd6f7b9b9cd tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fdd192fe-b85f-44d3-9f59-9741152f5a0e" status: 200 len: 351 microversion: 2.1 time: 0.096837 Sep 13 17:11:13.118403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3402/6756] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes/fdd192fe-b85f-44d3-9f59-9741152f5a0e => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:13.133044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a6f45f3-e837-40ba-92f4-e786fa6f1b2f tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb95b9160>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.214014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:13.222642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=17 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:13.242424 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a6f45f3-e837-40ba-92f4-e786fa6f1b2f tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.113075 Sep 13 17:11:13.243010 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3355/6757] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:13.258254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f05b5f38-63f7-4921-8e70-7a5c5911bb17 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb40fa280>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.267999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:13.269511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:13.382201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f05b5f38-63f7-4921-8e70-7a5c5911bb17 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128664 Sep 13 17:11:13.398467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3403/6758] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:11:13.401988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b7f48f6c-a474-48eb-b0b4-2052fdd57057 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeafeecc10>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.514307 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b7f48f6c-a474-48eb-b0b4-2052fdd57057 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.118090 Sep 13 17:11:13.514901 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3356/6759] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:13.529806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc34052e-d661-4ea3-be99-48879979c71d tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb40930d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.636529 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc34052e-d661-4ea3-be99-48879979c71d tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.111889 Sep 13 17:11:13.648064 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3404/6760] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:13.652744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1e7cc3b-5b8d-4179-8b46-68fafca509e0 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb95b91f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.760693 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1e7cc3b-5b8d-4179-8b46-68fafca509e0 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.112081 Sep 13 17:11:13.761260 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3357/6761] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:11:13.776783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13f1a9fd-731e-447c-902e-34e5ca8296a6 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb40461f0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:13.888537 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13f1a9fd-731e-447c-902e-34e5ca8296a6 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.116149 Sep 13 17:11:13.891826 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3405/6762] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:13.905304 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:11:13.905517 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:11:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/detail?offset=1&limit=1 (ip 10.222.0.61) !!! Sep 13 17:11:13.909639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f12fa866-8c4d-4ebc-942a-c62e5c1f011b tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb53a9940>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:14.004811 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f12fa866-8c4d-4ebc-942a-c62e5c1f011b tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102901 Sep 13 17:11:14.005427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3358/6763] 10.222.0.61 () {58 vars in 1188 bytes} [Tue Sep 13 17:11:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:14.020540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9c052df-5bfb-45c8-8812-abde1cb267d5 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] Calling method '.version_select at 0x7fbeb40aec10>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:14.135180 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9c052df-5bfb-45c8-8812-abde1cb267d5 tempest-VolumesTestJSON-663475528 tempest-VolumesTestJSON-663475528-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.118481 Sep 13 17:11:14.135771 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3406/6764] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Sep 13 17:11:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:20.714282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:20.715008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:20.735684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:20.736292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:20.736839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:20.737638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:20.738219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:20.738727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:20.932297 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb2308d0-0b81-4e2a-97e7-7c845ed07634 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1832 microversion: 2.1 time: 0.222777 Sep 13 17:11:20.941278 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3359/6765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:20 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1832 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:22.754813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:22.755944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:22.774085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-584a487c-103e-400f-a7eb-a00d4448d569 req-91577e13-81b4-4f1a-9ece-a34ced3a073b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:22.803718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-584a487c-103e-400f-a7eb-a00d4448d569 req-91577e13-81b4-4f1a-9ece-a34ced3a073b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:22.806590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-584a487c-103e-400f-a7eb-a00d4448d569 req-91577e13-81b4-4f1a-9ece-a34ced3a073b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:22.818477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-584a487c-103e-400f-a7eb-a00d4448d569 req-91577e13-81b4-4f1a-9ece-a34ced3a073b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:22.887548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-584a487c-103e-400f-a7eb-a00d4448d569 req-91577e13-81b4-4f1a-9ece-a34ced3a073b service nova] Creating event network-changed:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h1-857467-1 Sep 13 17:11:22.897502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-584a487c-103e-400f-a7eb-a00d4448d569 req-91577e13-81b4-4f1a-9ece-a34ced3a073b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128892 Sep 13 17:11:22.903161 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3360/6766] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:11:23.205794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:23.206681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:23.206976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:23.207872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:23.209327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:23.209327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:23.253849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:11:23.410285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c5d18623-4ca0-48d6-905a-ce19242edff4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 204 len: 0 microversion: 2.1 time: 0.658015 Sep 13 17:11:23.412648 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3407/6767] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:11:22 2022] DELETE /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:11:23.422423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:23.423391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:23.444383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:23.454013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:23.455557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:23.461089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:23.461964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:23.462687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:23.724984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:23.734856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-343979e4-21a9-4e5d-a7b9-21157b95e9fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1687 microversion: 2.1 time: 0.317647 Sep 13 17:11:23.737866 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3361/6768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:23 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1687 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:24.540654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4092ba33-1a86-445c-801d-111309186e23 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Action: 'create', calling method: .version_select at 0x7fbeb4171dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1327615493", "metadata": {"Type": "work"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4092ba33-1a86-445c-801d-111309186e23 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Request method failure captured: Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 122 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILm8WaTcTMaIdAkaCetllv-KM5JF7qBKtafE-JnK6nr3kBCZuiMzu_FC0N071GamKqwn6jPdDSR95eqSXbcA7bRsdO4ttCQHZi3doBzNSz7Ldeu31gS0Pip72l0XcHiI-JYOnIc5ajWE1IB6_9ZK4i91NhcTnUDUKDYal_LDiSyuGVw Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62157de110e64bb3a10c921a94b74352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 9a524ce9915042a19b8ec1d3e91b0f8f Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1327615493", "metadata": {"Type": "work"}}} Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1327615493', 'metadata': {'Type': 'work'}}}} Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 17:11:24.554195 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 17:11:24.560310 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.562451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4092ba33-1a86-445c-801d-111309186e23 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:24.563334 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4092ba33-1a86-445c-801d-111309186e23 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.216081 Sep 13 17:11:24.563922 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3408/6769] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Sep 13 17:11:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:11:24.574040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b3d2dde3-f507-479e-ae61-ac210411386f tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Action: 'create', calling method: .version_select at 0x7fbeb45ddaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-636644570", "metadata": {"Type": "work"}}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b3d2dde3-f507-479e-ae61-ac210411386f tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Request method failure captured: Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 119 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILm8WaTcTMaIdAkaCetllv-KM5JF7qBKtafE-JnK6nr3kBCZuiMzu_FC0N071GamKqwn6jPdDSR95eqSXbcA7bRsdO4ttCQHZi3doBzNSz7Ldeu31gS0Pip72l0XcHiI-JYOnIc5ajWE1IB6_9ZK4i91NhcTnUDUKDYal_LDiSyuGVw Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62157de110e64bb3a10c921a94b74352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 9a524ce9915042a19b8ec1d3e91b0f8f Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-636644570", "metadata": {"Type": "work"}}} Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-636644570', 'metadata': {'Type': 'work'}}}} Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '0' Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 17:11:24.578663 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 17:11:24.583731 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.585976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b3d2dde3-f507-479e-ae61-ac210411386f tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:24.585976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b3d2dde3-f507-479e-ae61-ac210411386f tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016395 Sep 13 17:11:24.586556 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3362/6770] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Sep 13 17:11:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 17:11:24.597574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1b6af8e-a4c0-4d06-9d22-96de0989abb8 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Action: 'create', calling method: .version_select at 0x7fbeb4171700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-97767742", "metadata": {"Type": "work"}}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1b6af8e-a4c0-4d06-9d22-96de0989abb8 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Request method failure captured: Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 117 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILm8WaTcTMaIdAkaCetllv-KM5JF7qBKtafE-JnK6nr3kBCZuiMzu_FC0N071GamKqwn6jPdDSR95eqSXbcA7bRsdO4ttCQHZi3doBzNSz7Ldeu31gS0Pip72l0XcHiI-JYOnIc5ajWE1IB6_9ZK4i91NhcTnUDUKDYal_LDiSyuGVw Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62157de110e64bb3a10c921a94b74352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 9a524ce9915042a19b8ec1d3e91b0f8f Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-97767742", "metadata": {"Type": "work"}}} Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-97767742', 'metadata': {'Type': 'work'}}}} Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise error Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi '' Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 17:11:24.601916 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c1b6af8e-a4c0-4d06-9d22-96de0989abb8 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c1b6af8e-a4c0-4d06-9d22-96de0989abb8 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011194 Sep 13 17:11:24.608008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3409/6771] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Sep 13 17:11:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 17:11:24.614619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c11fad83-be51-4045-92d0-5644be0cc610 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Calling method '.version_select at 0x7fbeafe9c430>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:24.656009 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c11fad83-be51-4045-92d0-5644be0cc610 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] HTTP exception thrown: Volume tempest-invalid-279213841 could not be found. Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c11fad83-be51-4045-92d0-5644be0cc610 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Request method failure captured: Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-279213841 HTTP/1.1 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILm8WaTcTMaIdAkaCetllv-KM5JF7qBKtafE-JnK6nr3kBCZuiMzu_FC0N071GamKqwn6jPdDSR95eqSXbcA7bRsdO4ttCQHZi3doBzNSz7Ldeu31gS0Pip72l0XcHiI-JYOnIc5ajWE1IB6_9ZK4i91NhcTnUDUKDYal_LDiSyuGVw Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62157de110e64bb3a10c921a94b74352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 9a524ce9915042a19b8ec1d3e91b0f8f Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: method: Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: exception: Volume tempest-invalid-279213841 could not be found. Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'tempest-invalid-279213841'} Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-279213841 could not be found. (HTTP 404) (Request-ID: req-456d192a-bbe3-430b-aa64-3fa390170aed) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:11:24.659585 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-279213841 could not be found. Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-279213841 could not be found. Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-279213841 could not be found. Sep 13 17:11:24.664905 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.670985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c11fad83-be51-4045-92d0-5644be0cc610 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Returning 404 to user: Volume tempest-invalid-279213841 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:24.672732 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c11fad83-be51-4045-92d0-5644be0cc610 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-279213841" status: 404 len: 98 microversion: 2.1 time: 0.062914 Sep 13 17:11:24.673989 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3363/6772] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Sep 13 17:11:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-279213841 => generated 98 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 17:11:24.682727 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-adb0196d-9d86-4642-8da7-3f990ebf8278 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003726 Sep 13 17:11:24.683229 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3410/6773] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Sep 13 17:11:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 13 17:11:24.700842 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae3f96a3-e8ce-4e2e-ab47-02e7e3cebfe0 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011003 Sep 13 17:11:24.702283 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3364/6774] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Sep 13 17:11:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 17:11:24.713847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-691ac51c-4ede-4f67-9afb-cc690f066293 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Calling method '.version_select at 0x7fbeb4162ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:24.749739 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-691ac51c-4ede-4f67-9afb-cc690f066293 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] HTTP exception thrown: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-691ac51c-4ede-4f67-9afb-cc690f066293 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Request method failure captured: Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/os-volumes/0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 HTTP/1.1 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILm8WaTcTMaIdAkaCetllv-KM5JF7qBKtafE-JnK6nr3kBCZuiMzu_FC0N071GamKqwn6jPdDSR95eqSXbcA7bRsdO4ttCQHZi3doBzNSz7Ldeu31gS0Pip72l0XcHiI-JYOnIc5ajWE1IB6_9ZK4i91NhcTnUDUKDYal_LDiSyuGVw Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62157de110e64bb3a10c921a94b74352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 9a524ce9915042a19b8ec1d3e91b0f8f Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: exception: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70'} Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. (HTTP 404) (Request-ID: req-d37e5936-05c8-4274-9070-02ae2bc9bb1d) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:11:24.752379 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. Sep 13 17:11:24.757156 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.761462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-691ac51c-4ede-4f67-9afb-cc690f066293 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Returning 404 to user: Volume 0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:24.761462 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-691ac51c-4ede-4f67-9afb-cc690f066293 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70" status: 404 len: 109 microversion: 2.1 time: 0.054591 Sep 13 17:11:24.764365 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3411/6775] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Sep 13 17:11:24 2022] DELETE /compute/v2.1/os-volumes/0c3e9acf-6c6e-4daa-8a6a-642db9a0bc70 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:11:24.785599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6e13e55-c170-418a-b193-7f269061a730 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Calling method '.version_select at 0x7fbeb4162790>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:24.794150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:24.807208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:24.825248 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-f6e13e55-c170-418a-b193-7f269061a730 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] HTTP exception thrown: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6e13e55-c170-418a-b193-7f269061a730 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Request method failure captured: Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/os-volumes/209768a4-7d5f-4f34-abb9-377c008696b8 HTTP/1.1 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILm8WaTcTMaIdAkaCetllv-KM5JF7qBKtafE-JnK6nr3kBCZuiMzu_FC0N071GamKqwn6jPdDSR95eqSXbcA7bRsdO4ttCQHZi3doBzNSz7Ldeu31gS0Pip72l0XcHiI-JYOnIc5ajWE1IB6_9ZK4i91NhcTnUDUKDYal_LDiSyuGVw Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62157de110e64bb3a10c921a94b74352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62157de110e64bb3a10c921a94b74352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 62157de110e64bb3a10c921a94b74352 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesNegativeTest-2065691861 Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 9a524ce9915042a19b8ec1d3e91b0f8f Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesNegativeTest-2065691861-project Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: method: Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: exception: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '209768a4-7d5f-4f34-abb9-377c008696b8'} Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. (HTTP 404) (Request-ID: req-83836d25-a250-4c00-86e6-ab9308febf6d) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 17:11:24.828925 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:24.834284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6e13e55-c170-418a-b193-7f269061a730 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] Returning 404 to user: Volume 209768a4-7d5f-4f34-abb9-377c008696b8 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:24.838786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6e13e55-c170-418a-b193-7f269061a730 tempest-VolumesNegativeTest-2065691861 tempest-VolumesNegativeTest-2065691861-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/209768a4-7d5f-4f34-abb9-377c008696b8" status: 404 len: 109 microversion: 2.1 time: 0.056892 Sep 13 17:11:24.838910 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3412/6776] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Sep 13 17:11:24 2022] GET /compute/v2.1/os-volumes/209768a4-7d5f-4f34-abb9-377c008696b8 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:11:24.846241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:24.846789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:24.851209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:24.852001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:24.852501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:24.852954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:25.179850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:25.191785 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89ac683c-730c-4977-a2f4-dec2c2fdebec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1568 microversion: 2.1 time: 0.428157 Sep 13 17:11:25.192983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3365/6777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:24 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1568 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:25.842246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-db895a8a-37da-4f02-97d9-71d2775216a4 req-02b53e95-98b1-4f9f-8f0b-8302132ee5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551", "name": "network-vif-deleted", "tag": "61b33a5e-55e7-44c3-b461-8d882119a4e6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:25.883617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db895a8a-37da-4f02-97d9-71d2775216a4 req-02b53e95-98b1-4f9f-8f0b-8302132ee5ff service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:25.884685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db895a8a-37da-4f02-97d9-71d2775216a4 req-02b53e95-98b1-4f9f-8f0b-8302132ee5ff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:25.885377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db895a8a-37da-4f02-97d9-71d2775216a4 req-02b53e95-98b1-4f9f-8f0b-8302132ee5ff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:25.938083 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-db895a8a-37da-4f02-97d9-71d2775216a4 req-02b53e95-98b1-4f9f-8f0b-8302132ee5ff service nova] Creating event network-vif-deleted:61b33a5e-55e7-44c3-b461-8d882119a4e6 for instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 on n-h1-857467-1 Sep 13 17:11:25.951189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-db895a8a-37da-4f02-97d9-71d2775216a4 req-02b53e95-98b1-4f9f-8f0b-8302132ee5ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122619 Sep 13 17:11:25.955218 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3413/6778] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:26.216988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:26.218350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:26.227518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:26.235789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:26.236849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:26.237627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:26.239794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:26.240249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:26.301537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:26.302288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:26.302907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:26.303539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lazy-loading 'fault' on Instance uuid 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:11:26.377042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:26.402658 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9659a796-83c2-4072-a04e-402434f59f9b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 200 len: 1356 microversion: 2.1 time: 0.189787 Sep 13 17:11:26.403296 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3366/6779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:26 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:27.428378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:27.429087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:27.436951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:27.437455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:27.437920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:27.439135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:27.439811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:27.440499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:27.457411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] HTTP exception thrown: Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 could not be found. Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Request method failure captured: Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 HTTP/1.1 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILkBD_BBT3s4zy_iG7sW47eVxVhtuVN_LpJ6eyAUTVvnGgEm9nSZ71UjSc1mqRFOMtzGHRtuKPNYOb27Y7896o9j0UBG-IY446yIe1mwU0n5obKNM0QrU6LYkTdijiJKBk0jXG5U2VW_weDPuhy7fiXeRA5C3vy8OT4OYrDX05PpuzM Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7aa877fdd453495997fbbc66a9bd1b1b Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 could not be found. Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551'} Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 could not be found. Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 could not be found. Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:27.459281 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 could not be found. Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Returning 404 to user: Instance 69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:11:27.464095 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82b8cca7-9a15-4619-974c-280d7a26158c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551" status: 404 len: 111 microversion: 2.1 time: 0.037908 Sep 13 17:11:27.465251 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3414/6780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:27 2022] GET /compute/v2.1/servers/69e11cb1-6ff7-4fc9-a1d0-0cb9b1d54551 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:11:29.949021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1852179134", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "244bfa8d-0bf6-49c8-b55b-4a93f01e60f5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:30.120640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:11:30.870500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:11:30.872557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:11:30.873659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:11:30.874114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:11:30.874537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:11:30.892433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:30.893216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:30.893880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:30.894626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:30.895084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:30.895749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:30.930263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:11:30.939588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:11:30.956519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:11:30.960648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='244bfa8d-0bf6-49c8-b55b-4a93f01e60f5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:11:31.115195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4051946d-43d5-418c-b977-10975de5a877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176058 Sep 13 17:11:31.132835 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3367/6781] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:11:31.143759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4a8da33a-767b-4bc9-ad38-e0ff3a68c9e0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:31.145311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4a8da33a-767b-4bc9-ad38-e0ff3a68c9e0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:31.267965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4a8da33a-767b-4bc9-ad38-e0ff3a68c9e0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:31.293649 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4a8da33a-767b-4bc9-ad38-e0ff3a68c9e0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1057 microversion: 2.1 time: 0.158252 Sep 13 17:11:31.294872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3415/6782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:31 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1057 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:32.179812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-01a33e71-2608-4549-acd9-abdbb14f9c47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '.version_select at 0x7fbeafe9c280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:32.228734 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-01a33e71-2608-4549-acd9-abdbb14f9c47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-848108569" status: 202 len: 0 microversion: 2.1 time: 0.052700 Sep 13 17:11:32.234361 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3368/6783] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Sep 13 17:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-848108569 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:11:32.266716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6d58694-400f-4fcb-9fce-28852f9ee9f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: .version_select at 0x7fbeb45f2160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1854626087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr2Ix/Sr+blwaY02E2GiXiSzK15bHLEqqtRo9fNFx4bolKIbwOHbhIeS+7UhAv+nnrqGnD4zWYGhnWRa6f9dipAqxMGR6SXy11II4HhbvYIORKj+6PtM8QlOQZzY9swIQ=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:32.289675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d6d58694-400f-4fcb-9fce-28852f9ee9f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:11:32.299954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d6d58694-400f-4fcb-9fce-28852f9ee9f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:11:32.321497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:32.322303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:32.330242 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6d58694-400f-4fcb-9fce-28852f9ee9f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.068944 Sep 13 17:11:32.339586 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3416/6784] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:11:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:32.351950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:32.352748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:32.353360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:32.354456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:32.355216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:32.355819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:32.440791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:32.451850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95e82854-65a1-4d5c-9096-29391f0e1aa2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1109 microversion: 2.1 time: 0.138777 Sep 13 17:11:32.452494 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3369/6785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:32 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1109 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:33.479865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:33.481090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:33.493367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:33.498457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:33.499134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:33.500090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:33.500763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:33.501689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:33.654815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:33.666425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-565e74d4-6846-4f4a-960c-7d40087f5fe7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1127 microversion: 2.1 time: 0.191230 Sep 13 17:11:33.676004 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3417/6786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:33 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1127 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:34.705226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:34.706557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:34.728521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:34.729407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:34.733642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:34.739986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:34.743517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:34.744357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:35.099615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:35.114131 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e25e8380-ca9a-42a5-93d0-87d8ee256a5a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.416682 Sep 13 17:11:35.115974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3370/6787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:34 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:35.680505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-efaf9670-54ed-41bd-b44b-be180134f438 req-b538e0fe-e23b-40b0-b7ca-eaa4d6340ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857324ca-99e4-470b-9894-31f0f2075a55", "tag": "42b897eb-0cbb-42c0-ad11-7d758c176a9b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:35.700385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-efaf9670-54ed-41bd-b44b-be180134f438 req-b538e0fe-e23b-40b0-b7ca-eaa4d6340ef5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:35.700762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-efaf9670-54ed-41bd-b44b-be180134f438 req-b538e0fe-e23b-40b0-b7ca-eaa4d6340ef5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:35.701197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-efaf9670-54ed-41bd-b44b-be180134f438 req-b538e0fe-e23b-40b0-b7ca-eaa4d6340ef5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:35.720977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-efaf9670-54ed-41bd-b44b-be180134f438 req-b538e0fe-e23b-40b0-b7ca-eaa4d6340ef5 service nova] Creating event network-changed:42b897eb-0cbb-42c0-ad11-7d758c176a9b for instance 857324ca-99e4-470b-9894-31f0f2075a55 on n-h2-857467-1 Sep 13 17:11:35.726784 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-efaf9670-54ed-41bd-b44b-be180134f438 req-b538e0fe-e23b-40b0-b7ca-eaa4d6340ef5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051913 Sep 13 17:11:35.728194 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3418/6788] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:36.141450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:36.142143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:36.154619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:36.155137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:36.155577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:36.156313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:36.158408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:36.160121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:36.560443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:36.570811 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e28db516-d529-4be2-8e3a-2cdd8754d441 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.434011 Sep 13 17:11:36.574520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3371/6789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:36 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:37.600582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:37.601298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:37.610032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:37.610537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:37.610985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:37.611699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:37.612183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:37.612609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:38.491534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:38.508541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e30ad33-aa1a-4b78-90ad-5440d2322692 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.908286 Sep 13 17:11:38.510605 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3419/6790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:37 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:39.538575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:39.540909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:39.568489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:39.577103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:39.580094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:39.581161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:39.582782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:39.584364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:40.162089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:40.176851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55cc430e-0d86-4d20-97f7-ec183480b18b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.645207 Sep 13 17:11:40.178096 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3372/6791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:39 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:41.223358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:41.223358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:41.230795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:41.231029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:41.231451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:41.232261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:41.232747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:41.233165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:41.532843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:41.544686 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ddc1a92-793d-41c8-95b0-49771492e0c1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.344207 Sep 13 17:11:41.562420 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3420/6792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:41 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:42.576814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:42.579517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:42.610191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:42.611002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:42.612902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:42.613568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:42.614208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:42.615165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:42.615777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:42.616423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:42.979762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:42.994558 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08f49da3-243a-41a9-991e-b16366a4f53d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.426806 Sep 13 17:11:42.997297 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3373/6793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:42 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:44.022372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:44.023751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:44.027971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:44.037737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:44.059256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:44.068230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:44.068952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:44.075448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:44.076065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:44.081596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:44.168631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:44.581166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:44.603739 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aafe9863-c70f-460d-a68f-fe0244a89e0f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.585325 Sep 13 17:11:44.610186 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3421/6794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:44 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:45.628981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:45.629602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:45.641376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:45.647051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:45.648551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:45.650493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:45.656459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:45.658191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:45.659087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:45.668804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=61 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:45.711239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-632384066", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "e3011cc2-ffa9-478a-b1c6-1c184b17622b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1854626087", "security_groups": [{"name": "tempest-secgroup-smoke-1803839695"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:45.988024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:46.010923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69ff9897-9cf0-4b11-9b25-a77c22dfdcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.385223 Sep 13 17:11:46.026636 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3374/6795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:45 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:46.048996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] validate_networks() for [('e3011cc2-ffa9-478a-b1c6-1c184b17622b', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:11:47.047187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:47.048035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:47.063810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:47.065257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:47.065996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:47.068224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:47.069283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:47.069981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:47.082109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:11:47.082692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:11:47.084616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:11:47.085144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:11:47.086154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:11:47.108542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:47.110074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:47.110761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:47.111639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:47.115427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:47.116172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:47.183844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:11:47.202741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:11:47.218093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:11:47.220473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:11:47.262318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:47.282357 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d52d551-39e3-48ff-8690-6386af69cd47 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.239349 Sep 13 17:11:47.285889 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2d6a636-6406-442a-8703-beefa9b54af9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.578847 Sep 13 17:11:47.286876 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3422/6796] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:11:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 17:11:47.296778 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3375/6797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:47 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:47.299589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55542f5d-00a6-435d-a5b9-a425b426e7f0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:47.300610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-55542f5d-00a6-435d-a5b9-a425b426e7f0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:47.380434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-55542f5d-00a6-435d-a5b9-a425b426e7f0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:47.391574 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55542f5d-00a6-435d-a5b9-a425b426e7f0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1266 microversion: 2.1 time: 0.096876 Sep 13 17:11:47.393191 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3423/6798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:47 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:48.318944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:48.319715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:48.331179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:48.331682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:48.339646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:48.341062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:48.342669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:48.343829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:48.420972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:48.423162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:48.442045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:48.442932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:48.443615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:48.444589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:48.445348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:48.446339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:48.575508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:48.586952 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bf6ea194-8a19-4c68-a263-33d8a29011f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1318 microversion: 2.1 time: 0.173642 Sep 13 17:11:48.598404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:48.606983 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8552e004-644a-4f94-b425-bcb026683fc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.291839 Sep 13 17:11:48.607974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3376/6799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:48 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:48.615379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3424/6800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:48 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:49.622281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:49.631006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:49.646155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:49.646155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:49.648023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:49.648023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:49.651791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:49.651791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:49.651791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:49.652327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:49.675406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:49.675912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:49.676358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:49.677066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:49.677532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:49.677999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:49.847246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:49.857974 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6be64db3-e557-4117-bd86-b45864e5a424 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1324 microversion: 2.1 time: 0.250495 Sep 13 17:11:49.863660 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3377/6801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:49 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:49.991904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:50.001750 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1973fda9-a694-4779-b724-811a4a032362 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.373723 Sep 13 17:11:50.012032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3425/6802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:49 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:50.888841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:50.889655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:50.900380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:50.909431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:50.910530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:50.911379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:50.911939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:50.912453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:51.026583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:51.027255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:51.043665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:51.044163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:51.045320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:51.055755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:51.057210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:51.058442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:51.216566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:51.227085 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b818559-71ad-4cdc-a66c-770b39a96717 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.342351 Sep 13 17:11:51.227673 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3378/6803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:50 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:51.334661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:51.345954 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b7e5a1a-a9dc-4bca-9d43-9cd949f7bb4b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.323801 Sep 13 17:11:51.359055 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3426/6804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:51 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:51.505422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ccba63e3-4ab1-4e93-a8d3-bb0a32792311 req-a2049125-ccf6-471c-8f7e-7267e738d73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:51.517612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ccba63e3-4ab1-4e93-a8d3-bb0a32792311 req-a2049125-ccf6-471c-8f7e-7267e738d73d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:51.519100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ccba63e3-4ab1-4e93-a8d3-bb0a32792311 req-a2049125-ccf6-471c-8f7e-7267e738d73d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:51.519930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ccba63e3-4ab1-4e93-a8d3-bb0a32792311 req-a2049125-ccf6-471c-8f7e-7267e738d73d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:51.553140 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ccba63e3-4ab1-4e93-a8d3-bb0a32792311 req-a2049125-ccf6-471c-8f7e-7267e738d73d service nova] Creating event network-changed:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:11:51.579392 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ccba63e3-4ab1-4e93-a8d3-bb0a32792311 req-a2049125-ccf6-471c-8f7e-7267e738d73d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077121 Sep 13 17:11:51.580499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3379/6805] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:11:52.253790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:52.254556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:52.261427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:52.262141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:52.262485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:52.263205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:52.263671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:52.264105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:52.372926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:52.380085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:52.396067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:52.396722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:52.397413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:52.398376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:52.399107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:52.399774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:52.488496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:52.501270 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e1d03b0-df60-4410-80bf-c1da0c126605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.252632 Sep 13 17:11:52.502525 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3427/6806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:52 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:52.618842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:52.635581 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b859febf-268e-492c-af05-ad8569056461 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.266604 Sep 13 17:11:52.638566 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3380/6807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:52 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:53.535106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:53.535889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:53.545620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:53.546615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:53.547632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:53.548702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:53.549522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:53.550234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:53.660644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:53.662180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:53.674617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:53.677174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:53.679396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:53.682157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:53.683357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:53.686222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:53.736783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:53.750665 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2bef69e5-d16b-41c0-8ac6-58dfb58d3e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.225339 Sep 13 17:11:53.774636 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3428/6808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:53 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:53.902157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:53.911229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e0cb321-08bc-44be-9233-0b81ffe59912 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.254337 Sep 13 17:11:53.912471 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3381/6809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:53 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:54.782079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:54.782807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:54.807925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:54.811151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:54.811899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:54.813099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:54.816334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:54.817147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:54.937295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:54.937735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:54.944916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:54.945838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:54.946485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:54.947408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:54.948084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:54.949579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:55.067881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:55.079589 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-398bc15b-245d-4cd2-ba12-3dc059a24581 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.301051 Sep 13 17:11:55.098387 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3429/6810] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:54 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:55.168239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:55.177402 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da676ec6-cbcc-4e59-9141-2d68af8f8b19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1169 microversion: 2.1 time: 0.246340 Sep 13 17:11:55.202605 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3382/6811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:54 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1169 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:56.106937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:56.108525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:56.116477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:56.117342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:56.118347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:56.119355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:56.120761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:56.121610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:56.218794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:56.220203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:56.227792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:56.228378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:56.228966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:56.230071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:56.230627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:56.231137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:56.325854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:56.335265 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79bf00d4-f275-4d77-bfbf-066080ee10f3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.232494 Sep 13 17:11:56.337306 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3430/6812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:56 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:56.486135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:56.496299 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71a0a78c-75e7-4911-a066-47591532a1b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1215 microversion: 2.1 time: 0.281995 Sep 13 17:11:56.497223 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3383/6813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:56 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:57.360564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:57.361373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:57.369534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:57.372830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:57.373533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:57.374325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:57.375453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:57.376432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:57.377566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:57.387738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:11:57.532344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:57.535321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:57.545877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:57.546748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:57.547436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:57.548423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:57.549251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:57.550127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:57.574195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:57.583961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad3218a7-3882-4bac-994e-3ba9e8043292 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.227694 Sep 13 17:11:57.585075 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3431/6814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:57 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:57.753274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:57.762928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ce1de34-ed08-48cf-ab86-c621a0f3c4d0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.245542 Sep 13 17:11:57.763528 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3384/6815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:57 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:11:58.611751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:58.614125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:58.628675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:58.629314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:58.630078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:58.630904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:58.631594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:58.632254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:58.787020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:58.787640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:58.805355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:58.806147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:58.806762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:58.808620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:58.809369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:58.809843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:58.810378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:58.820712 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2488dece-2f54-4cd0-8b25-b22c57e3235f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.214254 Sep 13 17:11:58.821406 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3432/6816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:58 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:58.891392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4f90ebaf-bd1b-4678-ae12-98f5789ca87d req-90cd6fe1-12c5-4e53-9153-9a09a8b82874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "name": "network-vif-plugged", "status": "completed", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:11:58.912335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4f90ebaf-bd1b-4678-ae12-98f5789ca87d req-90cd6fe1-12c5-4e53-9153-9a09a8b82874 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:58.912873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4f90ebaf-bd1b-4678-ae12-98f5789ca87d req-90cd6fe1-12c5-4e53-9153-9a09a8b82874 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:58.913446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4f90ebaf-bd1b-4678-ae12-98f5789ca87d req-90cd6fe1-12c5-4e53-9153-9a09a8b82874 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:58.935425 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4f90ebaf-bd1b-4678-ae12-98f5789ca87d req-90cd6fe1-12c5-4e53-9153-9a09a8b82874 service nova] Creating event network-vif-plugged:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:11:58.951240 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4f90ebaf-bd1b-4678-ae12-98f5789ca87d req-90cd6fe1-12c5-4e53-9153-9a09a8b82874 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063549 Sep 13 17:11:58.951895 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3433/6817] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:11:59.065409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:11:59.091385 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2490a7f6-3d13-49fd-b22c-5b47a173b08b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.308341 Sep 13 17:11:59.093375 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3385/6818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:58 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:11:59.851182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:11:59.851935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:11:59.859446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:59.859954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:59.860401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:11:59.861129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:11:59.861600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:11:59.862075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:00.031122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:00.039893 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ef50059d-2ae0-40eb-90b3-ce78fa8840a0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1392 microversion: 2.1 time: 0.196147 Sep 13 17:12:00.041886 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3434/6819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:11:59 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:00.117796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:00.119859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:00.132371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:00.132880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:00.133505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:00.134431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:00.135054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:00.137068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:00.282965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:00.291659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9ea10d3-35f5-4612-ab1d-78d94ea847b2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.177761 Sep 13 17:12:00.293436 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3386/6820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:00 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:01.064298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:01.064918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:01.073705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:01.074161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:01.074603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:01.075337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:01.077040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:01.077480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:01.284616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:01.293548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-099b92c9-7394-4d12-90ad-4e3b29393e47 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1562 microversion: 2.1 time: 0.233105 Sep 13 17:12:01.294295 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3435/6821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:01 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:01.316789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:01.317414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:01.326952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:01.327428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:01.327965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:01.332735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:01.333421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:01.334130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:01.334657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:01.335173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:01.347331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:01.351780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:01.352230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:01.353051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:01.353529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:01.353982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:01.531985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:01.542436 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8051247c-ad33-4e81-846e-1204ad55800c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1562 microversion: 2.1 time: 0.219545 Sep 13 17:12:01.544740 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3436/6822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:01 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:01.555102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:01.570613 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8eea9b8-f2b9-4b96-9299-fda365996042 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.257847 Sep 13 17:12:01.571726 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3387/6823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:01 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:02.597016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:02.600909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:02.609642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:02.610239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:02.610752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:02.611532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:02.612111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:02.612691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:02.858560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:02.872087 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e44a806-3c32-4f0c-bda1-354e263e6a0e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.280332 Sep 13 17:12:02.873119 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3437/6824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:02 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:03.595242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:03.598531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:03.599104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-5265cbc4-98dd-49d9-91c5-abc2d8577874 req-04305123-9c94-44d1-a409-7a52441155d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:03.616748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:03.620010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:03.620739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:03.623021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5265cbc4-98dd-49d9-91c5-abc2d8577874 req-04305123-9c94-44d1-a409-7a52441155d4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:03.623696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:03.624935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:03.625609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:03.626592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5265cbc4-98dd-49d9-91c5-abc2d8577874 req-04305123-9c94-44d1-a409-7a52441155d4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:03.628188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5265cbc4-98dd-49d9-91c5-abc2d8577874 req-04305123-9c94-44d1-a409-7a52441155d4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:03.660036 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-5265cbc4-98dd-49d9-91c5-abc2d8577874 req-04305123-9c94-44d1-a409-7a52441155d4 service nova] Creating event network-changed:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:12:03.671931 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-5265cbc4-98dd-49d9-91c5-abc2d8577874 req-04305123-9c94-44d1-a409-7a52441155d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083421 Sep 13 17:12:03.675498 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3438/6825] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:12:03.903324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:03.909205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:03.925730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:03.926573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:03.927256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:03.928180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:03.928850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:03.929535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:04.032524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:04.044400 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a869a062-f4ae-4a82-985d-d16812c1673f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1562 microversion: 2.1 time: 0.458940 Sep 13 17:12:04.045179 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3388/6826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:03 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1562 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:04.138609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:04.147024 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-845ac6bb-80a5-41ad-b728-64e6ffcdc7f6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.252819 Sep 13 17:12:04.147614 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3439/6827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:03 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:05.192178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:05.194142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:05.205316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:05.205936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:05.206464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:05.207287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:05.208012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:05.208528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:05.391570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:05.406476 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ea320b9-fbfb-436d-bdea-6c1b44709238 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.237839 Sep 13 17:12:05.407935 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3389/6828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:05 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:12:06.431915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:06.433548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:06.441009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:06.441659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:06.442356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:06.443181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:06.443971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:06.444851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:06.839960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:06.842434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:06.853096 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7050412e-c54e-473a-97d0-355bcd5f9202 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.425259 Sep 13 17:12:06.869577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3440/6829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:06 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:07.301959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f95c2694-3044-4b90-bdac-7346ddd8d33d req-93ce8b1a-9c7b-41e7-8798-e3467363a731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857324ca-99e4-470b-9894-31f0f2075a55", "name": "network-vif-plugged", "status": "completed", "tag": "42b897eb-0cbb-42c0-ad11-7d758c176a9b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:07.320233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f95c2694-3044-4b90-bdac-7346ddd8d33d req-93ce8b1a-9c7b-41e7-8798-e3467363a731 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:07.321661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f95c2694-3044-4b90-bdac-7346ddd8d33d req-93ce8b1a-9c7b-41e7-8798-e3467363a731 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:07.323443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f95c2694-3044-4b90-bdac-7346ddd8d33d req-93ce8b1a-9c7b-41e7-8798-e3467363a731 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:07.342947 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f95c2694-3044-4b90-bdac-7346ddd8d33d req-93ce8b1a-9c7b-41e7-8798-e3467363a731 service nova] Creating event network-vif-plugged:42b897eb-0cbb-42c0-ad11-7d758c176a9b for instance 857324ca-99e4-470b-9894-31f0f2075a55 on n-h2-857467-1 Sep 13 17:12:07.350311 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f95c2694-3044-4b90-bdac-7346ddd8d33d req-93ce8b1a-9c7b-41e7-8798-e3467363a731 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051970 Sep 13 17:12:07.352505 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3390/6830] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:12:07.877279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:07.878088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:07.885789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:07.886503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:07.887141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:07.887848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:07.888330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:07.888765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:08.114338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:08.123344 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8296991a-90d9-4baa-b810-10a4732eb9b6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1203 microversion: 2.1 time: 0.250089 Sep 13 17:12:08.124362 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3441/6831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:07 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1203 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:09.158301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:09.159770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:09.169099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:09.169709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:09.170317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:09.171361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:09.172365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:09.173073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:09.522004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:09.531195 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa1f4aa4-3673-4d27-af29-cbed663d4c26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1391 microversion: 2.1 time: 0.382436 Sep 13 17:12:09.531787 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3391/6832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:09 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:09.554847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:09.556107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:09.564193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:09.564702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:09.565432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:09.566293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:09.566863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:09.567512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.036205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:10.056198 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e23727c-7b86-4e4e-94b4-afe72459049d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1391 microversion: 2.1 time: 0.505409 Sep 13 17:12:10.056800 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3442/6833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:09 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:10.083146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:10.083909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:10.091136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:10.091527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:10.092058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.093512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:10.094187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:10.094714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.097821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:10.348162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:10.357553 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ca7ccd9-b9d6-44f8-8fdb-0feec0f521ae tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1391 microversion: 2.1 time: 0.278497 Sep 13 17:12:10.358619 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3392/6834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:10 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:10.452412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:10.452902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:10.459070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:10.459807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:10.461228 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.462820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:10.463866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:10.466083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.511640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:12:10.648119 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-957926a5-97f5-4bf0-996f-1029e175ee1b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 204 len: 0 microversion: 2.1 time: 0.198250 Sep 13 17:12:10.650902 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3443/6835] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:12:10 2022] DELETE /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:12:10.661919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:10.662803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:10.690144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:10.691633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:10.692199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.693149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:10.698398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:10.699040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:10.882894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:10.891883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5fab9e38-dca7-434e-a2ac-8294632e19cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1397 microversion: 2.1 time: 0.236411 Sep 13 17:12:10.893379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3393/6836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:10 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1397 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:11.916795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:11.917766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:11.926304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:11.926915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:11.927455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:11.928260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:11.928819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:11.929353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:12.152997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:12.162520 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-46617c9e-91b6-43ee-94e7-1857222aaa28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1397 microversion: 2.1 time: 0.250018 Sep 13 17:12:12.163764 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3444/6837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:11 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1397 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:12.842592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3c7981e1-f2d3-4b28-913e-6c8259830fb1 req-270329f5-fe7c-424d-ae9d-dd8108076ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857324ca-99e4-470b-9894-31f0f2075a55", "name": "network-vif-deleted", "tag": "42b897eb-0cbb-42c0-ad11-7d758c176a9b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:12.856888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3c7981e1-f2d3-4b28-913e-6c8259830fb1 req-270329f5-fe7c-424d-ae9d-dd8108076ed6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:12.857693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3c7981e1-f2d3-4b28-913e-6c8259830fb1 req-270329f5-fe7c-424d-ae9d-dd8108076ed6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:12.858799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3c7981e1-f2d3-4b28-913e-6c8259830fb1 req-270329f5-fe7c-424d-ae9d-dd8108076ed6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:12.872637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3c7981e1-f2d3-4b28-913e-6c8259830fb1 req-270329f5-fe7c-424d-ae9d-dd8108076ed6 service nova] Creating event network-vif-deleted:42b897eb-0cbb-42c0-ad11-7d758c176a9b for instance 857324ca-99e4-470b-9894-31f0f2075a55 on n-h2-857467-1 Sep 13 17:12:12.878972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3c7981e1-f2d3-4b28-913e-6c8259830fb1 req-270329f5-fe7c-424d-ae9d-dd8108076ed6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041433 Sep 13 17:12:12.882977 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3394/6838] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:12:13.190113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:13.190742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:13.214323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:13.216874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:13.217500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:13.218453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:13.219093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:13.220489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:13.308676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:13.329805 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0146bc80-eecb-4365-86d9-27d7ed483811 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1188 microversion: 2.1 time: 0.132984 Sep 13 17:12:13.330731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3445/6839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:13 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1188 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:14.354256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:14.356078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:14.364844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:14.365790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:14.366714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:14.368607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:14.370074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:14.371516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:14.457166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:14.468411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1462c1ca-2adf-4754-aed4-1b43f6f64525 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1188 microversion: 2.1 time: 0.118546 Sep 13 17:12:14.469849 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3395/6840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:14 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:15.491562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:15.492192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:15.495843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:15.502458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:15.502961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:15.503412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:15.504148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:15.504631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:15.505068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:15.580134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:15.590967 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-04f59fa0-8d82-4404-b790-da4c27606052 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1188 microversion: 2.1 time: 0.103350 Sep 13 17:12:15.592183 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3446/6841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:15 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:16.619036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:16.622401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:16.627242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=44 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:16.631773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:16.632788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:16.633421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:16.634528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:16.636096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:16.637152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:16.785865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:16.795798 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a642669-b410-41a5-a3e7-091e7c35d562 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1188 microversion: 2.1 time: 0.184540 Sep 13 17:12:16.796702 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3396/6842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:16 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1188 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:17.819443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:17.820972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:17.829960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:17.830736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:17.831375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:17.832425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:17.833264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:17.833977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:17.881300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:17.882164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:17.882787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:17.883427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lazy-loading 'fault' on Instance uuid 857324ca-99e4-470b-9894-31f0f2075a55 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:12:17.936599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:17.946666 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3fb5d73a-750d-420f-96cc-6929c71a548d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 200 len: 1193 microversion: 2.1 time: 0.131267 Sep 13 17:12:17.949034 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3447/6843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:17 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 1193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:18.977399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:18.978956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:18.990154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:18.991029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:18.991743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:18.992748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:18.993444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:18.994328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:19.011797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 HTTP/1.1 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '857324ca-99e4-470b-9894-31f0f2075a55'} Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:12:19.013816 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:19.018275 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:19.020199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:12:19.021289 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-19301f81-53a0-4db3-8367-9dc1b00f9a91 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 404 len: 111 microversion: 2.1 time: 0.048762 Sep 13 17:12:19.022444 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3397/6844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:18 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:12:22.318988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:22.320150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:22.327494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:22.328232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:22.328874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:22.329932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:22.330570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:22.331298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:22.346858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 HTTP/1.1 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '857324ca-99e4-470b-9894-31f0f2075a55'} Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:12:22.348930 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.354318 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.356213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:12:22.357333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2f727d0-0517-4486-81d9-a05e48751279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 404 len: 111 microversion: 2.1 time: 0.043145 Sep 13 17:12:22.358506 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3448/6845] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:12:22 2022] DELETE /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:12:22.366844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:22.367484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 857324ca-99e4-470b-9894-31f0f2075a55] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:22.376676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:22.377181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:22.377635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:22.378393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:22.378868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:22.379310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:22.398262 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 HTTP/1.1 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '857324ca-99e4-470b-9894-31f0f2075a55'} Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:12:22.399826 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 857324ca-99e4-470b-9894-31f0f2075a55 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:12:22.406045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a26ffc66-9adf-4c58-8c9b-5cabca59c4da tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55" status: 404 len: 111 microversion: 2.1 time: 0.041148 Sep 13 17:12:22.408196 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3398/6846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:22 2022] GET /compute/v2.1/servers/857324ca-99e4-470b-9894-31f0f2075a55 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:12:35.425042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:35.428454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:35.444992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=7 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:35.451370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:35.454386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:35.456962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:35.459528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:35.461596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:35.464775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:35.465633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:35.565651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e9a4c13-0474-4d1a-beb3-d044bda5b98f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action" status: 200 len: 24569 microversion: 2.1 time: 0.145366 Sep 13 17:12:35.566749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3449/6847] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:12:35 2022] POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action => generated 24569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:12:43.548961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=5 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:43.550083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=29 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:43.751815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c32c549f-2314-49f3-bdb8-6d82b5feb3e8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Action: 'create', calling method: .version_select at 0x7fbeb4acea60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-605798807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ogFIUYnp+AvyCM6FFq8wpKBtq8pZhNPPRdujAovPdF2NiyoWnLozuiP+hL/xJ8erwglMcfE6t0g0uuW8eE4iVY4mi+KsiWs0h6ZWWbOXg69Ied1qCSamqpS+NuXLaGw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:43.769502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-c32c549f-2314-49f3-bdb8-6d82b5feb3e8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Getting quotas for project 61996a9f03bd44d2a855253f0f38ae5e. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:12:43.776677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-c32c549f-2314-49f3-bdb8-6d82b5feb3e8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Getting quotas for user c9779362ba4c47d48d1c12bd59ff0dd1 and project 61996a9f03bd44d2a855253f0f38ae5e. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:12:43.804872 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c32c549f-2314-49f3-bdb8-6d82b5feb3e8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.261178 Sep 13 17:12:43.805611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3399/6848] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:12:43 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:12:48.134539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1533978596", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "57afa7c2-0b48-47bf-9373-a7be8fad9557", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:48.161914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:48.163254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:48.234904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:12:49.710348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:12:49.711005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:12:49.711762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:12:49.712182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:12:49.712685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:12:49.722798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:49.723253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:49.723693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:49.724423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:49.724887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:49.725311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:49.743926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:12:49.749887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:12:49.810977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:12:49.813171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57afa7c2-0b48-47bf-9373-a7be8fad9557',volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:12:50.013584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60a7ed88-4233-4e73-ac6a-631a1612bb7e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883658 Sep 13 17:12:50.016433 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3450/6849] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:12:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:12:50.030180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e9bea9ca-f1fa-4e98-bd59-e3c9534d85ca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:50.031499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e9bea9ca-f1fa-4e98-bd59-e3c9534d85ca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:50.390187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e9bea9ca-f1fa-4e98-bd59-e3c9534d85ca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:50.398118 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e9bea9ca-f1fa-4e98-bd59-e3c9534d85ca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1071 microversion: 2.1 time: 0.374250 Sep 13 17:12:50.402036 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3400/6850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:50 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1071 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:51.440719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:51.444162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:51.481817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:51.482621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:51.484282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:51.490426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:51.490936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:51.491393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:51.663140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:51.676858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec07fa32-033b-465a-b813-8729cbc7076c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1169 microversion: 2.1 time: 0.252578 Sep 13 17:12:51.684034 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3451/6851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:51 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1169 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:52.529484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1242473381-access_point-1236516869", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "9aa83c80-0a05-478c-8e19-251849c9eb6d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-605798807", "security_groups": [{"name": "tempest-secgroup_access--697771691"}, {"name": "tempest-secgroup_general--1831569454"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:52.702205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:52.703843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:52.718925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:52.722873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:52.724210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:52.726874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:52.728385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:52.730000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:52.914795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:52.928259 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6c2495d4-337e-414a-a26b-1fba09fd0874 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1187 microversion: 2.1 time: 0.231843 Sep 13 17:12:52.933100 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3452/6852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:52 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1187 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:53.173453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] validate_networks() for [('9aa83c80-0a05-478c-8e19-251849c9eb6d', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:12:53.965734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:53.967035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:53.995574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:53.996099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:53.996545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:53.997266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:53.998045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:53.998856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:54.135732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:54.148359 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c10359e7-33c5-4046-a9de-af1fbc3403ac tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1187 microversion: 2.1 time: 0.184479 Sep 13 17:12:54.150936 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3453/6853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:53 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1187 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:55.098973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:12:55.100057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:12:55.100884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:12:55.101575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:12:55.102272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:12:55.128587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:55.128732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:55.129424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:55.130442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:55.131140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:55.131808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:55.172967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:55.173648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:55.176298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Getting quotas for project 61996a9f03bd44d2a855253f0f38ae5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:12:55.186011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:55.186516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:55.186963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:55.187689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:55.188157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:55.191008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Getting quotas for user c9779362ba4c47d48d1c12bd59ff0dd1 and project 61996a9f03bd44d2a855253f0f38ae5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:12:55.191157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:55.217049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:12:55.219685 n-d-857467-1 devstack@n-api.service[122327]: WARNING nova.utils [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1242473381-access_point-1236516869 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1242473381-ac Sep 13 17:12:55.220694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:12:55.315432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e7765c7-127e-4fe9-981c-7f59294701c5 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.790887 Sep 13 17:12:55.335947 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3401/6854] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:12:52 2022] POST /compute/v2.1/servers => generated 457 bytes in 2811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:12:55.347020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96c2ecdc-5cdd-412d-91e6-a9910747d693 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:55.359799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96c2ecdc-5cdd-412d-91e6-a9910747d693 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:55.518677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:55.532517 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19d281b3-7e1e-4486-ae17-4b8984761ae7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1229 microversion: 2.1 time: 0.363378 Sep 13 17:12:55.533392 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3454/6855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:55 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1229 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:12:55.545865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-96c2ecdc-5cdd-412d-91e6-a9910747d693 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:55.558272 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96c2ecdc-5cdd-412d-91e6-a9910747d693 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1294 microversion: 2.1 time: 0.217993 Sep 13 17:12:55.577914 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3402/6856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:55 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1294 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:56.560188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:56.561552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:56.576206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:56.577124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:56.577792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:56.578802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:56.579523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:56.580189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:56.586049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:56.587339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:56.602692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:56.604003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:56.605739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:56.606910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:56.607728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:56.615578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:56.808404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:56.820597 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f9b7b68-4015-4f2a-aa82-c42dc9f83e73 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1290 microversion: 2.1 time: 0.239453 Sep 13 17:12:56.823240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:56.832503 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3403/6857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:56 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1290 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:56.835360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-312e425b-c63e-4ea5-8525-46cc80866fad tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1229 microversion: 2.1 time: 0.279212 Sep 13 17:12:56.839678 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3455/6858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:56 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1229 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:57.847066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:57.847715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:57.858277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:57.860932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:57.862522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:57.873938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:57.876898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:57.891629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:57.898895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:57.907245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:57.922812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:57.923567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:57.927848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:57.928642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:57.929325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:57.930765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:58.099118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:58.108325 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60b9c97f-3346-458e-a002-869f6cdf2411 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1352 microversion: 2.1 time: 0.267201 Sep 13 17:12:58.126166 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3404/6859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:57 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:58.132957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-bae47d89-3604-40fe-bf61-085afd8d93dc req-19ba2a3b-aa2b-40a0-922d-238a9c880bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f43947-d40e-47fd-bc10-2e11d5e2f0a7", "tag": "0ff936f0-1745-4bb3-ad1d-04522c1f6984"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:12:58.144626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bae47d89-3604-40fe-bf61-085afd8d93dc req-19ba2a3b-aa2b-40a0-922d-238a9c880bc0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:58.145498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bae47d89-3604-40fe-bf61-085afd8d93dc req-19ba2a3b-aa2b-40a0-922d-238a9c880bc0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:58.146795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-bae47d89-3604-40fe-bf61-085afd8d93dc req-19ba2a3b-aa2b-40a0-922d-238a9c880bc0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:58.162225 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-bae47d89-3604-40fe-bf61-085afd8d93dc req-19ba2a3b-aa2b-40a0-922d-238a9c880bc0 service nova] Creating event network-changed:0ff936f0-1745-4bb3-ad1d-04522c1f6984 for instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 on n-h2-857467-1 Sep 13 17:12:58.168699 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-bae47d89-3604-40fe-bf61-085afd8d93dc req-19ba2a3b-aa2b-40a0-922d-238a9c880bc0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040775 Sep 13 17:12:58.169978 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3405/6860] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:12:58.342461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:58.360923 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e999c28-762e-420d-8a42-a1d5426bc704 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1229 microversion: 2.1 time: 0.496214 Sep 13 17:12:58.375752 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3456/6861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:57 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1229 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:59.133252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:59.135378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:59.142689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:59.143429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:59.144059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:59.144969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:59.150724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:59.151660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:59.396848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:12:59.398562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:12:59.407230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:59.409665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:59.411325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:59.416922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:59.418284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:12:59.418946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:12:59.419594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:12:59.419918 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9186fe37-e23a-46b7-8dec-11b098243b49 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.287017 Sep 13 17:12:59.421716 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3406/6862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:59 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:12:59.734399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:59.752278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:12:59.758588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:12:59.762412 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-71104f2a-dae4-4ef0-8438-f83513288ec6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1229 microversion: 2.1 time: 0.377156 Sep 13 17:12:59.763036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3457/6863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:12:59 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1229 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:00.444543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:00.446276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:00.459695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:00.460524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:00.461170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:00.462098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:00.462735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:00.465538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:00.748538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:00.757188 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54406aa8-9d4a-44ef-b9a4-8ab136034ef2 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.316507 Sep 13 17:13:00.757793 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3407/6864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:00 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:00.786088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:00.786716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:00.793064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:00.793771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:00.794447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:00.795331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:00.796000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:00.796428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:00.815729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-89197931-0fda-440d-ae4e-c2ecfa7e1756 req-2672e658-601d-4b26-b9fd-f9fb6394395e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207bab3f-4a11-460a-9fc9-a84c414ec24c", "tag": "31dbe931-6dfe-4a01-be7e-2b9efab32b94"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:00.827005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89197931-0fda-440d-ae4e-c2ecfa7e1756 req-2672e658-601d-4b26-b9fd-f9fb6394395e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:00.827503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89197931-0fda-440d-ae4e-c2ecfa7e1756 req-2672e658-601d-4b26-b9fd-f9fb6394395e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:00.827950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89197931-0fda-440d-ae4e-c2ecfa7e1756 req-2672e658-601d-4b26-b9fd-f9fb6394395e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:00.839630 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-89197931-0fda-440d-ae4e-c2ecfa7e1756 req-2672e658-601d-4b26-b9fd-f9fb6394395e service nova] Creating event network-changed:31dbe931-6dfe-4a01-be7e-2b9efab32b94 for instance 207bab3f-4a11-460a-9fc9-a84c414ec24c on n-h2-857467-1 Sep 13 17:13:00.844570 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-89197931-0fda-440d-ae4e-c2ecfa7e1756 req-2672e658-601d-4b26-b9fd-f9fb6394395e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185549 Sep 13 17:13:00.845191 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3458/6865] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:13:01.049693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:01.067199 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4905d54c-00a2-4021-9529-f45a340274a6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.282824 Sep 13 17:13:01.067199 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3408/6866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:00 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:01.782473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:01.783472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:01.790043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:01.790552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:01.791032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:01.792022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:01.792682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:01.793300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:02.041001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:02.050418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6486d685-b206-4833-ad88-bc605756a5d4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.273062 Sep 13 17:13:02.051020 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3459/6867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:01 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:02.090484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:02.091280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:02.098882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:02.099374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:02.099814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:02.100517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:02.100979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:02.101540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:02.698453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:02.706521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e33a1c7e-a66c-40b8-a845-35af4d16987c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.620312 Sep 13 17:13:02.707123 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3409/6868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:02 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:03.075666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:03.076293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:03.083194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:03.083695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:03.084145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:03.084867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:03.085334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:03.085769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:03.241061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:03.250897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4cadcaef-7fa1-4eab-89b4-057f76376382 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.179256 Sep 13 17:13:03.251491 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3460/6869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:03 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:03.728861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:03.729534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:03.736825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:03.737331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:03.737783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:03.738531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:03.739000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:03.739438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:03.882548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:03.891607 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b271e65c-6266-4f98-8a08-52bbdc983b2f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.166833 Sep 13 17:13:03.892214 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3410/6870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:03 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:04.274400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:04.277468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:04.285475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:04.286541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:04.287083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:04.287924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:04.288616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:04.289055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:04.486019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:04.494916 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-505a67ee-a769-4995-9638-dfee952a1d03 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.224146 Sep 13 17:13:04.496041 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3461/6871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:04 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:04.920255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:04.922145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:04.930772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:04.931500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:04.933353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:04.934388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:04.935240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:04.937244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:05.098699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:05.108436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0db0898e-6e73-4b27-882d-b9e1c41437c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.195394 Sep 13 17:13:05.109264 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3411/6872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:04 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:05.518634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:05.519890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:05.527520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:05.527960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:05.528405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:05.529128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:05.529578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:05.530057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:05.693977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:05.702804 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17dc20cb-2e70-4d86-bbef-bb7dea62ee75 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.188036 Sep 13 17:13:05.713282 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3462/6873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:05 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:06.084755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:06.085321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:06.087282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:06.088681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:06.095845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.096413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.096858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.097565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.098062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.098500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.131611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:06.132656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:06.139672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.140376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.141275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.142136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.142701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.143237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.287002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:06.297528 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-74902f18-2475-496f-9a30-546f59551b39 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.169781 Sep 13 17:13:06.298179 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3463/6874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:06 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:06.358405 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37862316-5358-49ae-a4a6-fbafb9c44532 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1832 microversion: 2.1 time: 0.277548 Sep 13 17:13:06.358998 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3412/6875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:06 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1832 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:06.385067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:06.386223 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:06.392752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.393333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.393886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.394827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.395374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.396525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.627677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:06.643884 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64253329-8d9e-481e-bc36-fd2a4e0ba266 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1681 microversion: 2.1 time: 0.265249 Sep 13 17:13:06.645646 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3464/6876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:06 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:06.728623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:06.729575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:06.747289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.748057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.748687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.749586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.750079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.750698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.762787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:06.765265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:06.773899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.774488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.775004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.776857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:06.777764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:06.778400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:06.855816 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1fe5903a-237f-47eb-b48f-da5d809d7d13 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action" status: 200 len: 32640 microversion: 2.1 time: 0.097209 Sep 13 17:13:06.856744 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3465/6877] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:13:06 2022] POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action => generated 32640 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:13:07.005607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:07.022171 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-048df4d0-46e4-4f93-b942-aec30c1812dc tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.297389 Sep 13 17:13:07.023437 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3413/6878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:06 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:07.075781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:07.076447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:07.083203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:07.084222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:07.084222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:07.084819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:07.085276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:07.085702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:07.133012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f059164e383840eabe6dbee6706e00a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c734da404449b9b6b50125f7310aef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:07.134101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] flavor_id is None. Assuming migration. {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 13 17:13:07.135409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:13:07.322124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:07.324786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:07.355114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:07.355675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:07.357538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:07.358748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:07.359383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:07.360560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:07.386809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:07.437309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-767a00cb-0f29-45d0-9364-210a9f4995cc tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action" status: 202 len: 0 microversion: 2.1 time: 0.365997 Sep 13 17:13:07.438581 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3466/6879] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:13:07 2022] POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:13:07.462631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:07.464185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:07.471701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:07.472220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:07.472672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:07.473452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:07.473948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:07.474447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:07.599118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:07.611260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eab3a348-f86c-41e4-94d8-ed42574afd60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.294185 Sep 13 17:13:07.625499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3414/6880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:07 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:07.840195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:07.855345 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00dcd770-5e76-44cf-8ef5-cfd6b326294c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1690 microversion: 2.1 time: 0.404132 Sep 13 17:13:07.856766 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3467/6881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:07 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1690 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:08.048000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:08.048634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:08.055199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:08.055713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:08.056155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:08.057391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:08.058423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:08.059036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:08.328612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:08.341518 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c398368-40aa-4bd4-9900-5bbf35e8953f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.297568 Sep 13 17:13:08.343164 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3415/6882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:08 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:08.635527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:08.636341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:08.644766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:08.645241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:08.645684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:08.646425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:08.646886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:08.647312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:08.880415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:08.881110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:08.889245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:08.889981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:08.890434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:08.891156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:08.891615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:08.892280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:08.962094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:08.978229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ab6e148b-2c5c-46fd-9c02-de44657e7891 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.347745 Sep 13 17:13:08.994348 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3468/6883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:08 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:09.050622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:09.067809 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f327b80-0683-4a70-841f-f1bddfbbec73 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1690 microversion: 2.1 time: 0.191199 Sep 13 17:13:09.068427 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3416/6884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:08 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:09.371845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:09.372775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:09.389274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:09.390492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:09.392659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:09.395341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:09.397181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:09.398014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:09.717187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:09.731497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-401928d6-e3f3-4116-97e9-48d56eb6b342 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.363526 Sep 13 17:13:09.752854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3469/6885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:09 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:09.972357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-7b3378b4-5c5e-4ee0-9362-32ada629ea6b req-e6d62300-47f4-4217-b9ec-57198b923b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207bab3f-4a11-460a-9fc9-a84c414ec24c", "name": "network-vif-plugged", "status": "completed", "tag": "31dbe931-6dfe-4a01-be7e-2b9efab32b94"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:09.988589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7b3378b4-5c5e-4ee0-9362-32ada629ea6b req-e6d62300-47f4-4217-b9ec-57198b923b0a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:09.989213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7b3378b4-5c5e-4ee0-9362-32ada629ea6b req-e6d62300-47f4-4217-b9ec-57198b923b0a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:09.989942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-7b3378b4-5c5e-4ee0-9362-32ada629ea6b req-e6d62300-47f4-4217-b9ec-57198b923b0a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.004766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-7b3378b4-5c5e-4ee0-9362-32ada629ea6b req-e6d62300-47f4-4217-b9ec-57198b923b0a service nova] Creating event network-vif-plugged:31dbe931-6dfe-4a01-be7e-2b9efab32b94 for instance 207bab3f-4a11-460a-9fc9-a84c414ec24c on n-h2-857467-1 Sep 13 17:13:10.005618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:10.006833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:10.012137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-7b3378b4-5c5e-4ee0-9362-32ada629ea6b req-e6d62300-47f4-4217-b9ec-57198b923b0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170349 Sep 13 17:13:10.013439 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3417/6886] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:10.017102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:10.017813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:10.019920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.020933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:10.021442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:10.026526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.093119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:10.094003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:10.109330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:10.110523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:10.111340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.112355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:10.113044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:10.113741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.308714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:10.317342 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b53b5fb1-20f1-4bab-ac80-068deac71983 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1690 microversion: 2.1 time: 0.229457 Sep 13 17:13:10.317870 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3418/6887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:10 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1690 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:10.745312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:10.753272 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3f01b2b6-44fe-4680-82eb-7f9c631b07c2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.752192 Sep 13 17:13:10.754300 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3470/6888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:09 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:10.771366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:10.772016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:10.779290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:10.779791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:10.780242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.780950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:10.781424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:10.781887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:10.927539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:10.935955 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e1a4cf6-24a0-4040-8407-cab68da69c07 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.168582 Sep 13 17:13:10.936551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3419/6889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:10 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:11.342436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:11.343874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:11.352901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:11.353889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:11.354597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:11.356516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:11.358043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:11.358906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:11.649008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:11.660325 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60c2a332-9b05-4177-8ace-175ed60bdbf2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.322531 Sep 13 17:13:11.660907 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3471/6890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:11 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:11.777886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:11.779102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:11.785717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:11.786248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:11.786697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:11.787413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:11.787874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:11.788309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:11.809119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:11.931433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:11.939716 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da82b384-4650-4d06-97ef-0ad8d0bf2c92 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.166968 Sep 13 17:13:11.940308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3420/6891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:11 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:11.959205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:11.959825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:11.966396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:11.966890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:11.967331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:11.968031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:11.968493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:11.968919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:12.072615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-303dad85-3a1f-48e8-9db4-a7cce143919d req-3a2370cb-902f-4339-b89e-2c4e0ca69a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f43947-d40e-47fd-bc10-2e11d5e2f0a7", "name": "network-vif-plugged", "status": "completed", "tag": "0ff936f0-1745-4bb3-ad1d-04522c1f6984"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:12.082791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-303dad85-3a1f-48e8-9db4-a7cce143919d req-3a2370cb-902f-4339-b89e-2c4e0ca69a65 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:12.083552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-303dad85-3a1f-48e8-9db4-a7cce143919d req-3a2370cb-902f-4339-b89e-2c4e0ca69a65 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:12.084697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-303dad85-3a1f-48e8-9db4-a7cce143919d req-3a2370cb-902f-4339-b89e-2c4e0ca69a65 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:12.098718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-303dad85-3a1f-48e8-9db4-a7cce143919d req-3a2370cb-902f-4339-b89e-2c4e0ca69a65 service nova] Creating event network-vif-plugged:0ff936f0-1745-4bb3-ad1d-04522c1f6984 for instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 on n-h2-857467-1 Sep 13 17:13:12.104869 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-303dad85-3a1f-48e8-9db4-a7cce143919d req-3a2370cb-902f-4339-b89e-2c4e0ca69a65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036026 Sep 13 17:13:12.110759 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3421/6892] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:12.115962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:12.124346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-898d5e5d-5d8f-4195-bf23-32b7c9e9706f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1471 microversion: 2.1 time: 0.169066 Sep 13 17:13:12.125036 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3472/6893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:11 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:12.688146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:12.688915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:12.695363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:12.696250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:12.696702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:12.697544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:12.698076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:12.699463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:12.931150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:12.952565 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e62f031-f0ba-4f91-8772-de12e2ba475e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.268760 Sep 13 17:13:12.953170 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3422/6894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:12 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:12.965054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:12.965054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:12.979938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:12.980467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:12.980909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:12.981660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:12.982171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:12.982657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.118692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:13.127773 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f6cabbec-9a3c-4692-a62a-929267b66c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1217 microversion: 2.1 time: 0.169837 Sep 13 17:13:13.128496 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3473/6895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:12 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:13.149678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:13.151528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:13.158218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.158665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.159112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.159864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.160358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.160774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.327877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:13.335837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9593f609-7684-4cbf-8c88-613d16fbf33f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1642 microversion: 2.1 time: 0.191778 Sep 13 17:13:13.336429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3423/6896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:13 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1642 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:13.359516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:13.359931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:13.366230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.366719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.367165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.367857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.368316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.368742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.540065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:13.548555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ffc360b-6bfb-4b7e-bc15-ebe4c4cd2800 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1642 microversion: 2.1 time: 0.193794 Sep 13 17:13:13.549157 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3474/6897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:13 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1642 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:13.571128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:13.571782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:13.575125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:13.580605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.581103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.581546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.582286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.582753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.583330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.978073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:13.980577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:13.986253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.994700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.995387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:13.996369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:13.996857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:13.997476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:14.034521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-96ea6349-3745-4eb2-8713-7b2224b8a1db tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1793 microversion: 2.1 time: 0.467247 Sep 13 17:13:14.035711 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3424/6898] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:13 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1793 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:14.154325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:14.159844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:14.161658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:14.166699 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eb141044-37ce-4ae8-be44-22802cfea449 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.192027 Sep 13 17:13:14.172927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:14.173731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:14.174448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:14.175802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:14.176508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:14.177334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:14.182590 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3475/6899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:13 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:14.829600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:14.842127 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc30033e-a5b7-4e59-b896-9ff6c568d669 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1404 microversion: 2.1 time: 0.688558 Sep 13 17:13:14.843252 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3425/6900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:14 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:14.865758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:14.866757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:14.873741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:14.874756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:14.875282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:14.876338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:14.876987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:14.877605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:15.190683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:15.191537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:15.201592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:15.203054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:15.203856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:15.204778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:15.206407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:15.207087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:15.225257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:15.235306 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0549876-4946-4aad-802c-2ea17d6c8e19 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1404 microversion: 2.1 time: 0.373275 Sep 13 17:13:15.236220 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3476/6901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:14 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1404 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:15.260206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-905762586"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:15.264374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:15.270530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:15.271119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:15.271797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:15.272512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:15.272972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:15.273405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:15.397774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.compute.api [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Attempting to quiesce instance before volume snapshot. Sep 13 17:13:15.465808 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.compute.api [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 13 17:13:15.506042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:15.517146 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d62fbee7-5f3f-412c-80f0-26592d8cc38b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.330331 Sep 13 17:13:15.518194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3426/6902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:15 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:15.555813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Creating snapshot from volume 57afa7c2-0b48-47bf-9373-a7be8fad9557. {{(pid=122328) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 13 17:13:16.547151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:16.547969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:16.562928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:16.564564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:16.566208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:16.567166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:16.569598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:16.571901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:16.876871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:16.889856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7b6f5076-55af-48a0-b6b2-0b10638c809e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.348352 Sep 13 17:13:16.891853 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3427/6903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:16 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:17.209275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-77b83bd9-fdf6-4221-b042-0ebc33f91e3d req-528f9052-2c84-4c68-b3db-efc171de61ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207bab3f-4a11-460a-9fc9-a84c414ec24c", "tag": "31dbe931-6dfe-4a01-be7e-2b9efab32b94"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:17.212616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6f578508-5783-4da0-acfd-e8a5debf4e83 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7/action" status: 202 len: 0 microversion: 2.1 time: 1.957374 Sep 13 17:13:17.217753 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3477/6904] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:13:15 2022] POST /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7/action => generated 0 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 13 17:13:17.232301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-77b83bd9-fdf6-4221-b042-0ebc33f91e3d req-528f9052-2c84-4c68-b3db-efc171de61ee service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:17.232952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-77b83bd9-fdf6-4221-b042-0ebc33f91e3d req-528f9052-2c84-4c68-b3db-efc171de61ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:17.233404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-77b83bd9-fdf6-4221-b042-0ebc33f91e3d req-528f9052-2c84-4c68-b3db-efc171de61ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:17.264547 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-77b83bd9-fdf6-4221-b042-0ebc33f91e3d req-528f9052-2c84-4c68-b3db-efc171de61ee service nova] Creating event network-changed:31dbe931-6dfe-4a01-be7e-2b9efab32b94 for instance 207bab3f-4a11-460a-9fc9-a84c414ec24c on n-h2-857467-1 Sep 13 17:13:17.281740 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-77b83bd9-fdf6-4221-b042-0ebc33f91e3d req-528f9052-2c84-4c68-b3db-efc171de61ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078245 Sep 13 17:13:17.283655 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3428/6905] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:13:17.924932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:17.930919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:17.940478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:17.943842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:17.944515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:17.947816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:17.950436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:17.951090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:18.411180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-425147489", "imageRef": "3bc8951c-0cf6-40cc-9279-cfcdab3dd59a", "flavorRef": "452", "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:18.477785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:13:18.514560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:18.531684 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7bd4257-1164-48aa-a804-e45642bc2005 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.615402 Sep 13 17:13:18.537929 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3478/6906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:17 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:19.257915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:13:19.258352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:13:19.258839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:13:19.259276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:13:19.259825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:13:19.269207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:19.269700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:19.270230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:19.270972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:19.271438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:19.271879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:19.293804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:13:19.299385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:13:19.312459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:13:19.315216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f94e2912-8ff2-45af-a2e9-5f756bd8f098',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:13:19.392137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37cfe3a3-8354-4e52-9ad7-3d6ecf659ad7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986978 Sep 13 17:13:19.393261 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3429/6907] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 17:13:19.405906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2287b967-c13b-44ea-bf60-34b4a10c908b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:19.407747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2287b967-c13b-44ea-bf60-34b4a10c908b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:19.411473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:19.517075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2287b967-c13b-44ea-bf60-34b4a10c908b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:19.527630 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2287b967-c13b-44ea-bf60-34b4a10c908b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1229 microversion: 2.1 time: 0.126957 Sep 13 17:13:19.528985 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3479/6908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:19 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:19.705694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:19.706350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:19.713603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:19.714304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:19.715066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:19.715878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:19.716592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:19.717140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:19.895294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:19.908687 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0d961abf-c303-42d5-aa6c-cac88ae89d1c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.355768 Sep 13 17:13:19.909405 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3430/6909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:19 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:20.551646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:20.554255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:20.562594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:20.563412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:20.563557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:20.564870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:20.564870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:20.565209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:20.932712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:20.933948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:20.941200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:20.942067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:20.942707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:20.944275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:20.944702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:20.945433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:20.959368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:20.976987 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be3c479f-dfdf-4948-b0c8-952821ac1ff6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1281 microversion: 2.1 time: 0.429418 Sep 13 17:13:20.977919 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3480/6910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:20 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:21.186005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:21.199446 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5499443b-9154-4336-b3d7-e78658cdc4f1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.268753 Sep 13 17:13:21.200446 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3431/6911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:20 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:22.003867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:22.004973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:22.013434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:22.014013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:22.014474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:22.015201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:22.015683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:22.016139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:22.130106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:22.138613 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b773c23a-2269-4f8b-a7f1-8b856977a1db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1299 microversion: 2.1 time: 0.141604 Sep 13 17:13:22.139206 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3481/6912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:21 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:22.226535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:22.227098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:22.235910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:22.236802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:22.237808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:22.239121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:22.239780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:22.240435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:22.482943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:22.495685 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fb9ee310-dbb7-4cfe-a2b1-81ddaf9a421e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1695 microversion: 2.1 time: 0.273521 Sep 13 17:13:22.496863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3432/6913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:22 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1695 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:23.164299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:23.165263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:23.179770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:23.180533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:23.181148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:23.182781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:23.183497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:23.184109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:23.228567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:23.522262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:23.523049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:23.532746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:23.533607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:23.534398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:23.535475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:23.536316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:23.537047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:23.548861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:23.562274 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e363377-31de-44cc-8fde-7f74b61dedd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.403971 Sep 13 17:13:23.563299 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3482/6914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:23 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:23.765931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "name": "network-vif-unplugged", "status": "completed", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:23.778029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:23.778835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:23.779519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:23.794314 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] Creating event network-vif-unplugged:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h2-857467-1 Sep 13 17:13:23.803190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:13:23.816454 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-215061a6-79f8-464a-acad-297fb0affcbb req-61e2647b-5c61-4bfb-b9ab-48635b1ff6aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054277 Sep 13 17:13:23.817758 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3483/6915] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:23.846790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:23.861066 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f338294c-2c58-4b88-8923-dfd17f6984b5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1694 microversion: 2.1 time: 0.343620 Sep 13 17:13:23.874584 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3433/6916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:23 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1694 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:24.087276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-89aee656-c693-4e51-a9a0-7ecedc2b644f req-7bd6e9c5-9cd2-41aa-afd0-a20492a50e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5", "tag": "77dc770f-5c64-4f01-951c-2a7472efab65"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:24.099773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89aee656-c693-4e51-a9a0-7ecedc2b644f req-7bd6e9c5-9cd2-41aa-afd0-a20492a50e3d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:24.100698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89aee656-c693-4e51-a9a0-7ecedc2b644f req-7bd6e9c5-9cd2-41aa-afd0-a20492a50e3d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:24.101353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-89aee656-c693-4e51-a9a0-7ecedc2b644f req-7bd6e9c5-9cd2-41aa-afd0-a20492a50e3d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:24.116789 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-89aee656-c693-4e51-a9a0-7ecedc2b644f req-7bd6e9c5-9cd2-41aa-afd0-a20492a50e3d service nova] Creating event network-changed:77dc770f-5c64-4f01-951c-2a7472efab65 for instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 on n-h1-857467-1 Sep 13 17:13:24.132604 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-89aee656-c693-4e51-a9a0-7ecedc2b644f req-7bd6e9c5-9cd2-41aa-afd0-a20492a50e3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176583 Sep 13 17:13:24.138799 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3484/6917] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:24.591932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:24.592497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:24.603052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:24.604006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:24.604688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:24.605871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:24.606852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:24.607584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:24.875557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:24.888899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:24.890086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:24.899390 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29a3929b-ae8a-4dc8-8587-2c83361bd0d7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.313630 Sep 13 17:13:24.901209 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3434/6918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:24 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:24.904402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:24.905281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:24.905812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:24.907809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:24.908517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:24.909176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:25.184402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:25.193312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b10f81ee-40df-49e6-9a20-a848dc0e9334 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1694 microversion: 2.1 time: 0.310998 Sep 13 17:13:25.211062 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3485/6919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:24 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1694 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:25.928422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:25.929604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:25.940546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:25.941390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:25.942137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:25.944140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:25.945669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:25.946640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:26.116513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:26.126843 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77b42c64-4c36-4bae-8e03-7525a8ff714f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.203281 Sep 13 17:13:26.127370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:26.128355 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3435/6920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:25 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:26.139435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:26.140452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:26.140936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:26.157213 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] Creating event network-changed:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h2-857467-1 Sep 13 17:13:26.164487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:13:26.180464 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b83facb1-c94c-4381-bac1-82c20e70b53c req-080a63ca-21dc-4108-864e-1a4f894a4cf6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056873 Sep 13 17:13:26.181615 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3486/6921] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:26.220812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:26.221794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:26.227883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:26.230041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:26.230726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:26.231464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:26.231939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:26.232381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:26.593032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:26.607267 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ff9dd7db-bc72-468e-aed0-be4f0d495c7b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1692 microversion: 2.1 time: 0.391516 Sep 13 17:13:26.608144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3436/6922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:26 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1692 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:27.170163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:27.171289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:27.191102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:27.192238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:27.194020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:27.198035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:27.199248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:27.201051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:27.461602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:27.479978 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bad1ccb8-e539-492a-b20d-7be4eb178ece tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.327557 Sep 13 17:13:27.482115 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3487/6923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:27 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:27.664718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:27.665457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:27.678509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:27.679096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:27.684534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:27.685478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:27.686081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:27.691185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:28.022993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:28.033431 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c89662de-e00d-4bd2-9b96-86415878fdd0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1692 microversion: 2.1 time: 0.373404 Sep 13 17:13:28.034676 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3437/6924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:27 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1692 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:28.509519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:28.511953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:28.523899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:28.524668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:28.529012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:28.530060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:28.530768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:28.531410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:28.763241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:28.776322 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7db6cf38-8c29-4c16-bbb7-b77bc3bd4026 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.270471 Sep 13 17:13:28.803614 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3488/6925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:28 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:29.070644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:29.072693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:29.089747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.091426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.092122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.094274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.095475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.096021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.281668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:29.310184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:29.421007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:29.444973 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-410e4b18-6ba5-42e7-86dc-a16dc728cc5d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1689 microversion: 2.1 time: 0.381013 Sep 13 17:13:29.452767 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3438/6926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:29 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1689 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:29.485812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:29.486642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:29.501125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.501719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.502208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.502964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.503440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.504174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.594364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:29.804445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:29.805369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:29.816816 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79351083-9e35-4cae-8476-3cc6659b8bb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action" status: 202 len: 0 microversion: 2.1 time: 0.334214 Sep 13 17:13:29.822029 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3489/6927] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:13:29 2022] POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:13:29.829821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.830357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.830809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.831536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.832038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.832484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.837672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:29.839148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:29.845554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:29.867005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.867755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.879523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:29.882781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:29.884060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:29.886550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:30.186746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:30.195863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1abe80ea-50c9-4259-ba93-40dc13ab5633 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.396718 Sep 13 17:13:30.196635 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3439/6928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:29 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:30.387403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:30.405792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-126ad929-179b-460e-9134-8303c46662b9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.579659 Sep 13 17:13:30.407966 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3490/6929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:29 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:31.224948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:31.226767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:31.245790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:31.248301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:31.250933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:31.251851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:31.256045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:31.256760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:31.444623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:31.445317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:31.471875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:31.478997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:31.479358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:31.483743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:31.485816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:31.486332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:31.711385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:31.720145 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ca6e676-f121-406b-ba00-5be2a2b65603 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.280581 Sep 13 17:13:31.733921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3491/6930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:31 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:31.882858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:31.897190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-81b49d4a-e29c-456d-923d-0a05819a8619 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.676147 Sep 13 17:13:31.898034 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3440/6931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:31 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:32.373192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "name": "network-vif-plugged", "status": "completed", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:32.398259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:32.399162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:32.399848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:32.422379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] Creating event network-vif-plugged:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h2-857467-1 Sep 13 17:13:32.434418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:13:32.454576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-af6ef890-0f2b-4842-920d-f1ee40d91d54 req-04f91b31-c578-48b1-b036-983843135e04 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088825 Sep 13 17:13:32.459577 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3492/6932] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:32.750452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:32.751637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:32.760357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:32.761083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:32.761643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:32.762504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:32.762981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:32.763422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:32.924882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:32.925960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:32.936286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:32.937127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:32.937760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:32.938765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:32.939750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:32.940374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:33.016234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:33.024828 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5604087e-ba7f-431d-8958-f298e5d4f22f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.278692 Sep 13 17:13:33.030941 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3441/6933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:32 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:33.090141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:33.098372 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12ced032-12b4-4f7e-8b54-e8dc0bba339c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.179514 Sep 13 17:13:33.099277 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3493/6934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:32 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:34.048985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:34.050280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:34.058751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:34.059474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:34.060582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:34.061490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:34.062167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:34.062768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:34.122790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:34.123439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:34.132023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:34.132909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:34.133575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:34.134536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:34.135512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:34.136133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:34.303978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:34.313335 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93962657-238e-4be7-ad43-1b3541a3c52b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.195135 Sep 13 17:13:34.315238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3494/6935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:34 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:34.428672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:34.447356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ffb7104c-2331-4df5-b17f-7857fb4a91de tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.402068 Sep 13 17:13:34.460719 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3442/6936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:34 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:34.959732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "name": "network-vif-unplugged", "status": "completed", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:34.982763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:34.983365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:34.984040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:35.003956 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] Creating event network-vif-unplugged:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:13:35.013558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:13:35.031232 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-503976d4-e1e3-4b04-974c-025196fe5791 req-3213cafe-c7b4-4e7a-844b-68782bef4558 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077752 Sep 13 17:13:35.033170 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3495/6937] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:35.342801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:35.342801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:35.352391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:35.353425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:35.354970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:35.355859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:35.356337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:35.356778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:35.475399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:35.476141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:35.491275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:35.492559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:35.494654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:35.495780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:35.496807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:35.497799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:35.634562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:35.647212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62e14576-50e7-4b1f-97fd-3f2083668185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.313492 Sep 13 17:13:35.656621 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3443/6938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:35 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:35.739020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:35.751850 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f324fda6-0955-4fb2-b6fd-6b8fcc42f0ec tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.281158 Sep 13 17:13:35.752996 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3496/6939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:35 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:36.676325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:36.676959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:36.690608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:36.691943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:36.693389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:36.695435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:36.696183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:36.696889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:36.780455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:36.781734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:36.797120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:36.797950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:36.798600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:36.804195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:36.805016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:36.805753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:36.959024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:36.970305 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-08da3a64-0482-4780-a70f-a33df34ee400 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.299783 Sep 13 17:13:36.971417 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3444/6940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:36 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:37.145972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:37.156355 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f1d3954-86c6-40a4-9fc7-7e4357bf2456 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.381967 Sep 13 17:13:37.170254 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3497/6941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:36 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:37.399775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:37.418295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:37.419165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:37.419871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:37.436911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] Creating event network-changed:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:13:37.446727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:13:37.480303 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c4b85c4c-2c1e-48b8-9539-d1a4cdc2761c req-00de88be-6576-4464-8289-493a803c193f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087142 Sep 13 17:13:37.483810 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3445/6942] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:13:37.995243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:37.996012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:38.011524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:38.012369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:38.013026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:38.013994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:38.014657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:38.015290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:38.186473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:38.188102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:38.196270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:38.196940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:38.198066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:38.198895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:38.199446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:38.199960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:38.404108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:38.406240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:38.409002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:38.415186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4044c27e-7d00-45cc-bc73-8b6701c03637 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.425138 Sep 13 17:13:38.430662 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3498/6943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:37 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:38.430856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a68c6ba-5aff-4255-854f-df2c99fcc9c9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.247188 Sep 13 17:13:38.434646 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3446/6944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:38 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:39.443217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:39.444916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:39.455719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:39.457143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:39.487284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:39.487863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:39.495009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:39.496102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:39.496636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:39.497156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:39.497730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:39.498168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:39.498940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:39.499429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:39.499982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:39.502503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:39.862936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:39.873291 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0e2fd2b2-b785-4780-9951-f505bdc7c12c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1688 microversion: 2.1 time: 0.422499 Sep 13 17:13:39.877955 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3447/6945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:39 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1688 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:39.941348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:39.957856 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5a183790-7e11-45bc-ba80-fe736e94fcdf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1341 microversion: 2.1 time: 0.519318 Sep 13 17:13:39.962023 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3499/6946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:39 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1341 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:40.903807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:40.905210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:40.916715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:40.917630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:40.918356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:40.919603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:40.920259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:40.920949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:40.993729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:40.996008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:41.012431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:41.013012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:41.013646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:41.014590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:41.015094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:41.015673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:41.190007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:41.207757 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-114c33b9-db79-446c-b8c9-0f7c2814b6fd tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1681 microversion: 2.1 time: 0.309184 Sep 13 17:13:41.208705 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3448/6947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:40 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:41.330343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:41.341374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd6c75ef-1172-4c8e-b101-0dae4186b7ff tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1387 microversion: 2.1 time: 0.352267 Sep 13 17:13:41.344914 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3500/6948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:40 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1387 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:42.368428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:42.369812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:42.378336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:42.379042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:42.380682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:42.381106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:42.381655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:42.382211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:42.698320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:42.718489 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c5b29b4-7ccb-43ec-b553-1ccdbe48b514 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.352725 Sep 13 17:13:42.720176 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3449/6949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:42 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:13:43.749258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:43.750727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:43.759135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:43.760746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:43.761339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:43.762421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:43.762977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:43.763520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:43.995663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:44.006309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52c27e39-b466-4d55-a4d7-e60ce910b3a0 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.261668 Sep 13 17:13:44.022536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3501/6950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:43 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:44.564257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c636280a-ac84-424b-a26f-6d794dde6758 req-b2b3e4e2-37dc-4681-83ca-e4dddf03adb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "name": "network-vif-plugged", "status": "completed", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:44.582462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:44.591963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c636280a-ac84-424b-a26f-6d794dde6758 req-b2b3e4e2-37dc-4681-83ca-e4dddf03adb8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:44.592744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c636280a-ac84-424b-a26f-6d794dde6758 req-b2b3e4e2-37dc-4681-83ca-e4dddf03adb8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:44.593388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c636280a-ac84-424b-a26f-6d794dde6758 req-b2b3e4e2-37dc-4681-83ca-e4dddf03adb8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:44.615091 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c636280a-ac84-424b-a26f-6d794dde6758 req-b2b3e4e2-37dc-4681-83ca-e4dddf03adb8 service nova] Creating event network-vif-plugged:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:13:44.623035 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c636280a-ac84-424b-a26f-6d794dde6758 req-b2b3e4e2-37dc-4681-83ca-e4dddf03adb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061913 Sep 13 17:13:44.624394 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3450/6951] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:13:45.033255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:45.033965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:45.047279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:45.047998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:45.048446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:45.049158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:45.049664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:45.067030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:45.346326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:45.355906 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e1ddb95c-8af0-4829-af2c-63dd759520e7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.326588 Sep 13 17:13:45.363696 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3502/6952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:45 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:46.388461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:46.389863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:46.415224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:46.417666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:46.420428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:46.421421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:46.422110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:46.422738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:46.693643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:46.705618 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6c1c0636-1fb0-48b2-b43f-91394c957a3b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.320806 Sep 13 17:13:46.707197 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3451/6953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:46 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:47.732337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:47.733988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:47.742570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:47.746275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:47.747038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:47.748248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:47.752732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:47.753642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:47.982097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:47.995049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b0ab7427-bfd4-4843-811c-4f25f7a1afaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.266560 Sep 13 17:13:47.996061 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3503/6954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:47 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:49.020374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:49.020981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:49.034707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:49.035523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:49.036291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:49.037384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:49.038142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:49.038921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:49.305013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:49.314031 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-22da52d8-cec2-4e90-a058-fda1b9a01c22 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.298343 Sep 13 17:13:49.331910 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3452/6955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:49 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:50.340943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:50.343570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:50.351320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=56 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:50.353014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:50.353748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:50.354498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:50.355446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:50.356098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:50.356716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:50.505578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:50.514998 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03d03049-34f7-4c35-ace3-f7a1df91dfd7 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.178127 Sep 13 17:13:50.516140 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3504/6956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:50 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:51.547894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:51.549521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:51.558477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:51.559240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:51.560209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:51.561490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:51.562222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:51.562837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:51.788102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:51.798898 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b7a27ff6-6515-4f94-b742-16b1412ea1c8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.262076 Sep 13 17:13:51.802266 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3453/6957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:51 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:52.826550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:52.827211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:52.835361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:52.846799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:52.847557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:52.848534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:52.849026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:52.849482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:53.077617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:53.089886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17614529-9c55-4a0a-98e7-3bdc033eb9eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.267860 Sep 13 17:13:53.092193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3505/6958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:52 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:54.117129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:54.118574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:54.133254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:54.134059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:54.134548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:54.136662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:54.137245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:54.137773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:54.264317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e09b4a40-23c5-490f-a59d-8aef1aba8760 req-05e72d47-295c-4752-842c-ab5fc0363529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5", "name": "network-vif-plugged", "status": "completed", "tag": "77dc770f-5c64-4f01-951c-2a7472efab65"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:13:54.295178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e09b4a40-23c5-490f-a59d-8aef1aba8760 req-05e72d47-295c-4752-842c-ab5fc0363529 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:54.295664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e09b4a40-23c5-490f-a59d-8aef1aba8760 req-05e72d47-295c-4752-842c-ab5fc0363529 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:54.296665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e09b4a40-23c5-490f-a59d-8aef1aba8760 req-05e72d47-295c-4752-842c-ab5fc0363529 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:54.309730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e09b4a40-23c5-490f-a59d-8aef1aba8760 req-05e72d47-295c-4752-842c-ab5fc0363529 service nova] Creating event network-vif-plugged:77dc770f-5c64-4f01-951c-2a7472efab65 for instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 on n-h1-857467-1 Sep 13 17:13:54.316897 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e09b4a40-23c5-490f-a59d-8aef1aba8760 req-05e72d47-295c-4752-842c-ab5fc0363529 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056763 Sep 13 17:13:54.321731 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3506/6959] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:13:54.501033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:54.514850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d400fb39-28b5-4637-b27f-11a1d0a2d03d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.404636 Sep 13 17:13:54.517939 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3454/6960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:54 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:55.541493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:55.542441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:55.549959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:55.550480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:55.550977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:55.551709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:55.552199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:55.552655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:55.705755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:55.713942 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d8104919-78c5-41ae-a45b-b821fc567768 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1375 microversion: 2.1 time: 0.176861 Sep 13 17:13:55.714564 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3507/6961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:55 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:56.737021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:56.737765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:56.745786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:56.746336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:56.746796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:56.747455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:56.747916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:56.748356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.034618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:57.044286 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6414113-e554-4883-bd87-e44d64095d5f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1563 microversion: 2.1 time: 0.311617 Sep 13 17:13:57.045083 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3455/6962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:56 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1563 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:57.071438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:57.073108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:57.081554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:57.082279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:57.082978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.084041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:57.084536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:57.084982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.225521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:57.234940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c4d4215c-40c5-4945-b1cf-6f1d5da9cc5b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1563 microversion: 2.1 time: 0.170201 Sep 13 17:13:57.235544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3508/6963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:57 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:57.329159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:57.329677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:57.335759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:57.336238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:57.336684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.337397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:57.338485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:57.339162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.373083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:13:57.376274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:13:57.466105 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-426b94c6-962e-4d6c-b802-2a10ef7fd85e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 204 len: 0 microversion: 2.1 time: 0.140444 Sep 13 17:13:57.467991 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3456/6964] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:13:57 2022] DELETE /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:13:57.477767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:57.478969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:57.485443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:57.486001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:57.486701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.487655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:57.488323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:57.488776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:57.640116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:57.655383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b656863b-74d7-46fe-b921-d2735135af60 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1569 microversion: 2.1 time: 0.182897 Sep 13 17:13:57.656002 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3509/6965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:57 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:58.681815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:58.684135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:58.692765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:58.694045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:58.694748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:58.696045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:58.696770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:58.697116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:58.901089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:13:58.912474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66add09c-efbb-45fe-8bf8-c162788ec857 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1569 microversion: 2.1 time: 0.235671 Sep 13 17:13:58.927098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3457/6966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:58 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:13:59.938890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:13:59.939583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:13:59.948018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:59.948675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:59.949140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:13:59.949913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:13:59.950429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:13:59.950876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:00.141331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:00.151631 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1c7fd8f5-3f36-4e79-bdab-f10b6aec5f5c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1569 microversion: 2.1 time: 0.216721 Sep 13 17:14:00.153148 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3510/6967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:13:59 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:00.642716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e1413879-aa97-4012-8b38-278b52995c70 req-97906b8f-e1e5-41d2-ad74-8c00e6f40443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5", "name": "network-vif-deleted", "tag": "77dc770f-5c64-4f01-951c-2a7472efab65"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:00.664317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e1413879-aa97-4012-8b38-278b52995c70 req-97906b8f-e1e5-41d2-ad74-8c00e6f40443 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:00.665124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e1413879-aa97-4012-8b38-278b52995c70 req-97906b8f-e1e5-41d2-ad74-8c00e6f40443 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:00.665770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e1413879-aa97-4012-8b38-278b52995c70 req-97906b8f-e1e5-41d2-ad74-8c00e6f40443 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:00.710401 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e1413879-aa97-4012-8b38-278b52995c70 req-97906b8f-e1e5-41d2-ad74-8c00e6f40443 service nova] Creating event network-vif-deleted:77dc770f-5c64-4f01-951c-2a7472efab65 for instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 on n-h1-857467-1 Sep 13 17:14:00.717208 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e1413879-aa97-4012-8b38-278b52995c70 req-97906b8f-e1e5-41d2-ad74-8c00e6f40443 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078191 Sep 13 17:14:00.717979 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3458/6968] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:01.180285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:01.181196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:01.189003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:01.189781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:01.190647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:01.191581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:01.192349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:01.193052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:01.273739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:01.283614 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35000b24-0dc2-498f-8560-8dd0471bf650 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1360 microversion: 2.1 time: 0.107646 Sep 13 17:14:01.287186 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3511/6969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:01 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1360 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:02.312345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:02.313193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:02.320933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:02.321767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:02.323299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:02.324742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:02.325576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:02.326062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:02.418220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:02.428797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9d23d6a0-f8e2-4924-aea6-59b6715c409e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1360 microversion: 2.1 time: 0.123499 Sep 13 17:14:02.429408 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3459/6970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:02 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1360 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:03.460196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:03.461714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:03.471190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:03.472093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:03.472741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:03.473888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:03.475037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:03.475684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:03.548998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:03.560547 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25199845-147f-4a7f-b600-0903e2ccd302 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1360 microversion: 2.1 time: 0.106186 Sep 13 17:14:03.561169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3512/6971] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:03 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1360 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:04.590878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:04.592454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:04.603771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:04.604691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:04.605531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:04.606915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:04.607905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:04.608533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:04.705177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:04.718404 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aaa1bd9b-a390-491d-a658-cdc79d6558e1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1360 microversion: 2.1 time: 0.133384 Sep 13 17:14:04.730852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3460/6972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:04 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:05.758600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:05.760497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:05.768664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:05.769429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:05.770174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:05.771112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:05.771760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:05.772383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:05.831035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:05.831468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:05.833796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:05.834342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lazy-loading 'fault' on Instance uuid 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:14:05.890450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:05.905348 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b8c826f4-d89a-4b5a-92af-301a02505c77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 200 len: 1365 microversion: 2.1 time: 0.154178 Sep 13 17:14:05.933228 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3513/6973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:05 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:06.941497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:06.943055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:06.954383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:06.955153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:06.955780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:06.956686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:06.957318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:06.958181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:06.975762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 HTTP/1.1 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5'} Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:06.977481 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-429b622f-6580-4cc8-90e5-cbf4eb8a1c1c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 404 len: 111 microversion: 2.1 time: 0.042294 Sep 13 17:14:06.982865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3461/6974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:06 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:11.324051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:11.324579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:11.331579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:11.332085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:11.332572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:11.333281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:11.333755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:11.334220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:11.336867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=89 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:11.361650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:14:11.437780 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-059884f1-b7d5-449f-9a71-2cbb656c50b1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 204 len: 0 microversion: 2.1 time: 0.117699 Sep 13 17:14:11.438578 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3514/6975] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:14:11 2022] DELETE /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:14:11.447092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:11.448457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:11.455197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:11.455739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:11.456292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:11.456917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:11.457386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:11.457836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:11.591196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:11.599171 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ea4d0a58-e376-4bf7-85d8-7bc1707f83cb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1410 microversion: 2.1 time: 0.156143 Sep 13 17:14:11.599753 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3462/6976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:11 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:14:12.623259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:12.623992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:12.631104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:12.631619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:12.632080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:12.632805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:12.633284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:12.633740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:12.778317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:12.787384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9a4a1fd-12a0-4994-b30a-313ad3aa48d2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1410 microversion: 2.1 time: 0.168877 Sep 13 17:14:12.787974 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3515/6977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:12 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1410 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:13.733149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-42577ec4-06e0-40c2-a6ec-b6a099ff409d req-cb3c8fc5-06f6-45d3-af92-7b60a46e0cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f43947-d40e-47fd-bc10-2e11d5e2f0a7", "name": "network-vif-deleted", "tag": "0ff936f0-1745-4bb3-ad1d-04522c1f6984"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:13.746367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-42577ec4-06e0-40c2-a6ec-b6a099ff409d req-cb3c8fc5-06f6-45d3-af92-7b60a46e0cbc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:13.746854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-42577ec4-06e0-40c2-a6ec-b6a099ff409d req-cb3c8fc5-06f6-45d3-af92-7b60a46e0cbc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:13.747817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-42577ec4-06e0-40c2-a6ec-b6a099ff409d req-cb3c8fc5-06f6-45d3-af92-7b60a46e0cbc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:13.760437 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-42577ec4-06e0-40c2-a6ec-b6a099ff409d req-cb3c8fc5-06f6-45d3-af92-7b60a46e0cbc service nova] Creating event network-vif-deleted:0ff936f0-1745-4bb3-ad1d-04522c1f6984 for instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 on n-h2-857467-1 Sep 13 17:14:13.766949 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-42577ec4-06e0-40c2-a6ec-b6a099ff409d req-cb3c8fc5-06f6-45d3-af92-7b60a46e0cbc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Sep 13 17:14:13.767804 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3463/6978] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:13.811615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:13.812254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:13.819531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:13.820170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:13.820784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:13.821620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:13.822900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:13.824307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:13.894618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:13.904985 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-290cf070-cc00-4dc1-a784-522f84ce3eaf tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1202 microversion: 2.1 time: 0.097296 Sep 13 17:14:13.905922 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3516/6979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:13 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:14.929625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:14.932335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:14.951034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:14.956615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:14.957130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:14.958932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:14.958932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:14.959279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:14.962899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:15.037166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:15.046575 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-37a1107f-05ef-4e16-a5fd-dd4e0bb4f49f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1202 microversion: 2.1 time: 0.122032 Sep 13 17:14:15.047693 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3464/6980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:14 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:14:15.539955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:15.542413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:15.549537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:15.550084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:15.550541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:15.551246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:15.551721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:15.552162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:15.630367 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfed9100-319a-4cae-b848-688b54920d4c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action" status: 200 len: 63043 microversion: 2.1 time: 0.094338 Sep 13 17:14:15.631351 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3517/6981] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:14:15 2022] POST /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db/action => generated 63043 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:14:16.071918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:16.073789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:16.082840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:16.083736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:16.084188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:16.084903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:16.085372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:16.085810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:16.155329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:16.163381 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa6b3f04-64d3-441a-bde4-7866695021eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1202 microversion: 2.1 time: 0.097319 Sep 13 17:14:16.164156 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3465/6982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:16 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:17.189133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:17.189894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:17.198411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:17.198806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:17.199269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:17.200002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:17.200693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:17.201152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:17.268938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:17.279253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3dc6b13-6303-43fc-ad37-0bd0708dedec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1202 microversion: 2.1 time: 0.094103 Sep 13 17:14:17.279935 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3518/6983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:17 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:18.303053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:18.304461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:18.316201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:18.318037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:18.318619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:18.319447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:18.320164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:18.320945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:18.356444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:18.357049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:18.357560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:18.358109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lazy-loading 'fault' on Instance uuid 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:14:18.400467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:18.409459 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-69b423bb-0ba3-4c8a-886b-1a15b30bb279 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 200 len: 1207 microversion: 2.1 time: 0.110477 Sep 13 17:14:18.410257 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3466/6984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:18 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 1207 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:19.437535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:19.439184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:19.449090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:19.450178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:19.450711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:19.451751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:19.452465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:19.453216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:19.469168 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 HTTP/1.1 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '31f43947-d40e-47fd-bc10-2e11d5e2f0a7'} Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:19.471583 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:19.476870 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:19.478329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:19.479447 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-282c20de-4e56-4d96-bd42-8dcf48410085 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 404 len: 111 microversion: 2.1 time: 0.046049 Sep 13 17:14:19.480694 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3519/6985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:19 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:21.647698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:21.648859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:21.657623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:21.658459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:21.658978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:21.659956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:21.660677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:21.661401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:21.677610 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 HTTP/1.1 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5'} Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:21.679466 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.683925 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.685932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:21.686837 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-901d0603-cde3-4afa-bdc7-5ff00ed36582 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 404 len: 111 microversion: 2.1 time: 0.044215 Sep 13 17:14:21.690590 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3467/6986] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:14:21 2022] DELETE /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:21.700391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:21.701738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:21.705116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:21.714316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:21.715815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:21.716531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:21.717768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:21.718318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:21.719109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:21.736365 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 HTTP/1.1 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5'} Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:21.738347 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. Sep 13 17:14:21.743289 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:21.744655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:21.746414 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-20c64415-0dad-4c96-95e2-9d1fc9f105af tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5" status: 404 len: 111 microversion: 2.1 time: 0.051105 Sep 13 17:14:21.747532 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3520/6987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:21 2022] GET /compute/v2.1/servers/2bdf8487-e6e9-4f65-b37c-97dbd0f27ff5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:22.408428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:22.408941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:22.415736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:22.416846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:22.417543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:22.418454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:22.419091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:22.419735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:22.434665 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 HTTP/1.1 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '31f43947-d40e-47fd-bc10-2e11d5e2f0a7'} Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:22.436467 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68e9fc52-d12f-415f-8b88-315db276d435 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 404 len: 111 microversion: 2.1 time: 0.033605 Sep 13 17:14:22.442110 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3468/6988] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:14:22 2022] DELETE /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:22.447825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:22.448505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: 31f43947-d40e-47fd-bc10-2e11d5e2f0a7] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:22.456585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:22.457106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:22.457587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:22.458358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:22.458851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:22.459312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:22.474234 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 HTTP/1.1 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '31f43947-d40e-47fd-bc10-2e11d5e2f0a7'} Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:22.475927 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance 31f43947-d40e-47fd-bc10-2e11d5e2f0a7 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e406bcc7-0c81-4814-9e2b-8903c5a3cb28 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7" status: 404 len: 111 microversion: 2.1 time: 0.034292 Sep 13 17:14:22.484394 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3521/6989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:22 2022] GET /compute/v2.1/servers/31f43947-d40e-47fd-bc10-2e11d5e2f0a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:22.560958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-969bde45-a454-400d-8755-20adb83ee3bb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: .version_select at 0x7fbeb966f670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1395877829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOZ4RToiMLOoVmuHuRXgCXStsXeYv4QJFdahxP3YjIZkpXrDDyDBRqD09ku4U9ocfNyXijmkeLmZf/pBgrDc90kjrgs2pYyPoKdAzCaMTguG3Svc4Cd93vI6+qZo9OXZQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:22.578104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-969bde45-a454-400d-8755-20adb83ee3bb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:14:22.583904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-969bde45-a454-400d-8755-20adb83ee3bb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:14:22.608964 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-969bde45-a454-400d-8755-20adb83ee3bb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.053606 Sep 13 17:14:22.609690 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3469/6990] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:14:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:32.047276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:32.048540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:32.070956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:32.071806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:32.073483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:32.074370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:32.074950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:32.075627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:32.223111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe97d3ed-0b81-4696-9432-6da2e980cf2a tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1832 microversion: 2.1 time: 0.411833 Sep 13 17:14:32.223803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3522/6991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:31 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1832 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:33.396392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:33.397717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:33.398629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:33.399091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ad55bfa5-f522-4afe-a0c7-f2d8467a1d99 req-8dc36fb9-9436-4912-94f5-86bfb95d89b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:33.404855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:33.405367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:33.410129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ad55bfa5-f522-4afe-a0c7-f2d8467a1d99 req-8dc36fb9-9436-4912-94f5-86bfb95d89b6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:33.410867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ad55bfa5-f522-4afe-a0c7-f2d8467a1d99 req-8dc36fb9-9436-4912-94f5-86bfb95d89b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:33.411520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ad55bfa5-f522-4afe-a0c7-f2d8467a1d99 req-8dc36fb9-9436-4912-94f5-86bfb95d89b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:33.425662 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ad55bfa5-f522-4afe-a0c7-f2d8467a1d99 req-8dc36fb9-9436-4912-94f5-86bfb95d89b6 service nova] Creating event network-changed:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:14:33.426420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:33.426954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:33.427414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:33.428161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:33.428636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:33.429081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:33.431199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ad55bfa5-f522-4afe-a0c7-f2d8467a1d99 req-8dc36fb9-9436-4912-94f5-86bfb95d89b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036337 Sep 13 17:14:33.432695 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3523/6992] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:33.472204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:14:33.666386 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-768f11b8-b906-4a69-a4e5-84573eda1de3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 204 len: 0 microversion: 2.1 time: 0.271375 Sep 13 17:14:33.667407 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3470/6993] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:14:33 2022] DELETE /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:14:33.677456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:33.684538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:33.702289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:33.704699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:33.705294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:33.707963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:33.708580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:33.710066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:33.879232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:33.888018 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-21b07115-6c6f-4b7a-897d-e7d1597913ca tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1687 microversion: 2.1 time: 0.215494 Sep 13 17:14:33.889003 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3524/6994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:33 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:34.919867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:34.922029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:34.942561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:34.944572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:34.945105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:34.946439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:34.948674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:34.949437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:35.270184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:35.279850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-002b621e-b5bd-40e1-a5cf-e1c4d772f895 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1687 microversion: 2.1 time: 0.370023 Sep 13 17:14:35.286011 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3471/6995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:34 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1687 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:36.113081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f231d285-b657-4484-922f-2ff51c8ffa6a req-bcd1ae85-37f4-449c-aa1d-b5c8592471b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378fd3b6-3b0d-4e50-9052-b13970ff75db", "name": "network-vif-deleted", "tag": "9d0a9347-8329-4c65-9c54-06fcd82f495b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:36.124647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f231d285-b657-4484-922f-2ff51c8ffa6a req-bcd1ae85-37f4-449c-aa1d-b5c8592471b6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:36.125160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f231d285-b657-4484-922f-2ff51c8ffa6a req-bcd1ae85-37f4-449c-aa1d-b5c8592471b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:36.125749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f231d285-b657-4484-922f-2ff51c8ffa6a req-bcd1ae85-37f4-449c-aa1d-b5c8592471b6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:36.160418 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f231d285-b657-4484-922f-2ff51c8ffa6a req-bcd1ae85-37f4-449c-aa1d-b5c8592471b6 service nova] Creating event network-vif-deleted:9d0a9347-8329-4c65-9c54-06fcd82f495b for instance 378fd3b6-3b0d-4e50-9052-b13970ff75db on n-h1-857467-1 Sep 13 17:14:36.167199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f231d285-b657-4484-922f-2ff51c8ffa6a req-bcd1ae85-37f4-449c-aa1d-b5c8592471b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058452 Sep 13 17:14:36.168069 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3525/6996] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:36.325041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:36.325678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:36.343616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:36.344648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:36.345345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:36.346934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:36.348970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:36.349647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:36.408020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:36.411173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:36.414062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:36.414715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lazy-loading 'fault' on Instance uuid 378fd3b6-3b0d-4e50-9052-b13970ff75db {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:14:36.692664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:36.711833 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b0a17242-3727-4839-a677-66b593f9a981 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 200 len: 1356 microversion: 2.1 time: 0.391945 Sep 13 17:14:36.726118 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3472/6997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:36 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 1356 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:37.739166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:37.739952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 378fd3b6-3b0d-4e50-9052-b13970ff75db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:37.749289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:37.750398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:37.752140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:37.753476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:37.754007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:37.754741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:37.772483 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] HTTP exception thrown: Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db could not be found. Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Request method failure captured: Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db HTTP/1.1 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILkBD_BBT3s4zy_iG7sW47eVxVhtuVN_LpJ6eyAUTVvnGgEm9nSZ71UjSc1mqRFOMtzGHRtuKPNYOb27Y7896o9j0UBG-IY446yIe1mwU0n5obKNM0QrU6LYkTdijiJKBk0jXG5U2VW_weDPuhy7fiXeRA5C3vy8OT4OYrDX05PpuzM Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7aa877fdd453495997fbbc66a9bd1b1b Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db could not be found. Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '378fd3b6-3b0d-4e50-9052-b13970ff75db'} Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db could not be found. Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db could not be found. Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:37.778279 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db could not be found. Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Returning 404 to user: Instance 378fd3b6-3b0d-4e50-9052-b13970ff75db could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b65af100-42f0-4a72-9441-8659a849e7e2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db" status: 404 len: 111 microversion: 2.1 time: 0.045967 Sep 13 17:14:37.784037 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3526/6998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:37 2022] GET /compute/v2.1/servers/378fd3b6-3b0d-4e50-9052-b13970ff75db => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:14:43.206895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-778615847", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "c2a3b903-9ea3-41d3-bb09-8bf0527bf193"}], "key_name": "tempest-TestSecurityGroupsBasicOps-605798807", "security_groups": []}, "os:scheduler_hints": {"different_host": ["207bab3f-4a11-460a-9fc9-a84c414ec24c"]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:43.300598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] validate_networks() for [('c2a3b903-9ea3-41d3-bb09-8bf0527bf193', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:14:43.971157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-705134453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1395877829", "security_groups": [{"name": "tempest-secgroup-smoke-197606766"}], "block_device_mapping_v2": [{"uuid": "80c2ffea-c74d-4510-8eac-52bb90d0bb09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:44.081111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:14:44.082332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:14:44.082967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:14:44.083459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:14:44.083889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:14:44.104924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:44.105438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:44.106088 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:44.106849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:44.107804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:44.108248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:44.149185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Getting quotas for project 61996a9f03bd44d2a855253f0f38ae5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:14:44.160072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Getting quotas for user c9779362ba4c47d48d1c12bd59ff0dd1 and project 61996a9f03bd44d2a855253f0f38ae5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:14:44.181360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:14:44.196227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:14:44.303482 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a74a28d2-3427-4f29-848b-ff8feb45dd7f tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.102554 Sep 13 17:14:44.304167 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3473/6999] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:14:43 2022] POST /compute/v2.1/servers => generated 361 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:14:44.317756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ac0533e-a989-4efc-9280-0c1a78a8dcf7 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:44.318411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ac0533e-a989-4efc-9280-0c1a78a8dcf7 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:44.442520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ac0533e-a989-4efc-9280-0c1a78a8dcf7 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:44.454008 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ac0533e-a989-4efc-9280-0c1a78a8dcf7 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1240 microversion: 2.1 time: 0.140308 Sep 13 17:14:44.476481 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3474/7000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:44 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:44.649185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:14:45.483675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:45.486453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:45.510617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:45.517496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:45.518216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:45.520598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:45.522219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:45.524705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:45.633057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:45.642358 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-034b7fe3-9a80-452b-84d8-ad514f7ff80a tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1236 microversion: 2.1 time: 0.165797 Sep 13 17:14:45.658299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3475/7001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:45 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1236 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:14:45.664019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ab0bbf7-4609-49a3-beb4-0457813e22e4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '.version_select at 0x7fbeb4d92550>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:45.694266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ab0bbf7-4609-49a3-beb4-0457813e22e4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1854626087" status: 202 len: 0 microversion: 2.1 time: 0.034630 Sep 13 17:14:45.699852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3476/7002] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Sep 13 17:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1854626087 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:14:45.740905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b2add58-7c38-4fc6-8e77-47fcbdb5d928 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: .version_select at 0x7fbeb49cee50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-578188879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj4XoItSdvM4wpM07P8tST2EORRJQFuuuBgzIqY+KxrU9mqXdl2fHMkJpczC+S+4LxqkFeQOXAUWuGzPNerSy1nv5U6y+d339Q48xL5a+RBpFQQ33Rrb01RZRYI9wtT3Q=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:45.781168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4b2add58-7c38-4fc6-8e77-47fcbdb5d928 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:14:45.798762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4b2add58-7c38-4fc6-8e77-47fcbdb5d928 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:14:45.827026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:14:45.827717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:14:45.828262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:14:45.829009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:14:45.830067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:14:45.842879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:45.844483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:45.845122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:45.846298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:45.846505 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b2add58-7c38-4fc6-8e77-47fcbdb5d928 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.110277 Sep 13 17:14:45.847261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:45.853228 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3477/7003] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:14:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:14:45.855143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:45.864638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:45.897791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:14:45.905152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:14:46.001596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:14:46.004216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80c2ffea-c74d-4510-8eac-52bb90d0bb09',volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:14:46.292335 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5985588e-ea42-4f34-99db-143d9f19430e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.326015 Sep 13 17:14:46.293015 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3527/7004] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:14:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 17:14:46.315566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fd0e3ff7-b052-405c-997c-978d799cc29e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:46.316494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fd0e3ff7-b052-405c-997c-978d799cc29e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:46.600040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fd0e3ff7-b052-405c-997c-978d799cc29e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:46.610707 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fd0e3ff7-b052-405c-997c-978d799cc29e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1094 microversion: 2.1 time: 0.308310 Sep 13 17:14:46.622971 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3478/7005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:46 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1094 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:46.670713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:46.671653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:46.685690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:46.702390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:46.702801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:46.703575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:46.704128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:46.707012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:46.885607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:46.914339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d5d5fbee-960b-43ad-a867-24ed00fb463b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.247655 Sep 13 17:14:46.915715 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3528/7006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:46 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:47.921013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:47.921642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:47.950767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:47.952714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:47.955312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:47.956163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:47.956804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:47.957920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:47.958816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:47.959553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:47.971533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:47.984222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:47.984868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:47.990076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:47.990594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:47.992581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:48.292059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:48.302963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3ab68b89-1214-4d81-9946-f7be3309fd41 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.364408 Sep 13 17:14:48.303811 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3529/7007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:47 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:48.331911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:48.346170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c4bd942-7b84-4ec1-a44b-51c3935a719a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1192 microversion: 2.1 time: 0.714513 Sep 13 17:14:48.347398 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3479/7008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:47 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1192 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:49.256980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d5d72229-1d20-4cca-a626-ef94760865d6 req-3b62c704-dd73-4ab0-8aad-3ff8eb090403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bee4e9d-4af9-464f-a740-4f44ca2a2e8b", "tag": "ae164a1f-8345-4809-8344-50dbef808a9b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:49.324592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d5d72229-1d20-4cca-a626-ef94760865d6 req-3b62c704-dd73-4ab0-8aad-3ff8eb090403 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:49.325084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d5d72229-1d20-4cca-a626-ef94760865d6 req-3b62c704-dd73-4ab0-8aad-3ff8eb090403 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:49.325554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d5d72229-1d20-4cca-a626-ef94760865d6 req-3b62c704-dd73-4ab0-8aad-3ff8eb090403 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:49.334939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:49.336430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:49.343077 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d5d72229-1d20-4cca-a626-ef94760865d6 req-3b62c704-dd73-4ab0-8aad-3ff8eb090403 service nova] Creating event network-changed:ae164a1f-8345-4809-8344-50dbef808a9b for instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b on n-h1-857467-1 Sep 13 17:14:49.353029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d5d72229-1d20-4cca-a626-ef94760865d6 req-3b62c704-dd73-4ab0-8aad-3ff8eb090403 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103482 Sep 13 17:14:49.353821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:49.354400 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3530/7009] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:49.355290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:49.358459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:49.359242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:49.359733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:49.360182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:49.380467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:49.382562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:49.407628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:49.408527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:49.409211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:49.410241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:49.410942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:49.411633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:49.639402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:49.651174 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-50ccc577-4eaa-4860-a1e1-4949d3bedcb4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1210 microversion: 2.1 time: 0.283245 Sep 13 17:14:49.667785 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3531/7010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:49 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1210 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:49.860238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:49.874177 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4582a6ca-74bd-43d3-a1d7-7ae2fc174c3b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.547090 Sep 13 17:14:49.874952 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3480/7011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:49 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:50.676633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:50.677290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:50.691073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:50.691599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:50.692065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:50.692801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:50.704642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:50.705275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:50.912406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:50.914676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:50.933655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:50.936006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:50.936672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:50.938906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:50.942480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:50.943221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:51.061608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:51.080863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d1903d60-1888-4310-9344-ddf441fe1d27 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1277 microversion: 2.1 time: 0.404700 Sep 13 17:14:51.084262 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3532/7012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:50 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1277 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:51.192773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:51.210297 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99cbbc36-9f19-4d37-b0a3-9782d63f914c tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.309822 Sep 13 17:14:51.211743 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3481/7013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:50 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:51.663402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3082b81b-9dc9-4a8d-a2f4-3acf4e362c5a req-e6e047f8-12b5-4627-905c-e3a1257feb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e", "tag": "67bdda21-2de9-4ff8-9bfa-181d9825033b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:51.699338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3082b81b-9dc9-4a8d-a2f4-3acf4e362c5a req-e6e047f8-12b5-4627-905c-e3a1257feb49 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:51.700755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3082b81b-9dc9-4a8d-a2f4-3acf4e362c5a req-e6e047f8-12b5-4627-905c-e3a1257feb49 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:51.702373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3082b81b-9dc9-4a8d-a2f4-3acf4e362c5a req-e6e047f8-12b5-4627-905c-e3a1257feb49 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:51.736229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3082b81b-9dc9-4a8d-a2f4-3acf4e362c5a req-e6e047f8-12b5-4627-905c-e3a1257feb49 service nova] Creating event network-changed:67bdda21-2de9-4ff8-9bfa-181d9825033b for instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e on n-h2-857467-1 Sep 13 17:14:51.748995 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3082b81b-9dc9-4a8d-a2f4-3acf4e362c5a req-e6e047f8-12b5-4627-905c-e3a1257feb49 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093030 Sep 13 17:14:51.754230 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3533/7014] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:52.108452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:52.109153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:52.118884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:52.119671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:52.120167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:52.123613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:52.123613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:52.123613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:52.236474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:52.238036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:52.240337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:52.250947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:52.252036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:52.254922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:52.256541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:52.257644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:52.261277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:52.378649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:52.392851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9567515f-bf3b-495a-8f58-1f99426adb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1277 microversion: 2.1 time: 0.289194 Sep 13 17:14:52.407636 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3482/7015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:52 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1277 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:52.542164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:52.562076 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2abd0239-a0bb-4279-b856-6c9ccac6e599 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.327173 Sep 13 17:14:52.563999 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3534/7016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:52 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:14:53.422565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:53.423495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:53.439041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:53.442710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:53.443449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:53.444266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:53.449186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:53.449682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:53.593064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:53.593720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:53.611824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:53.615101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:53.615635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:53.620218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:53.624758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:53.625250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:53.834286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:53.846001 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-26b6f8af-c4e3-439d-baf0-78865df1b6cd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1277 microversion: 2.1 time: 0.426085 Sep 13 17:14:53.855391 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3483/7017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:53 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1277 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:53.884247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:53.895231 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e056884-646d-44fc-9600-4ca8f28300db tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.307145 Sep 13 17:14:53.915056 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3535/7018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:53 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:54.868196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:54.883829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:54.884675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:54.905788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:54.908493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:54.908962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:54.909710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:54.910211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:54.910651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:54.926917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:54.927672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:54.942706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:54.944362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:54.945076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:54.946158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:54.946888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:54.947552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:55.301600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:55.312862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:55.314384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3f42606-64d8-4050-a292-8030a78c5035 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.391259 Sep 13 17:14:55.318869 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3536/7019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:54 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:55.326234 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93358585-26c2-4280-a762-b9f3079d8670 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1277 microversion: 2.1 time: 0.457079 Sep 13 17:14:55.327084 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3484/7020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:54 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:56.341734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:56.342439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:56.345593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:56.353277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:56.354718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:56.361136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:56.375418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:56.378017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:56.378872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:56.379394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:56.380203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:56.382211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:56.382498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:56.382686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:56.383183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:56.386463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:56.387717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:56.392215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:56.558356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:56.575081 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bceae092-597d-45b4-8f92-2b74310e4e4b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.232412 Sep 13 17:14:56.575890 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3537/7021] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:56 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:56.604870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:56.660055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:56.665688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4ebedb2b-049e-4689-ad3f-123c9362203b req-b7bd3ff1-e298-4649-ac2e-e28b47115f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bee4e9d-4af9-464f-a740-4f44ca2a2e8b", "name": "network-vif-plugged", "status": "completed", "tag": "ae164a1f-8345-4809-8344-50dbef808a9b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:56.682786 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a9a68df-1074-43b2-a20e-86b3d59abc45 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.332480 Sep 13 17:14:56.689820 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3485/7022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:56 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:56.692812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4ebedb2b-049e-4689-ad3f-123c9362203b req-b7bd3ff1-e298-4649-ac2e-e28b47115f9b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:56.693579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4ebedb2b-049e-4689-ad3f-123c9362203b req-b7bd3ff1-e298-4649-ac2e-e28b47115f9b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:56.694292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4ebedb2b-049e-4689-ad3f-123c9362203b req-b7bd3ff1-e298-4649-ac2e-e28b47115f9b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:56.710966 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4ebedb2b-049e-4689-ad3f-123c9362203b req-b7bd3ff1-e298-4649-ac2e-e28b47115f9b service nova] Creating event network-vif-plugged:ae164a1f-8345-4809-8344-50dbef808a9b for instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b on n-h1-857467-1 Sep 13 17:14:56.718022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4ebedb2b-049e-4689-ad3f-123c9362203b req-b7bd3ff1-e298-4649-ac2e-e28b47115f9b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056168 Sep 13 17:14:56.720080 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3538/7023] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:14:56.868936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-856136404", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "9c8e8c49-7e11-4d9a-b73a-64cd15c1a085"}], "key_name": "tempest-TestNetworkAdvancedServerOps-578188879", "security_groups": [{"name": "tempest-secgroup-smoke-1180414802"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:14:57.008895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] validate_networks() for [('9c8e8c49-7e11-4d9a-b73a-64cd15c1a085', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:14:57.565003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:14:57.566247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:14:57.566773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:14:57.567276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:14:57.567601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:14:57.580909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:57.581413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:57.581968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:57.582888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:57.583457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:57.583980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:57.602463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:57.603262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:57.618405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:57.619009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:57.620052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:57.621571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:57.623978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:14:57.624807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:57.625444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:57.637152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:14:57.669207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:14:57.675053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:14:57.764072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:57.766212 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-167eaa37-1101-4df4-b797-c3ec047c91af tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.901116 Sep 13 17:14:57.772463 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a407d30a-2824-4eba-adff-a7d5e3450939 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1298 microversion: 2.1 time: 0.175634 Sep 13 17:14:57.773536 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3486/7024] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:14:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:14:57.781816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:57.782757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:57.795262 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3539/7025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:57 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:14:57.801543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:57.802094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:57.802557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:57.803277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:57.803746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:57.804185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:57.807992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d50cda4d-6116-4fb5-9e58-36fc76b2bcbe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:57.816453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d50cda4d-6116-4fb5-9e58-36fc76b2bcbe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:57.966881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:57.968609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d50cda4d-6116-4fb5-9e58-36fc76b2bcbe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:57.977246 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d50cda4d-6116-4fb5-9e58-36fc76b2bcbe tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1265 microversion: 2.1 time: 0.180321 Sep 13 17:14:57.977632 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66294726-f007-433a-be28-980201d56a02 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.202384 Sep 13 17:14:57.978459 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3487/7026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:57 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:57.981467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3540/7027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:57 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:58.801878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:58.803410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:58.817756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:58.822762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:58.824007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:58.826037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:58.828861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:58.829690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:58.967899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:58.977504 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9118270e-6efe-4060-a7ad-a58a40963cc8 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1471 microversion: 2.1 time: 0.180728 Sep 13 17:14:58.979558 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3488/7028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:58 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:59.003614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:59.004933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:59.008772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:59.011083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:59.018254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.019225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.020004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.021809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.022511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.023388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.035852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.036719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.037311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.038523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.039131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.039799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.124958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:59.130584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:59.140848 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c079f751-305c-401c-9ec7-b3227abcefb8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1261 microversion: 2.1 time: 0.137476 Sep 13 17:14:59.144645 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3489/7029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:59 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:59.156878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:59.158856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:59.174502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.179115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.180114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.181132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.182640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.183413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.269156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:59.280708 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3fbbd92-ea2a-49d0-9741-988f56aa95fa tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.281218 Sep 13 17:14:59.282792 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3541/7030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:58 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:59.355879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:14:59.366045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e7fb7b3-f5ee-498c-90d1-ea65eb13d0b4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1471 microversion: 2.1 time: 0.220092 Sep 13 17:14:59.367624 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3490/7031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:59 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:59.390969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:59.391817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:59.399206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.400131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.402104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.402929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.403437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.403909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.544690 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c2d254af-b178-4869-961b-6e73273058d0 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1622 microversion: 2.1 time: 0.157244 Sep 13 17:14:59.546654 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3542/7032] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:59 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1622 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:59.570091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:59.571321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:59.575043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:14:59.580943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.581817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.582585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.586026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.587597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.588318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.803643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc3529eb-a5b9-44eb-9af9-24f879f5e397 tempest-TestSecurityGroupsBasicOps-30809373 tempest-TestSecurityGroupsBasicOps-30809373-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1912 microversion: 2.1 time: 0.238772 Sep 13 17:14:59.805044 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3491/7033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:14:59 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1912 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:14:59.905624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:14:59.906516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:14:59.915135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.915916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.916445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.917198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:14:59.917673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:14:59.918142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:14:59.956737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:15:00.065943 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-14b57dab-e1d9-41a2-94bc-f8ca2ff993cd tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 204 len: 0 microversion: 2.1 time: 0.164636 Sep 13 17:15:00.066618 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3543/7034] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:14:59 2022] DELETE /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:15:00.075086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:00.075955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:00.083072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:00.083564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:00.083999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:00.084903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:00.085419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:00.086003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:00.172068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:00.172911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:00.174128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:00.179626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:00.180156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:00.180816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:00.181683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:00.182701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:00.183348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:00.184523 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d65e00c8-69d8-4d37-9aa2-c3269593b0c4 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1477 microversion: 2.1 time: 0.113363 Sep 13 17:15:00.185368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3492/7035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:00 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1477 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:00.266488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:00.275184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6c15a04-f2c1-4339-96e1-f7fbd8966481 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1317 microversion: 2.1 time: 0.109018 Sep 13 17:15:00.276421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3544/7036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:00 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:00.306309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:00.306914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:00.313090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:00.313584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:00.314061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:00.314770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:00.315231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:00.315668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:00.469805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:00.478365 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3c384c47-6eba-491b-a0f7-4cc45649f721 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.176702 Sep 13 17:15:00.479724 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3493/7037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:00 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:01.208551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:01.209403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:01.217296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:01.217760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:01.228723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:01.229647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:01.230366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:01.231006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:01.300216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:01.300767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:01.311760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:01.312383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:01.312922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:01.313756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:01.314622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:01.315273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:01.349850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:01.352344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:01.365968 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c397c3f9-615f-46e1-8210-5b81e276ba32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1477 microversion: 2.1 time: 0.161305 Sep 13 17:15:01.367118 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3545/7038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:01 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:01.433254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:01.441289 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b5fe7f6-f046-47ed-8b97-336820c27f2f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1325 microversion: 2.1 time: 0.145104 Sep 13 17:15:01.442282 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3494/7039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:01 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:01.504164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:01.504857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:01.512867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:01.513546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:01.514696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:01.515451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:01.515936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:01.516383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:01.672386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:01.682698 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9f2c6ac2-c0ae-411b-91ff-a262ab750995 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.183587 Sep 13 17:15:01.683693 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3546/7040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:01 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:02.347969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-42ae678e-a309-48b1-9243-42fc002faded req-d9806f77-8bac-4865-879e-3e89383c1f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bee4e9d-4af9-464f-a740-4f44ca2a2e8b", "name": "network-vif-deleted", "tag": "ae164a1f-8345-4809-8344-50dbef808a9b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:02.362178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-42ae678e-a309-48b1-9243-42fc002faded req-d9806f77-8bac-4865-879e-3e89383c1f9d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.363678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-42ae678e-a309-48b1-9243-42fc002faded req-d9806f77-8bac-4865-879e-3e89383c1f9d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.364331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-42ae678e-a309-48b1-9243-42fc002faded req-d9806f77-8bac-4865-879e-3e89383c1f9d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.381324 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-42ae678e-a309-48b1-9243-42fc002faded req-d9806f77-8bac-4865-879e-3e89383c1f9d service nova] Creating event network-vif-deleted:ae164a1f-8345-4809-8344-50dbef808a9b for instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b on n-h1-857467-1 Sep 13 17:15:02.393221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:02.394193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:02.403633 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-42ae678e-a309-48b1-9243-42fc002faded req-d9806f77-8bac-4865-879e-3e89383c1f9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060199 Sep 13 17:15:02.406417 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3495/7041] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:15:02.412169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.413021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.413702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.414901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.415697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.417354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.465717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:02.466680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:02.497065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.497849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.498624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.499579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.502289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.503223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.521773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:02.533866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03c86872-67bb-4a0a-86c9-50cd0eb70d32 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 200 len: 1325 microversion: 2.1 time: 0.145345 Sep 13 17:15:02.535328 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3547/7042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:02 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:02.708095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:02.708763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:02.724064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.724597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.729777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.729777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:02.729777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:02.729777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:02.865026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:02.875434 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-64946b9e-cbee-495c-b408-8aafe3109436 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.414399 Sep 13 17:15:02.876653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3496/7043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:02 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:02.912552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:02.921486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3188ea7-fda3-47c4-8456-1ef580a73807 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.218354 Sep 13 17:15:02.922242 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3548/7044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:02 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:03.558334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:03.559458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:03.567942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.568826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.569611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:03.570627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.571081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.571588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:03.589259 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] HTTP exception thrown: Instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b could not be found. Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Request method failure captured: Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b HTTP/1.1 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILoK1K2xLmseufAAnSpChmpbRLQSzowIi-Ql16RXcKuE1KK0VnG_tDTOzVvhJAm4GuvBhhlgRYWAtFfJRrbM-hQ1ssweLTCpU19oUHgSeJ3PhE1eVy7yc3cHq3jXmCRWfaNrEPK-_enG8QSDgaHIzEgH5zX7lnRA9Ml_80XAtIWiL4k Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 61996a9f03bd44d2a855253f0f38ae5e Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1242473381 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1242473381 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 61996a9f03bd44d2a855253f0f38ae5e Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1242473381 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestSecurityGroupsBasicOps-1242473381-project Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c9779362ba4c47d48d1c12bd59ff0dd1 Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1242473381-project Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b could not be found. Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '5bee4e9d-4af9-464f-a740-4f44ca2a2e8b'} Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b could not be found. Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b could not be found. Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:15:03.591089 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b could not be found. Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Returning 404 to user: Instance 5bee4e9d-4af9-464f-a740-4f44ca2a2e8b could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:15:03.596347 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99cc2758-f9ec-4ac3-9e77-f0bb2f87fa9b tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b" status: 404 len: 111 microversion: 2.1 time: 0.040844 Sep 13 17:15:03.600142 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3497/7045] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:03 2022] GET /compute/v2.1/servers/5bee4e9d-4af9-464f-a740-4f44ca2a2e8b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:15:03.741536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6c9b3616-10df-4796-9196-669c3718eea6 req-38274736-c518-4bda-97d4-f4dce8614d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:03.772912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6c9b3616-10df-4796-9196-669c3718eea6 req-38274736-c518-4bda-97d4-f4dce8614d61 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.773862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6c9b3616-10df-4796-9196-669c3718eea6 req-38274736-c518-4bda-97d4-f4dce8614d61 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.776040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6c9b3616-10df-4796-9196-669c3718eea6 req-38274736-c518-4bda-97d4-f4dce8614d61 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:03.814840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6c9b3616-10df-4796-9196-669c3718eea6 req-38274736-c518-4bda-97d4-f4dce8614d61 service nova] Creating event network-changed:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h1-857467-1 Sep 13 17:15:03.821313 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6c9b3616-10df-4796-9196-669c3718eea6 req-38274736-c518-4bda-97d4-f4dce8614d61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092794 Sep 13 17:15:03.823367 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3549/7046] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:15:03.902960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:03.903985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:03.913165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.914129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.914786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:03.915724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.916699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.917453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:03.945400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:03.946162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:03.956831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.957351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.959324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:03.961264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:03.961771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:03.962676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:04.217148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:04.238905 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6b70bef-9ae6-421d-ab77-9002f7db5f89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.340970 Sep 13 17:15:04.254483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3498/7047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:03 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:04.348297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:04.362667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f469cb58-71af-4eff-9275-ae70669b6388 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.421485 Sep 13 17:15:04.363651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3550/7048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:03 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:05.264185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:05.264739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:05.275421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:05.276859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:05.277324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:05.278116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:05.278601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:05.279044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:05.388001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:05.390407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:05.400530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:05.407148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:05.407875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:05.408839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:05.409498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:05.410160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:05.473145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:05.482356 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c7fc1f5a-d3fd-4151-9fb7-ed3e37833d82 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.223183 Sep 13 17:15:05.485810 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3499/7049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:05 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:05.707372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:05.716113 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c158b990-d8d8-4e47-9e90-f3fbad907592 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.333633 Sep 13 17:15:05.716884 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3551/7050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:05 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:06.509433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:06.511890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:06.522350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:06.523243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:06.524086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:06.525903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:06.527528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:06.528460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:06.740761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:06.742073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:06.749608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:06.750485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:06.751172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:06.752138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:06.753118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:06.753695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:06.788248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:06.803083 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1c3b360-3f11-4f3d-ab09-e5c34a6ff761 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.299255 Sep 13 17:15:06.803793 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3500/7051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:06 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:06.982301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:06.995498 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-014d62e1-94e4-4869-aac1-95975dcf2eba tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.258029 Sep 13 17:15:06.996889 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3552/7052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:06 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:07.078445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-343e668d-361c-4b5c-8622-9318e2ee0e35 req-212f2174-a111-4094-bfe8-e1e11d76a971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e", "name": "network-vif-plugged", "status": "completed", "tag": "67bdda21-2de9-4ff8-9bfa-181d9825033b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:07.092136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-343e668d-361c-4b5c-8622-9318e2ee0e35 req-212f2174-a111-4094-bfe8-e1e11d76a971 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:07.092995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-343e668d-361c-4b5c-8622-9318e2ee0e35 req-212f2174-a111-4094-bfe8-e1e11d76a971 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:07.093695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-343e668d-361c-4b5c-8622-9318e2ee0e35 req-212f2174-a111-4094-bfe8-e1e11d76a971 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:07.109081 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-343e668d-361c-4b5c-8622-9318e2ee0e35 req-212f2174-a111-4094-bfe8-e1e11d76a971 service nova] Creating event network-vif-plugged:67bdda21-2de9-4ff8-9bfa-181d9825033b for instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e on n-h2-857467-1 Sep 13 17:15:07.115245 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-343e668d-361c-4b5c-8622-9318e2ee0e35 req-212f2174-a111-4094-bfe8-e1e11d76a971 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044548 Sep 13 17:15:07.117298 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3501/7053] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:15:07.828300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:07.828935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:07.835969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:07.836488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:07.836970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:07.837700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:07.838786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:07.839247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:07.973394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:08.020174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:08.021072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:08.024134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:08.024927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:08.032389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:08.032946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:08.033489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:08.034333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:08.034930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:08.035610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:08.071715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:08.088764 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c572aa78-7a3a-4010-a666-33536b4c547b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.263767 Sep 13 17:15:08.090535 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3553/7054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:07 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:08.222585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:08.231458 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c652d520-75cd-4321-89ff-2180c65dc185 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1265 microversion: 2.1 time: 0.215827 Sep 13 17:15:08.232050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3502/7055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:08 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:08.837293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:08.838820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:08.852252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:08.852825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:08.854341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:08.860698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:08.861275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:08.861741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:08.862752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6c9f01b6-788b-4c56-ba47-b41e42ee6363 req-6d03ff22-d742-43fb-af12-b56cdb191d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207bab3f-4a11-460a-9fc9-a84c414ec24c", "tag": "31dbe931-6dfe-4a01-be7e-2b9efab32b94"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:08.873457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c9f01b6-788b-4c56-ba47-b41e42ee6363 req-6d03ff22-d742-43fb-af12-b56cdb191d65 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:08.874321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c9f01b6-788b-4c56-ba47-b41e42ee6363 req-6d03ff22-d742-43fb-af12-b56cdb191d65 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:08.875050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6c9f01b6-788b-4c56-ba47-b41e42ee6363 req-6d03ff22-d742-43fb-af12-b56cdb191d65 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:08.912831 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6c9f01b6-788b-4c56-ba47-b41e42ee6363 req-6d03ff22-d742-43fb-af12-b56cdb191d65 service nova] Creating event network-changed:31dbe931-6dfe-4a01-be7e-2b9efab32b94 for instance 207bab3f-4a11-460a-9fc9-a84c414ec24c on n-h2-857467-1 Sep 13 17:15:08.917370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:15:08.925073 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6c9f01b6-788b-4c56-ba47-b41e42ee6363 req-6d03ff22-d742-43fb-af12-b56cdb191d65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067360 Sep 13 17:15:08.927304 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3503/7056] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:15:09.081402 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c79a6cb1-dee3-4fcd-a790-baad954a48a3 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "DELETE /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 204 len: 0 microversion: 2.1 time: 0.247393 Sep 13 17:15:09.082724 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3554/7057] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:15:08 2022] DELETE /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 17:15:09.093438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:09.094818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:09.101634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.102490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.103118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.104712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.105352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.106002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.118045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:09.119940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:09.132437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.133276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.134035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.135887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.139819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.140942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.390200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:09.407773 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58ba69fc-7e10-4010-b0e6-a697fc473336 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1767 microversion: 2.1 time: 0.320239 Sep 13 17:15:09.408661 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3504/7058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:09 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1767 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:09.414482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:09.418711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:09.435567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.436292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.441711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.442623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.443121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.443566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.607494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:09.617186 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf802c3b-7b61-4ac2-a9aa-76497cb9a9b9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1453 microversion: 2.1 time: 0.207198 Sep 13 17:15:09.619547 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3505/7059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:09 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:09.650935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:09.651954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:09.660805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.661632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.662422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.663765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:09.664964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:09.665602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:09.694072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:09.706178 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc7c2ca1-8e05-497a-b686-4efd2ba4456d tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.589269 Sep 13 17:15:09.708008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3555/7060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:09 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:09.832502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:09.841857 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-065876f4-2868-4527-918f-b013717d09f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1453 microversion: 2.1 time: 0.200484 Sep 13 17:15:09.842443 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3506/7061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:09 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:10.437379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:10.438689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:10.446006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:10.446793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:10.448021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:10.448971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:10.449457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:10.450124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:10.536111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-88335d4f-f0d8-477c-8ba1-0ff1d727cb51 req-f72a8aeb-c4ef-40b6-b9ad-1959b94fc9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "name": "network-vif-plugged", "status": "completed", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:10.553169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88335d4f-f0d8-477c-8ba1-0ff1d727cb51 req-f72a8aeb-c4ef-40b6-b9ad-1959b94fc9c1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:10.553707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88335d4f-f0d8-477c-8ba1-0ff1d727cb51 req-f72a8aeb-c4ef-40b6-b9ad-1959b94fc9c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:10.554451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-88335d4f-f0d8-477c-8ba1-0ff1d727cb51 req-f72a8aeb-c4ef-40b6-b9ad-1959b94fc9c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:10.569104 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-88335d4f-f0d8-477c-8ba1-0ff1d727cb51 req-f72a8aeb-c4ef-40b6-b9ad-1959b94fc9c1 service nova] Creating event network-vif-plugged:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h1-857467-1 Sep 13 17:15:10.577190 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-88335d4f-f0d8-477c-8ba1-0ff1d727cb51 req-f72a8aeb-c4ef-40b6-b9ad-1959b94fc9c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046812 Sep 13 17:15:10.579500 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3507/7062] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:15:10.729963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:10.730980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:10.737555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:10.738470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:10.741659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:10.742444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:10.743046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:10.743547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:10.901952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:10.919295 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b81af05b-c50e-4315-80a5-23f0c4dee900 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1767 microversion: 2.1 time: 0.484720 Sep 13 17:15:10.930234 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3556/7063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:10 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1767 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:11.053564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:11.066786 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c31775d5-8259-42e6-aca6-cc7d1bace1e6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.341378 Sep 13 17:15:11.068681 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3508/7064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:10 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:11.371312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6b0b49dc-3f73-4842-9fdb-fb42c5f97be4 req-3ff96812-dbc1-4419-8cef-e2436743e7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207bab3f-4a11-460a-9fc9-a84c414ec24c", "name": "network-vif-deleted", "tag": "31dbe931-6dfe-4a01-be7e-2b9efab32b94"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:11.384406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6b0b49dc-3f73-4842-9fdb-fb42c5f97be4 req-3ff96812-dbc1-4419-8cef-e2436743e7f0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:11.385543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6b0b49dc-3f73-4842-9fdb-fb42c5f97be4 req-3ff96812-dbc1-4419-8cef-e2436743e7f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:11.386031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6b0b49dc-3f73-4842-9fdb-fb42c5f97be4 req-3ff96812-dbc1-4419-8cef-e2436743e7f0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:11.404904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6b0b49dc-3f73-4842-9fdb-fb42c5f97be4 req-3ff96812-dbc1-4419-8cef-e2436743e7f0 service nova] Creating event network-vif-deleted:31dbe931-6dfe-4a01-be7e-2b9efab32b94 for instance 207bab3f-4a11-460a-9fc9-a84c414ec24c on n-h2-857467-1 Sep 13 17:15:11.412674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6b0b49dc-3f73-4842-9fdb-fb42c5f97be4 req-3ff96812-dbc1-4419-8cef-e2436743e7f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046815 Sep 13 17:15:11.413330 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3557/7065] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:15:11.946981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:11.948077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:11.957560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:11.958387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:11.958939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:11.960211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:11.960826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:11.961672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:12.003837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:12.004335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:12.004781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:12.005240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lazy-loading 'fault' on Instance uuid 207bab3f-4a11-460a-9fc9-a84c414ec24c {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:15:12.008329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:12.060936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9779362ba4c47d48d1c12bd59ff0dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61996a9f03bd44d2a855253f0f38ae5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:12.069633 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2439932d-c54b-4a62-89d8-037c3623c10d tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 200 len: 1384 microversion: 2.1 time: 0.129489 Sep 13 17:15:12.089709 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3509/7066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:11 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 1384 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:12.094533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:12.095606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:12.105912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:12.107032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:12.107693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:12.108580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:12.109205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:12.109887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:12.413160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:12.424493 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b46ad86c-83f6-428b-9788-29fb05cea66b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1391 microversion: 2.1 time: 0.337185 Sep 13 17:15:12.425391 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3558/7067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:12 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1391 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:15:12.628355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-449da38b-6be5-4ce4-b936-8bfd157348f0 req-61ed7bc5-20f5-4878-8e40-908bcf735283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e", "tag": "67bdda21-2de9-4ff8-9bfa-181d9825033b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:12.638768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-449da38b-6be5-4ce4-b936-8bfd157348f0 req-61ed7bc5-20f5-4878-8e40-908bcf735283 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:12.639268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-449da38b-6be5-4ce4-b936-8bfd157348f0 req-61ed7bc5-20f5-4878-8e40-908bcf735283 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:12.639713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-449da38b-6be5-4ce4-b936-8bfd157348f0 req-61ed7bc5-20f5-4878-8e40-908bcf735283 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:12.651933 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-449da38b-6be5-4ce4-b936-8bfd157348f0 req-61ed7bc5-20f5-4878-8e40-908bcf735283 service nova] Creating event network-changed:67bdda21-2de9-4ff8-9bfa-181d9825033b for instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e on n-h2-857467-1 Sep 13 17:15:12.657475 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-449da38b-6be5-4ce4-b936-8bfd157348f0 req-61ed7bc5-20f5-4878-8e40-908bcf735283 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032947 Sep 13 17:15:12.658235 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3510/7068] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:15:13.098145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:13.099252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] [instance: 207bab3f-4a11-460a-9fc9-a84c414ec24c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:13.106430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:13.107669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:13.108155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:13.109447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:13.110014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:13.111175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:13.131150 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] HTTP exception thrown: Instance 207bab3f-4a11-460a-9fc9-a84c414ec24c could not be found. Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Request method failure captured: Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c HTTP/1.1 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILoK1K2xLmseufAAnSpChmpbRLQSzowIi-Ql16RXcKuE1KK0VnG_tDTOzVvhJAm4GuvBhhlgRYWAtFfJRrbM-hQ1ssweLTCpU19oUHgSeJ3PhE1eVy7yc3cHq3jXmCRWfaNrEPK-_enG8QSDgaHIzEgH5zX7lnRA9Ml_80XAtIWiL4k Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 61996a9f03bd44d2a855253f0f38ae5e Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1242473381 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61996a9f03bd44d2a855253f0f38ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1242473381 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 61996a9f03bd44d2a855253f0f38ae5e Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1242473381 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestSecurityGroupsBasicOps-1242473381-project Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c9779362ba4c47d48d1c12bd59ff0dd1 Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1242473381-project Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 207bab3f-4a11-460a-9fc9-a84c414ec24c could not be found. Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '207bab3f-4a11-460a-9fc9-a84c414ec24c'} Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207bab3f-4a11-460a-9fc9-a84c414ec24c could not be found. Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207bab3f-4a11-460a-9fc9-a84c414ec24c could not be found. Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:15:13.133196 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207bab3f-4a11-460a-9fc9-a84c414ec24c could not be found. Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Returning 404 to user: Instance 207bab3f-4a11-460a-9fc9-a84c414ec24c could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9887e709-3a2d-4684-bec4-c69cd40a7f12 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c" status: 404 len: 111 microversion: 2.1 time: 0.041969 Sep 13 17:15:13.140164 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3559/7069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:13 2022] GET /compute/v2.1/servers/207bab3f-4a11-460a-9fc9-a84c414ec24c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:15:13.465707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:13.467135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:13.476610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:13.477408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:13.478120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:13.479174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:13.479881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:13.480828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:13.677111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:13.686928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-42d722fd-796b-476c-a7a2-0a191c7fbc89 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1562 microversion: 2.1 time: 0.241592 Sep 13 17:15:13.687519 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3511/7070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:13 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:13.709708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:13.711125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:13.717794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:13.718437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:13.718908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:13.719827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:13.720532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:13.721173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:14.023044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:14.038135 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dadbc310-a0f8-44aa-9350-abdfa2a396c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1562 microversion: 2.1 time: 0.331647 Sep 13 17:15:14.039610 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3560/7071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:13 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1562 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:16.264606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f1896b85-af81-4b51-8744-86d660cff7d8 req-39c757fe-bbb1-4b57-ad64-498a1fa8adf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:16.265471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:16.266683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:16.277723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f1896b85-af81-4b51-8744-86d660cff7d8 req-39c757fe-bbb1-4b57-ad64-498a1fa8adf7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:16.278609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f1896b85-af81-4b51-8744-86d660cff7d8 req-39c757fe-bbb1-4b57-ad64-498a1fa8adf7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:16.279309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f1896b85-af81-4b51-8744-86d660cff7d8 req-39c757fe-bbb1-4b57-ad64-498a1fa8adf7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:16.281651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:16.282192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:16.282647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:16.283375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:16.283852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:16.284295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:16.294508 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f1896b85-af81-4b51-8744-86d660cff7d8 req-39c757fe-bbb1-4b57-ad64-498a1fa8adf7 service nova] Creating event network-changed:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h1-857467-1 Sep 13 17:15:16.300437 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f1896b85-af81-4b51-8744-86d660cff7d8 req-39c757fe-bbb1-4b57-ad64-498a1fa8adf7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Sep 13 17:15:16.303273 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3561/7072] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:15:16.710784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:15:16.723959 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e2b55701-2af6-43d9-b4ab-734d1930bb00 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1562 microversion: 2.1 time: 0.464392 Sep 13 17:15:16.726609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3512/7073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:15:16 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1562 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:15:17.529287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-69fd11fc-5db2-4496-8b24-5dbe941eade1 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] Calling method '.version_select at 0x7fbeb5100040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:15:17.553164 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-69fd11fc-5db2-4496-8b24-5dbe941eade1 tempest-TestSecurityGroupsBasicOps-1242473381 tempest-TestSecurityGroupsBasicOps-1242473381-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-605798807" status: 202 len: 0 microversion: 2.1 time: 0.028996 Sep 13 17:15:17.558241 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3562/7074] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 17:15:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-605798807 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:15:48.121611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:15:48.124687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:15:48.128036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=44 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:48.128797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=16 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:15:48.135604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:48.136107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:48.136555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:48.137269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:15:48.137734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:15:48.138643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:15:48.221014 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fda7a87c-ea52-4c3d-a5e8-694b116938d9 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action" status: 200 len: 24576 microversion: 2.1 time: 0.107409 Sep 13 17:15:48.222167 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3513/7075] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:15:48 2022] POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action => generated 24576 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 17:16:18.612056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:18.612875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:18.619049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:18.619808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:18.627694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:18.628161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:18.628661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:18.629333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:18.629804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:18.630284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:18.962414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:18.971080 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-547ebeef-3857-4842-84ce-420c663b1148 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1681 microversion: 2.1 time: 0.362393 Sep 13 17:16:18.971883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3563/7076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:18 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:19.076518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:19.080125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:19.082986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:19.083873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:19.092252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:19.092743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:19.093242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:19.094033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:19.095040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:19.095583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:19.165255 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1df06785-d233-4665-8bda-3a1fbecab0cc tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action" status: 200 len: 32644 microversion: 2.1 time: 0.093052 Sep 13 17:16:19.166088 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3514/7077] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:16:19 2022] POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action => generated 32644 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:16:19.322271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:19.322916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:19.329769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:19.330394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:19.330880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:19.331870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:19.332329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:19.332791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:19.473841 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2848669b-745b-4eed-8f16-aac7d65d45e9 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1832 microversion: 2.1 time: 0.155536 Sep 13 17:16:19.474526 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3564/7078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:19 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1832 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:19.505195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:19.507852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:19.514824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:19.515416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:19.515766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:19.517156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:19.517855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:19.518293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:19.546286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lazy-loading 'flavor' on Instance uuid 487167a7-13bb-4efe-a801-334ba6b8604e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:16:19.559564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Going to try to live migrate instance to another host {{(pid=122327) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 13 17:16:21.198065 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2cb8e8cf-1682-4f95-8331-66e9fa2eb9f3 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action" status: 202 len: 0 microversion: 2.1 time: 1.697706 Sep 13 17:16:21.199098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3515/7079] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:16:19 2022] POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action => generated 0 bytes in 1700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:16:21.208782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:21.210260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:21.217696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:21.218642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:21.220107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:21.220925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:21.221448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:21.221882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:21.389625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:21.398405 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bb9fd368-d2db-4547-a663-8e2ca0b1bdcf tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.193401 Sep 13 17:16:21.399654 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3565/7080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:21 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:22.428797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:22.429456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:22.430880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-09517a7b-345a-4b4b-b672-d9b5145c841d req-e0f7e300-0b50-497b-845b-b9061fe882b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:22.447636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:22.447997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:22.451840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-09517a7b-345a-4b4b-b672-d9b5145c841d req-e0f7e300-0b50-497b-845b-b9061fe882b4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:22.452740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:22.454697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:22.455481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:22.456284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-09517a7b-345a-4b4b-b672-d9b5145c841d req-e0f7e300-0b50-497b-845b-b9061fe882b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:22.457308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:22.457986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-09517a7b-345a-4b4b-b672-d9b5145c841d req-e0f7e300-0b50-497b-845b-b9061fe882b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:22.493873 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-09517a7b-345a-4b4b-b672-d9b5145c841d req-e0f7e300-0b50-497b-845b-b9061fe882b4 service nova] Creating event network-vif-unplugged:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h1-857467-1 Sep 13 17:16:22.501308 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-09517a7b-345a-4b4b-b672-d9b5145c841d req-e0f7e300-0b50-497b-845b-b9061fe882b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084272 Sep 13 17:16:22.505465 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3516/7081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:16:22.655680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:22.670414 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3cf8e73-d61e-469e-8364-7d6fe1c3b2c4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.246493 Sep 13 17:16:22.683843 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3566/7082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:22 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:23.701456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:23.702188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:23.709208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:23.709701 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:23.710165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:23.710862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:23.711326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:23.711754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:23.915933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:23.924409 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49af21f8-5c37-4cb8-b5c0-d89a4a5592df tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.228172 Sep 13 17:16:23.924983 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3517/7083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:23 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:24.557878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9f2fbf8c-358d-40ce-9156-ec445956572a req-2bb52501-f5c6-40f2-8e97-ddbb384d3871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:24.568188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9f2fbf8c-358d-40ce-9156-ec445956572a req-2bb52501-f5c6-40f2-8e97-ddbb384d3871 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:24.568683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9f2fbf8c-358d-40ce-9156-ec445956572a req-2bb52501-f5c6-40f2-8e97-ddbb384d3871 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:24.569130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9f2fbf8c-358d-40ce-9156-ec445956572a req-2bb52501-f5c6-40f2-8e97-ddbb384d3871 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:24.580075 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9f2fbf8c-358d-40ce-9156-ec445956572a req-2bb52501-f5c6-40f2-8e97-ddbb384d3871 service nova] Creating event network-changed:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h1-857467-1 Sep 13 17:16:24.585432 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9f2fbf8c-358d-40ce-9156-ec445956572a req-2bb52501-f5c6-40f2-8e97-ddbb384d3871 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031479 Sep 13 17:16:24.586077 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3567/7084] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:16:24.948060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:24.948831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:24.956604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:24.957332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:24.958188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:24.958914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:24.959448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:24.960066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:25.202556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:25.211659 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c5d070e1-fa34-4d41-9064-2e910d2a06eb tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.267756 Sep 13 17:16:25.212593 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3518/7085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:24 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:26.237610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:26.238366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:26.245395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:26.245935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:26.246394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:26.247108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:26.247583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:26.248031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:26.381301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:26.389395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f516290-6055-4ef3-a75a-a76536444680 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.157352 Sep 13 17:16:26.390011 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3568/7086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:26 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:27.413474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:27.414057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:27.421135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:27.421628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:27.422770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:27.423582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:27.424120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:27.424575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:27.569623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:27.578135 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bd6b0cd-b96e-4716-a8cd-21408af347ae tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.168639 Sep 13 17:16:27.579475 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3519/7087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:27 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:28.601697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:28.602358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:28.609330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:28.610587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:28.611045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:28.611759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:28.612229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:28.612668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:28.753869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:28.774377 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b29ab9d-b34a-4cfe-95e8-d06bf4a4902f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.176405 Sep 13 17:16:28.792160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3569/7088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:28 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:29.801419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:29.802093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:29.809280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:29.809808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:29.810278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:29.810992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:29.811459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:29.811895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:29.955795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:29.965070 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3bdcbb7b-9373-48d3-87c2-c4971ece078c tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.168131 Sep 13 17:16:29.967598 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3520/7089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:29 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:30.990182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:30.990810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:30.998515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:30.999491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:30.999955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:31.000772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:31.001286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:31.001736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:31.155666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:31.166719 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e72cd40-a61a-47cd-ac8c-89fe48b05a03 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.180650 Sep 13 17:16:31.167508 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3570/7090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:30 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:32.191977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:32.192609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:32.199498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:32.199997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:32.200447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:32.201164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:32.201636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:32.202100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:32.370848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:32.380483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-33b50136-c117-4ce5-9813-0e5685a4f248 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1691 microversion: 2.1 time: 0.193202 Sep 13 17:16:32.394630 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3521/7091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:32 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:33.407309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:33.409132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:33.419221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:33.420128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:33.421313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:33.422690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:33.424148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:33.425313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:33.583728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:33.591696 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e7b9de2-59a6-4feb-8953-5d64f3271465 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1681 microversion: 2.1 time: 0.188856 Sep 13 17:16:33.592278 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3571/7092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:33 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:33.615801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:33.616504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:33.623490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:33.623992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:33.624440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:33.625183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:33.625659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:33.626120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:33.763451 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7cc2bbc-08c8-4712-b680-64ed80615285 tempest-TestNetworkAdvancedServerOps-1724735749 tempest-TestNetworkAdvancedServerOps-1724735749-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1832 microversion: 2.1 time: 0.151309 Sep 13 17:16:33.764045 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3522/7093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:33 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1832 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:16:33.787937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:33.788571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:33.794622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:33.795127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:33.795589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:33.796301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:33.796782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:33.797778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:33.949114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:33.958453 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac465156-ace4-4d3e-af78-32fc59f8cc75 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1681 microversion: 2.1 time: 0.174374 Sep 13 17:16:33.959047 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3572/7094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:33 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:34.063858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:34.066153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:34.072593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:34.073097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:34.073548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:34.074285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:34.074757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:34.075205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:34.139237 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b70fea3d-4d21-4d78-b9b0-3d9f839f05c8 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action" status: 200 len: 38538 microversion: 2.1 time: 0.079464 Sep 13 17:16:34.139958 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3523/7095] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:16:34 2022] POST /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e/action => generated 38538 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:16:34.910009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-08e1f7e8-74ec-4e99-9e2d-1675bfb5ba97 req-f559571e-e2f2-4005-95ee-d3ae161cb731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "name": "network-vif-plugged", "status": "completed", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:34.925646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-08e1f7e8-74ec-4e99-9e2d-1675bfb5ba97 req-f559571e-e2f2-4005-95ee-d3ae161cb731 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:34.926464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-08e1f7e8-74ec-4e99-9e2d-1675bfb5ba97 req-f559571e-e2f2-4005-95ee-d3ae161cb731 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:34.927049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-08e1f7e8-74ec-4e99-9e2d-1675bfb5ba97 req-f559571e-e2f2-4005-95ee-d3ae161cb731 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:34.940106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-08e1f7e8-74ec-4e99-9e2d-1675bfb5ba97 req-f559571e-e2f2-4005-95ee-d3ae161cb731 service nova] Creating event network-vif-plugged:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h2-857467-1 Sep 13 17:16:34.946026 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-08e1f7e8-74ec-4e99-9e2d-1675bfb5ba97 req-f559571e-e2f2-4005-95ee-d3ae161cb731 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043972 Sep 13 17:16:34.947692 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3573/7096] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:16:35.208959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:35.211980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-561ab9c4-ff18-4767-82c2-1dea699add08 req-260f15be-c53e-4eaf-b274-62f7249e41d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:35.212276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:35.226416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:35.230668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-561ab9c4-ff18-4767-82c2-1dea699add08 req-260f15be-c53e-4eaf-b274-62f7249e41d7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:35.231171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-561ab9c4-ff18-4767-82c2-1dea699add08 req-260f15be-c53e-4eaf-b274-62f7249e41d7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:35.231623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-561ab9c4-ff18-4767-82c2-1dea699add08 req-260f15be-c53e-4eaf-b274-62f7249e41d7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:35.235539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:35.236060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:35.236824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:35.237294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:35.237732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:35.256575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-561ab9c4-ff18-4767-82c2-1dea699add08 req-260f15be-c53e-4eaf-b274-62f7249e41d7 service nova] Creating event network-changed:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h2-857467-1 Sep 13 17:16:35.276035 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-561ab9c4-ff18-4767-82c2-1dea699add08 req-260f15be-c53e-4eaf-b274-62f7249e41d7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072482 Sep 13 17:16:35.276671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3574/7097] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:16:35.284953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:16:35.392612 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a34ffa59-ccbb-4fb2-bb4c-a92279207605 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 204 len: 0 microversion: 2.1 time: 0.191817 Sep 13 17:16:35.393865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3524/7098] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:16:35 2022] DELETE /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:16:35.402828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:35.403548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:35.411315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:35.412054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:35.412712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:35.413443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:35.414120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:35.414743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:35.559295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:35.568584 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-75ecfd59-5a7f-4bd0-8f78-4d9f6f948b21 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1687 microversion: 2.1 time: 0.170315 Sep 13 17:16:35.569193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3575/7099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:35 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:36.593250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:36.594755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:36.608349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:36.608986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:36.609781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:36.610652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:36.611409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:36.611914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:36.860789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:36.870404 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-05f094c5-9655-4b9b-ae76-4725d23ee885 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 200 len: 1568 microversion: 2.1 time: 0.281469 Sep 13 17:16:36.870997 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3525/7100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:36 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:37.292716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f6620606-172c-4cc8-83e4-c8062d86ef3f req-46b8c86c-efeb-46bf-ab2d-73e1e018e612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487167a7-13bb-4efe-a801-334ba6b8604e", "name": "network-vif-deleted", "tag": "9a9561d5-9439-4d35-9447-9556b77ecd02"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:37.304313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6620606-172c-4cc8-83e4-c8062d86ef3f req-46b8c86c-efeb-46bf-ab2d-73e1e018e612 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:37.304804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6620606-172c-4cc8-83e4-c8062d86ef3f req-46b8c86c-efeb-46bf-ab2d-73e1e018e612 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:37.305243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6620606-172c-4cc8-83e4-c8062d86ef3f req-46b8c86c-efeb-46bf-ab2d-73e1e018e612 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:37.318100 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f6620606-172c-4cc8-83e4-c8062d86ef3f req-46b8c86c-efeb-46bf-ab2d-73e1e018e612 service nova] Creating event network-vif-deleted:9a9561d5-9439-4d35-9447-9556b77ecd02 for instance 487167a7-13bb-4efe-a801-334ba6b8604e on n-h2-857467-1 Sep 13 17:16:37.324211 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f6620606-172c-4cc8-83e4-c8062d86ef3f req-46b8c86c-efeb-46bf-ab2d-73e1e018e612 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035054 Sep 13 17:16:37.324821 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3576/7101] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:16:37.894794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:37.895421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: 487167a7-13bb-4efe-a801-334ba6b8604e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:37.904390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:37.904889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:37.905335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:37.906150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:37.907131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:37.908177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:37.923395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] HTTP exception thrown: Instance 487167a7-13bb-4efe-a801-334ba6b8604e could not be found. Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Request method failure captured: Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e HTTP/1.1 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILkBD_BBT3s4zy_iG7sW47eVxVhtuVN_LpJ6eyAUTVvnGgEm9nSZ71UjSc1mqRFOMtzGHRtuKPNYOb27Y7896o9j0UBG-IY446yIe1mwU0n5obKNM0QrU6LYkTdijiJKBk0jXG5U2VW_weDPuhy7fiXeRA5C3vy8OT4OYrDX05PpuzM Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 7aa877fdd453495997fbbc66a9bd1b1b Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 487167a7-13bb-4efe-a801-334ba6b8604e could not be found. Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '487167a7-13bb-4efe-a801-334ba6b8604e'} Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487167a7-13bb-4efe-a801-334ba6b8604e could not be found. Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487167a7-13bb-4efe-a801-334ba6b8604e could not be found. Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:16:37.925203 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487167a7-13bb-4efe-a801-334ba6b8604e could not be found. Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Returning 404 to user: Instance 487167a7-13bb-4efe-a801-334ba6b8604e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dd4569e0-4e84-41d9-8252-62826459e9a6 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e" status: 404 len: 111 microversion: 2.1 time: 0.036192 Sep 13 17:16:37.931231 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3526/7102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:37 2022] GET /compute/v2.1/servers/487167a7-13bb-4efe-a801-334ba6b8604e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:16:41.627086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b1b9e7e-c59e-4fe1-b338-c7ef9ec20462 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '.version_select at 0x7fbeb5158430>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:41.696063 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b1b9e7e-c59e-4fe1-b338-c7ef9ec20462 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-578188879" status: 202 len: 0 microversion: 2.1 time: 0.088240 Sep 13 17:16:41.697012 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3577/7103] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Sep 13 17:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-578188879 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:16:41.747398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d2930c5-fdde-4e34-be79-f936cd87a096 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: .version_select at 0x7fbeb5436e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-518550122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOf84gQGW2ZQdpB0oxfehJkLANYsvCPyK/3y2NTKL29sCR5fHwKP6SBmPs4e3pBgxMbul868h2QujkT1WnVDm8qQV/RofcoDZQkDhWBdj6XXGBkam46EjdQTXEFD0CbHLw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:41.769066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4d2930c5-fdde-4e34-be79-f936cd87a096 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:16:41.782967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-4d2930c5-fdde-4e34-be79-f936cd87a096 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:16:41.809854 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d2930c5-fdde-4e34-be79-f936cd87a096 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.068758 Sep 13 17:16:41.810508 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3527/7104] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:16:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:16:48.320469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=68 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:48.333335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-543433266", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "33ad7517-c7a9-4bf9-9523-9944bdcf7171"}], "key_name": "tempest-TestNetworkAdvancedServerOps-518550122", "security_groups": [{"name": "tempest-secgroup-smoke-527088683"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:48.568122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] validate_networks() for [('33ad7517-c7a9-4bf9-9523-9944bdcf7171', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:16:48.926218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:49.147694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:16:49.148143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:16:49.148687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:16:49.149134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:16:49.149566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:16:49.160271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:49.160787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:49.161240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:49.162287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:49.162912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:49.163447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:49.183987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:16:49.190290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Getting quotas for user 7aa877fdd453495997fbbc66a9bd1b1b and project f6a27a6c02e24505bcc86dc4b7470393. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:16:49.204426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:16:49.207118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:16:49.257035 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e43b4be8-5933-4189-a82f-1d0c3aca0b7e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.938205 Sep 13 17:16:49.257765 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3578/7105] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:16:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:16:49.269112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39d5427a-bff8-4012-9bb1-a59bb35cd35e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:49.270304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39d5427a-bff8-4012-9bb1-a59bb35cd35e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:49.273417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:49.274472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:49.353684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-39d5427a-bff8-4012-9bb1-a59bb35cd35e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:49.366656 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39d5427a-bff8-4012-9bb1-a59bb35cd35e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1265 microversion: 2.1 time: 0.101391 Sep 13 17:16:49.374415 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3528/7106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:49 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:50.392610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:50.393327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:50.405997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:50.411563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:50.416696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:50.418948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:50.419629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:50.420282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:50.577004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:50.599293 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bee7235d-325c-4001-acb1-0cd51e2b9f55 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1317 microversion: 2.1 time: 0.209236 Sep 13 17:16:50.618238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3579/7107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:50 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:51.624762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:51.625425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:51.638691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:51.639196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:51.639637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:51.640352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:51.640987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:51.641589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:51.882260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:51.892990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-473c7e9e-a3c2-406d-bbd1-b8e64119f9da tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.272058 Sep 13 17:16:51.893601 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3529/7108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:51 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:52.472839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ece2bab0-4312-4fcc-b719-e3218c1073d7 req-d07708f4-7cd1-4749-8dfc-b06fc2792730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:52.491881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ece2bab0-4312-4fcc-b719-e3218c1073d7 req-d07708f4-7cd1-4749-8dfc-b06fc2792730 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:52.492869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ece2bab0-4312-4fcc-b719-e3218c1073d7 req-d07708f4-7cd1-4749-8dfc-b06fc2792730 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:52.493086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ece2bab0-4312-4fcc-b719-e3218c1073d7 req-d07708f4-7cd1-4749-8dfc-b06fc2792730 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:52.505744 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ece2bab0-4312-4fcc-b719-e3218c1073d7 req-d07708f4-7cd1-4749-8dfc-b06fc2792730 service nova] Creating event network-changed:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:16:52.511492 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ece2bab0-4312-4fcc-b719-e3218c1073d7 req-d07708f4-7cd1-4749-8dfc-b06fc2792730 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044311 Sep 13 17:16:52.512436 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3580/7109] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:16:52.917928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:52.918997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:52.926504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:52.927001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:52.927458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:52.928185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:52.928655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:52.929094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:53.074832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:53.084704 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a61a34c3-c22e-42da-80ff-bd4f17fdf4be tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.171874 Sep 13 17:16:53.085470 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3530/7110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:52 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:54.108522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:54.109236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:54.116524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:54.117030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:54.117481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:54.118241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:54.118716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:54.119158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:54.260524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:54.269163 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31ca0b13-ca8b-45eb-a660-3b4b434430f7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.165735 Sep 13 17:16:54.269758 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3581/7111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:54 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:55.292616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:55.293947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:55.301321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:55.302166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:55.302842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:55.303774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:55.304551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:55.305186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:55.866511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:55.874616 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d173b6ae-4d41-47c4-9fa9-2b95a6926903 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.585805 Sep 13 17:16:55.887806 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3531/7112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:55 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:56.900310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:56.901617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:56.914803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:56.915587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:56.916208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:56.917112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:56.917764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:56.922509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:57.085677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:57.094191 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e77f6bfb-b26e-4de7-8e09-66c7bd825f94 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.197654 Sep 13 17:16:57.095007 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3582/7113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:56 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:58.122911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:58.129220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:58.137567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:58.138150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:58.138689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:58.139430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:58.139888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:58.140330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:58.290410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:58.298366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-56bec593-fe9d-488f-818f-27665a458a51 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.179479 Sep 13 17:16:58.298953 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3532/7114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:58 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:16:58.869294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-923948b7-a02c-425a-b7fc-648d24b57a32 req-d50f4147-b528-491e-a1d4-7e853fd626b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "name": "network-vif-plugged", "status": "completed", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:16:58.885383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-923948b7-a02c-425a-b7fc-648d24b57a32 req-d50f4147-b528-491e-a1d4-7e853fd626b4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:58.885913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-923948b7-a02c-425a-b7fc-648d24b57a32 req-d50f4147-b528-491e-a1d4-7e853fd626b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:58.886555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-923948b7-a02c-425a-b7fc-648d24b57a32 req-d50f4147-b528-491e-a1d4-7e853fd626b4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:58.898961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-923948b7-a02c-425a-b7fc-648d24b57a32 req-d50f4147-b528-491e-a1d4-7e853fd626b4 service nova] Creating event network-vif-plugged:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:16:58.904399 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-923948b7-a02c-425a-b7fc-648d24b57a32 req-d50f4147-b528-491e-a1d4-7e853fd626b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039371 Sep 13 17:16:58.905717 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3583/7115] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:16:59.321174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:16:59.321174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:16:59.328261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:59.328883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:59.329414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:59.330156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:16:59.330627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:16:59.331063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:16:59.366176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:16:59.482323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:16:59.490245 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e1713e74-36c9-41cb-aef1-a8a776a2a5b7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.173569 Sep 13 17:16:59.491041 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3533/7116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:16:59 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:17:00.511270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:00.512294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:00.518685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:00.519517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:00.528505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:00.529753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:00.530463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:00.531431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:00.532121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:00.532779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:00.688688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:00.696541 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b9b5a834-9c61-4145-8f4d-bee7a712e587 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1390 microversion: 2.1 time: 0.186357 Sep 13 17:17:00.697122 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3584/7117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:00 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:01.719857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:01.721071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:01.728600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:01.729286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:01.729929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:01.730843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:01.731279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:01.731953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:01.886664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:01.900871 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95a099ab-a4b3-4dbe-bc9c-f1af82038169 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1563 microversion: 2.1 time: 0.185335 Sep 13 17:17:01.901588 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3534/7118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:01 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:01.926234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:01.926234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:01.933358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:01.933937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:01.934398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:01.935257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:01.935739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:01.936183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:02.089607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:02.098587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0a03f074-5255-45d9-88ae-cfb8a8ae9649 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1563 microversion: 2.1 time: 0.179019 Sep 13 17:17:02.099171 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3585/7119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:01 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:04.103450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:04.104074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:04.106368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-671ceed9-6497-4608-bdef-d7d0b8295101 req-66a44442-aa9a-4e45-9520-225c4609dfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:04.111878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:04.112371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:04.112820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:04.113529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:04.114021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:04.114457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:04.131055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-671ceed9-6497-4608-bdef-d7d0b8295101 req-66a44442-aa9a-4e45-9520-225c4609dfef service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:04.131887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-671ceed9-6497-4608-bdef-d7d0b8295101 req-66a44442-aa9a-4e45-9520-225c4609dfef service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:04.132544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-671ceed9-6497-4608-bdef-d7d0b8295101 req-66a44442-aa9a-4e45-9520-225c4609dfef service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:04.147000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-671ceed9-6497-4608-bdef-d7d0b8295101 req-66a44442-aa9a-4e45-9520-225c4609dfef service nova] Creating event network-changed:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:17:04.152304 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-671ceed9-6497-4608-bdef-d7d0b8295101 req-66a44442-aa9a-4e45-9520-225c4609dfef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049845 Sep 13 17:17:04.153527 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3586/7120] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:17:04.327147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:04.337744 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d84bca77-7ff4-4488-bff4-ad179a2e1011 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1563 microversion: 2.1 time: 0.238024 Sep 13 17:17:04.339068 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3535/7121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:04 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:05.419053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:05.419703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:05.428012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:05.428581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:05.429328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:05.430111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:05.430781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:05.431604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:05.460293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:17:05.551858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e62e5efa-02d9-4e7e-9f61-f6e2016f27c4 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 204 len: 0 microversion: 2.1 time: 0.137067 Sep 13 17:17:05.551858 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3587/7122] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:17:05 2022] DELETE /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:17:05.565112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:05.566402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:05.574105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:05.574606 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:05.575058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:05.575779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:05.576247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:05.576686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:05.725156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:05.733266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ed83931-b030-4392-8071-2b1ff839d143 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1577 microversion: 2.1 time: 0.173136 Sep 13 17:17:05.733865 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3536/7123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:05 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:06.757113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:06.757843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:06.769631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:06.770181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:06.770636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:06.771378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:06.771916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:06.772357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:06.918019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:06.927382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a106c04a-eaad-4932-bb8d-8165b8a7272c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1577 microversion: 2.1 time: 0.174518 Sep 13 17:17:06.928111 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3588/7124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:06 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:07.951963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:07.952584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:07.959950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:07.960446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:07.960887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:07.961598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:07.962110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:07.962542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:08.071023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:08.080210 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8bae21d7-7182-45c1-abb5-b4e2bd310d77 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1510 microversion: 2.1 time: 0.132175 Sep 13 17:17:08.080928 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3537/7125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:07 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1510 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:08.330908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-823668ca-af5d-4eb1-ac60-571b7e37de84 req-dcfaaa4c-6160-45ca-a853-ec6e56696f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e", "name": "network-vif-deleted", "tag": "67bdda21-2de9-4ff8-9bfa-181d9825033b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:08.341775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-823668ca-af5d-4eb1-ac60-571b7e37de84 req-dcfaaa4c-6160-45ca-a853-ec6e56696f92 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:08.342514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-823668ca-af5d-4eb1-ac60-571b7e37de84 req-dcfaaa4c-6160-45ca-a853-ec6e56696f92 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:08.343108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-823668ca-af5d-4eb1-ac60-571b7e37de84 req-dcfaaa4c-6160-45ca-a853-ec6e56696f92 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:08.357098 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-823668ca-af5d-4eb1-ac60-571b7e37de84 req-dcfaaa4c-6160-45ca-a853-ec6e56696f92 service nova] Creating event network-vif-deleted:67bdda21-2de9-4ff8-9bfa-181d9825033b for instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e on n-h2-857467-1 Sep 13 17:17:08.366716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-823668ca-af5d-4eb1-ac60-571b7e37de84 req-dcfaaa4c-6160-45ca-a853-ec6e56696f92 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038911 Sep 13 17:17:08.367617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3589/7126] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:17:09.105000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:09.105628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:09.113200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:09.113962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:09.114588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:09.115468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:09.116095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:09.116672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:09.188241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:09.198374 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-36a65037-0a05-4e81-b04a-62c180670879 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1225 microversion: 2.1 time: 0.097295 Sep 13 17:17:09.199500 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3538/7127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:09 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:10.224385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:10.225700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:10.233173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:10.233934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:10.234589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:10.235693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:10.239129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:10.239129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:10.301987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:10.310411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0aa3ce67-6d7e-487e-b36b-1aac8add0275 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1225 microversion: 2.1 time: 0.089959 Sep 13 17:17:10.326303 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3590/7128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:10 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:11.332876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:11.334556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:11.342002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:11.342649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:11.343223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:11.344542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:11.345144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:11.345708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:11.425612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:11.435832 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2fe1226-ee77-48a8-b3d1-40245d976f12 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1225 microversion: 2.1 time: 0.106945 Sep 13 17:17:11.450330 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3539/7129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:11 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:12.460312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:12.461616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:12.469321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:12.470196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:12.470864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:12.471803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:12.472355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:12.473057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:12.546262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:12.557249 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52239c18-b3e4-4986-b05b-821c4aefba14 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 200 len: 1225 microversion: 2.1 time: 0.100737 Sep 13 17:17:12.558596 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3591/7130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:12 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:13.580737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:13.581278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:13.588596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:13.589098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:13.589633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:13.590637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:13.591302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:13.591812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:13.606540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e HTTP/1.1 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e'} Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:17:13.608322 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-98baa1c7-c963-4a36-881a-759ce202decd tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 404 len: 111 microversion: 2.1 time: 0.033754 Sep 13 17:17:13.613776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3540/7131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:13 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:17:13.714739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2082839808", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1395877829", "security_groups": [{"name": "tempest-secgroup-smoke-197606766"}], "block_device_mapping_v2": [{"uuid": "80c2ffea-c74d-4510-8eac-52bb90d0bb09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:13.835295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:17:14.225748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:17:14.226232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:17:14.226735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:17:14.227172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:17:14.227637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:17:14.239156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:14.239959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:14.240427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:14.241192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:14.241678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:14.242157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:14.263009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:17:14.268540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:17:14.330030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:17:14.332173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80c2ffea-c74d-4510-8eac-52bb90d0bb09',volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:17:14.470621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96c32b6f-8442-4d48-94b7-6c56e0cac509 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759681 Sep 13 17:17:14.477534 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3592/7132] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:17:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:17:14.482981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b22c777d-e79c-4ddb-a914-eb87d7404e6b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:14.483673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b22c777d-e79c-4ddb-a914-eb87d7404e6b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:14.544046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b22c777d-e79c-4ddb-a914-eb87d7404e6b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:14.551982 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b22c777d-e79c-4ddb-a914-eb87d7404e6b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1095 microversion: 2.1 time: 0.072949 Sep 13 17:17:14.552585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3541/7133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:14 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:15.576504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:15.578354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:15.587668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:15.588774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:15.589700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:15.590716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:15.591435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:15.592279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:15.676994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:15.691518 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c49d5bcd-6e08-48ca-81fd-bf59db609148 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1201 microversion: 2.1 time: 0.119318 Sep 13 17:17:15.692675 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3593/7134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:15 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1201 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:16.715901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:16.716767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:16.725669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:16.726306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:16.726942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:16.727750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:16.728289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:16.728927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:16.970954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:16.979937 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec4c9067-3b18-4261-a586-b3ece4aec6ec tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1278 microversion: 2.1 time: 0.267985 Sep 13 17:17:16.980881 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3542/7135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:16 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:17:17.187073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6da845cc-2030-4903-8035-c352c9bc94d0 req-ff2d2d8d-0da8-4506-a173-4d3c88d84c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc125b52-69a3-4b93-8a2e-0dd48e6fc929", "tag": "9c450470-e447-4394-b097-81b8f30ca52f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:17.202215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6da845cc-2030-4903-8035-c352c9bc94d0 req-ff2d2d8d-0da8-4506-a173-4d3c88d84c52 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:17.202750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6da845cc-2030-4903-8035-c352c9bc94d0 req-ff2d2d8d-0da8-4506-a173-4d3c88d84c52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:17.203988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6da845cc-2030-4903-8035-c352c9bc94d0 req-ff2d2d8d-0da8-4506-a173-4d3c88d84c52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:17.215487 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6da845cc-2030-4903-8035-c352c9bc94d0 req-ff2d2d8d-0da8-4506-a173-4d3c88d84c52 service nova] Creating event network-changed:9c450470-e447-4394-b097-81b8f30ca52f for instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 on n-h2-857467-1 Sep 13 17:17:17.223342 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6da845cc-2030-4903-8035-c352c9bc94d0 req-ff2d2d8d-0da8-4506-a173-4d3c88d84c52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041150 Sep 13 17:17:17.223962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3594/7136] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:17:18.004318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:18.004959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:18.012726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:18.013232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:18.013684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:18.014442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:18.014912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:18.015367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:18.581308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:18.589764 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7784aafc-7d8d-4776-81fc-cf593a079b26 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1278 microversion: 2.1 time: 0.589221 Sep 13 17:17:18.590410 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3543/7137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:17 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1278 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:19.616544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:19.616544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:19.621036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:19.623138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:19.623803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:19.624462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:19.625290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:19.625768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:19.626411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:19.632903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:19.782083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:19.794857 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5f4359a6-8a6c-41f3-a782-8b6beca4a4db tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1278 microversion: 2.1 time: 0.185843 Sep 13 17:17:19.795466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3595/7138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:19 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:20.817852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:20.818711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:20.821672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=36 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:20.827113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:20.827833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:20.828361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:20.829381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:20.829912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:20.830299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:20.833525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=81 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:21.003833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:21.012181 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5a30d9f-d4a7-4702-b57b-b5ad833e9cb6 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1278 microversion: 2.1 time: 0.198212 Sep 13 17:17:21.012776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3544/7139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:20 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:22.035605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:22.036244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:22.042908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:22.048024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:22.048024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:22.048024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:22.048024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:22.048024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:22.210538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:22.219049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5368f130-4be1-4b67-8704-81251f5c1ac3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1278 microversion: 2.1 time: 0.187296 Sep 13 17:17:22.219633 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3596/7140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:22 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:23.242783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:23.243406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:23.250703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:23.251206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:23.251656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:23.252370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:23.252842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:23.253283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:23.395226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:23.403346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-05a47b85-e665-4d2c-a9f8-1b2abf448675 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.164511 Sep 13 17:17:23.403933 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3545/7141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:23 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:24.427437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:24.428274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:24.431035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:24.431765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:24.437650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:24.438190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:24.438647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:24.439364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:24.439847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:24.440293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:24.574765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:24.582810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f9a67d6-ffaa-4591-abb8-24351f112298 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.159352 Sep 13 17:17:24.583403 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3597/7142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:24 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:25.606790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:25.607434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:25.610069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:25.615775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:25.616270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:25.616708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:25.617417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:25.617897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:25.618334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:25.762891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:25.771589 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-108cf337-da11-4ebe-a112-e1970c48bb4c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.168754 Sep 13 17:17:25.772184 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3546/7143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:25 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:26.795886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:26.796920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:26.804382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:26.804889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:26.805370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:26.806112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:26.806591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:26.807067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:26.947069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:26.957907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b181dbd1-a973-4238-899b-6a18368fce63 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.166220 Sep 13 17:17:26.958513 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3598/7144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:26 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:27.980715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:27.981363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:27.988437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:27.988924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:27.989359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:27.990084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:27.990545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:27.990973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:28.128246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:28.136230 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8957fe3c-f8ce-4c6d-938f-323b5c1e671a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.159485 Sep 13 17:17:28.136809 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3547/7145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:27 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:29.160808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:29.161480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:29.168505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:29.169012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:29.169475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:29.170214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:29.170690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:29.171143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:29.310017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:29.318536 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e59d8282-347a-4c18-bbb1-2207de0a7915 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.162601 Sep 13 17:17:29.319132 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3599/7146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:29 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:30.341691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:30.342361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:30.350069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:30.350570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:30.351018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:30.351730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:30.352199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:30.352640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:30.494457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:30.502782 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48fabeac-81c1-4d08-81a9-639afccc494e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.165043 Sep 13 17:17:30.503366 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3548/7147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:30 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:31.527660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:31.528210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:31.536179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:31.536964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:31.537119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:31.538041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:31.538521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:31.538965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:31.684250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:31.693391 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e4d79ae-a40c-42b8-9340-8788ea88328f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.169600 Sep 13 17:17:31.694108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3600/7148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:31 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:32.716713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:32.717332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:32.724475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:32.725005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:32.725449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:32.726192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:32.726657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:32.727092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:32.868135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:32.876374 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d792fd8-ae17-4c11-bbcb-86fbd03246a5 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.163639 Sep 13 17:17:32.876953 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3549/7149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:32 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:33.120069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-41c08ee6-6243-4c40-9b1c-5b948128a5a9 req-4ad40032-0cde-4bd5-930a-517260ff1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc125b52-69a3-4b93-8a2e-0dd48e6fc929", "name": "network-vif-plugged", "status": "completed", "tag": "9c450470-e447-4394-b097-81b8f30ca52f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:33.132638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-41c08ee6-6243-4c40-9b1c-5b948128a5a9 req-4ad40032-0cde-4bd5-930a-517260ff1bc1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:33.133388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-41c08ee6-6243-4c40-9b1c-5b948128a5a9 req-4ad40032-0cde-4bd5-930a-517260ff1bc1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:33.134093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-41c08ee6-6243-4c40-9b1c-5b948128a5a9 req-4ad40032-0cde-4bd5-930a-517260ff1bc1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:33.149858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-41c08ee6-6243-4c40-9b1c-5b948128a5a9 req-4ad40032-0cde-4bd5-930a-517260ff1bc1 service nova] Creating event network-vif-plugged:9c450470-e447-4394-b097-81b8f30ca52f for instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 on n-h2-857467-1 Sep 13 17:17:33.155836 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-41c08ee6-6243-4c40-9b1c-5b948128a5a9 req-4ad40032-0cde-4bd5-930a-517260ff1bc1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039836 Sep 13 17:17:33.157384 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3601/7150] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:17:33.900017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:33.900648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:33.907783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:33.908278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:33.908724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:33.909859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:33.910339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:33.910785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:34.048899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:34.056986 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72786bba-4399-436e-8841-1dc8493c92f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1266 microversion: 2.1 time: 0.160983 Sep 13 17:17:34.064801 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3550/7151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:33 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:35.083546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:35.084299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:35.090968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:35.091487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:35.091953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:35.092686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:35.093171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:35.094320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:35.232740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:35.241310 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1201316b-0731-459b-bad1-10de37c69dd2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1453 microversion: 2.1 time: 0.165107 Sep 13 17:17:35.241902 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3602/7152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:35 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:35.264076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:35.264781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:35.271941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:35.272544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:35.273098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:35.273952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:35.274416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:35.274843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:35.414037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:35.423112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-012f3beb-a0b0-488e-9f70-e1268b0bee71 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1453 microversion: 2.1 time: 0.162788 Sep 13 17:17:35.423705 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3551/7153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:35 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:35.698029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:35.700164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:35.707531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:35.708039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:35.708494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:35.709419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:35.709935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:35.710383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:35.780014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3647d377-8e1e-4fda-813c-c015288eed83 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84/action" status: 200 len: 24567 microversion: 2.1 time: 0.086412 Sep 13 17:17:35.780847 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3603/7154] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:17:35 2022] POST /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84/action => generated 24567 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:17:37.121279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-24984d14-5749-412b-9890-2eddbc460d35 req-f5eece80-89fe-4056-a44b-c76ee6fcc82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc125b52-69a3-4b93-8a2e-0dd48e6fc929", "tag": "9c450470-e447-4394-b097-81b8f30ca52f"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:37.134803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-24984d14-5749-412b-9890-2eddbc460d35 req-f5eece80-89fe-4056-a44b-c76ee6fcc82d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:37.135415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-24984d14-5749-412b-9890-2eddbc460d35 req-f5eece80-89fe-4056-a44b-c76ee6fcc82d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:37.136013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-24984d14-5749-412b-9890-2eddbc460d35 req-f5eece80-89fe-4056-a44b-c76ee6fcc82d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:37.148810 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-24984d14-5749-412b-9890-2eddbc460d35 req-f5eece80-89fe-4056-a44b-c76ee6fcc82d service nova] Creating event network-changed:9c450470-e447-4394-b097-81b8f30ca52f for instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 on n-h2-857467-1 Sep 13 17:17:37.154255 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-24984d14-5749-412b-9890-2eddbc460d35 req-f5eece80-89fe-4056-a44b-c76ee6fcc82d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036717 Sep 13 17:17:37.155047 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3552/7155] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:17:55.247603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-426307608", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "2d1a39fc-9f2b-41e0-9348-3f24b73b03a6"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:55.257735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=17 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:55.258556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=47 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:55.307876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] validate_networks() for [('2d1a39fc-9f2b-41e0-9348-3f24b73b03a6', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:17:55.732536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:17:55.732984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:17:55.733482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:17:55.733952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:17:55.734386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:17:55.744199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:55.744707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:55.745172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:55.745969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:55.746452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:55.746901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:55.765292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Getting quotas for project 45b0126810794a4095a08ad983fd29c5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:17:55.773480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Getting quotas for user f204e179cfc845aaae22c587b8421787 and project 45b0126810794a4095a08ad983fd29c5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:17:55.787909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:17:55.790484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:17:55.845533 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d5786b0-f821-410d-a490-d0310778dfbe tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601335 Sep 13 17:17:55.846506 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3604/7156] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:17:55.855855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=17 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:55.856610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=49 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:17:55.861865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3fcaa85-67f0-44d9-b6c0-abfcd8319936 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:55.862589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3fcaa85-67f0-44d9-b6c0-abfcd8319936 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:55.919292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3fcaa85-67f0-44d9-b6c0-abfcd8319936 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:55.927570 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3fcaa85-67f0-44d9-b6c0-abfcd8319936 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1218 microversion: 2.1 time: 0.073889 Sep 13 17:17:55.928351 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3553/7157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:55 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:56.949899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:56.950624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:56.959383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:56.959893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:56.960395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:56.961129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:56.961603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:56.962287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:57.028422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:57.038152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22c78264-6d41-406e-b4cc-d778102d60c8 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1270 microversion: 2.1 time: 0.092282 Sep 13 17:17:57.038736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3605/7158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:56 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:58.062075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:58.062717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:58.074361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:58.074869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:58.075320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:58.076037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:58.076506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:58.077229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:58.303375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:58.311280 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-877510ad-c6a5-4eb7-a7f1-8d8961c262dc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.253268 Sep 13 17:17:58.311875 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3554/7159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:58 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:17:58.681795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f0f82f7f-628b-4769-ad11-5a2b069bf5d2 req-3bd9afbb-9f6e-4af6-935f-756edf2d6624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ded46d-879a-4fad-b61e-a4331f5b0a29", "tag": "750abc9b-65a8-4062-942b-fc5c86faa309"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:17:58.699285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0f82f7f-628b-4769-ad11-5a2b069bf5d2 req-3bd9afbb-9f6e-4af6-935f-756edf2d6624 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:58.699789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0f82f7f-628b-4769-ad11-5a2b069bf5d2 req-3bd9afbb-9f6e-4af6-935f-756edf2d6624 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:58.700244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f0f82f7f-628b-4769-ad11-5a2b069bf5d2 req-3bd9afbb-9f6e-4af6-935f-756edf2d6624 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:58.712500 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f0f82f7f-628b-4769-ad11-5a2b069bf5d2 req-3bd9afbb-9f6e-4af6-935f-756edf2d6624 service nova] Creating event network-changed:750abc9b-65a8-4062-942b-fc5c86faa309 for instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 on n-h1-857467-1 Sep 13 17:17:58.718266 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f0f82f7f-628b-4769-ad11-5a2b069bf5d2 req-3bd9afbb-9f6e-4af6-935f-756edf2d6624 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047563 Sep 13 17:17:58.719089 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3606/7160] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:17:59.334908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:17:59.335527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:17:59.343022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:59.343515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:59.343964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:59.344687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:17:59.345740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:17:59.346210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:17:59.487992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:17:59.496065 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89474c42-d345-41a3-bab6-eede1cce2111 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.165151 Sep 13 17:17:59.496658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3555/7161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:17:59 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:00.521348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:00.522145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:00.528807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:00.529417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:00.529900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:00.530674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:00.531150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:00.531659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:00.677756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:00.686041 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d798ae78-cb60-4a41-814a-9c5ff4428ca9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.170835 Sep 13 17:18:00.686634 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3607/7162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:00 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:01.709878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:01.710480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:01.718707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:01.718707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:01.719526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:01.720330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:01.720813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:01.721250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:01.859491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:01.868360 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3b633b4-79bc-42bf-af73-f76436bee7aa tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.163620 Sep 13 17:18:01.868948 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3556/7163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:01 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:02.892800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:02.893605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:02.900570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:02.901145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:02.901529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:02.902269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:02.902750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:02.903193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:03.042161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:03.050400 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2521b640-ac14-4b29-ad5b-89f3079577bb tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.162317 Sep 13 17:18:03.051225 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3608/7164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:02 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:04.073907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:04.074747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:04.082349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:04.082838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:04.083286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:04.083986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:04.084447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:04.084876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:04.224218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:04.231896 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2debaa79-068d-4581-8b4b-455ee416674d tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.161984 Sep 13 17:18:04.232467 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3557/7165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:04 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:05.215108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c8cbcd6c-b837-44aa-9507-b789ae7f08c1 req-748bb8e1-f036-4f67-a1c6-5e3645b6ca6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ded46d-879a-4fad-b61e-a4331f5b0a29", "name": "network-vif-plugged", "status": "completed", "tag": "750abc9b-65a8-4062-942b-fc5c86faa309"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:05.226468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c8cbcd6c-b837-44aa-9507-b789ae7f08c1 req-748bb8e1-f036-4f67-a1c6-5e3645b6ca6d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:05.226996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c8cbcd6c-b837-44aa-9507-b789ae7f08c1 req-748bb8e1-f036-4f67-a1c6-5e3645b6ca6d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:05.227456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c8cbcd6c-b837-44aa-9507-b789ae7f08c1 req-748bb8e1-f036-4f67-a1c6-5e3645b6ca6d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:05.239693 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c8cbcd6c-b837-44aa-9507-b789ae7f08c1 req-748bb8e1-f036-4f67-a1c6-5e3645b6ca6d service nova] Creating event network-vif-plugged:750abc9b-65a8-4062-942b-fc5c86faa309 for instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 on n-h1-857467-1 Sep 13 17:18:05.244792 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c8cbcd6c-b837-44aa-9507-b789ae7f08c1 req-748bb8e1-f036-4f67-a1c6-5e3645b6ca6d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Sep 13 17:18:05.245357 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3609/7166] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:18:05.255192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:05.255821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:05.262723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:05.263220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:05.263663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:05.264367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:05.264833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:05.265267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:05.405550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:05.414889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a093e07b-d243-4beb-82ec-fd0501976f83 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.163967 Sep 13 17:18:05.430600 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3558/7167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:05 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:06.335151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:06.335964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:06.341636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:06.344488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:06.351430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.351925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.352375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.353077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.353548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.354024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.434454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:18:06.434902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:18:06.435400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:18:06.435834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:18:06.436266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:18:06.438424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:06.439843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:06.441785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:06.448212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.448598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.449043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.449758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.450253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.450695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.501786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:06.508330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.508946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.509489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.510329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.510885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.511415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.541393 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-124317b1-70f1-4366-9eb0-71516340afd2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84/action" status: 202 len: 1137 microversion: 2.1 time: 0.207133 Sep 13 17:18:06.542095 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3610/7168] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:18:06 2022] POST /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84/action => generated 1137 bytes in 209 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 13 17:18:06.561364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:06.562026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:06.568892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.569397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.569882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.570582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:06.571087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:06.571534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:06.594548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:06.602751 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc0fca22-9695-4721-8d62-427aeec4be2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1318 microversion: 2.1 time: 0.168196 Sep 13 17:18:06.603653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3559/7169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:06 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:18:06.707852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:06.715877 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d18b3c8-d78a-496a-822b-1f25f9fcd6e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.158410 Sep 13 17:18:06.716466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3611/7170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:06 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:18:07.626266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:07.626895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:07.634784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:07.635332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:07.635784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:07.636574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:07.637041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:07.637529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:07.740892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:07.742167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:07.761497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:07.762086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:07.762550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:07.763277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:07.763764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:07.764210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:07.781157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:07.791805 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-78e895c3-a7c4-4e39-a62b-388b61245532 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1508 microversion: 2.1 time: 0.169309 Sep 13 17:18:07.794012 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3560/7171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:07 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:07.918419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:07.927256 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d557275-6133-474f-9c25-5210d65f1ec0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.190468 Sep 13 17:18:07.927842 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3612/7172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:07 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:08.950177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:08.950830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:08.958551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:08.959136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:08.959654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:08.960357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:08.960825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:08.961263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:09.101032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:09.108928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4e9d967-ada9-4f34-96f5-0e9e26cf1ef2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.162823 Sep 13 17:18:09.109501 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3561/7173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:08 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:10.133134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:10.133788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:10.140750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:10.141265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:10.141720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:10.142456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:10.142932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:10.144019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:10.297978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:10.306971 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca740004-a367-40f0-83fa-322af699b76e tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.177710 Sep 13 17:18:10.311790 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3613/7174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:10 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:11.331838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:11.332577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:11.339909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:11.340546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:11.341076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:11.341953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:11.342504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:11.343016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:11.484082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:11.492952 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9635fd99-13e5-4b30-bb39-218fc6583e90 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.165260 Sep 13 17:18:11.493542 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3562/7175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:11 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:12.516535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:12.517325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:12.525067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:12.525576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:12.526069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:12.526791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:12.530021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:12.530021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:12.680374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:12.688543 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1c190db9-97ec-498d-8770-27bc922c90a2 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.175844 Sep 13 17:18:12.689132 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3614/7176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:12 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:13.712957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:13.713504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:13.721030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:13.721629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:13.722080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:13.722789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:13.723255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:13.723698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:13.862479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:13.870616 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-42216796-8b95-4ded-bd9a-ee72ca42a727 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.161548 Sep 13 17:18:13.871213 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3563/7177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:13 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:14.894325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:14.895612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:14.903381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:14.904093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:14.904724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:14.905439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:14.906114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:14.906704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:15.055101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:15.063687 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-05c5bfd2-931b-4021-a056-db62270fd9b0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.173876 Sep 13 17:18:15.064556 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3615/7178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:14 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:16.090272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:16.090908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:16.098192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:16.098714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:16.099159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:16.099871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:16.100342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:16.100782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:16.249932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:16.263457 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd0bea59-6411-48bc-8274-eb568d9f583b tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.177067 Sep 13 17:18:16.264053 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3564/7179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:16 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:17.287875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:17.288548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:17.295861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:17.296375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:17.296835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:17.297558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:17.298075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:17.298528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:17.434511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:17.442804 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5fb14389-c8e3-4100-85d7-36d53c5c05c0 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.159665 Sep 13 17:18:17.443468 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3616/7180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:17 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:18.466387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:18.467015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:18.474209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:18.474708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:18.475160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:18.475875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:18.476347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:18.476790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:18.613050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:18.621019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8c76324-ae43-4f71-aa8f-c97c93c8e5a4 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1690 microversion: 2.1 time: 0.158779 Sep 13 17:18:18.621598 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3565/7181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:18 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:19.849699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:19.851204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:19.859411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:19.859932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:19.860394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:19.861124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:19.861603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:19.862182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:20.000160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:20.008177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df3dd606-8387-4cfe-9c74-ad35283a4239 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1696 microversion: 2.1 time: 0.367368 Sep 13 17:18:20.008772 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3617/7182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:19 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1696 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:21.031424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:21.032039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:21.039506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:21.040003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:21.040456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:21.041164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:21.041641 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:21.042110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:21.182826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:21.191435 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7fcc3eba-8aa5-44be-8392-62921a8840e1 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1696 microversion: 2.1 time: 0.164053 Sep 13 17:18:21.192023 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3566/7183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:21 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:22.215465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:22.216102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:22.224275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:22.224931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:22.225455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:22.226289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:22.226834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:22.227364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:22.385880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:22.394489 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e34d37a-463a-48f3-837c-668ef3dc31a7 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1696 microversion: 2.1 time: 0.183292 Sep 13 17:18:22.395498 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3618/7184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:22 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:23.048302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acd07729-6bb5-48a7-b8bd-2486dcb81932", "device": "/dev/sdb"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:23.051345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:23.058684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:23.059178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:23.059680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:23.060386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:23.060936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:23.061550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:23.466188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-51a2070a-c906-46ed-b82c-d276fcec4973 req-dfe91916-f6f7-4d33-b7fe-35ac38a2b780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "name": "network-vif-unplugged", "status": "completed", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:23.478540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-51a2070a-c906-46ed-b82c-d276fcec4973 req-dfe91916-f6f7-4d33-b7fe-35ac38a2b780 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:23.479044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-51a2070a-c906-46ed-b82c-d276fcec4973 req-dfe91916-f6f7-4d33-b7fe-35ac38a2b780 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:23.479723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-51a2070a-c906-46ed-b82c-d276fcec4973 req-dfe91916-f6f7-4d33-b7fe-35ac38a2b780 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:23.493346 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-51a2070a-c906-46ed-b82c-d276fcec4973 req-dfe91916-f6f7-4d33-b7fe-35ac38a2b780 service nova] Creating event network-vif-unplugged:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:18:23.499162 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-51a2070a-c906-46ed-b82c-d276fcec4973 req-dfe91916-f6f7-4d33-b7fe-35ac38a2b780 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146372 Sep 13 17:18:23.499790 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3619/7185] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:18:23.513381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:23.514305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:23.522577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:23.523144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:23.523631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:23.524387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:23.525044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:23.525391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:23.541723 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a30dd479-629d-4cde-931c-4306e7d12586 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "POST /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497562 Sep 13 17:18:23.542615 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3567/7186] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:18:23 2022] POST /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:18:23.716291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:23.725003 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9b1ca7a8-0dc8-426b-8cf8-f1c6631187e5 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1681 microversion: 2.1 time: 0.223832 Sep 13 17:18:23.725585 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3620/7187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:23 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:25.648286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e88119f5-f407-4b2d-a594-5252260fe4b3 req-c19cc349-717d-4754-8f53-ae2963d83124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "name": "network-vif-plugged", "status": "completed", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:25.663036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e88119f5-f407-4b2d-a594-5252260fe4b3 req-c19cc349-717d-4754-8f53-ae2963d83124 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:25.663884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e88119f5-f407-4b2d-a594-5252260fe4b3 req-c19cc349-717d-4754-8f53-ae2963d83124 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:25.664333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e88119f5-f407-4b2d-a594-5252260fe4b3 req-c19cc349-717d-4754-8f53-ae2963d83124 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:25.677421 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e88119f5-f407-4b2d-a594-5252260fe4b3 req-c19cc349-717d-4754-8f53-ae2963d83124 service nova] Creating event network-vif-plugged:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:18:25.683712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e88119f5-f407-4b2d-a594-5252260fe4b3 req-c19cc349-717d-4754-8f53-ae2963d83124 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039255 Sep 13 17:18:25.684391 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3568/7188] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:18:48.474346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:48.474902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:48.478120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:48.478916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:48.485622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:48.486301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:48.486888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:48.487611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:48.488096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:48.488551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:48.573748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lazy-loading 'services' on Instance uuid 48ded46d-879a-4fad-b61e-a4331f5b0a29 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:18:48.644987 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f1da6138-aab0-4381-9546-2e6e89ab312b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "DELETE /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29/os-volume_attachments/acd07729-6bb5-48a7-b8bd-2486dcb81932" status: 202 len: 0 microversion: 2.1 time: 0.175201 Sep 13 17:18:48.645619 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3621/7189] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:18:48 2022] DELETE /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29/os-volume_attachments/acd07729-6bb5-48a7-b8bd-2486dcb81932 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:18:54.025022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:54.025733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:54.028310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=34 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:54.028967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:18:54.035790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:54.036276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:54.036714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:54.037406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:54.037889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:54.038323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:54.065756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:18:54.140137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b0adaae-7645-430d-b7d0-af68b7830d2e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "DELETE /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 204 len: 0 microversion: 2.1 time: 0.119144 Sep 13 17:18:54.140830 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3569/7190] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:18:54 2022] DELETE /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:18:54.151524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:54.152255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:54.158832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:54.159339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:54.159798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:54.160785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:54.161262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:54.161714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:54.293446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:54.301820 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1841ccbf-b5cb-496f-952f-160d4b86cb4b tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1514 microversion: 2.1 time: 0.155639 Sep 13 17:18:54.302424 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3622/7191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:54 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:55.326128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:55.326750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:55.333869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:55.334368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:55.334815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:55.335525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:55.336032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:55.336626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:55.468117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:55.476070 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6317522-7b98-445a-bb5b-3e85c2f96b70 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1514 microversion: 2.1 time: 0.154569 Sep 13 17:18:55.476649 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3570/7192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:55 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:56.492770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a4aa7d55-cb49-4ce6-ae47-5c497a497517 req-7cc176d5-5b9d-4854-9af2-dfaf143e8c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ded46d-879a-4fad-b61e-a4331f5b0a29", "name": "network-vif-deleted", "tag": "750abc9b-65a8-4062-942b-fc5c86faa309"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:56.499017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:56.499819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:56.504265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a4aa7d55-cb49-4ce6-ae47-5c497a497517 req-7cc176d5-5b9d-4854-9af2-dfaf143e8c66 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:56.505025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a4aa7d55-cb49-4ce6-ae47-5c497a497517 req-7cc176d5-5b9d-4854-9af2-dfaf143e8c66 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:56.505590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a4aa7d55-cb49-4ce6-ae47-5c497a497517 req-7cc176d5-5b9d-4854-9af2-dfaf143e8c66 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:56.507460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:56.508169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:56.508619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:56.509397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:56.509925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:56.510540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:56.519225 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a4aa7d55-cb49-4ce6-ae47-5c497a497517 req-7cc176d5-5b9d-4854-9af2-dfaf143e8c66 service nova] Creating event network-vif-deleted:750abc9b-65a8-4062-942b-fc5c86faa309 for instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 on n-h1-857467-1 Sep 13 17:18:56.524484 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a4aa7d55-cb49-4ce6-ae47-5c497a497517 req-7cc176d5-5b9d-4854-9af2-dfaf143e8c66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155073 Sep 13 17:18:56.525227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3623/7193] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:18:56.552802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:56.553288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:56.553725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:56.554203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lazy-loading 'fault' on Instance uuid 48ded46d-879a-4fad-b61e-a4331f5b0a29 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:18:56.598313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:18:56.606331 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce3f9e14-0f11-4d99-975e-b70e764c72d9 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 200 len: 1308 microversion: 2.1 time: 0.111253 Sep 13 17:18:56.606893 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3571/7194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:56 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:18:57.631534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:18:57.632260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 48ded46d-879a-4fad-b61e-a4331f5b0a29] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:18:57.638579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:57.639083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:57.639548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:57.640256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:18:57.640734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:18:57.641182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:18:57.654894 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] HTTP exception thrown: Instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 could not be found. Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Request method failure captured: Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 HTTP/1.1 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILsNQ-zEXI5cki037Q54E_u4eh3sGz4SrHRTNq0nZVXTrcXPkO3AiMn_mwcEbHKc8sfzMOzsc15AmN_oBjAbDv4Sp4YO9gpC6-OpXd3cVeiQClTQl3VCTm3jJal9Zc0nQE99-oM0TAt3WrzGOpXOObioJ6atM10Ck5se45ckr22jIRI Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 45b0126810794a4095a08ad983fd29c5 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1912860943 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45b0126810794a4095a08ad983fd29c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45b0126810794a4095a08ad983fd29c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45b0126810794a4095a08ad983fd29c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45b0126810794a4095a08ad983fd29c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesSnapshotTestJSON-1912860943 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 45b0126810794a4095a08ad983fd29c5 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1912860943 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesSnapshotTestJSON-1912860943-project Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f204e179cfc845aaae22c587b8421787 Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesSnapshotTestJSON-1912860943-project Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 could not be found. Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '48ded46d-879a-4fad-b61e-a4331f5b0a29'} Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 could not be found. Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 could not be found. Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:18:57.656545 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 could not be found. Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Returning 404 to user: Instance 48ded46d-879a-4fad-b61e-a4331f5b0a29 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b692c9b8-6c61-489d-9996-a7ebbdc2fe8e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29" status: 404 len: 111 microversion: 2.1 time: 0.031779 Sep 13 17:18:57.662383 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3624/7195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:18:57 2022] GET /compute/v2.1/servers/48ded46d-879a-4fad-b61e-a4331f5b0a29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:18:59.993051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:18:59.995510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:00.003353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:00.004060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:00.004504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:00.006323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:00.006820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:00.007252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:00.076733 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-90029a91-fde9-438a-b311-e52fc0302153 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "POST /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84/action" status: 200 len: 24574 microversion: 2.1 time: 0.086597 Sep 13 17:19:00.076733 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3572/7196] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:18:59 2022] POST /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84/action => generated 24574 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:19:04.428624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1574431465", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "2d1a39fc-9f2b-41e0-9348-3f24b73b03a6"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:04.484723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] validate_networks() for [('2d1a39fc-9f2b-41e0-9348-3f24b73b03a6', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:19:04.853280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:19:04.853672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:19:04.854346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:19:04.854828 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:19:04.855267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:19:04.864283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:04.864788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:04.865250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:04.866046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:04.866525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:04.866976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:04.883946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Getting quotas for project 45b0126810794a4095a08ad983fd29c5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:19:04.889215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Getting quotas for user f204e179cfc845aaae22c587b8421787 and project 45b0126810794a4095a08ad983fd29c5. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:19:04.902427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:19:04.904758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:19:04.950816 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cc2cd1c-e244-4831-8e9d-f2b16692d3cf tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527041 Sep 13 17:19:04.951482 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3625/7197] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:19:04.963859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-25cdf34c-6170-432f-8c2d-e110e430c396 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:04.968977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-25cdf34c-6170-432f-8c2d-e110e430c396 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:05.027803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-25cdf34c-6170-432f-8c2d-e110e430c396 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:05.036542 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-25cdf34c-6170-432f-8c2d-e110e430c396 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1219 microversion: 2.1 time: 0.077221 Sep 13 17:19:05.037131 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3573/7198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:04 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:06.063698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:06.064920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:06.072642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:06.073160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:06.073621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:06.074382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:06.074865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:06.075319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:06.141198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:06.149691 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1ebac6b0-3e66-4732-b5f4-373d67973a89 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1271 microversion: 2.1 time: 0.094435 Sep 13 17:19:06.156269 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3626/7199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:06 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:07.174394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:07.175124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:07.182404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:07.182783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:07.183180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:07.183882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:07.184349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:07.184972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:07.413771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:07.422011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3cd33dee-b5ec-4ba1-8b5e-7bc433689ddd tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.252097 Sep 13 17:19:07.422604 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3574/7200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:07 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:07.940115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6a6f946b-66a6-4d31-a83c-f1aaaa8fec4c req-80b67e30-6206-485a-a091-c6478c5666f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c7560b-023b-4df1-987c-64ab27c73b1e", "tag": "b141a2ef-a1c7-449a-898a-50ca20fdb251"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:07.951713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6a6f946b-66a6-4d31-a83c-f1aaaa8fec4c req-80b67e30-6206-485a-a091-c6478c5666f6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:07.952277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6a6f946b-66a6-4d31-a83c-f1aaaa8fec4c req-80b67e30-6206-485a-a091-c6478c5666f6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:07.952715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6a6f946b-66a6-4d31-a83c-f1aaaa8fec4c req-80b67e30-6206-485a-a091-c6478c5666f6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:07.965103 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6a6f946b-66a6-4d31-a83c-f1aaaa8fec4c req-80b67e30-6206-485a-a091-c6478c5666f6 service nova] Creating event network-changed:b141a2ef-a1c7-449a-898a-50ca20fdb251 for instance 00c7560b-023b-4df1-987c-64ab27c73b1e on n-h2-857467-1 Sep 13 17:19:07.970079 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6a6f946b-66a6-4d31-a83c-f1aaaa8fec4c req-80b67e30-6206-485a-a091-c6478c5666f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106901 Sep 13 17:19:07.970727 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3627/7201] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:19:08.446116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:08.446665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:08.453599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:08.454114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:08.454563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:08.455286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:08.455749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:08.456187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:08.587083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:08.595053 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40b488a0-28cb-4585-acb4-8fbdc0b5ff41 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.152977 Sep 13 17:19:08.595734 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3575/7202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:08 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:09.619363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:09.620087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:09.626368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:09.626960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:09.627607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:09.628306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:09.628779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:09.629224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:09.765341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:09.773982 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2300925f-3881-48bd-a1db-a2587e139676 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.159707 Sep 13 17:19:09.774584 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3628/7203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:09 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:10.796745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:10.797364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:10.804954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:10.805451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:10.806248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:10.807020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:10.807486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:10.807921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:10.968559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:10.977555 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bcceeadf-ab6a-4458-b9ba-5e70c7e48abc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.184943 Sep 13 17:19:10.978173 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3576/7204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:10 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:12.000232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:12.000886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:12.008117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:12.008630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:12.009089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:12.009801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:12.010301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:12.010745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:12.139743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:12.147932 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f955328-88c5-40f9-95ba-0494760090cc tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.151630 Sep 13 17:19:12.148522 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3629/7205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:11 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:13.172205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:13.172832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:13.179826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:13.180312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:13.180756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:13.181446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:13.181943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:13.182374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:13.311552 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:13.319923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f7e7f4a-1ae2-484e-a5f1-1dcd08bf6198 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.151920 Sep 13 17:19:13.320498 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3577/7206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:13 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:14.344679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:14.345227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:14.352982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:14.353491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:14.353970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:14.354694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:14.355168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:14.355616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:14.496472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:14.504831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b6102cce-187b-454b-8f25-a13f0d439647 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.164173 Sep 13 17:19:14.505412 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3630/7207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:14 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:15.529359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:15.530040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:15.532917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:15.540259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:15.540745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:15.541186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:15.541929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:15.542390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:15.542837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:15.684150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:15.692601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d320f7d2-42f3-4c98-ba19-f9e019acb0b7 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.167076 Sep 13 17:19:15.694450 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3578/7208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:15 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:15.731244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9d5b8c00-e64c-4619-a934-3e64e3667caa req-0db583d7-f99f-434a-9c34-4c787d4def00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c7560b-023b-4df1-987c-64ab27c73b1e", "name": "network-vif-plugged", "status": "completed", "tag": "b141a2ef-a1c7-449a-898a-50ca20fdb251"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:15.737113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:15.738200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:15.746068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9d5b8c00-e64c-4619-a934-3e64e3667caa req-0db583d7-f99f-434a-9c34-4c787d4def00 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:15.746578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9d5b8c00-e64c-4619-a934-3e64e3667caa req-0db583d7-f99f-434a-9c34-4c787d4def00 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:15.747042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9d5b8c00-e64c-4619-a934-3e64e3667caa req-0db583d7-f99f-434a-9c34-4c787d4def00 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:15.759271 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9d5b8c00-e64c-4619-a934-3e64e3667caa req-0db583d7-f99f-434a-9c34-4c787d4def00 service nova] Creating event network-vif-plugged:b141a2ef-a1c7-449a-898a-50ca20fdb251 for instance 00c7560b-023b-4df1-987c-64ab27c73b1e on n-h2-857467-1 Sep 13 17:19:15.764360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9d5b8c00-e64c-4619-a934-3e64e3667caa req-0db583d7-f99f-434a-9c34-4c787d4def00 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037030 Sep 13 17:19:15.765038 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3631/7209] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:19:16.716520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:16.717144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:16.724742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:16.725229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:16.725665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:16.726396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:16.726857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:16.727290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:16.896213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:16.910223 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f68ef330-dbfd-4e62-9c78-4622f069521f tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1319 microversion: 2.1 time: 0.191661 Sep 13 17:19:16.911707 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3579/7210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:16 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:17.935364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:17.936104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:17.943969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:17.944482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:17.944947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:17.945671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:17.946189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:17.946640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:18.078992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:18.087707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fccccc45-031f-4faa-a3d5-35d7098351d1 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1508 microversion: 2.1 time: 0.158634 Sep 13 17:19:18.088290 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3632/7211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:17 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:18.110991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34723dc7-538e-4e83-b543-926811b4f9d2", "device": "/dev/sdb"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:18.113424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:18.119904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:18.120410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:18.120856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:18.121570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:18.122082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:18.122504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:18.389574 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f50aef68-5d8c-44f5-a22a-467e4999e7ba tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "POST /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283371 Sep 13 17:19:18.390236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3580/7212] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:19:18 2022] POST /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:19:27.168939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2045222029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1395877829", "security_groups": [{"name": "tempest-secgroup-smoke-197606766"}], "block_device_mapping_v2": [{"uuid": "61757752-79bd-49ad-9f04-871434767805", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b347ac9-9044-4908-8b1d-b4b9b101e5a0"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:27.179599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:27.283790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] validate_networks() for [('6b347ac9-9044-4908-8b1d-b4b9b101e5a0', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:19:27.658236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:19:27.658679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:19:27.659824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:19:27.660234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:19:27.660752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:19:27.670280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:27.670780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:27.671233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:27.671973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:27.672443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:27.672885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:27.680202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:27.692537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:19:27.697893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Getting quotas for user 39d8a5ab87e44d2c945f80e216957463 and project 6a317dc3b7f644af8884ca824181ece1. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:19:27.758284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:19:27.760419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61757752-79bd-49ad-9f04-871434767805',volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:19:27.889714 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a47071de-664e-450d-a2e3-ff8f55424664 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724831 Sep 13 17:19:27.890618 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3633/7213] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:19:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:19:27.903603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-524d0077-fa86-43bb-9714-74b3b02c42ef tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:27.904436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-524d0077-fa86-43bb-9714-74b3b02c42ef tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:27.907442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:27.962099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-524d0077-fa86-43bb-9714-74b3b02c42ef tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:27.969044 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-524d0077-fa86-43bb-9714-74b3b02c42ef tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1095 microversion: 2.1 time: 0.070877 Sep 13 17:19:27.969618 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3581/7214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:27 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:28.992364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d38a98a-1a58-4f8a-81bb-efffbd8345eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:28.992953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d38a98a-1a58-4f8a-81bb-efffbd8345eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:29.048750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d38a98a-1a58-4f8a-81bb-efffbd8345eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:29.059449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d38a98a-1a58-4f8a-81bb-efffbd8345eb tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1095 microversion: 2.1 time: 0.070968 Sep 13 17:19:29.068686 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3634/7215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:28 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:30.083567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:30.084254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:30.087994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:30.097260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:30.098171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:30.098642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:30.099565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:30.100058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:30.100495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:30.187059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:30.196213 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b6b72543-8566-45f4-ab80-747c7fb04537 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1201 microversion: 2.1 time: 0.117194 Sep 13 17:19:30.209874 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3582/7216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:30 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1201 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:31.223427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:31.224184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:31.234263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.234916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.235477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:31.236449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.237076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.238168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:31.539339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:31.539965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:31.555700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.556556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.557224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:31.558215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.558976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.559623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:31.590633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:31.599631 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-625366b9-b1ad-42ae-af69-b8de5d3f50a8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1278 microversion: 2.1 time: 0.381635 Sep 13 17:19:31.603507 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3635/7217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:31 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1278 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:31.621662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fb73751b-ba77-4def-8808-90500cf8a1a7 req-da042a41-896d-4532-bd8b-635ac1b252ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:31.636366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:19:31.646515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fb73751b-ba77-4def-8808-90500cf8a1a7 req-da042a41-896d-4532-bd8b-635ac1b252ce service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.647132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fb73751b-ba77-4def-8808-90500cf8a1a7 req-da042a41-896d-4532-bd8b-635ac1b252ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.647716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fb73751b-ba77-4def-8808-90500cf8a1a7 req-da042a41-896d-4532-bd8b-635ac1b252ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:31.680160 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fb73751b-ba77-4def-8808-90500cf8a1a7 req-da042a41-896d-4532-bd8b-635ac1b252ce service nova] Creating event network-changed:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:19:31.692757 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fb73751b-ba77-4def-8808-90500cf8a1a7 req-da042a41-896d-4532-bd8b-635ac1b252ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087715 Sep 13 17:19:31.693745 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3636/7218] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:19:31.848580 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4995c356-6443-4a15-9eb1-7cae87f48344 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 204 len: 0 microversion: 2.1 time: 0.313308 Sep 13 17:19:31.849194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3583/7219] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:19:31 2022] DELETE /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:19:31.859326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:31.860212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:31.874082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.874750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.876555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:31.877403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:31.881605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:31.882500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:32.222810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:32.237642 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6addacbe-cc69-459f-acc6-1413615836a3 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1687 microversion: 2.1 time: 0.383254 Sep 13 17:19:32.258852 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3637/7220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:31 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1687 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:32.341045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-308d88c7-7aa7-4ef0-a6c6-1dea79ccc1df req-fb1a6087-ac12-43f1-9d8c-1c33d739fde0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6df2527-7969-46f5-8d00-9e97f6ec4e11", "tag": "4b3e1b07-044f-4e3f-8152-da0cd62aea4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:32.365761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-308d88c7-7aa7-4ef0-a6c6-1dea79ccc1df req-fb1a6087-ac12-43f1-9d8c-1c33d739fde0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:32.366419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-308d88c7-7aa7-4ef0-a6c6-1dea79ccc1df req-fb1a6087-ac12-43f1-9d8c-1c33d739fde0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:32.366938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-308d88c7-7aa7-4ef0-a6c6-1dea79ccc1df req-fb1a6087-ac12-43f1-9d8c-1c33d739fde0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:32.391568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-308d88c7-7aa7-4ef0-a6c6-1dea79ccc1df req-fb1a6087-ac12-43f1-9d8c-1c33d739fde0 service nova] Creating event network-changed:4b3e1b07-044f-4e3f-8152-da0cd62aea4b for instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 on n-h1-857467-1 Sep 13 17:19:32.401015 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-308d88c7-7aa7-4ef0-a6c6-1dea79ccc1df req-fb1a6087-ac12-43f1-9d8c-1c33d739fde0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064126 Sep 13 17:19:32.403879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3584/7221] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:19:32.634176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:32.635310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:32.644121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:32.644967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:32.645715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:32.646791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:32.647562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:32.648393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:32.877787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:32.887025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fb2bc1b4-bede-4866-881c-c1b04a2f7644 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1278 microversion: 2.1 time: 0.260106 Sep 13 17:19:32.903381 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3638/7222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:32 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:33.274835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:33.275752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:33.292347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:33.292347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:33.292693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:33.293413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:33.296859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:33.297603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:33.825329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:33.835734 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9de5c6e8-dfc4-41c9-9cf7-88016439c000 tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1687 microversion: 2.1 time: 0.565375 Sep 13 17:19:33.836325 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3585/7223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:33 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1687 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:33.913035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:33.914430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:33.934413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:33.934996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:33.935559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:33.936397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:33.936976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:33.938080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:34.140611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:34.152496 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce72fb8b-6bd7-40d2-bd3e-7b3672e57508 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1278 microversion: 2.1 time: 0.244964 Sep 13 17:19:34.153702 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3639/7224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:33 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:34.695028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-18ac7417-59ca-4248-a959-685035a14a27 req-4afb3632-cae4-46dd-8025-0934fe428c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea09e01a-685e-4b60-b683-06580e9dae84", "name": "network-vif-deleted", "tag": "9bd1fdca-3b75-4dd6-b9dc-2765b65398d1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:34.719656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-18ac7417-59ca-4248-a959-685035a14a27 req-4afb3632-cae4-46dd-8025-0934fe428c68 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:34.720614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-18ac7417-59ca-4248-a959-685035a14a27 req-4afb3632-cae4-46dd-8025-0934fe428c68 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:34.721314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-18ac7417-59ca-4248-a959-685035a14a27 req-4afb3632-cae4-46dd-8025-0934fe428c68 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:34.738819 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-18ac7417-59ca-4248-a959-685035a14a27 req-4afb3632-cae4-46dd-8025-0934fe428c68 service nova] Creating event network-vif-deleted:9bd1fdca-3b75-4dd6-b9dc-2765b65398d1 for instance ea09e01a-685e-4b60-b683-06580e9dae84 on n-h1-857467-1 Sep 13 17:19:34.745138 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-18ac7417-59ca-4248-a959-685035a14a27 req-4afb3632-cae4-46dd-8025-0934fe428c68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060773 Sep 13 17:19:34.746106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3586/7225] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:19:34.869476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:34.870152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:34.887811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:34.888301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:34.889468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:34.890624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:34.891231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:34.892798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:34.953403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:34.954355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:34.955475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:34.956501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lazy-loading 'fault' on Instance uuid ea09e01a-685e-4b60-b683-06580e9dae84 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:19:35.014666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa877fdd453495997fbbc66a9bd1b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a27a6c02e24505bcc86dc4b7470393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:35.025933 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d56ba14-cc60-48e3-9e31-12bbac37ecff tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 200 len: 1355 microversion: 2.1 time: 0.169071 Sep 13 17:19:35.026667 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3640/7226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:34 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 1355 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:35.176745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:35.177480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:35.184602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:35.185217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:35.185791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:35.186553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:35.187052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:35.187539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:35.375747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:35.385710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-767fda71-c95c-4da1-8f06-173365dcbcc2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1278 microversion: 2.1 time: 0.213418 Sep 13 17:19:35.386457 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3587/7227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:35 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:19:36.069960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:36.070576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [instance: ea09e01a-685e-4b60-b683-06580e9dae84] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:36.078566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:36.079212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:36.079714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:36.080423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:36.081033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:36.081676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:36.096182 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] HTTP exception thrown: Instance ea09e01a-685e-4b60-b683-06580e9dae84 could not be found. Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Request method failure captured: Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 HTTP/1.1 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILkBD_BBT3s4zy_iG7sW47eVxVhtuVN_LpJ6eyAUTVvnGgEm9nSZ71UjSc1mqRFOMtzGHRtuKPNYOb27Y7896o9j0UBG-IY446yIe1mwU0n5obKNM0QrU6LYkTdijiJKBk0jXG5U2VW_weDPuhy7fiXeRA5C3vy8OT4OYrDX05PpuzM Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6a27a6c02e24505bcc86dc4b7470393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: f6a27a6c02e24505bcc86dc4b7470393 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-509737294 Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 7aa877fdd453495997fbbc66a9bd1b1b Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkAdvancedServerOps-509737294-project Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ea09e01a-685e-4b60-b683-06580e9dae84 could not be found. Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ea09e01a-685e-4b60-b683-06580e9dae84'} Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea09e01a-685e-4b60-b683-06580e9dae84 could not be found. Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea09e01a-685e-4b60-b683-06580e9dae84 could not be found. Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:36.098798 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea09e01a-685e-4b60-b683-06580e9dae84 could not be found. Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Returning 404 to user: Instance ea09e01a-685e-4b60-b683-06580e9dae84 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:19:36.102902 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf8c1ca0-5411-444f-b3c8-a0b3de7c431f tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84" status: 404 len: 111 microversion: 2.1 time: 0.051765 Sep 13 17:19:36.104223 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3641/7228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:36 2022] GET /compute/v2.1/servers/ea09e01a-685e-4b60-b683-06580e9dae84 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:19:36.417172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:36.417897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:36.432234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:36.433428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:36.433975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:36.434778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:36.436018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:36.436682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:36.729132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:36.740486 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-50251666-6b7a-438f-a19c-971e9de254e8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1278 microversion: 2.1 time: 0.331166 Sep 13 17:19:36.741102 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3588/7229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:36 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1278 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:37.769123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:37.769674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:37.772645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:37.780610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:37.781534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:37.782340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:37.783192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:37.784290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:37.784847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:37.934718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:37.943492 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-caa1a512-f01f-409b-ab60-30078b2de0ab tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.179147 Sep 13 17:19:37.944214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3642/7230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:37 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:38.967453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:38.968434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:38.971431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:38.977618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:38.978505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:38.979063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:38.979903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:38.980478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:38.981055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:39.195966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:39.210756 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5445f1cd-a7f0-4390-937c-fe4dd6f1b8a1 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.247542 Sep 13 17:19:39.214032 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3589/7231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:38 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:39.990359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b074225-6c21-47c5-a902-fc8fef01ea4a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] Calling method '.version_select at 0x7fbeb96c0280>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:39.995257 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b074225-6c21-47c5-a902-fc8fef01ea4a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [9ea0d3b1-a414-45dd-90cd-674e5695e5db] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:19:39.996875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:40.235261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:40.235879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:40.239880 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:19:40.240041 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 (ip 10.222.0.61) !!! Sep 13 17:19:40.241194 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:19:40.241320 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 (ip 10.222.0.61) !!! Sep 13 17:19:40.251587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:40.252089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:40.253115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:40.254269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:40.254882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:40.255543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:40.399603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:40.407568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-582107ac-591d-4a4e-bff5-28fe5940e2df tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.176227 Sep 13 17:19:40.408147 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3590/7232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:40 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:19:41.006149 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b074225-6c21-47c5-a902-fc8fef01ea4a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] [9ea0d3b1-a414-45dd-90cd-674e5695e5db] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35514. Sep 13 17:19:41.025773 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b074225-6c21-47c5-a902-fc8fef01ea4a tempest-TestNetworkAdvancedServerOps-509737294 tempest-TestNetworkAdvancedServerOps-509737294-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-518550122" status: 202 len: 0 microversion: 2.1 time: 1.039948 Sep 13 17:19:41.026632 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3643/7233] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Sep 13 17:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-518550122 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:19:41.435668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:41.436277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:41.449664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:41.450568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:41.451208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:41.452465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:41.453133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:41.453578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:41.616946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:41.625552 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6980cdc9-cee9-44c8-8c10-e44eeeb22460 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.195650 Sep 13 17:19:41.626618 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3591/7234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:41 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:42.348148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:42.348731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:42.355775 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:42.356289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:42.356758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:42.357506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:42.358030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:42.358487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:42.452658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lazy-loading 'services' on Instance uuid 00c7560b-023b-4df1-987c-64ab27c73b1e {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:19:42.532721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-55b8347e-9b2d-40cc-9a5b-a17239c9e042 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "DELETE /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e/os-volume_attachments/34723dc7-538e-4e83-b543-926811b4f9d2" status: 202 len: 0 microversion: 2.1 time: 0.189643 Sep 13 17:19:42.533440 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3644/7235] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:19:42 2022] DELETE /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e/os-volume_attachments/34723dc7-538e-4e83-b543-926811b4f9d2 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:19:42.649455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:42.650922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:42.660436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:42.660975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:42.661682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:42.662441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:42.662913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:42.663409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:42.813630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:42.822550 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d138bfbd-b3f7-4a32-b936-3a9a8355704f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.177619 Sep 13 17:19:42.823128 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3592/7236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:42 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:43.846980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:43.847914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:43.854879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:43.855388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:43.855840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:43.856562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:43.857042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:43.857667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:44.008145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:44.016802 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6dc19e84-e5fe-4c5b-b257-19f31208c743 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.175753 Sep 13 17:19:44.017634 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3645/7237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:43 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:45.040942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:45.041704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:45.048914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:45.049415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:45.049873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:45.050591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:45.051060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:45.051627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:45.202437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:45.211858 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-309307db-62e0-44e7-851b-63bfe058ae62 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.175035 Sep 13 17:19:45.213038 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3593/7238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:45 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:46.235602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:46.236232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:46.243329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:46.243837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:46.244296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:46.245007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:46.245484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:46.245955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:46.387114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:46.396402 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cfc96e61-ee0f-4d06-8bf8-94616d1de604 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.164732 Sep 13 17:19:46.396991 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3646/7239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:46 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:47.693636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:47.694328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:47.700492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:47.700978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:47.701413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:47.702141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:47.702602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:47.703034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:47.837871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:47.845635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a440892c-8333-4523-8dd6-aeb938725cb9 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.429695 Sep 13 17:19:47.847079 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3594/7240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:47 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:47.912378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:47.912920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:47.920329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:47.920849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:47.921315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:47.922101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:47.922584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:47.923041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:47.949723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:19:47.993927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-4f7bbf50-6cb3-463f-8f8c-f289c07dc1cf req-d79f72f8-7c49-474f-b86e-1f1caa747e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df2527-7969-46f5-8d00-9e97f6ec4e11", "name": "network-vif-plugged", "status": "completed", "tag": "4b3e1b07-044f-4e3f-8152-da0cd62aea4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:48.005147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4f7bbf50-6cb3-463f-8f8c-f289c07dc1cf req-d79f72f8-7c49-474f-b86e-1f1caa747e27 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:48.005617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4f7bbf50-6cb3-463f-8f8c-f289c07dc1cf req-d79f72f8-7c49-474f-b86e-1f1caa747e27 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:48.006091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-4f7bbf50-6cb3-463f-8f8c-f289c07dc1cf req-d79f72f8-7c49-474f-b86e-1f1caa747e27 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:48.019613 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-4f7bbf50-6cb3-463f-8f8c-f289c07dc1cf req-d79f72f8-7c49-474f-b86e-1f1caa747e27 service nova] Creating event network-vif-plugged:4b3e1b07-044f-4e3f-8152-da0cd62aea4b for instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 on n-h1-857467-1 Sep 13 17:19:48.025033 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-4f7bbf50-6cb3-463f-8f8c-f289c07dc1cf req-d79f72f8-7c49-474f-b86e-1f1caa747e27 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035457 Sep 13 17:19:48.026346 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3595/7241] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:19:48.035612 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b00eee72-0fd7-49d1-875d-c55957aeb611 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "DELETE /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 204 len: 0 microversion: 2.1 time: 0.127748 Sep 13 17:19:48.036239 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3647/7242] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:19:47 2022] DELETE /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:19:48.045449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:48.046216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:48.053413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:48.054034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:48.054521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:48.055201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:48.055667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:48.056104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:48.262896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:48.271713 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c68fbfe3-550d-45af-aba2-885adf7e542e tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1514 microversion: 2.1 time: 0.230558 Sep 13 17:19:48.272294 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3596/7243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:48 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:48.870156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:48.870795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:48.876831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:48.877365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:48.877847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:48.878557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:48.879039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:48.879486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:49.016846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:49.024862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f58cb5b-bc43-4aa7-bd8a-e1b80bb55b37 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1266 microversion: 2.1 time: 0.159149 Sep 13 17:19:49.025451 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3648/7244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:48 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:49.294809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:49.295465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:49.302546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:49.303035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:49.303480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:49.304181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:49.304645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:49.305082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:49.437553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:49.446620 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7e4b981-eea6-4adc-8a9a-6354c1c6b901 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1514 microversion: 2.1 time: 0.155731 Sep 13 17:19:49.447200 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3597/7245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:49 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:50.048526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:50.049190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:50.056883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.057770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.058330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.059080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.060300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.060300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.209227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c68933c1-055a-48ca-86c0-4d8057cebc63 req-e922398a-9fa9-441b-ba54-de69d8eec84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c7560b-023b-4df1-987c-64ab27c73b1e", "name": "network-vif-deleted", "tag": "b141a2ef-a1c7-449a-898a-50ca20fdb251"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:50.219551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c68933c1-055a-48ca-86c0-4d8057cebc63 req-e922398a-9fa9-441b-ba54-de69d8eec84f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.220046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c68933c1-055a-48ca-86c0-4d8057cebc63 req-e922398a-9fa9-441b-ba54-de69d8eec84f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.220483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c68933c1-055a-48ca-86c0-4d8057cebc63 req-e922398a-9fa9-441b-ba54-de69d8eec84f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.226941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:50.236062 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba7ba8fc-e17f-4a33-a914-5d95a5b5c72f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1454 microversion: 2.1 time: 0.191517 Sep 13 17:19:50.236273 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c68933c1-055a-48ca-86c0-4d8057cebc63 req-e922398a-9fa9-441b-ba54-de69d8eec84f service nova] Creating event network-vif-deleted:b141a2ef-a1c7-449a-898a-50ca20fdb251 for instance 00c7560b-023b-4df1-987c-64ab27c73b1e on n-h2-857467-1 Sep 13 17:19:50.237712 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3649/7246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:50 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1454 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:50.242288 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c68933c1-055a-48ca-86c0-4d8057cebc63 req-e922398a-9fa9-441b-ba54-de69d8eec84f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037758 Sep 13 17:19:50.243159 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3598/7247] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:19:50.259923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:50.260553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:50.267270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.267805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.268537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.269260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.269734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.270213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.412215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:50.420253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f5c69fda-18bc-4429-a8fe-daa891344877 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1454 microversion: 2.1 time: 0.164470 Sep 13 17:19:50.420840 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3650/7248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:50 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:50.473854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:50.474574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:50.482148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.482647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.483391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.484107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.484704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.485145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.505692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:50.522780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:50.523279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:50.523736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:50.524186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lazy-loading 'fault' on Instance uuid 00c7560b-023b-4df1-987c-64ab27c73b1e {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:19:50.568722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f204e179cfc845aaae22c587b8421787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b0126810794a4095a08ad983fd29c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:19:50.576942 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-841653c1-fd5a-4883-a185-bbeb70f0eae2 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 200 len: 1309 microversion: 2.1 time: 0.110607 Sep 13 17:19:50.577609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3599/7249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:50 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:19:51.600938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:19:51.601572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] [instance: 00c7560b-023b-4df1-987c-64ab27c73b1e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:19:51.608454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:51.608962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:51.609417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:51.610166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:51.610640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:51.611082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:51.614626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:19:51.628123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] HTTP exception thrown: Instance 00c7560b-023b-4df1-987c-64ab27c73b1e could not be found. Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Request method failure captured: Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e HTTP/1.1 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILsNQ-zEXI5cki037Q54E_u4eh3sGz4SrHRTNq0nZVXTrcXPkO3AiMn_mwcEbHKc8sfzMOzsc15AmN_oBjAbDv4Sp4YO9gpC6-OpXd3cVeiQClTQl3VCTm3jJal9Zc0nQE99-oM0TAt3WrzGOpXOObioJ6atM10Ck5se45ckr22jIRI Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 45b0126810794a4095a08ad983fd29c5 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1912860943 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45b0126810794a4095a08ad983fd29c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45b0126810794a4095a08ad983fd29c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45b0126810794a4095a08ad983fd29c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45b0126810794a4095a08ad983fd29c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-VolumesSnapshotTestJSON-1912860943 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 45b0126810794a4095a08ad983fd29c5 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1912860943 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-VolumesSnapshotTestJSON-1912860943-project Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: f204e179cfc845aaae22c587b8421787 Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-VolumesSnapshotTestJSON-1912860943-project Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 00c7560b-023b-4df1-987c-64ab27c73b1e could not be found. Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '00c7560b-023b-4df1-987c-64ab27c73b1e'} Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c7560b-023b-4df1-987c-64ab27c73b1e could not be found. Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c7560b-023b-4df1-987c-64ab27c73b1e could not be found. Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:19:51.629884 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c7560b-023b-4df1-987c-64ab27c73b1e could not be found. Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] Returning 404 to user: Instance 00c7560b-023b-4df1-987c-64ab27c73b1e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf3566bb-cf29-4402-a504-2cefa1052472 tempest-VolumesSnapshotTestJSON-1912860943 tempest-VolumesSnapshotTestJSON-1912860943-project] 10.222.0.61 "GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e" status: 404 len: 111 microversion: 2.1 time: 0.034472 Sep 13 17:19:51.633530 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3651/7250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:19:51 2022] GET /compute/v2.1/servers/00c7560b-023b-4df1-987c-64ab27c73b1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:19:52.099957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d708fe74-f097-4b2c-9942-5ed2ab6b6736 req-caca1139-279c-4198-a1a2-8a1ae9bfc27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6df2527-7969-46f5-8d00-9e97f6ec4e11", "tag": "4b3e1b07-044f-4e3f-8152-da0cd62aea4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:19:52.110924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d708fe74-f097-4b2c-9942-5ed2ab6b6736 req-caca1139-279c-4198-a1a2-8a1ae9bfc27f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:19:52.111466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d708fe74-f097-4b2c-9942-5ed2ab6b6736 req-caca1139-279c-4198-a1a2-8a1ae9bfc27f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:19:52.112639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d708fe74-f097-4b2c-9942-5ed2ab6b6736 req-caca1139-279c-4198-a1a2-8a1ae9bfc27f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:19:52.124449 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d708fe74-f097-4b2c-9942-5ed2ab6b6736 req-caca1139-279c-4198-a1a2-8a1ae9bfc27f service nova] Creating event network-changed:4b3e1b07-044f-4e3f-8152-da0cd62aea4b for instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 on n-h1-857467-1 Sep 13 17:19:52.130538 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d708fe74-f097-4b2c-9942-5ed2ab6b6736 req-caca1139-279c-4198-a1a2-8a1ae9bfc27f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034707 Sep 13 17:19:52.132557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3600/7251] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:20:47.541931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:20:47.740046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27e0ade5-6fb1-4484-90f8-8c16e6b8acee tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Action: 'create', calling method: .version_select at 0x7fbeb96ca160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-699432440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw5XHfhm7sBgCxzA7gOzEsWa8IACYTpN5GtmPhr6joMnOiCSYEpJu5fL2osLZcXGyq0jcSqo5E6WSya/RsKpWQt7oCM3d5BIqMPa9sWz6bgGUUwpHu39DgL6LGA44qpqg=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:20:47.761784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-27e0ade5-6fb1-4484-90f8-8c16e6b8acee tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Getting quotas for project 7464c66005cc41f2bd8ffc9efe028558. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:20:47.767630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-27e0ade5-6fb1-4484-90f8-8c16e6b8acee tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Getting quotas for user c80aa7b438b94ec09d018e4a7a700cdd and project 7464c66005cc41f2bd8ffc9efe028558. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:20:47.800916 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27e0ade5-6fb1-4484-90f8-8c16e6b8acee tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.264902 Sep 13 17:20:47.801598 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3652/7252] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:20:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:20:48.849578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:20:48.850365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:20:48.854978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1195889065", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-699432440", "security_groups": [{"name": "tempest-secgroup-smoke-1165118068"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b683a9ec-878a-4851-8244-5ea0399ef09e"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:20:48.966678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] validate_networks() for [('b683a9ec-878a-4851-8244-5ea0399ef09e', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:20:49.506686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Getting quotas for project 7464c66005cc41f2bd8ffc9efe028558. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:20:49.512127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Getting quotas for user c80aa7b438b94ec09d018e4a7a700cdd and project 7464c66005cc41f2bd8ffc9efe028558. Resources: dict_keys(['metadata_items']) {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:20:49.526614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:20:49.527044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:20:49.527527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:20:49.527940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:20:49.528355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:20:49.536902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:49.537659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:49.538143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:49.538890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:49.539352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:49.539786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:49.557416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Getting quotas for project 7464c66005cc41f2bd8ffc9efe028558. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:20:49.562988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Getting quotas for user c80aa7b438b94ec09d018e4a7a700cdd and project 7464c66005cc41f2bd8ffc9efe028558. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:20:49.576573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:20:49.579079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:20:49.630859 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c22cc31-aa96-472b-8398-e82bd85a68e0 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784474 Sep 13 17:20:49.631585 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3601/7253] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:20:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:20:49.644916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e959633-57bc-4571-a09c-4bc9ed7d5d02 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:49.645560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e959633-57bc-4571-a09c-4bc9ed7d5d02 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:49.714084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e959633-57bc-4571-a09c-4bc9ed7d5d02 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:49.723387 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e959633-57bc-4571-a09c-4bc9ed7d5d02 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1302 microversion: 2.1 time: 0.084613 Sep 13 17:20:49.724693 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3653/7254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:49 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:20:50.747875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:50.749207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:50.758949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:50.759770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:50.760444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:50.761909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:50.762698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:50.763336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:50.837596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:50.847182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9c86f2a-eda7-4b49-843d-a1b9a7cc5e69 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1354 microversion: 2.1 time: 0.104104 Sep 13 17:20:50.849655 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3602/7255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:50 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:20:51.870966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:51.871848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:51.880342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:51.881199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:51.881665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:51.882693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:51.883382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:51.883907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:52.050999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:52.060456 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d0db02c6-65e9-4a71-a96b-f28fbfb6ed15 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.193583 Sep 13 17:20:52.061474 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3654/7256] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:51 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:20:52.440737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-0f442157-727e-4bb3-bd3c-5fd5cb3f7d90 req-96c558be-9a7d-4b7d-bb7f-f356fbdac22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a30a8e-ba1c-4090-84dd-1adf7b2c1946", "tag": "513b5a3c-273a-4b95-9941-dac75705b201"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:20:52.451958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0f442157-727e-4bb3-bd3c-5fd5cb3f7d90 req-96c558be-9a7d-4b7d-bb7f-f356fbdac22c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:52.452453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0f442157-727e-4bb3-bd3c-5fd5cb3f7d90 req-96c558be-9a7d-4b7d-bb7f-f356fbdac22c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:52.452894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0f442157-727e-4bb3-bd3c-5fd5cb3f7d90 req-96c558be-9a7d-4b7d-bb7f-f356fbdac22c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:52.465471 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-0f442157-727e-4bb3-bd3c-5fd5cb3f7d90 req-96c558be-9a7d-4b7d-bb7f-f356fbdac22c service nova] Creating event network-changed:513b5a3c-273a-4b95-9941-dac75705b201 for instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 on n-h2-857467-1 Sep 13 17:20:52.472671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-0f442157-727e-4bb3-bd3c-5fd5cb3f7d90 req-96c558be-9a7d-4b7d-bb7f-f356fbdac22c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035639 Sep 13 17:20:52.476401 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3603/7257] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:20:53.087518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:53.088854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:53.096756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:53.097405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:53.097903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:53.098652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:53.099135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:53.099587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:53.239014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:53.248814 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c58acdec-9205-4753-9c0b-9944eeb26d8c tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.167031 Sep 13 17:20:53.249400 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3655/7258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:53 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:20:54.273382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:54.274124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:54.280375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:54.280863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:54.281310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:54.282042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:54.282508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:54.283530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:54.419102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:54.427119 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-02194fd6-a32e-4ba2-bb25-9924e669341b tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.158866 Sep 13 17:20:54.427694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3604/7259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:54 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:20:55.449564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:55.450236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:55.458375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:55.458832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:55.459292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:55.460021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:55.460505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:55.461274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:55.601393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:55.609211 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0fbcd197-42e0-4cf2-9f84-bd660b4f0221 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.163985 Sep 13 17:20:55.609796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3656/7260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:55 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:20:56.632537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:56.633156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:56.639613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:56.640099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:56.640536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:56.641223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:56.641684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:56.642231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:56.779397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:56.787432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b8354d1d-370d-4029-89b4-4b063cae0a59 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.159084 Sep 13 17:20:56.788282 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3605/7261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:56 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:20:57.811685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:57.812323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:57.820070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:57.820579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:57.821039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:57.821757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:57.822265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:57.822728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:57.958819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:57.966632 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2a644af2-a32f-4d49-a571-108d6fec948f tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.158963 Sep 13 17:20:57.967222 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3657/7262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:57 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:20:58.989659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:20:58.990304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:20:58.997096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:58.997589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:58.998055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:58.998762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:20:58.999226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:20:58.999654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:20:59.142507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:20:59.150384 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b50baa6-8cdd-423e-b904-1629be62ce7a tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.164693 Sep 13 17:20:59.150967 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3606/7263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:20:58 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:00.174497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:00.175168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:00.178098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:00.183026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:00.183536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:00.184001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:00.184732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:00.185208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:00.185658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:00.234818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e0b95989-a631-42b0-b783-6f5ac4f5a5a1 req-cf61c70c-ff0c-4a4e-954d-9ff7963e47e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a30a8e-ba1c-4090-84dd-1adf7b2c1946", "name": "network-vif-plugged", "status": "completed", "tag": "513b5a3c-273a-4b95-9941-dac75705b201"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:21:00.242132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:00.243040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=10 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:00.248786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e0b95989-a631-42b0-b783-6f5ac4f5a5a1 req-cf61c70c-ff0c-4a4e-954d-9ff7963e47e4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:00.249275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e0b95989-a631-42b0-b783-6f5ac4f5a5a1 req-cf61c70c-ff0c-4a4e-954d-9ff7963e47e4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:00.249910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e0b95989-a631-42b0-b783-6f5ac4f5a5a1 req-cf61c70c-ff0c-4a4e-954d-9ff7963e47e4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:00.263042 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e0b95989-a631-42b0-b783-6f5ac4f5a5a1 req-cf61c70c-ff0c-4a4e-954d-9ff7963e47e4 service nova] Creating event network-vif-plugged:513b5a3c-273a-4b95-9941-dac75705b201 for instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 on n-h2-857467-1 Sep 13 17:21:00.268254 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e0b95989-a631-42b0-b783-6f5ac4f5a5a1 req-cf61c70c-ff0c-4a4e-954d-9ff7963e47e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037195 Sep 13 17:21:00.268864 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3607/7264] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:21:00.326303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:00.337368 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b4566ed-9e5e-448b-a331-c8655204ea4d tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.167481 Sep 13 17:21:00.338484 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3658/7265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:00 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:01.362816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:01.363456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:01.369637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:01.370181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:01.370634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:01.371350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:01.371872 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:01.372267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:01.511393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:01.519573 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-177ebe7d-bd84-47e0-993d-99bafa030b72 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1428 microversion: 2.1 time: 0.162702 Sep 13 17:21:01.520182 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3608/7266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:01 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:02.545058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:02.545737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:02.553130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:02.553636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:02.554120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:02.554863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:02.555448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:02.555891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:02.693771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:02.701690 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-48f35dc5-e167-43e0-a12b-5e0f8ce4e9d7 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1608 microversion: 2.1 time: 0.161480 Sep 13 17:21:02.702493 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3659/7267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:02 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1608 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:02.726023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:02.726646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:02.733526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:02.734136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:02.734579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:02.735282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:02.735753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:02.736423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:02.868495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:02.876232 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bd452f5-38f9-4429-8dec-72a7950fe152 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1608 microversion: 2.1 time: 0.154154 Sep 13 17:21:02.876920 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3609/7268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:02 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1608 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:02.898536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:02.899168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:02.905081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:02.905577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:02.906055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:02.906759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:02.907229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:02.907667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:03.042716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:03.050919 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e5770a3-b807-49ec-88f7-6b592274e79e tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1608 microversion: 2.1 time: 0.156307 Sep 13 17:21:03.051792 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3660/7269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:02 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:05.099113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-2e584617-41ff-4d5f-87c2-b9d3a3606ffd req-89435132-d4a0-4813-a8ac-e726bbb6d889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a30a8e-ba1c-4090-84dd-1adf7b2c1946", "tag": "513b5a3c-273a-4b95-9941-dac75705b201"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:21:05.109417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2e584617-41ff-4d5f-87c2-b9d3a3606ffd req-89435132-d4a0-4813-a8ac-e726bbb6d889 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:05.109940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2e584617-41ff-4d5f-87c2-b9d3a3606ffd req-89435132-d4a0-4813-a8ac-e726bbb6d889 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:05.110387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-2e584617-41ff-4d5f-87c2-b9d3a3606ffd req-89435132-d4a0-4813-a8ac-e726bbb6d889 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:05.123438 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-2e584617-41ff-4d5f-87c2-b9d3a3606ffd req-89435132-d4a0-4813-a8ac-e726bbb6d889 service nova] Creating event network-changed:513b5a3c-273a-4b95-9941-dac75705b201 for instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 on n-h2-857467-1 Sep 13 17:21:05.130274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-2e584617-41ff-4d5f-87c2-b9d3a3606ffd req-89435132-d4a0-4813-a8ac-e726bbb6d889 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Sep 13 17:21:05.130933 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3610/7270] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:21:24.676543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:24.677100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:24.678806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ab1cd6fe-d4c9-48d1-85a9-43df2030351f req-e7008b71-f73c-4b61-a262-1110d22c0ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6df2527-7969-46f5-8d00-9e97f6ec4e11", "tag": "4b3e1b07-044f-4e3f-8152-da0cd62aea4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:21:24.679424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:24.680309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=43 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:24.688146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:24.688650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:24.689119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:24.689604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:24.690039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:24.690516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:24.690828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=44 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:21:24.691148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:24.693775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab1cd6fe-d4c9-48d1-85a9-43df2030351f req-e7008b71-f73c-4b61-a262-1110d22c0ad2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:24.694594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab1cd6fe-d4c9-48d1-85a9-43df2030351f req-e7008b71-f73c-4b61-a262-1110d22c0ad2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:24.695523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ab1cd6fe-d4c9-48d1-85a9-43df2030351f req-e7008b71-f73c-4b61-a262-1110d22c0ad2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:24.709027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ab1cd6fe-d4c9-48d1-85a9-43df2030351f req-e7008b71-f73c-4b61-a262-1110d22c0ad2 service nova] Creating event network-changed:4b3e1b07-044f-4e3f-8152-da0cd62aea4b for instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 on n-h1-857467-1 Sep 13 17:21:24.714762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ab1cd6fe-d4c9-48d1-85a9-43df2030351f req-e7008b71-f73c-4b61-a262-1110d22c0ad2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040694 Sep 13 17:21:24.715568 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3611/7271] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:21:24.721238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:21:24.810763 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ecb6730-c16f-48e7-a694-a46c52dfdfca tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 204 len: 0 microversion: 2.1 time: 0.138664 Sep 13 17:21:24.811619 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3661/7272] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:21:24 2022] DELETE /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:21:24.821084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:24.821984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:24.829595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:24.830310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:24.830864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:24.831871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:24.832218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:24.832726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:25.036141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:25.044344 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ef43b31-e118-45a6-9bd7-3f0f732b0a84 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1578 microversion: 2.1 time: 0.227901 Sep 13 17:21:25.044926 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3612/7273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:24 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:21:26.070448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:26.071226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:26.078162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:26.078669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:26.079163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:26.079906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:26.080732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:26.081274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:26.587966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:26.595755 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c17d172b-e20f-46b2-a016-0eb00d311ee3 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1578 microversion: 2.1 time: 0.529978 Sep 13 17:21:26.596339 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3662/7274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:26 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1578 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:27.083685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-76c37acb-3b01-4c22-9053-0c77ed9fb83c req-1c7b6f80-aa01-4f14-a34e-d5a26aa30970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6df2527-7969-46f5-8d00-9e97f6ec4e11", "name": "network-vif-deleted", "tag": "4b3e1b07-044f-4e3f-8152-da0cd62aea4b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:21:27.093756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-76c37acb-3b01-4c22-9053-0c77ed9fb83c req-1c7b6f80-aa01-4f14-a34e-d5a26aa30970 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:27.094203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-76c37acb-3b01-4c22-9053-0c77ed9fb83c req-1c7b6f80-aa01-4f14-a34e-d5a26aa30970 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:27.094636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-76c37acb-3b01-4c22-9053-0c77ed9fb83c req-1c7b6f80-aa01-4f14-a34e-d5a26aa30970 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:27.106199 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-76c37acb-3b01-4c22-9053-0c77ed9fb83c req-1c7b6f80-aa01-4f14-a34e-d5a26aa30970 service nova] Creating event network-vif-deleted:4b3e1b07-044f-4e3f-8152-da0cd62aea4b for instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 on n-h1-857467-1 Sep 13 17:21:27.111585 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-76c37acb-3b01-4c22-9053-0c77ed9fb83c req-1c7b6f80-aa01-4f14-a34e-d5a26aa30970 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032281 Sep 13 17:21:27.112551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3613/7275] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:21:27.620607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:27.621621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:27.629417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:27.630019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:27.630479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:27.631190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:27.631660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:27.632470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:27.700955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:27.709689 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d29309e3-13e3-4411-9dfc-e9c3156bde94 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1226 microversion: 2.1 time: 0.093175 Sep 13 17:21:27.710317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3663/7276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:27 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:28.734146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:28.734865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:28.742499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:28.743002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:28.743451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:28.744168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:28.744642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:28.745077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:28.814459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:28.822739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f95f7f0-06ff-426a-b840-99ac9517f264 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1226 microversion: 2.1 time: 0.093835 Sep 13 17:21:28.823339 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3614/7277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:28 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:29.845854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:29.846673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:29.853644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:29.854180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:29.854650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:29.855349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:29.855824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:29.856271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:29.920437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:29.929297 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-992df72f-1b33-4a98-9725-31cfdb36067f tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1226 microversion: 2.1 time: 0.087638 Sep 13 17:21:29.930098 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3664/7278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:29 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:30.952515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:30.953264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:30.960941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:30.961440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:30.961928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:30.962633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:30.963241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:30.963687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:31.026284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:31.034946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-38149a75-c7fa-4437-b7e5-806781a2a925 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 200 len: 1226 microversion: 2.1 time: 0.086499 Sep 13 17:21:31.035525 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3615/7279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:30 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:32.058655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:32.059285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: b6df2527-7969-46f5-8d00-9e97f6ec4e11] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:32.066797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:32.067300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:32.067754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:32.068495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:32.068965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:32.069408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:32.083586 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 could not be found. Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 HTTP/1.1 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 could not be found. Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b6df2527-7969-46f5-8d00-9e97f6ec4e11'} Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 could not be found. Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 could not be found. Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:32.085245 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 could not be found. Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance b6df2527-7969-46f5-8d00-9e97f6ec4e11 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d01e80a9-f89f-42c2-b781-4fb4b2287750 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11" status: 404 len: 111 microversion: 2.1 time: 0.032214 Sep 13 17:21:32.089734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3665/7280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:32 2022] GET /compute/v2.1/servers/b6df2527-7969-46f5-8d00-9e97f6ec4e11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:21:38.323955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:38.324451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:38.327100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c800aa96-002c-46c7-b14d-1cc60f533f7a req-7eae5b62-22ce-4ab6-8c5b-b01c810a5c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc125b52-69a3-4b93-8a2e-0dd48e6fc929", "tag": "9c450470-e447-4394-b097-81b8f30ca52f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:21:38.332732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:38.333232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:38.333683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:38.334434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:38.334917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:38.335531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:38.340114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c800aa96-002c-46c7-b14d-1cc60f533f7a req-7eae5b62-22ce-4ab6-8c5b-b01c810a5c2b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:38.340794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c800aa96-002c-46c7-b14d-1cc60f533f7a req-7eae5b62-22ce-4ab6-8c5b-b01c810a5c2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:38.341372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c800aa96-002c-46c7-b14d-1cc60f533f7a req-7eae5b62-22ce-4ab6-8c5b-b01c810a5c2b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:38.353787 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c800aa96-002c-46c7-b14d-1cc60f533f7a req-7eae5b62-22ce-4ab6-8c5b-b01c810a5c2b service nova] Creating event network-changed:9c450470-e447-4394-b097-81b8f30ca52f for instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 on n-h2-857467-1 Sep 13 17:21:38.359407 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c800aa96-002c-46c7-b14d-1cc60f533f7a req-7eae5b62-22ce-4ab6-8c5b-b01c810a5c2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036767 Sep 13 17:21:38.360410 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3666/7281] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:21:38.362539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:21:38.448741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79c885cf-708e-42bd-8712-fe9dd96d768e tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 204 len: 0 microversion: 2.1 time: 0.128833 Sep 13 17:21:38.449445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3616/7282] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:21:38 2022] DELETE /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:21:38.461602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:38.462440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:38.469196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:38.469925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:38.470745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:38.471727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:38.472392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:38.472901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:38.624449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:38.633585 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9df82329-970e-41ac-98aa-350b3f8de0ed tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1577 microversion: 2.1 time: 0.178866 Sep 13 17:21:38.634227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3667/7283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:38 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:39.659208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:39.660388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:39.667121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:39.667687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:39.668060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:39.668776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:39.669238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:39.669671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:39.808876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:39.816762 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93e58f99-108c-4ba2-95f4-7d94056aabb8 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1577 microversion: 2.1 time: 0.162915 Sep 13 17:21:39.817337 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3617/7284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:39 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:40.747453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f9da46bb-4fa3-4fc5-b559-5474078add64 req-dca8bceb-d580-4825-9668-eb4fa0bb2a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc125b52-69a3-4b93-8a2e-0dd48e6fc929", "name": "network-vif-deleted", "tag": "9c450470-e447-4394-b097-81b8f30ca52f"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:21:40.759981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9da46bb-4fa3-4fc5-b559-5474078add64 req-dca8bceb-d580-4825-9668-eb4fa0bb2a40 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:40.760486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9da46bb-4fa3-4fc5-b559-5474078add64 req-dca8bceb-d580-4825-9668-eb4fa0bb2a40 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:40.760940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f9da46bb-4fa3-4fc5-b559-5474078add64 req-dca8bceb-d580-4825-9668-eb4fa0bb2a40 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:40.773467 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f9da46bb-4fa3-4fc5-b559-5474078add64 req-dca8bceb-d580-4825-9668-eb4fa0bb2a40 service nova] Creating event network-vif-deleted:9c450470-e447-4394-b097-81b8f30ca52f for instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 on n-h2-857467-1 Sep 13 17:21:40.778581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f9da46bb-4fa3-4fc5-b559-5474078add64 req-dca8bceb-d580-4825-9668-eb4fa0bb2a40 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Sep 13 17:21:40.779212 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3668/7285] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:21:40.840165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:40.840784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:40.847952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:40.848428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:40.848884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:40.849553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:40.850047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:40.850478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:40.917006 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:40.925479 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4eb5e0ee-04ef-4d6e-95b1-0ff83ef1888d tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1226 microversion: 2.1 time: 0.089296 Sep 13 17:21:40.926088 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3618/7286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:40 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:41.950431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:41.951047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:41.957979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:41.958495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:41.958952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:41.959672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:41.960154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:41.960608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:42.025289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:42.033347 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11f261c2-7c07-46e0-a924-07aff8e8421c tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1226 microversion: 2.1 time: 0.088335 Sep 13 17:21:42.033953 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3669/7287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:41 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:43.056752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:43.057772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:43.066415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:43.066933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:43.067385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:43.068112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:43.068584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:43.069025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:43.139499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:43.148856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b37d8e83-2481-4293-9fcc-19f1c1ef87f2 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1226 microversion: 2.1 time: 0.095999 Sep 13 17:21:43.149451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3619/7288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:43 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:44.172936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:44.174287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:44.181434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:44.181973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:44.182431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:44.183143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:44.183769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:44.184208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:44.248883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:44.258400 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d98e20da-f02d-413d-8038-9ce91dcd199b tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1226 microversion: 2.1 time: 0.089343 Sep 13 17:21:44.259182 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3670/7289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:44 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:45.282558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:45.283969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:45.291311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:45.291814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:45.292261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:45.292993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:45.293456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:45.293933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:45.325383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:45.326058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:45.326514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:45.326977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lazy-loading 'fault' on Instance uuid cc125b52-69a3-4b93-8a2e-0dd48e6fc929 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:21:45.370666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d8a5ab87e44d2c945f80e216957463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a317dc3b7f644af8884ca824181ece1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:21:45.379152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3b5eb57-71c6-48df-8690-1a0667276017 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 200 len: 1231 microversion: 2.1 time: 0.100432 Sep 13 17:21:45.379930 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3620/7290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:45 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:21:46.403209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:46.403761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: cc125b52-69a3-4b93-8a2e-0dd48e6fc929] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:46.411559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:46.412096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:46.412587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:46.413574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:46.414094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:46.414548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:46.431512 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 could not be found. Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 HTTP/1.1 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 could not be found. Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'cc125b52-69a3-4b93-8a2e-0dd48e6fc929'} Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 could not be found. Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 could not be found. Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:46.433190 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 could not be found. Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance cc125b52-69a3-4b93-8a2e-0dd48e6fc929 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb4214c7-35dd-4c72-bae6-c68275e14c61 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929" status: 404 len: 111 microversion: 2.1 time: 0.035545 Sep 13 17:21:46.437152 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3671/7291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:46 2022] GET /compute/v2.1/servers/cc125b52-69a3-4b93-8a2e-0dd48e6fc929 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:21:46.878652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:46.879166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:46.886055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:46.886549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:46.886997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:46.887700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:46.888170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:46.888607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:46.902266 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e HTTP/1.1 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e'} Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:21:46.903940 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-85b9cf28-1750-48b7-87d2-f73adde2e300 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 404 len: 111 microversion: 2.1 time: 0.031370 Sep 13 17:21:46.908395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3621/7292] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:21:46 2022] DELETE /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:21:46.914819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:46.915459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] [instance: c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:21:46.921597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:46.922142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:46.922604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:46.923876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:21:46.924356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:21:46.924806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:21:46.938449 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] HTTP exception thrown: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Request method failure captured: Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e HTTP/1.1 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILlStgfvwzj1FMkAidLqSEKR31f9qBSJI519tZ4YazApBaI3ntZWQ1C4XBQo4HnRD3jE65K9706uqm-W036BWJc1ysQsiBT4A-9l-it1r5gHYQ-7TaJne20ymVXRyHJsspC5eOJszBZ1Fszz-yskhbgqNn3hqWmi2L_1Nz0XVsEjYLA Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6a317dc3b7f644af8884ca824181ece1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 6a317dc3b7f644af8884ca824181ece1 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestVolumeBootPattern-1912364324 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 39d8a5ab87e44d2c945f80e216957463 Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestVolumeBootPattern-1912364324-project Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e'} Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:21:46.940673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Returning 404 to user: Instance c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b67cb6cf-14af-4912-81cb-e1912e7b721a tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e" status: 404 len: 111 microversion: 2.1 time: 0.031489 Sep 13 17:21:46.944961 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3672/7293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:21:46 2022] GET /compute/v2.1/servers/c4a0d23c-c1b8-47b6-bbce-c660a2f8ae2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:21:50.371534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6683e9d0-f763-4681-9c03-68b56b1e2149 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] Calling method '.version_select at 0x7fbeb4dbd820>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:21:50.406857 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6683e9d0-f763-4681-9c03-68b56b1e2149 tempest-TestVolumeBootPattern-1912364324 tempest-TestVolumeBootPattern-1912364324-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1395877829" status: 202 len: 0 microversion: 2.1 time: 0.042228 Sep 13 17:21:50.407600 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3622/7294] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Sep 13 17:21:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1395877829 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 17:22:12.022997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:22:12.023526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:22:12.025849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:22:12.026520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:22:12.032679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:22:12.033917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:22:12.034410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:22:12.035133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:22:12.035646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:22:12.036104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:22:12.063621 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e810a56a-2401-4745-a30d-d6312ce5d1ea tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044856 Sep 13 17:22:12.067930 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3673/7295] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Sep 13 17:22:12 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:15.420995 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:26:15.421733 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:26:15.422173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:15.423098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:15.425240 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 17:26:15.425416 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 (ip 10.222.0.61) !!! Sep 13 17:26:15.426403 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:26:15.426555 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 (ip 10.222.0.61) !!! Sep 13 17:26:15.427549 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 17:26:15.427655 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 (ip 10.222.0.61) !!! Sep 13 17:26:15.611941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:15.612453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:15.618615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:15.619104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:15.619549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:15.620249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:15.620724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:15.621156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:15.646952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:26:15.725235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6f27685a-e4c5-424b-9e76-7003b1c26845 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 204 len: 0 microversion: 2.1 time: 0.306720 Sep 13 17:26:15.725887 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3623/7296] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:26:15 2022] DELETE /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 17:26:15.732096 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 17:26:15.733238 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 17:26:15.737046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:15.737668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:15.739660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:15.740324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:15.741721 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 17:26:15.741875 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 (ip 10.222.0.61) !!! Sep 13 17:26:15.743087 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 17:26:15.743202 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 (ip 10.222.0.61) !!! Sep 13 17:26:15.744094 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:26:15.744205 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 (ip 10.222.0.61) !!! Sep 13 17:26:15.755754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:15.756259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:15.756720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:15.757421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:15.757915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:15.758356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:15.895148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:15.902962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff743016-31db-4f94-a5cc-d8e940b24c97 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1733 microversion: 2.1 time: 0.172933 Sep 13 17:26:15.903553 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3674/7297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:15 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:16.927618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:16.928328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:16.945643 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36230. Sep 13 17:26:16.947773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:16.948431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:16.948874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:16.949582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:16.950066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:16.950498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:16.956734 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36228. Sep 13 17:26:17.208540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80aa7b438b94ec09d018e4a7a700cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7464c66005cc41f2bd8ffc9efe028558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:17.216361 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2e8cb8f-259e-4966-b6ba-cac9710d4654 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 200 len: 1733 microversion: 2.1 time: 0.293097 Sep 13 17:26:17.216964 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3624/7298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:16 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 1733 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:17.449995 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36236. Sep 13 17:26:17.454780 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36238. Sep 13 17:26:17.529157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-32c0b60e-3ce1-46a5-9859-d23fdc20aacb req-1e8d8988-b269-410e-a982-3475b05dcaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a30a8e-ba1c-4090-84dd-1adf7b2c1946", "name": "network-vif-deleted", "tag": "513b5a3c-273a-4b95-9941-dac75705b201"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:17.542587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-32c0b60e-3ce1-46a5-9859-d23fdc20aacb req-1e8d8988-b269-410e-a982-3475b05dcaff service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:17.543093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-32c0b60e-3ce1-46a5-9859-d23fdc20aacb req-1e8d8988-b269-410e-a982-3475b05dcaff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:17.543543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-32c0b60e-3ce1-46a5-9859-d23fdc20aacb req-1e8d8988-b269-410e-a982-3475b05dcaff service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:17.555595 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-32c0b60e-3ce1-46a5-9859-d23fdc20aacb req-1e8d8988-b269-410e-a982-3475b05dcaff service nova] Creating event network-vif-deleted:513b5a3c-273a-4b95-9941-dac75705b201 for instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 on n-h2-857467-1 Sep 13 17:26:17.569284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-32c0b60e-3ce1-46a5-9859-d23fdc20aacb req-1e8d8988-b269-410e-a982-3475b05dcaff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135695 Sep 13 17:26:17.570106 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3675/7299] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:18.240784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:18.241414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:18.249485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:18.250083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:18.250480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:18.251199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:18.251664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:18.252101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:18.266977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] HTTP exception thrown: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Request method failure captured: Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 HTTP/1.1 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILvqXWf-FL2ZrRxFphKwQy8iDN7mt-frAHHCaWHdk7iR_l0s9KttF1nFRBXNTCo6kUp37jQ9GGPwLi0Ghc4sdcIpapHJVRjz0q_QmQZg8oQNL0fOPX2tIORIXPM76dik78MX0kAarw8m39b8joUExWQwUKL9jshflKX-1CRY0BTh9wg Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7464c66005cc41f2bd8ffc9efe028558 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7464c66005cc41f2bd8ffc9efe028558 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestServerBasicOps-1176646664-project Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c80aa7b438b94ec09d018e4a7a700cdd Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestServerBasicOps-1176646664-project Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'b0a30a8e-ba1c-4090-84dd-1adf7b2c1946'} Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:18.268937 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Returning 404 to user: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2b2227fc-270a-4fe3-83ce-a367b7cbc976 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 404 len: 111 microversion: 2.1 time: 0.033626 Sep 13 17:26:18.272764 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3625/7300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:18 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:26:18.724740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:18.725351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:18.731671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:18.732424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:18.732933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:18.733722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:18.734234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:18.734685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:18.748066 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] HTTP exception thrown: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Request method failure captured: Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 HTTP/1.1 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjILvqXWf-FL2ZrRxFphKwQy8iDN7mt-frAHHCaWHdk7iR_l0s9KttF1nFRBXNTCo6kUp37jQ9GGPwLi0Ghc4sdcIpapHJVRjz0q_QmQZg8oQNL0fOPX2tIORIXPM76dik78MX0kAarw8m39b8joUExWQwUKL9jshflKX-1CRY0BTh9wg Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 7464c66005cc41f2bd8ffc9efe028558 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 7464c66005cc41f2bd8ffc9efe028558 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestServerBasicOps-1176646664-project Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: c80aa7b438b94ec09d018e4a7a700cdd Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestServerBasicOps-1176646664-project Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b0a30a8e-ba1c-4090-84dd-1adf7b2c1946'} Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:26:18.750139 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Returning 404 to user: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27bf243b-a674-4554-88d2-b7908dd1bae6 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 404 len: 111 microversion: 2.1 time: 0.032729 Sep 13 17:26:18.754264 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3676/7301] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:26:18 2022] DELETE /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:26:18.761479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:18.762142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] [instance: b0a30a8e-ba1c-4090-84dd-1adf7b2c1946] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:18.769050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:18.769536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:18.770117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:18.770815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:18.771274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:18.771700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:18.787566 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] HTTP exception thrown: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Request method failure captured: Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 HTTP/1.1 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjILvqXWf-FL2ZrRxFphKwQy8iDN7mt-frAHHCaWHdk7iR_l0s9KttF1nFRBXNTCo6kUp37jQ9GGPwLi0Ghc4sdcIpapHJVRjz0q_QmQZg8oQNL0fOPX2tIORIXPM76dik78MX0kAarw8m39b8joUExWQwUKL9jshflKX-1CRY0BTh9wg Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 7464c66005cc41f2bd8ffc9efe028558 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7464c66005cc41f2bd8ffc9efe028558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 7464c66005cc41f2bd8ffc9efe028558 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestServerBasicOps-1176646664 Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestServerBasicOps-1176646664-project Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: c80aa7b438b94ec09d018e4a7a700cdd Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestServerBasicOps-1176646664-project Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'b0a30a8e-ba1c-4090-84dd-1adf7b2c1946'} Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:18.789115 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Returning 404 to user: Instance b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:26:18.793424 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bcbe291-2850-40f6-ad4a-37686a9893c5 tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946" status: 404 len: 111 microversion: 2.1 time: 0.032963 Sep 13 17:26:18.794197 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3626/7302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:18 2022] GET /compute/v2.1/servers/b0a30a8e-ba1c-4090-84dd-1adf7b2c1946 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:26:18.955799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e213ee28-9c26-46f0-9653-b723726128af tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] Calling method '.version_select at 0x7fbeb97e3700>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:18.980056 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e213ee28-9c26-46f0-9653-b723726128af tempest-TestServerBasicOps-1176646664 tempest-TestServerBasicOps-1176646664-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-699432440" status: 202 len: 0 microversion: 2.1 time: 0.028317 Sep 13 17:26:18.980734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3677/7303] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 17:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-699432440 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:26:36.898556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:36.899286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:37.011562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1397242864", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:37.253879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] validate_networks() for None {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:26:37.836649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:26:37.837084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:26:37.837562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:26:37.838022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:26:37.838441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:26:37.847705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:37.848194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:37.848639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:37.849376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:37.849856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:37.850295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:37.867479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Getting quotas for project daf3c88ff43442ee96fa7576725a847a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:26:37.873475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Getting quotas for user 9c6e35a28eda40bba5d903886a9586dd and project daf3c88ff43442ee96fa7576725a847a. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:26:37.885875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:26:37.888785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:26:37.937206 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1f6c201-5f7e-48e5-9e9f-be4dc8f0210e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043990 Sep 13 17:26:37.938209 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3627/7304] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:26:37.948260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=10 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:37.949025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:37.953666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-80167fd4-3977-4fe0-80f6-8f3e005ba867 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:37.954354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-80167fd4-3977-4fe0-80f6-8f3e005ba867 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:38.126038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-80167fd4-3977-4fe0-80f6-8f3e005ba867 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:38.133207 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-80167fd4-3977-4fe0-80f6-8f3e005ba867 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1222 microversion: 2.1 time: 0.186877 Sep 13 17:26:38.133772 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3678/7305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:37 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:39.158130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:39.158678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:39.165727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:39.166262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:39.166986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:39.167696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:39.168165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:39.168605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:39.232738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:39.240666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-303020aa-a750-4110-8e91-5e54214f14f4 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1274 microversion: 2.1 time: 0.088097 Sep 13 17:26:39.241484 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3628/7306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:39 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:40.264772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:40.265357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:40.272782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:40.273086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:40.273553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:40.274321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:40.274806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:40.275382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:40.417997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:40.426579 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c490d907-c2d2-4553-8201-22032de52586 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.165824 Sep 13 17:26:40.427158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3679/7307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:40 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:40.900355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-49c8e8b1-3e3c-4d41-922f-b1cd587d431f req-27a4bebc-8a1a-4a3c-85ef-ef07409b0dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee0b169-8cdc-41d0-96a8-0121b419f444", "tag": "c49ae499-c534-4ac0-8dcc-afd0011d9878"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:40.912992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-49c8e8b1-3e3c-4d41-922f-b1cd587d431f req-27a4bebc-8a1a-4a3c-85ef-ef07409b0dbd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:40.913860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-49c8e8b1-3e3c-4d41-922f-b1cd587d431f req-27a4bebc-8a1a-4a3c-85ef-ef07409b0dbd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:40.914487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-49c8e8b1-3e3c-4d41-922f-b1cd587d431f req-27a4bebc-8a1a-4a3c-85ef-ef07409b0dbd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:40.927772 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-49c8e8b1-3e3c-4d41-922f-b1cd587d431f req-27a4bebc-8a1a-4a3c-85ef-ef07409b0dbd service nova] Creating event network-changed:c49ae499-c534-4ac0-8dcc-afd0011d9878 for instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 on n-h1-857467-1 Sep 13 17:26:40.938258 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-49c8e8b1-3e3c-4d41-922f-b1cd587d431f req-27a4bebc-8a1a-4a3c-85ef-ef07409b0dbd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041737 Sep 13 17:26:40.938895 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3629/7308] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:26:41.451735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:41.452365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:41.459277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:41.459758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:41.460213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:41.460921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:41.461397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:41.461865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:41.589810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:41.597632 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2f6dde0-7e92-474d-b007-c56db961893b tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.150541 Sep 13 17:26:41.598237 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3680/7309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:41 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:42.624835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:42.625547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:42.631837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:42.632327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:42.632782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:42.633481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:42.633974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:42.634408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:42.764750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:42.772599 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-34a5c05a-a613-43a6-ad8f-e965f38ac41a tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.153326 Sep 13 17:26:42.773174 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3630/7310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:42 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:43.796375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:43.797013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:43.803901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:43.804412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:43.804869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:43.805588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:43.806099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:43.806550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:43.945502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:43.954212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-327ab4a3-7398-474f-ac24-9ef0713a7cdc tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.162271 Sep 13 17:26:43.954810 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3681/7311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:43 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:44.976763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:44.977497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:44.985222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:44.985719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:44.986199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:44.986906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:44.987374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:44.987814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:45.123718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:45.132024 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee84b5b9-ee9e-451d-a954-607b70816031 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.159307 Sep 13 17:26:45.132736 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3631/7312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:44 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:46.134687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-22aae4bc-96d9-4990-85e1-23140d12e18d req-022e4830-a571-4194-a97a-ae993c453b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee0b169-8cdc-41d0-96a8-0121b419f444", "name": "network-vif-plugged", "status": "completed", "tag": "c49ae499-c534-4ac0-8dcc-afd0011d9878"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:46.144571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-22aae4bc-96d9-4990-85e1-23140d12e18d req-022e4830-a571-4194-a97a-ae993c453b19 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:46.145069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-22aae4bc-96d9-4990-85e1-23140d12e18d req-022e4830-a571-4194-a97a-ae993c453b19 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:46.145523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-22aae4bc-96d9-4990-85e1-23140d12e18d req-022e4830-a571-4194-a97a-ae993c453b19 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:46.157134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:46.157601 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-22aae4bc-96d9-4990-85e1-23140d12e18d req-022e4830-a571-4194-a97a-ae993c453b19 service nova] Creating event network-vif-plugged:c49ae499-c534-4ac0-8dcc-afd0011d9878 for instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 on n-h1-857467-1 Sep 13 17:26:46.157756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:46.162963 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-22aae4bc-96d9-4990-85e1-23140d12e18d req-022e4830-a571-4194-a97a-ae993c453b19 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103930 Sep 13 17:26:46.163868 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3682/7313] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:46.164840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:46.165329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:46.165868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:46.166484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:46.167521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:46.167873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:46.331071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:46.338978 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a1d0ca8-0716-4e34-8258-3ba971317e22 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.186570 Sep 13 17:26:46.339659 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3632/7314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:46 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:26:47.362850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:47.363482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:47.370502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:47.371000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:47.371451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:47.372154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:47.372720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:47.373156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:47.504945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:47.512649 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-281a6dcd-a3bf-4b4b-b063-2b69e669a9be tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1322 microversion: 2.1 time: 0.154133 Sep 13 17:26:47.513738 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3683/7315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:47 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:48.536268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:48.536886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:48.538879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:48.539570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:48.546377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:48.546863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:48.547302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:48.548024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:48.548481 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:48.548910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:48.691824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:48.699602 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e4d9fd11-d8f1-4388-b72f-dbb71d98c507 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1472 microversion: 2.1 time: 0.167615 Sep 13 17:26:48.700178 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3633/7316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:48 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:48.726149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:48.779188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6170656e-9237-465f-9216-6a8c34ef49f8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Calling method '.version_select at 0x7fbeb520bf70>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:48.853386 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6170656e-9237-465f-9216-6a8c34ef49f8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/dd4f47d06f57414e80f27da79c19d868" status: 200 len: 371 microversion: 2.1 time: 0.131852 Sep 13 17:26:48.854010 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3684/7317] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 17:26:48 2022] GET /compute/v2.1/os-quota-sets/dd4f47d06f57414e80f27da79c19d868 => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:48.865953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b4f61489-032d-4c91-9a89-2510dcd67b31 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1933908456", "id": 947677158, "os-flavor-access:is_public": "True"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:48.882766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b4f61489-032d-4c91-9a89-2510dcd67b31 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.020545 Sep 13 17:26:48.883349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3634/7318] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:26:48 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:48.896041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "947677158"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:48.898437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:48.905847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:48.906392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:48.906858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:48.907615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:48.908100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:48.908552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.049765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '77403976514044068b47f01e9806135b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f47d06f57414e80f27da79c19d868', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:49.056158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1933908456 {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:26:49.063830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.064335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.064792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.065549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.066055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.066507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.090683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Getting quotas for project daf3c88ff43442ee96fa7576725a847a. Resources: {'ram', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:26:49.095987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Getting quotas for user 9c6e35a28eda40bba5d903886a9586dd and project daf3c88ff43442ee96fa7576725a847a. Resources: {'ram', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:26:49.109839 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.compute.api [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] ram quota exceeded for dd4f47d06f57414e80f27da79c19d868, tried to resize instance. Sep 13 17:26:49.110411 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Request method failure captured: Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444/action HTTP/1.1 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 38 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL1MBBwBBbCosQ3obffSTHZyZW1b0v2Lvwxs9XUu6tAGOn9O5rNn8wnQr1WZmLTs57r6Jwq-7RMeizU1f7M5qJG2-RbuSnhSW4mq42HTwmUfb5b8ZHF4coKJwKJvcl7yezsh1C8xTuuMb_Y4E5gGoENs2MWGG1bySrM04GD095xXNU4 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: dd4f47d06f57414e80f27da79c19d868 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-944702617 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Role: admin,member,reader Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: admin,member,reader Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersAdminNegativeTestJSON-944702617 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: dd4f47d06f57414e80f27da79c19d868 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-944702617 Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersAdminNegativeTestJSON-944702617-project-admin Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 77403976514044068b47f01e9806135b Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersAdminNegativeTestJSON-944702617-project-admin Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: {"resize": {"flavorRef": "947677158"}} Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '3ee0b169-8cdc-41d0-96a8-0121b419f444', 'body': {'resize': {'flavorRef': '947677158'}}} Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:26:49.112518 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c5c817a-b6af-4ecb-8e01-7d1cec56f5d8 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444/action" status: 403 len: 118 microversion: 2.1 time: 0.221895 Sep 13 17:26:49.117265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3685/7319] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:26:48 2022] POST /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444/action => generated 118 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:26:49.123650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ae28ba7-ba7e-413e-b802-6085dbcdf4a5 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.141124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ae28ba7-ba7e-413e-b802-6085dbcdf4a5 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/947677158" status: 202 len: 0 microversion: 2.1 time: 0.021964 Sep 13 17:26:49.141686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3635/7320] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 17:26:49 2022] DELETE /compute/v2.1/flavors/947677158 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:26:49.149374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-54e04a9c-6cd6-4ad7-8399-ae2df9480189 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.169317 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-54e04a9c-6cd6-4ad7-8399-ae2df9480189 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023411 Sep 13 17:26:49.170112 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3686/7321] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 17:26:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:49.191118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0526cdd-6a96-4274-93a0-3f928d026647 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Calling method '.version_select at 0x7fbeb4df1280>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.261251 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0526cdd-6a96-4274-93a0-3f928d026647 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/dd4f47d06f57414e80f27da79c19d868" status: 200 len: 371 microversion: 2.1 time: 0.073825 Sep 13 17:26:49.261778 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3636/7322] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Sep 13 17:26:49 2022] GET /compute/v2.1/os-quota-sets/dd4f47d06f57414e80f27da79c19d868 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:49.274669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-22e5011b-0fc4-4eea-907d-773b05076c18 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1312842949", "id": 714677932, "os-flavor-access:is_public": "True"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:49.292582 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-22e5011b-0fc4-4eea-907d-773b05076c18 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021899 Sep 13 17:26:49.293177 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3687/7323] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:26:49 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:49.305293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "714677932"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:49.307688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:49.314389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.314868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.315320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.316022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.316489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.316930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.456057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '77403976514044068b47f01e9806135b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4f47d06f57414e80f27da79c19d868', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:49.462358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1312842949 {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:26:49.469098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.469618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.470091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.470835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.471304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.471743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.493478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Getting quotas for project daf3c88ff43442ee96fa7576725a847a. Resources: {'ram', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:26:49.498954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Getting quotas for user 9c6e35a28eda40bba5d903886a9586dd and project daf3c88ff43442ee96fa7576725a847a. Resources: {'ram', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:26:49.510998 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] cores quota exceeded for dd4f47d06f57414e80f27da79c19d868, tried to resize instance. Sep 13 17:26:49.511601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Request method failure captured: Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444/action HTTP/1.1 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 38 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL1MBBwBBbCosQ3obffSTHZyZW1b0v2Lvwxs9XUu6tAGOn9O5rNn8wnQr1WZmLTs57r6Jwq-7RMeizU1f7M5qJG2-RbuSnhSW4mq42HTwmUfb5b8ZHF4coKJwKJvcl7yezsh1C8xTuuMb_Y4E5gGoENs2MWGG1bySrM04GD095xXNU4 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: dd4f47d06f57414e80f27da79c19d868 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-944702617 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Role: admin,member,reader Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: admin,member,reader Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dd4f47d06f57414e80f27da79c19d868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminNegativeTestJSON-944702617 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: dd4f47d06f57414e80f27da79c19d868 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-944702617 Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminNegativeTestJSON-944702617-project-admin Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 77403976514044068b47f01e9806135b Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminNegativeTestJSON-944702617-project-admin Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: {"resize": {"flavorRef": "714677932"}} Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3ee0b169-8cdc-41d0-96a8-0121b419f444', 'body': {'resize': {'flavorRef': '714677932'}}} Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:26:49.514458 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f039d302-62e1-4bd9-8e3e-dd0931d9a518 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444/action" status: 403 len: 113 microversion: 2.1 time: 0.214561 Sep 13 17:26:49.519070 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3637/7324] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:26:49 2022] POST /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444/action => generated 113 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:26:49.527042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-96c88d29-cfbf-4594-96e3-da5a7186c729 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.544555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-96c88d29-cfbf-4594-96e3-da5a7186c729 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/714677932" status: 202 len: 0 microversion: 2.1 time: 0.021212 Sep 13 17:26:49.545410 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3688/7325] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Sep 13 17:26:49 2022] DELETE /compute/v2.1/flavors/714677932 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:26:49.553495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1fd96b5a-b574-4da0-b6db-305910910857 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.574170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1fd96b5a-b574-4da0-b6db-305910910857 tempest-ServersAdminNegativeTestJSON-944702617 tempest-ServersAdminNegativeTestJSON-944702617-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024437 Sep 13 17:26:49.574743 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3638/7326] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Sep 13 17:26:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:49.596137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.596657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:49.602669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.603177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.603640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.604344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.604821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.605262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.633605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:26:49.708838 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f91e0b04-8553-4e4e-b44f-cd3fad4832ab tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 204 len: 0 microversion: 2.1 time: 0.116174 Sep 13 17:26:49.709690 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3689/7327] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:26:49 2022] DELETE /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 17:26:49.718788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:49.719419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:49.725483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.726049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.726507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.727219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:49.727691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:49.728133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:49.859341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:49.867149 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f62e90d-ec6b-4d1f-9f06-118c3ca17175 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1478 microversion: 2.1 time: 0.152941 Sep 13 17:26:49.867723 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3639/7328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:49 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1478 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:50.892504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:50.893218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:50.900117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:50.900621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:50.901075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:50.901782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:50.902285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:50.902728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:51.039205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:51.047900 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cb763273-17ea-4727-81a0-851a55dd3b2f tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1478 microversion: 2.1 time: 0.160506 Sep 13 17:26:51.048492 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3690/7329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:50 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:51.742586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-22f0a30a-e03d-4aa9-b428-69e4f950e38a req-f2e7a814-6b5c-4132-8a3c-92154d91a551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee0b169-8cdc-41d0-96a8-0121b419f444", "name": "network-vif-deleted", "tag": "c49ae499-c534-4ac0-8dcc-afd0011d9878"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:51.755609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22f0a30a-e03d-4aa9-b428-69e4f950e38a req-f2e7a814-6b5c-4132-8a3c-92154d91a551 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:51.756256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22f0a30a-e03d-4aa9-b428-69e4f950e38a req-f2e7a814-6b5c-4132-8a3c-92154d91a551 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:51.757370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22f0a30a-e03d-4aa9-b428-69e4f950e38a req-f2e7a814-6b5c-4132-8a3c-92154d91a551 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:51.770385 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-22f0a30a-e03d-4aa9-b428-69e4f950e38a req-f2e7a814-6b5c-4132-8a3c-92154d91a551 service nova] Creating event network-vif-deleted:c49ae499-c534-4ac0-8dcc-afd0011d9878 for instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 on n-h1-857467-1 Sep 13 17:26:51.775749 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-22f0a30a-e03d-4aa9-b428-69e4f950e38a req-f2e7a814-6b5c-4132-8a3c-92154d91a551 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037177 Sep 13 17:26:51.776849 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3640/7330] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:26:52.071734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:52.072369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:52.080096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:52.080598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:52.081055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:52.081768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:52.082275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:52.082724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:52.112816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:52.113312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:52.113771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:52.114260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lazy-loading 'fault' on Instance uuid 3ee0b169-8cdc-41d0-96a8-0121b419f444 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:26:52.155186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6e35a28eda40bba5d903886a9586dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daf3c88ff43442ee96fa7576725a847a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:26:52.163457 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-232aec44-590f-43d3-aafb-db455116487e tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 200 len: 1312 microversion: 2.1 time: 0.095651 Sep 13 17:26:52.164049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3691/7331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:52 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:26:53.188244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:26:53.188957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] [instance: 3ee0b169-8cdc-41d0-96a8-0121b419f444] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:26:53.195294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:53.195787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:53.196249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:53.196949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:53.197420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:53.197883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:53.213027 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] HTTP exception thrown: Instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 could not be found. Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Request method failure captured: Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 HTTP/1.1 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL1M7h5bom1tEyDwLQrpzUTqPlfuq_GIISzc4BZlBFWWC7KE58evezncrmMuf-8twJOQrsYwdFrgYvYb3DlkUWjsbqNkAmtseVJ7QJxZuLLxndshCcEbuiXRkeeujQxNP8Ix7BiQolKjog5jqDbF_lUCFio6ixPZJO5MSVdVKphxVoM Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: daf3c88ff43442ee96fa7576725a847a Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-414167105 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/daf3c88ff43442ee96fa7576725a847a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_daf3c88ff43442ee96fa7576725a847a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/daf3c88ff43442ee96fa7576725a847a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/daf3c88ff43442ee96fa7576725a847a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersAdminNegativeTestJSON-414167105 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: daf3c88ff43442ee96fa7576725a847a Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-414167105 Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersAdminNegativeTestJSON-414167105-project Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 9c6e35a28eda40bba5d903886a9586dd Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersAdminNegativeTestJSON-414167105-project Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 could not be found. Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3ee0b169-8cdc-41d0-96a8-0121b419f444'} Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 could not be found. Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 could not be found. Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:53.214673 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 could not be found. Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] Returning 404 to user: Instance 3ee0b169-8cdc-41d0-96a8-0121b419f444 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-29a85f9a-ecd3-4839-963d-cbe67fc07882 tempest-ServersAdminNegativeTestJSON-414167105 tempest-ServersAdminNegativeTestJSON-414167105-project] 10.222.0.61 "GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444" status: 404 len: 111 microversion: 2.1 time: 0.033109 Sep 13 17:26:53.218793 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3641/7332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:26:53 2022] GET /compute/v2.1/servers/3ee0b169-8cdc-41d0-96a8-0121b419f444 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:26:59.327417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:59.328274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:26:59.458257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1094700361", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "87550d37-f7af-4218-8ae3-c55afcbb51f3"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:26:59.516343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] validate_networks() for [('87550d37-f7af-4218-8ae3-c55afcbb51f3', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:26:59.933634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:26:59.934183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:26:59.935333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:26:59.936004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:26:59.936491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:26:59.946025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:59.946692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:59.947158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:59.947928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:26:59.948438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:26:59.948887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:26:59.967810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Getting quotas for project a1827c312da74bf6a4dd29dc8c5f9363. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:26:59.973358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Getting quotas for user ccd8d24c2d1d4b2bb66b8e4c2ba7b90e and project a1827c312da74bf6a4dd29dc8c5f9363. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:26:59.986953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:26:59.989332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:27:00.039104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1227906a-0e9a-45d9-a9e0-cce6eb8b922d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717223 Sep 13 17:27:00.039776 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3692/7333] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:26:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:27:00.051666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5aac457d-72c1-4fda-9b27-ecae0342e937 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:00.053018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5aac457d-72c1-4fda-9b27-ecae0342e937 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:00.056876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:00.057916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:00.116531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5aac457d-72c1-4fda-9b27-ecae0342e937 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:00.127249 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5aac457d-72c1-4fda-9b27-ecae0342e937 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1215 microversion: 2.1 time: 0.079738 Sep 13 17:27:00.127842 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3642/7334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:00 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:01.155167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e55fb37-95d9-4402-a2a2-a774902be870 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:01.155751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e55fb37-95d9-4402-a2a2-a774902be870 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:01.214127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e55fb37-95d9-4402-a2a2-a774902be870 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:01.221527 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e55fb37-95d9-4402-a2a2-a774902be870 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1215 microversion: 2.1 time: 0.071533 Sep 13 17:27:01.222152 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3693/7335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:01 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:02.244537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e547602-a532-4ff7-8b89-5982d6d42aa9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:02.245163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e547602-a532-4ff7-8b89-5982d6d42aa9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:02.309428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4e547602-a532-4ff7-8b89-5982d6d42aa9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:02.318739 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e547602-a532-4ff7-8b89-5982d6d42aa9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1215 microversion: 2.1 time: 0.078003 Sep 13 17:27:02.319381 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3643/7336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:02 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:03.343215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee20073d-8c68-4578-8b28-e7de911afdd4 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:03.343844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee20073d-8c68-4578-8b28-e7de911afdd4 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:03.400702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee20073d-8c68-4578-8b28-e7de911afdd4 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:03.408964 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee20073d-8c68-4578-8b28-e7de911afdd4 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1215 microversion: 2.1 time: 0.070344 Sep 13 17:27:03.409545 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3694/7337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:03 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:04.432655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:04.433225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:04.435905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=57 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:04.442499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:04.442992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:04.443437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:04.444140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:04.444603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:04.445082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:04.510629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:04.518361 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-28ace50b-e4e3-47ec-8510-318ae17d0314 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1219 microversion: 2.1 time: 0.089686 Sep 13 17:27:04.518973 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3644/7338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:04 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:05.541091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:05.541727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:05.549599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:05.550136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:05.550589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:05.551301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:05.551774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:05.552214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:05.624064 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:05.631998 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f0984b3c-2773-4bc0-a1ff-170ba20df4a0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1273 microversion: 2.1 time: 0.094802 Sep 13 17:27:05.632651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3695/7339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:05 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:06.656424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:06.657079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:06.663966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:06.664579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:06.665029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:06.665737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:06.666234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:06.666758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:06.892491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:06.900345 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4c8cbfc3-d7f4-45b1-a07d-d515dc11ed4c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1315 microversion: 2.1 time: 0.248251 Sep 13 17:27:06.900940 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3645/7340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:06 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:07.044906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-661cdaf6-20d4-40c8-94d8-151ac97f5232 req-e223b512-566d-4f2f-a76a-f487fd6519fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790321f5-d72a-4b92-b01f-a6af29570c21", "tag": "7aea6f7d-b871-4d59-87e2-2421abbf89dc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:07.056065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-661cdaf6-20d4-40c8-94d8-151ac97f5232 req-e223b512-566d-4f2f-a76a-f487fd6519fa service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:07.056569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-661cdaf6-20d4-40c8-94d8-151ac97f5232 req-e223b512-566d-4f2f-a76a-f487fd6519fa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:07.057352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-661cdaf6-20d4-40c8-94d8-151ac97f5232 req-e223b512-566d-4f2f-a76a-f487fd6519fa service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:07.070012 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-661cdaf6-20d4-40c8-94d8-151ac97f5232 req-e223b512-566d-4f2f-a76a-f487fd6519fa service nova] Creating event network-changed:7aea6f7d-b871-4d59-87e2-2421abbf89dc for instance 790321f5-d72a-4b92-b01f-a6af29570c21 on n-h1-857467-1 Sep 13 17:27:07.074835 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-661cdaf6-20d4-40c8-94d8-151ac97f5232 req-e223b512-566d-4f2f-a76a-f487fd6519fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034314 Sep 13 17:27:07.075453 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3696/7341] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:27:07.925118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:07.925738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:07.928479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:07.934243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:07.934737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:07.935694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:07.936414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:07.936880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:07.937321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:08.072052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:08.080018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6f6c7b9c-e9f2-46d0-9b1e-a27150de349d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1315 microversion: 2.1 time: 0.158804 Sep 13 17:27:08.080649 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3646/7342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:07 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:09.104977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:09.105698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:09.108321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:09.116306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:09.116564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:09.117113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:09.117859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:09.118338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:09.118784 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:09.125733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:09.259007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:09.266776 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dc263163-9543-4cd5-b993-99ca28bd0382 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1315 microversion: 2.1 time: 0.166979 Sep 13 17:27:09.267369 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3697/7343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:09 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:10.290570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:10.291153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:10.299189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:10.299684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:10.300135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:10.300842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:10.301311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:10.301754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:10.435092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:10.444746 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ee0b721-e141-4381-9b4c-4d1281fd8cb0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1315 microversion: 2.1 time: 0.158056 Sep 13 17:27:10.445793 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3647/7344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:10 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:11.469387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:11.470069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:11.471948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:11.479592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:11.480366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:11.481112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:11.481820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:11.482387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:11.482840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:11.614881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:11.623170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0a39641-b27c-457e-8742-39c1592a65f0 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1315 microversion: 2.1 time: 0.158144 Sep 13 17:27:11.624072 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3698/7345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:11 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:12.219935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c76045a0-1f1e-4aeb-b11e-39a9ba0cc582 req-39856aef-6cd9-4e3f-88ed-0e74ca712a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790321f5-d72a-4b92-b01f-a6af29570c21", "name": "network-vif-plugged", "status": "completed", "tag": "7aea6f7d-b871-4d59-87e2-2421abbf89dc"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:12.231185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c76045a0-1f1e-4aeb-b11e-39a9ba0cc582 req-39856aef-6cd9-4e3f-88ed-0e74ca712a98 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:12.231859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c76045a0-1f1e-4aeb-b11e-39a9ba0cc582 req-39856aef-6cd9-4e3f-88ed-0e74ca712a98 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:12.232856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c76045a0-1f1e-4aeb-b11e-39a9ba0cc582 req-39856aef-6cd9-4e3f-88ed-0e74ca712a98 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:12.244572 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c76045a0-1f1e-4aeb-b11e-39a9ba0cc582 req-39856aef-6cd9-4e3f-88ed-0e74ca712a98 service nova] Creating event network-vif-plugged:7aea6f7d-b871-4d59-87e2-2421abbf89dc for instance 790321f5-d72a-4b92-b01f-a6af29570c21 on n-h1-857467-1 Sep 13 17:27:12.250287 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c76045a0-1f1e-4aeb-b11e-39a9ba0cc582 req-39856aef-6cd9-4e3f-88ed-0e74ca712a98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Sep 13 17:27:12.250895 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3648/7346] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:27:12.647277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:12.647855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:12.655501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:12.655999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:12.656453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:12.657161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:12.657677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:12.658149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:12.787078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:12.796045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67501331-f054-44d6-89d3-4f5a9a2e541a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1315 microversion: 2.1 time: 0.152584 Sep 13 17:27:12.796747 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3699/7347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:12 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:13.819815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:13.824887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:13.825587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:13.832876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:13.833372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:13.833821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:13.834554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:13.835022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:13.835462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:13.972570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:13.980338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eafec5b1-5281-4b2e-b4e7-6ff660d30ad3 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1501 microversion: 2.1 time: 0.161460 Sep 13 17:27:13.980908 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3649/7348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:13 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:14.004185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:14.006507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:14.008363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=10 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:14.015349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:14.015845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:14.016295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:14.016998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:14.017465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:14.017932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:14.093456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:14.098889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Old instance type m1.heat2, new instance type m1.heat {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:27:14.105234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:27:14.105667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:27:14.106177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:27:14.106597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:27:14.107675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:27:14.217294 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94905498-e196-4f59-846f-d3faadc1f804 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "POST /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21/action" status: 202 len: 0 microversion: 2.1 time: 0.216306 Sep 13 17:27:14.217958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3700/7349] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:27:13 2022] POST /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:27:14.226322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:14.227037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:14.233527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:14.234130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:14.234644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:14.235359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:14.235827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:14.236268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:14.415166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:14.424609 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e848cafc-b002-4cf1-b1d2-4989cb73184a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1510 microversion: 2.1 time: 0.202317 Sep 13 17:27:14.425197 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3650/7350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:14 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:15.449264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:15.450001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:15.456761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:15.457263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:15.457714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:15.458440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:15.458914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:15.459381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:15.598402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:15.606077 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4605f3cb-8ef0-4c9c-bfe3-ae08f6ef5fc8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1510 microversion: 2.1 time: 0.161480 Sep 13 17:27:15.606650 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3701/7351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:15 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:16.630268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:16.630928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:16.637911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:16.639082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:16.639504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:16.640211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:16.640680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:16.641119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:16.773084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:16.781588 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d48b767-69c3-4065-af17-f895d9a32487 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.155258 Sep 13 17:27:16.782204 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3651/7352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:16 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:17.806049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:17.806699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:17.812841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:17.813379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:17.813805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:17.814556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:17.815034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:17.815582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:17.945539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:17.953497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-371dc3d5-7c8e-4cf8-be85-657b0cb66d20 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.152191 Sep 13 17:27:17.954129 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3702/7353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:17 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:18.976916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:18.977570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:18.984095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:18.984580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:18.985022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:18.985713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:18.986209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:18.986644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:19.120913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:19.129253 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cb8f6264-d2d4-4f9f-8e3c-e832e4077309 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.156210 Sep 13 17:27:19.129841 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3652/7354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:18 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:20.152747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:20.153381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:20.160836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:20.161335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:20.161789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:20.162518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:20.162990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:20.163433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:20.292595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:20.300416 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6e7bce43-3322-4582-a9bb-37ec88a927cc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.151536 Sep 13 17:27:20.301001 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3703/7355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:20 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:21.324262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:21.324885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:21.332727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:21.333210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:21.333647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:21.334366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:21.334826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:21.335253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:21.467660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:21.475530 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c5eaaf3-0468-4400-99b0-918453a9cfc5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.155333 Sep 13 17:27:21.476097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3653/7356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:21 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:22.499043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:22.499682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:22.506804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:22.507331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:22.507786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:22.508492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:22.508991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:22.509463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:22.645736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:22.653478 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dd86cb54-3111-41cd-8de0-92596d58e6b9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.159302 Sep 13 17:27:22.654325 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3704/7357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:22 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:23.676605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:23.677228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:23.684066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:23.684550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:23.685570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:23.686344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:23.686803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:23.687239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:23.819653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:23.828279 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9c3aaa1-e80f-4993-bc27-8e585da629c7 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.155629 Sep 13 17:27:23.828870 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3654/7358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:23 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:24.851796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:24.852391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:24.860048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:24.860635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:24.861304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:24.862145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:24.862776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:24.863564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:24.996072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:25.003767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e46bac1b-ece4-4d55-b593-7cb4db46e47e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.156056 Sep 13 17:27:25.004354 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3705/7359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:24 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:26.027832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:26.028443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:26.036032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:26.036522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:26.036964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:26.037659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:26.038143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:26.038577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:26.173846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:26.181623 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aa628791-5b48-4c79-b3d0-29ce7eeb8fa1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.157687 Sep 13 17:27:26.182249 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3655/7360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:26 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:27.205294 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:27.205969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:27.212838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:27.213346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:27.213803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:27.214540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:27.215020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:27.215468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:27.349361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:27.357942 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-93f9ab1f-c33e-4f4a-994e-0a33637afc7b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.155857 Sep 13 17:27:27.358527 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3706/7361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:27 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:28.381089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:28.381711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:28.389422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:28.389929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:28.390368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:28.391060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:28.391520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:28.391950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:28.521296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:28.529262 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c605c05-abdd-4c4e-a395-25806523c94f tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.152078 Sep 13 17:27:28.529862 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3656/7362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:28 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:29.553058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:29.553694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:29.560477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:29.560976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:29.561435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:29.562433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:29.562911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:29.563350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:29.695750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:29.703921 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7ad569cf-f07c-4520-b36b-75d2154420d5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.154771 Sep 13 17:27:29.704507 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3707/7363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:29 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:30.729667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:30.730297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:30.737238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:30.737728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:30.738196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:30.738910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:30.739370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:30.739800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:30.875319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:30.884806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66f2a41b-8944-4259-961e-28d762be8416 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.159041 Sep 13 17:27:30.885386 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3657/7364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:30 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:31.909639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:31.910300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:31.917438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:31.917978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:31.918434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:31.919761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:31.920275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:31.920789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:32.053083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:32.061267 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fa9afa14-4c79-4f0b-ae99-ab8795c9f659 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.155461 Sep 13 17:27:32.061881 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3708/7365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:31 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:33.084876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:33.085676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:33.092903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:33.093394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:33.093860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:33.094568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:33.095033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:33.095471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:33.227482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:33.235947 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e33fa3fe-3f3c-4dfe-8b11-98365cce17ac tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.155247 Sep 13 17:27:33.236533 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3658/7366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:33 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:34.260989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:34.261627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:34.269237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:34.269747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:34.270237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:34.270950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:34.271429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:34.271880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:34.400822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:34.408753 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6e852ba-70e4-4e0d-86ba-c491ea4b0f7e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.151732 Sep 13 17:27:34.409325 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3709/7367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:34 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:35.433167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:35.433707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:35.440604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:35.441091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:35.441531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:35.442261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:35.442722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:35.443154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:35.447086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=87 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:35.573485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:35.581912 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2c5e63ec-3d36-44b8-97fc-fd119021f6d1 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.153013 Sep 13 17:27:35.582494 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3659/7368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:35 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:36.604644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:36.605272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:36.612995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:36.613506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:36.613994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:36.614702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:36.615175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:36.615646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:36.746017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:36.754064 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed80815f-89a8-4df0-8130-92c32945e6f5 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.153321 Sep 13 17:27:36.754647 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3710/7369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:36 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:37.777662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:37.778314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:37.785982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:37.786471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:37.786935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:37.787669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:37.788133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:37.788567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:37.927887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:37.935896 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f865f09-ebaa-4b89-8e7d-6ed67ce1d59c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.162224 Sep 13 17:27:37.936476 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3660/7370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:37 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:38.958886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:38.959402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:38.966567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:38.967076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:38.967563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:38.968273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:38.968751 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:38.969197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:39.107919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:39.115672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2ca4b29-d7ea-4fc7-8e16-bae03c86097a tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.160754 Sep 13 17:27:39.116267 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3711/7371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:38 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:40.139465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:40.140115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:40.142850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=30 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:40.148124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:40.148610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:40.149049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:40.149741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:40.150232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:40.150664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:40.279422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:40.287351 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4e252ed0-29b7-4a10-8bd6-c62970a8ed8d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.152613 Sep 13 17:27:40.287938 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3661/7372] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:40 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:41.313057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:41.313594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:41.316295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=34 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:41.321567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:41.322086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:41.322539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:41.323244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:41.323719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:41.324155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:41.328418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:27:41.454231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:41.462345 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f992b75a-1e09-4767-9aa6-0f6ec3f4f8d8 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.153665 Sep 13 17:27:41.462933 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3712/7373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:41 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:42.486377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:42.486994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:42.493861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:42.494354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:42.494795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:42.495490 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:42.495952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:42.496384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:42.635343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:42.643848 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-754f2251-cfb9-4cf0-8734-b53e4f2c840c tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1515 microversion: 2.1 time: 0.162141 Sep 13 17:27:42.644430 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3662/7374] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:42 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:27:43.668558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:43.669965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:43.676732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:43.677250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:43.677711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:43.678467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:43.678948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:43.679397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:43.818950 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:43.827052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0363d94b-72e6-4c90-82fa-a07b1b575560 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1514 microversion: 2.1 time: 0.162733 Sep 13 17:27:43.827661 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3713/7375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:43 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:43.839824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790321f5-d72a-4b92-b01f-a6af29570c21", "name": "network-vif-unplugged", "status": "completed", "tag": "7aea6f7d-b871-4d59-87e2-2421abbf89dc"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:43.853054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:43.853537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:43.854144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:43.866915 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] Creating event network-vif-unplugged:7aea6f7d-b871-4d59-87e2-2421abbf89dc for instance 790321f5-d72a-4b92-b01f-a6af29570c21 on n-h2-857467-1 Sep 13 17:27:43.872345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] Instance 790321f5-d72a-4b92-b01f-a6af29570c21 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:27:43.884768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9aba9e03-bfda-4ca8-8fea-4814ae270b35 req-9f4599e3-3bb0-4790-955e-7842d99a9467 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048899 Sep 13 17:27:43.885385 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3663/7376] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:27:44.851938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:44.852652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:44.860621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:44.861126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:44.861584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:44.862325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:44.862799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:44.863244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:45.000454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:45.008438 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2945c5aa-1e80-4e02-8e5f-51decf0cf5fc tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1512 microversion: 2.1 time: 0.160533 Sep 13 17:27:45.009029 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3714/7377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:44 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:45.910974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790321f5-d72a-4b92-b01f-a6af29570c21", "tag": "7aea6f7d-b871-4d59-87e2-2421abbf89dc"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:45.921563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:45.922074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:45.922513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:45.933731 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] Creating event network-changed:7aea6f7d-b871-4d59-87e2-2421abbf89dc for instance 790321f5-d72a-4b92-b01f-a6af29570c21 on n-h2-857467-1 Sep 13 17:27:45.939362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] Instance 790321f5-d72a-4b92-b01f-a6af29570c21 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:27:45.949736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-33f12397-fe08-4532-ab2c-26dc1f41ed9a req-cca9426f-0385-41e0-9e05-e3970f02569f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042777 Sep 13 17:27:45.951065 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3664/7378] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:27:46.033034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:46.033785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:46.041211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:46.041718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:46.042467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:46.043172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:46.043672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:46.044204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:46.179395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:46.188265 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-50e93602-340a-4457-b9d9-541f8fd2ad68 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1512 microversion: 2.1 time: 0.159696 Sep 13 17:27:46.188864 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3715/7379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:46 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:47.213761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:47.214566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:47.221385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:47.221904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:47.222374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:47.223170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:47.223517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:47.223944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:47.442763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:47.450556 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f709c094-ba82-48ee-9e68-068a51b8460b tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1512 microversion: 2.1 time: 0.241971 Sep 13 17:27:47.451243 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3665/7380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:47 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:48.473626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:48.474279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:48.482146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:48.482833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:48.483532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:48.484284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:48.485139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:48.485752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:48.624452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:48.632153 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-91ea9274-f649-4a0f-a34e-c00a0a0e9def tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1509 microversion: 2.1 time: 0.162444 Sep 13 17:27:48.632734 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3716/7381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:48 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:48.657058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:48.657685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:48.665126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:48.665633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:48.666107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:48.666839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:48.667580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:48.668019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:48.696940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:27:48.752405 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.compute.api [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Found an unconfirmed migration during delete, id: 16, status: finished Sep 13 17:27:50.202372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790321f5-d72a-4b92-b01f-a6af29570c21", "name": "network-vif-plugged", "status": "completed", "tag": "7aea6f7d-b871-4d59-87e2-2421abbf89dc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:50.213969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:50.214477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:50.214938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:50.227369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] Creating event network-vif-plugged:7aea6f7d-b871-4d59-87e2-2421abbf89dc for instance 790321f5-d72a-4b92-b01f-a6af29570c21 on n-h2-857467-1 Sep 13 17:27:50.233694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] Instance 790321f5-d72a-4b92-b01f-a6af29570c21 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:27:50.244815 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-79384c20-c175-40da-b52e-dd4578155c9f req-aa8d6dd0-b790-4ef2-bd4d-5c6929687d15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046380 Sep 13 17:27:50.246249 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3717/7382] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:27:50.575411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9ef3a1ab-e86a-46ba-ad53-916c7793660e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "DELETE /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 204 len: 0 microversion: 2.1 time: 1.922712 Sep 13 17:27:50.576371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3666/7383] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:27:48 2022] DELETE /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 0 bytes in 1924 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:27:50.585001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:50.585710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:50.592548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:50.593043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:50.593488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:50.594217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:50.594686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:50.595132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:50.730514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:50.739242 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be50af4d-5eeb-4943-abb9-863cea239173 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1501 microversion: 2.1 time: 0.158626 Sep 13 17:27:50.739827 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3718/7384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:50 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:51.764034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:51.765535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:51.773220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:51.773717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:51.774192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:51.774928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:51.775393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:51.775932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:51.910891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd8d24c2d1d4b2bb66b8e4c2ba7b90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1827c312da74bf6a4dd29dc8c5f9363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:27:51.920187 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b56afa37-b8c3-4174-b2f1-b4fec7a84627 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 200 len: 1501 microversion: 2.1 time: 0.161310 Sep 13 17:27:51.920778 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3667/7385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:51 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:27:52.623275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f6805a8d-59f5-45ce-b764-6dacdeacca8a req-590fb2eb-2f61-402c-a505-946f3e278f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790321f5-d72a-4b92-b01f-a6af29570c21", "name": "network-vif-deleted", "tag": "7aea6f7d-b871-4d59-87e2-2421abbf89dc"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:27:52.639584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6805a8d-59f5-45ce-b764-6dacdeacca8a req-590fb2eb-2f61-402c-a505-946f3e278f43 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:52.640805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6805a8d-59f5-45ce-b764-6dacdeacca8a req-590fb2eb-2f61-402c-a505-946f3e278f43 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:52.641298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f6805a8d-59f5-45ce-b764-6dacdeacca8a req-590fb2eb-2f61-402c-a505-946f3e278f43 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:52.654011 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f6805a8d-59f5-45ce-b764-6dacdeacca8a req-590fb2eb-2f61-402c-a505-946f3e278f43 service nova] Creating event network-vif-deleted:7aea6f7d-b871-4d59-87e2-2421abbf89dc for instance 790321f5-d72a-4b92-b01f-a6af29570c21 on n-h2-857467-1 Sep 13 17:27:52.659721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f6805a8d-59f5-45ce-b764-6dacdeacca8a req-590fb2eb-2f61-402c-a505-946f3e278f43 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041246 Sep 13 17:27:52.660624 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3719/7386] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:27:52.943855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:52.944405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:52.951297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:52.951860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:52.952236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:52.952941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:52.953408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:52.953865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:52.968093 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] HTTP exception thrown: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Request method failure captured: Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 HTTP/1.1 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL1j_8s2sb48v6xNIc_vUfkGasMjcFrizmh1ZMe3n_XgSnTn72oAzO_F9wtWq17GDDNxK1NHyv7-3aLYa8nzzkB4m0GxoEefB54ulawdcq1Xp5SqpaAjNdJyU2FhqpH8a5-F3d9A6XvV5LCXrZbPxFBeuJD7yui3M5aqaneS_LqlIiI Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a1827c312da74bf6a4dd29dc8c5f9363 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a1827c312da74bf6a4dd29dc8c5f9363 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1237218603-project Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ccd8d24c2d1d4b2bb66b8e4c2ba7b90e Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1237218603-project Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '790321f5-d72a-4b92-b01f-a6af29570c21'} Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:27:52.969762 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Returning 404 to user: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5187dfe6-985d-4695-8726-b44ccc4cfd8e tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 404 len: 111 microversion: 2.1 time: 0.031423 Sep 13 17:27:52.974759 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3668/7387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:52 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:27:52.988424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:52.989112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:52.995431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:52.995944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:52.996408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:52.997162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:52.997655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:52.998131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:53.011339 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] HTTP exception thrown: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Request method failure captured: Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 HTTP/1.1 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL1j_8s2sb48v6xNIc_vUfkGasMjcFrizmh1ZMe3n_XgSnTn72oAzO_F9wtWq17GDDNxK1NHyv7-3aLYa8nzzkB4m0GxoEefB54ulawdcq1Xp5SqpaAjNdJyU2FhqpH8a5-F3d9A6XvV5LCXrZbPxFBeuJD7yui3M5aqaneS_LqlIiI Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: a1827c312da74bf6a4dd29dc8c5f9363 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: a1827c312da74bf6a4dd29dc8c5f9363 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-DeleteServersTestJSON-1237218603-project Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: ccd8d24c2d1d4b2bb66b8e4c2ba7b90e Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-DeleteServersTestJSON-1237218603-project Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '790321f5-d72a-4b92-b01f-a6af29570c21'} Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:27:53.013057 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Returning 404 to user: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1edd9db2-720f-4c19-9f5e-97908842a36d tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "DELETE /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 404 len: 111 microversion: 2.1 time: 0.030422 Sep 13 17:27:53.017616 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3720/7388] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:27:52 2022] DELETE /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:27:53.023081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:27:53.023732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] [instance: 790321f5-d72a-4b92-b01f-a6af29570c21] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:27:53.030668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:53.031152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:53.031595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:53.032282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:27:53.032798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:27:53.033229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:27:53.047643 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] HTTP exception thrown: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Request method failure captured: Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 HTTP/1.1 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL1j_8s2sb48v6xNIc_vUfkGasMjcFrizmh1ZMe3n_XgSnTn72oAzO_F9wtWq17GDDNxK1NHyv7-3aLYa8nzzkB4m0GxoEefB54ulawdcq1Xp5SqpaAjNdJyU2FhqpH8a5-F3d9A6XvV5LCXrZbPxFBeuJD7yui3M5aqaneS_LqlIiI Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: a1827c312da74bf6a4dd29dc8c5f9363 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a1827c312da74bf6a4dd29dc8c5f9363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: a1827c312da74bf6a4dd29dc8c5f9363 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-DeleteServersTestJSON-1237218603 Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-DeleteServersTestJSON-1237218603-project Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: ccd8d24c2d1d4b2bb66b8e4c2ba7b90e Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-DeleteServersTestJSON-1237218603-project Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '790321f5-d72a-4b92-b01f-a6af29570c21'} Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:27:53.049152 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] Returning 404 to user: Instance 790321f5-d72a-4b92-b01f-a6af29570c21 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e69c439-c150-4c33-bc6e-c290a0081af9 tempest-DeleteServersTestJSON-1237218603 tempest-DeleteServersTestJSON-1237218603-project] 10.222.0.61 "GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21" status: 404 len: 111 microversion: 2.1 time: 0.031377 Sep 13 17:27:53.054191 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3669/7389] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:27:53 2022] GET /compute/v2.1/servers/790321f5-d72a-4b92-b01f-a6af29570c21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:28:01.472156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1114077972", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "2fa9d6ba-27f6-4ef7-ba97-998c94ab1ea9"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:01.534004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] validate_networks() for [('2fa9d6ba-27f6-4ef7-ba97-998c94ab1ea9', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:28:01.931467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:28:01.931930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:28:01.932420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:28:01.932844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:28:01.933268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:28:01.942872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:01.943366 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:01.943815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:01.944555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:01.945026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:01.945467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:01.962681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Getting quotas for project ec956728a813448c8cf78fcfcc90679c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:28:01.967749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Getting quotas for user fedcbd54b710468a9e0bcf14663c8a88 and project ec956728a813448c8cf78fcfcc90679c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:28:01.979730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:28:01.982391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:28:02.028184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-356e9612-c594-434c-a59f-65a033f3a5bf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689881 Sep 13 17:28:02.028831 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3721/7390] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:28:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:28:02.039975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c620c3d3-5249-49d5-a3be-55c90ad1a9ec tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:02.040605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c620c3d3-5249-49d5-a3be-55c90ad1a9ec tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:02.103914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c620c3d3-5249-49d5-a3be-55c90ad1a9ec tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:02.113606 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c620c3d3-5249-49d5-a3be-55c90ad1a9ec tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1218 microversion: 2.1 time: 0.077340 Sep 13 17:28:02.114686 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3670/7391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:02 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:03.141039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:03.141820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:03.149487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:03.150252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:03.150793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:03.151609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:03.152170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:03.152696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:03.226468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:03.238140 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90c36be1-cd71-45a5-ad8f-db59cd08a6e2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1270 microversion: 2.1 time: 0.102439 Sep 13 17:28:03.254641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3722/7392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:03 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:04.266860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:04.273028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:04.276720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:04.286377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:04.287027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:04.287478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:04.288483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:04.288960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:04.289391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:04.499676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:04.517341 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9dc83da4-4de6-4a01-a7d8-c42af107051d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.251842 Sep 13 17:28:04.518187 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3671/7393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:04 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:04.836419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3f41de7a-149a-48e8-b91f-d0e768ee9d1f req-6a81afaa-5732-490b-b5ed-06ed68c2fdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81560ae-d421-4aa5-adf7-cd1f3f834719", "tag": "1e8e9c14-d054-4de9-82da-ba503b19e6f6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:04.855601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3f41de7a-149a-48e8-b91f-d0e768ee9d1f req-6a81afaa-5732-490b-b5ed-06ed68c2fdc8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:04.855861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3f41de7a-149a-48e8-b91f-d0e768ee9d1f req-6a81afaa-5732-490b-b5ed-06ed68c2fdc8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:04.856520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3f41de7a-149a-48e8-b91f-d0e768ee9d1f req-6a81afaa-5732-490b-b5ed-06ed68c2fdc8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:04.874320 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3f41de7a-149a-48e8-b91f-d0e768ee9d1f req-6a81afaa-5732-490b-b5ed-06ed68c2fdc8 service nova] Creating event network-changed:1e8e9c14-d054-4de9-82da-ba503b19e6f6 for instance b81560ae-d421-4aa5-adf7-cd1f3f834719 on n-h2-857467-1 Sep 13 17:28:04.883910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3f41de7a-149a-48e8-b91f-d0e768ee9d1f req-6a81afaa-5732-490b-b5ed-06ed68c2fdc8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051244 Sep 13 17:28:04.884947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3723/7394] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:05.541648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:05.542548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:05.550390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:05.551250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:05.551705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:05.552421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:05.552893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:05.553334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:05.686181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:05.694152 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ab19ac22-0b86-4f9b-84e6-88d95fdfc049 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.156475 Sep 13 17:28:05.694737 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3672/7395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:05 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:06.718272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:06.718985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:06.725274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:06.725776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:06.726257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:06.726961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:06.727436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:06.727882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:06.868731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:06.877008 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44049074-f349-4a26-9f59-ff0f2ab71ec8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.164175 Sep 13 17:28:06.877580 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3724/7396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:06 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:07.900104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:07.900729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:07.908277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:07.908774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:07.909225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:07.909974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:07.910452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:07.910892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:08.039020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:08.047747 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d82e681-49c0-496e-a46c-61a20351e28c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.151679 Sep 13 17:28:08.048322 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3673/7397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:07 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:09.070257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:09.070920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:09.078793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:09.079307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:09.079762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:09.080487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:09.080958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:09.081462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:09.212587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:09.220557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ce2c501-f5f9-49c7-b7ff-090ca77bcc68 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.154348 Sep 13 17:28:09.221134 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3725/7398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:09 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:10.243841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:10.244516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:10.247436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:10.253113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:10.253713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:10.254307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:10.255021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:10.255511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:10.255941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:10.287038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-072a7d8c-3b08-413e-9f6a-c9bb65199615 req-8114b1de-bdbb-40c8-a236-e5cf34b544cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81560ae-d421-4aa5-adf7-cd1f3f834719", "name": "network-vif-plugged", "status": "completed", "tag": "1e8e9c14-d054-4de9-82da-ba503b19e6f6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:10.299546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-072a7d8c-3b08-413e-9f6a-c9bb65199615 req-8114b1de-bdbb-40c8-a236-e5cf34b544cc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:10.300045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-072a7d8c-3b08-413e-9f6a-c9bb65199615 req-8114b1de-bdbb-40c8-a236-e5cf34b544cc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:10.300494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-072a7d8c-3b08-413e-9f6a-c9bb65199615 req-8114b1de-bdbb-40c8-a236-e5cf34b544cc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:10.312254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-072a7d8c-3b08-413e-9f6a-c9bb65199615 req-8114b1de-bdbb-40c8-a236-e5cf34b544cc service nova] Creating event network-vif-plugged:1e8e9c14-d054-4de9-82da-ba503b19e6f6 for instance b81560ae-d421-4aa5-adf7-cd1f3f834719 on n-h2-857467-1 Sep 13 17:28:10.317273 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-072a7d8c-3b08-413e-9f6a-c9bb65199615 req-8114b1de-bdbb-40c8-a236-e5cf34b544cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Sep 13 17:28:10.318462 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3726/7399] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:28:10.773864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:10.784218 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6063a5f5-55bf-4ab0-b835-ec2c5b64fd35 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.544167 Sep 13 17:28:10.784780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3674/7400] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:10 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:11.810953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:11.811671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:11.813671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:11.820424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:11.821280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:11.821873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:11.824616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:11.824616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:11.825324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:11.831660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=68 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:11.953948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:11.965994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:11.973716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-12ac738a-69bc-43dc-b335-44e2c82b88d0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1318 microversion: 2.1 time: 0.168712 Sep 13 17:28:11.974348 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3727/7401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:11 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:12.997102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:12.997727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.000463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:13.006079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.006572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.007275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.007980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.008438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.008867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.145071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:13.153277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40719938-82de-4f0d-b40c-e03a012c6630 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1507 microversion: 2.1 time: 0.160191 Sep 13 17:28:13.153872 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3675/7402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:12 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:13.176231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:13.176936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.178848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:13.186300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.186808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.187263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.187983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.188460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.188906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.327467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:13.335383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d817b41-7bcb-49fb-a153-e819af17fb0c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1507 microversion: 2.1 time: 0.162952 Sep 13 17:28:13.336025 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3728/7403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:13 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:13.358121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:13.360705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.366773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.367270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.367717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.368422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.368891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.369614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.433874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88b9c4fc-1d83-427d-8cd7-03838a959505 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "PUT /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1079 microversion: 2.1 time: 0.080009 Sep 13 17:28:13.435117 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3676/7404] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Sep 13 17:28:13 2022] PUT /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:13.456263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:13.456922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.462982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.463485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.463943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.464650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.465154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.465613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.600809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:13.614052 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d0ca5bc-d121-4e88-b35a-8bc30073ae11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1505 microversion: 2.1 time: 0.161475 Sep 13 17:28:13.614653 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3729/7405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:13 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:13.636468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:13.637390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.643856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.644347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.644790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.645487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.646010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.646447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.783711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:13.791631 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03305d3a-4982-4ce2-b8df-2b0e8bd25834 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1505 microversion: 2.1 time: 0.159153 Sep 13 17:28:13.792208 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3677/7406] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:13 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:13.816788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:13.819497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.826582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.827088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.827544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.828255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.828733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.829175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.857680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:13.863124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Old instance type m1.heat2, new instance type m1.heat {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:28:13.869484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:28:13.869953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:28:13.870450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:28:13.870880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:28:13.871804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:28:13.942145 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-451f97e3-e049-4ec4-8f8d-33e8a53d96c9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719/action" status: 202 len: 0 microversion: 2.1 time: 0.130970 Sep 13 17:28:13.942789 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3730/7407] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:28:13 2022] POST /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:28:13.951325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:13.951977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:13.958020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.958510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.958950 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:13.959670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:13.960093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:13.960522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:14.123304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:14.131240 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f541ae19-152b-4f70-8d8f-d0755a1d0628 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1516 microversion: 2.1 time: 0.184185 Sep 13 17:28:14.131814 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3678/7408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:13 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:15.156125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:15.156757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:15.164575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:15.165085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:15.165542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:15.166297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:15.166777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:15.167222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:15.309704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:15.318510 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3da26a95-f82a-447d-b4fb-8a93f3fcf7b7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1516 microversion: 2.1 time: 0.167166 Sep 13 17:28:15.319107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3731/7409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:15 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:16.342423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:16.342954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:16.349924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:16.350452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:16.350901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:16.351604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:16.352069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:16.352508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:16.480515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:16.489900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-51a3a023-3457-4b2f-b4ea-862095c17808 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.151911 Sep 13 17:28:16.490483 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3679/7410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:16 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:17.514535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:17.515154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:17.521301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:17.521805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:17.522284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:17.522986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:17.523455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:17.523893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:17.661956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:17.670394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1004d8cd-4471-4c6e-b4be-fb91bd809107 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.160508 Sep 13 17:28:17.670968 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3732/7411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:17 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:18.694212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:18.694833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:18.702433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:18.702921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:18.703364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:18.704061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:18.704521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:18.704954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:18.838031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:18.848515 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-daa77fcd-d63d-441a-82df-352f966c78af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.158008 Sep 13 17:28:18.849116 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3680/7412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:18 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:19.873321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:19.874174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:19.881710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:19.882245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:19.882694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:19.883395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:19.883865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:19.884303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:20.018680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:20.026429 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2b2017f-f87b-40d6-b35c-ae6aef8464d8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.157865 Sep 13 17:28:20.027001 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3733/7413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:19 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:21.050410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:21.050945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:21.057883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:21.058541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:21.058936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:21.059963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:21.060461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:21.060900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:21.191926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:21.200324 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f409b77f-8bb3-4d9d-8b67-5c6807878f94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.153312 Sep 13 17:28:21.200916 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3681/7414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:21 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:22.224142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:22.224772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:22.232276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:22.232777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:22.233227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:22.233961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:22.234431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:22.234870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:22.500713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:22.508745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fbe9da09-3bdb-46fd-8a47-25ef27e57fff tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.288515 Sep 13 17:28:22.509319 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3734/7415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:22 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:23.533206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:23.533876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:23.540962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:23.541446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:23.541913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:23.542871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:23.544032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:23.544484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:23.715852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:23.724303 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2211496e-86a1-4539-8abe-d42f13ba2f86 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.194668 Sep 13 17:28:23.724972 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3682/7416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:23 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:28:24.749327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:24.750005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:24.757618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:24.758152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:24.758605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:24.759570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:24.760049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:24.760488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:24.887652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:24.895328 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4edad490-2351-4178-afb5-14b026febc92 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.150679 Sep 13 17:28:24.895902 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3735/7417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:24 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:25.919867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:25.920423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:25.927415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:25.927909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:25.928349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:25.929055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:25.929512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:25.929964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:26.067829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:26.076851 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0e23b736-11c6-4721-95c1-71ac3d7948ee tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.161923 Sep 13 17:28:26.077414 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3683/7418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:25 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:27.100054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:27.100819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:27.108821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:27.109329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:27.109786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:27.110527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:27.111001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:27.111446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:27.247873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:27.255937 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-535d0933-58b0-4cb3-bac6-c8882fd5a878 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.160586 Sep 13 17:28:27.256517 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3736/7419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:27 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:28.279279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:28.279903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:28.286942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:28.287429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:28.287869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:28.288567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:28.289034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:28.289500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:28.510123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:28.518013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-593df865-cc89-4bb3-99e0-0760ff1e01a8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.242919 Sep 13 17:28:28.518595 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3684/7420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:28 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:28:29.541186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:29.541865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:29.549163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:29.549667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:29.550160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:29.550874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:29.551351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:29.551798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:29.684313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:29.692029 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d71d2dcf-cb1d-4c77-9a82-9b7887f442e8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.154748 Sep 13 17:28:29.692614 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3737/7421] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:29 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:28:30.716244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:30.717030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:30.724197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:30.724680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:30.725123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:30.725821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:30.726309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:30.726744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:30.860342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:30.868112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5cf6acf7-1f7e-4475-acea-b1d14e5c3daf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.156542 Sep 13 17:28:30.868688 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3685/7422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:30 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:31.892904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:31.893532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:31.900639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:31.901137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:31.901586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:31.902986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:31.903515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:31.903957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:32.044696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:32.052478 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67eddaf0-c351-4e7f-8da3-7bd8b4811c8d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.163742 Sep 13 17:28:32.053107 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3738/7423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:31 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:33.075991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:33.076654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:33.083644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:33.084142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:33.084588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:33.085294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:33.085758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:33.086227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:33.217123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:33.220553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:33.226519 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77a9eb4f-5900-468c-8e62-1b759b2fbb4e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.154552 Sep 13 17:28:33.227105 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3686/7424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:33 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:34.258428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:34.259061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:34.266189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:34.266698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:34.267152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:34.267856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:34.268327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:34.268768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:34.397282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:34.405659 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eee9c5cd-32a8-4924-b05b-037beee8ceaa tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.151118 Sep 13 17:28:34.406283 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3739/7425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:34 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:35.428862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:35.429669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:35.438415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:35.438909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:35.439359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:35.440063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:35.440532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:35.440969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:35.575455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:35.584910 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bffba758-af75-4250-b79a-380ef2b04677 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.159694 Sep 13 17:28:35.585751 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3687/7426] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:35 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:36.609904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:36.610578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:36.617563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:36.618104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:36.618562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:36.619278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:36.619755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:36.620207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:36.752017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:36.759651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4432c376-f6bf-4246-b002-5996dd333c87 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.154508 Sep 13 17:28:36.760223 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3740/7427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:36 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:37.783918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:37.784529 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:37.791451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:37.791934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:37.792371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:37.793984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:37.794448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:37.794878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:37.926315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:37.934090 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3837ef0b-079b-4430-af57-1b2b9beb60e4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.154096 Sep 13 17:28:37.934680 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3688/7428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:37 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:38.957285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:38.957900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:38.964793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:38.965333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:38.965788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:38.966519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:38.966998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:38.967441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:39.096561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:39.104381 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2e1aee0-5107-4d51-b867-efd627f56d89 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.151107 Sep 13 17:28:39.104959 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3741/7429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:38 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:40.127972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:40.128589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:40.135519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:40.136007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:40.137119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:40.137998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:40.138461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:40.138890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:40.272775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:40.281069 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b741d4ae-4204-493e-97a0-cccd1f548c57 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.157044 Sep 13 17:28:40.281646 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3689/7430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:40 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:41.306485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:41.307666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:41.317663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:41.318246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:41.318708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:41.319689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:41.320173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:41.320624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:41.341046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:41.458337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:41.466685 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b8268976-4ea3-473b-b618-c83cab6139cf tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.165624 Sep 13 17:28:41.467266 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3742/7431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:41 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:42.490260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:42.490879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:42.493548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=32 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:42.499188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:42.499676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:42.500121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:42.500823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:42.501323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:42.501758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:42.635848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:42.644501 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-71839cfb-d7ac-4792-988f-e12ea98edb69 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1521 microversion: 2.1 time: 0.158582 Sep 13 17:28:42.645093 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3690/7432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:42 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:43.588156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81560ae-d421-4aa5-adf7-cd1f3f834719", "name": "network-vif-unplugged", "status": "completed", "tag": "1e8e9c14-d054-4de9-82da-ba503b19e6f6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:43.595317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=36 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:28:43.599505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:43.600008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:43.600661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:43.614136 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] Creating event network-vif-unplugged:1e8e9c14-d054-4de9-82da-ba503b19e6f6 for instance b81560ae-d421-4aa5-adf7-cd1f3f834719 on n-h1-857467-1 Sep 13 17:28:43.619607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:28:43.631254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ead3afb0-45e4-443f-b21c-22575e741cb1 req-481ce7ff-e35b-4d69-b242-c0be91b38f93 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046820 Sep 13 17:28:43.631879 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3743/7433] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:43.668815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:43.669432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:43.677151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:43.677643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:43.678121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:43.678827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:43.679294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:43.679729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:43.884949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:43.893799 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58e275e9-7154-47c8-bca8-0b8d7936962e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1520 microversion: 2.1 time: 0.229163 Sep 13 17:28:43.894414 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3691/7434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:43 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:44.919278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:44.920606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:44.927065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:44.927568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:44.928022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:44.928760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:44.929238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:44.929676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:45.068297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:45.076480 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d487d15-6a4d-4ea6-a77a-7f819cdba153 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1518 microversion: 2.1 time: 0.162631 Sep 13 17:28:45.077504 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3744/7435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:44 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:45.655268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81560ae-d421-4aa5-adf7-cd1f3f834719", "tag": "1e8e9c14-d054-4de9-82da-ba503b19e6f6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:45.665637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:45.666152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:45.666589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:45.678373 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] Creating event network-changed:1e8e9c14-d054-4de9-82da-ba503b19e6f6 for instance b81560ae-d421-4aa5-adf7-cd1f3f834719 on n-h1-857467-1 Sep 13 17:28:45.683651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:28:45.694426 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-beeaad1a-ff7a-4c5d-ad2c-e238cad2153a req-0eadb841-e5f4-4297-9703-b7032aa16fa3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043626 Sep 13 17:28:45.695032 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3692/7436] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:46.100560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:46.101185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:46.108723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:46.109288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:46.109738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:46.110480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:46.110946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:46.111414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:46.246352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:46.254122 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1833fabc-d416-4f3d-a862-082f404f63e3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1518 microversion: 2.1 time: 0.157476 Sep 13 17:28:46.254707 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3745/7437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:46 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:47.278754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:47.279495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:47.286404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:47.286895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:47.287336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:47.288389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:47.289229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:47.290201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:47.502462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:47.510445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79d6058d-d37a-4bff-85df-4fa736f86cea tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1518 microversion: 2.1 time: 0.236938 Sep 13 17:28:47.511038 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3693/7438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:47 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:48.534560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:48.535200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:48.541611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:48.542156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:48.542622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:48.543700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:48.544189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:48.544646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:48.684825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:48.693257 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d27b8c46-a679-4e4f-9388-e2b97b4cc7be tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1515 microversion: 2.1 time: 0.162626 Sep 13 17:28:48.693958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3746/7439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:48 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:48.715301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:48.715846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:48.723128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:48.723781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:48.724301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:48.725086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:48.725623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:48.726211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:48.786575 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b001033-b387-4837-98bb-d0e4d83caf21 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719/action" status: 204 len: 0 microversion: 2.1 time: 0.074904 Sep 13 17:28:48.787203 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3694/7440] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:28:48 2022] POST /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:28:48.795886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:48.796503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:48.803018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:48.803740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:48.804226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:48.805019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:48.805529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:48.806057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:48.940782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:48.948895 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bac6396c-3d68-48f7-9173-4320cce5bad2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1515 microversion: 2.1 time: 0.157398 Sep 13 17:28:48.949485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3747/7441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:48 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:49.974755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:49.975467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:49.981763 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:49.982284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:49.982865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:49.984423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:49.984897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:49.985336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:50.131353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:50.139765 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8c338c21-38e3-4c74-b59d-7aa3133c48fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1515 microversion: 2.1 time: 0.170118 Sep 13 17:28:50.140365 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3695/7442] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:49 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:50.679671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-895446be-99be-4e4b-9406-d8f09442d5dd req-ae28373e-9d87-4bba-88ac-2980b7461ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81560ae-d421-4aa5-adf7-cd1f3f834719", "name": "network-vif-plugged", "status": "completed", "tag": "1e8e9c14-d054-4de9-82da-ba503b19e6f6"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:50.690796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-895446be-99be-4e4b-9406-d8f09442d5dd req-ae28373e-9d87-4bba-88ac-2980b7461ef0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:50.691305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-895446be-99be-4e4b-9406-d8f09442d5dd req-ae28373e-9d87-4bba-88ac-2980b7461ef0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:50.691760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-895446be-99be-4e4b-9406-d8f09442d5dd req-ae28373e-9d87-4bba-88ac-2980b7461ef0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:50.703852 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-895446be-99be-4e4b-9406-d8f09442d5dd req-ae28373e-9d87-4bba-88ac-2980b7461ef0 service nova] Creating event network-vif-plugged:1e8e9c14-d054-4de9-82da-ba503b19e6f6 for instance b81560ae-d421-4aa5-adf7-cd1f3f834719 on n-h1-857467-1 Sep 13 17:28:50.708801 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-895446be-99be-4e4b-9406-d8f09442d5dd req-ae28373e-9d87-4bba-88ac-2980b7461ef0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Sep 13 17:28:50.709469 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3748/7443] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:51.162688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:51.163304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:51.171485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:51.171962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:51.172401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:51.173431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:51.173932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:51.174362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:51.309130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:51.317234 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2601306-e301-4444-b633-98d19631d435 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1507 microversion: 2.1 time: 0.158424 Sep 13 17:28:51.317844 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3696/7444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:51 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:51.340129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:51.340845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:51.347767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:51.348266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:51.348715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:51.349416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:51.349937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:51.350368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:51.481782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:51.491394 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52eec346-5ca5-4b42-8903-eb0fd8af8bd0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1507 microversion: 2.1 time: 0.155414 Sep 13 17:28:51.491984 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3749/7445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:51 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:51.517053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b0c87eb4-a656-42a1-a9c0-e762f86a6d79 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'create', calling method: .version_select at 0x7fbeb45d4040>, body: {"keypair": {"name": "tempest-keypair-7804108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSof7k9USC9wY3aKANrIrB6AmPuPm/J0Ow2CtdwG7AiSYzK5VdL2pJeMcY+pew0A2VJOcPMHdNcwaD0g1Fa5hJV3XxHWKM19GV+Hgd/AZVhbLgSemB5D2e0JRCi1JE5QA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:51.533158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b0c87eb4-a656-42a1-a9c0-e762f86a6d79 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Getting quotas for project ec956728a813448c8cf78fcfcc90679c. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:28:51.538366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b0c87eb4-a656-42a1-a9c0-e762f86a6d79 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Getting quotas for user fedcbd54b710468a9e0bcf14663c8a88 and project ec956728a813448c8cf78fcfcc90679c. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:28:51.567012 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b0c87eb4-a656-42a1-a9c0-e762f86a6d79 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.054203 Sep 13 17:28:51.567556 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3697/7446] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:28:51 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:52.788860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:52.789489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:52.796808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:52.797147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:52.797595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:52.798337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:52.798839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:52.799229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:52.929437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:52.937774 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2ad84cf-7dcd-4e28-b4c8-d3916c8eaab4 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 200 len: 1507 microversion: 2.1 time: 0.152814 Sep 13 17:28:52.938321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3750/7447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:52 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:52.960314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:52.960830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:52.969509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:52.970047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:52.970498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:52.971206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:52.971678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:52.972115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:52.997286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:28:53.073276 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8629c1a-a667-42ac-ad45-3f3dbfe4773c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 204 len: 0 microversion: 2.1 time: 0.116577 Sep 13 17:28:53.073989 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3698/7448] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:28:52 2022] DELETE /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:28:53.132579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1129235710", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "2fa9d6ba-27f6-4ef7-ba97-998c94ab1ea9"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:53.185484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] validate_networks() for [('2fa9d6ba-27f6-4ef7-ba97-998c94ab1ea9', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:28:53.555054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:28:53.555535 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:28:53.556029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:28:53.556459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:28:53.556894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:28:53.566457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:53.566958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:53.567417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:53.568162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:53.568635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:53.569080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:53.586711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Getting quotas for project ec956728a813448c8cf78fcfcc90679c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:28:53.591931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Getting quotas for user fedcbd54b710468a9e0bcf14663c8a88 and project ec956728a813448c8cf78fcfcc90679c. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:28:53.604452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:28:53.606852 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:28:53.652660 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa4a96c6-5ad3-477b-ae0c-b04bc6d86a32 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523818 Sep 13 17:28:53.653419 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3751/7449] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:28:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:28:53.665242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-de66bb41-5d80-4a33-81ad-a7e34e38fff5 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:53.665979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-de66bb41-5d80-4a33-81ad-a7e34e38fff5 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:53.720675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-de66bb41-5d80-4a33-81ad-a7e34e38fff5 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:53.727671 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-de66bb41-5d80-4a33-81ad-a7e34e38fff5 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1218 microversion: 2.1 time: 0.066649 Sep 13 17:28:53.728891 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3699/7450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:53 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:54.752843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:54.753546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:54.761197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:54.761707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:54.762191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:54.762904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:54.763497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:54.763945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:54.827069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:54.835119 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81e5a9a7-af02-439d-8918-fe10c96ed80b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1270 microversion: 2.1 time: 0.087773 Sep 13 17:28:54.835706 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3752/7451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:54 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:55.488165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5264b07c-e75d-42b4-ac22-07aaa970f1c9 req-b87e3dc0-cd2c-4700-8163-1fa51a749d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81560ae-d421-4aa5-adf7-cd1f3f834719", "name": "network-vif-deleted", "tag": "1e8e9c14-d054-4de9-82da-ba503b19e6f6"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:55.501046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5264b07c-e75d-42b4-ac22-07aaa970f1c9 req-b87e3dc0-cd2c-4700-8163-1fa51a749d81 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:55.501553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5264b07c-e75d-42b4-ac22-07aaa970f1c9 req-b87e3dc0-cd2c-4700-8163-1fa51a749d81 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:55.502019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5264b07c-e75d-42b4-ac22-07aaa970f1c9 req-b87e3dc0-cd2c-4700-8163-1fa51a749d81 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:55.513114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5264b07c-e75d-42b4-ac22-07aaa970f1c9 req-b87e3dc0-cd2c-4700-8163-1fa51a749d81 service nova] Creating event network-vif-deleted:1e8e9c14-d054-4de9-82da-ba503b19e6f6 for instance b81560ae-d421-4aa5-adf7-cd1f3f834719 on n-h1-857467-1 Sep 13 17:28:55.518321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5264b07c-e75d-42b4-ac22-07aaa970f1c9 req-b87e3dc0-cd2c-4700-8163-1fa51a749d81 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035336 Sep 13 17:28:55.519071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3700/7452] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:55.859373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:55.860144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:55.866721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:55.867220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:55.867842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:55.868551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:55.869023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:55.869462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:55.936554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:55.944331 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8ede2e58-569c-48e7-b0a4-ffcd1b3d892e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1276 microversion: 2.1 time: 0.089506 Sep 13 17:28:55.944909 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3753/7453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:55 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:56.969386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:56.970139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:56.976535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:56.977022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:56.977462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:56.978194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:56.978661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:56.979091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:57.207174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:57.214928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-99570725-d155-4e81-9c73-5af25fa6e629 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.251191 Sep 13 17:28:57.215521 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3701/7454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:56 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:28:57.540212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-43bcba36-f09b-4857-b406-702a168347d0 req-d38a77a7-08aa-4cdd-b299-e6dd5bfc8bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae539913-d343-45f3-9871-72b89c3f7e39", "tag": "87f01871-94b8-4560-8143-a119826d0df1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:28:57.551583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-43bcba36-f09b-4857-b406-702a168347d0 req-d38a77a7-08aa-4cdd-b299-e6dd5bfc8bc9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:57.552073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-43bcba36-f09b-4857-b406-702a168347d0 req-d38a77a7-08aa-4cdd-b299-e6dd5bfc8bc9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:57.552554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-43bcba36-f09b-4857-b406-702a168347d0 req-d38a77a7-08aa-4cdd-b299-e6dd5bfc8bc9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:57.563553 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-43bcba36-f09b-4857-b406-702a168347d0 req-d38a77a7-08aa-4cdd-b299-e6dd5bfc8bc9 service nova] Creating event network-changed:87f01871-94b8-4560-8143-a119826d0df1 for instance ae539913-d343-45f3-9871-72b89c3f7e39 on n-h1-857467-1 Sep 13 17:28:57.568563 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-43bcba36-f09b-4857-b406-702a168347d0 req-d38a77a7-08aa-4cdd-b299-e6dd5bfc8bc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032169 Sep 13 17:28:57.569139 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3754/7455] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:28:58.238450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:58.239063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:58.245929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:58.246418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:58.246855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:58.247546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:58.248005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:58.248949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:58.382997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:58.391286 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-890dbc4b-947d-49d2-ae90-5507f6067f4b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.156787 Sep 13 17:28:58.391861 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3702/7456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:58 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:28:59.416206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:28:59.417061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:28:59.424362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:59.424908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:59.425398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:59.426151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:28:59.426634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:28:59.427167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:28:59.572710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:28:59.580543 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b58a9c77-60d0-4dc1-b9ac-39b2c412cafe tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.169410 Sep 13 17:28:59.581200 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3755/7457] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:28:59 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:00.603986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:00.604605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:00.612394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:00.612883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:00.613333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:00.614071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:00.614537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:00.614971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:00.752916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:00.755450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:00.762679 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d8378cf-9e00-41d3-941a-63bbfe582710 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.162607 Sep 13 17:29:00.763379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3703/7458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:00 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:01.786254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:01.786885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:01.794180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:01.794679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:01.795161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:01.795863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:01.796439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:01.796883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:01.931239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:01.939659 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44eb7d3d-1a6c-4131-aac2-7869d7d5d38b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.157278 Sep 13 17:29:01.940245 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3756/7459] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:01 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:02.909952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5fc86f1f-2b55-4df9-b9d1-3062f9aaee50 req-126149b9-bc39-4be0-b67f-100a461b585c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae539913-d343-45f3-9871-72b89c3f7e39", "name": "network-vif-plugged", "status": "completed", "tag": "87f01871-94b8-4560-8143-a119826d0df1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:02.919678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5fc86f1f-2b55-4df9-b9d1-3062f9aaee50 req-126149b9-bc39-4be0-b67f-100a461b585c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:02.920166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5fc86f1f-2b55-4df9-b9d1-3062f9aaee50 req-126149b9-bc39-4be0-b67f-100a461b585c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:02.920895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5fc86f1f-2b55-4df9-b9d1-3062f9aaee50 req-126149b9-bc39-4be0-b67f-100a461b585c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:02.931731 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5fc86f1f-2b55-4df9-b9d1-3062f9aaee50 req-126149b9-bc39-4be0-b67f-100a461b585c service nova] Creating event network-vif-plugged:87f01871-94b8-4560-8143-a119826d0df1 for instance ae539913-d343-45f3-9871-72b89c3f7e39 on n-h1-857467-1 Sep 13 17:29:02.936912 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5fc86f1f-2b55-4df9-b9d1-3062f9aaee50 req-126149b9-bc39-4be0-b67f-100a461b585c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097695 Sep 13 17:29:02.937492 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3704/7460] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:02.963390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:02.964027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:02.971853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:02.972362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:02.972826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:02.973541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:02.974048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:02.974531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:03.114302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:03.122176 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8fb710b8-337a-4e4e-9c8d-3bd951658804 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.162565 Sep 13 17:29:03.122764 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3757/7461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:02 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:04.142368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:04.148773 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:04.149482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:04.158387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:04.158883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:04.159319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:04.160029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:04.160485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:04.160912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:04.322201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:04.331714 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7ffe4df-fad5-43a4-a16e-9a8b8889802b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1318 microversion: 2.1 time: 0.190630 Sep 13 17:29:04.332313 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3705/7462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:04 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:05.355572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:05.356212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:05.358975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:05.359779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:05.367139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.367646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.368098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.368838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.369367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.369805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.499054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:05.506863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ead77a41-2017-4798-a991-f06ce6abd793 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1508 microversion: 2.1 time: 0.155152 Sep 13 17:29:05.507421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3758/7463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:05 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:05.528944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:05.530340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:05.537242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.537731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.538206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.538910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.539375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.539809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.679930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:05.688033 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e07adba5-83f2-4792-95af-bc9151bb30fd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1508 microversion: 2.1 time: 0.162902 Sep 13 17:29:05.688616 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3706/7464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:05 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:05.712858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:05.715293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:05.722349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.722854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.723311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.724017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.724489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.724930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.757428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:05.763060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Old instance type m1.heat2, new instance type m1.heat {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:29:05.769862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:29:05.770298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:29:05.770790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:29:05.771214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:29:05.771637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:29:05.835014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26cbf5c0-b623-45c7-9ef0-1f9652b07d6d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39/action" status: 202 len: 0 microversion: 2.1 time: 0.126742 Sep 13 17:29:05.835634 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3759/7465] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:29:05 2022] POST /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:29:05.844427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:05.845143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:05.851101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.851589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.852036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:05.852736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:05.853197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:05.853624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:06.011477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:06.020246 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bb8bced-2b3e-4823-93c1-0570335e7e8a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1515 microversion: 2.1 time: 0.180340 Sep 13 17:29:06.020818 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3707/7466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:05 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:07.046193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:07.046778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:07.053781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:07.054387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:07.054841 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:07.055560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:07.056031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:07.056486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:07.059236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:07.193578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:07.201462 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7f1f0168-8c64-4a13-bbad-a2114cd799af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1515 microversion: 2.1 time: 0.160637 Sep 13 17:29:07.202728 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3760/7467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:07 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:29:08.225871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:08.226488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:08.233382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:08.234423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:08.235098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:08.235794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:08.236259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:08.236689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:08.370140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:08.378664 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d921b9f6-3f31-4949-a1e1-01dcc3621c4d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.156676 Sep 13 17:29:08.379257 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3708/7468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:08 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:09.402711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:09.403256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:09.410739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:09.411238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:09.411688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:09.412388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:09.412859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:09.413423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:09.548508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:09.556290 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0e7116ae-dce5-4442-81b8-fceaca6b2bb1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.157516 Sep 13 17:29:09.556878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3761/7469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:09 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:10.579238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:10.579867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:10.588233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:10.588736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:10.589189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:10.589940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:10.590418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:10.590863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:10.731011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:10.741076 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-25fa1d9f-94b4-452f-94a8-06957a0e800c tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.165708 Sep 13 17:29:10.741683 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3709/7470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:10 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:11.764591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:11.765965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:11.772732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:11.773231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:11.773682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:11.774407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:11.774880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:11.775323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:11.902638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:11.910637 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07344f8b-46c8-412a-aba0-af5be4ce3b54 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.149904 Sep 13 17:29:11.911235 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3762/7471] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:11 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:12.934667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:12.935288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:12.940766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:12.944771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:12.945261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:12.945719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:12.946431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:12.946893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:12.947320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:13.142743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:13.150635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0f9bf75c-aa99-41c8-b7f4-7f30658b944b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.219720 Sep 13 17:29:13.151144 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3710/7472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:12 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:14.175231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:14.175869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:14.178607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:14.183929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:14.184441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:14.184902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:14.185622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:14.186148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:14.186600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:14.320620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:14.329742 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bd5da94c-c11f-4df4-ac85-49b6539f7b43 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.159119 Sep 13 17:29:14.330363 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3763/7473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:14 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:15.353774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:15.354426 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:15.363422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:15.363927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:15.364380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:15.365090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:15.365550 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:15.366015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:15.506349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:15.514274 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e90e6352-2cbd-413c-8d75-e83df6554e2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.165294 Sep 13 17:29:15.514858 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3711/7474] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:15 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:16.537949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:16.538582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:16.545905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:16.547139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:16.547715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:16.548435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:16.548914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:16.549364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:16.677441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:16.685365 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bec4323b-8c35-4203-82c0-bd44acf32769 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.151267 Sep 13 17:29:16.686040 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3764/7475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:16 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:17.709896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:17.710539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:17.716834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:17.717316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:17.717876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:17.719130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:17.719589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:17.720042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:17.850352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:17.858436 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f2ee400f-f04b-4b7b-80c7-c2576b60c4af tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.152345 Sep 13 17:29:17.859564 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3712/7476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:17 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:18.883099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:18.883732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:18.890474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:18.891323 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:18.891923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:18.892652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:18.893129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:18.893712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:19.031442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:19.039316 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2865bf5-4220-4921-beba-3b1a72a1eb81 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.160294 Sep 13 17:29:19.039921 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3765/7477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:18 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:20.062403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:20.063081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:20.070144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:20.070640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:20.071082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:20.071787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:20.072248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:20.072750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:20.206939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:20.214759 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc1f4ad7-c2dd-4eab-9b78-b5b719106fef tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.156603 Sep 13 17:29:20.215324 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3713/7478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:20 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:21.239023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:21.239664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:21.246546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:21.247053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:21.247515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:21.248224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:21.248703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:21.249151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:21.379407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:21.387233 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-611b0a73-6697-4d34-a330-4b0422aacf3f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.152089 Sep 13 17:29:21.387819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3766/7479] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:21 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:22.410636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:22.411263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:22.418339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:22.418830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:22.419274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:22.419974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:22.420437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:22.420869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:22.550264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:22.558036 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1c892056-e295-4e8f-a676-645f196fb5a0 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.151520 Sep 13 17:29:22.558614 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3714/7480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:22 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:23.581519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:23.582202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:23.589003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:23.589538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:23.590029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:23.590734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:23.591212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:23.591657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:23.721127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:23.728978 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36a17c34-c9a2-418a-b60f-a401536ecc96 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.151373 Sep 13 17:29:23.729560 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3767/7481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:23 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:24.755087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:24.755708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:24.763168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:24.763649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:24.764090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:24.764783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:24.765242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:24.765671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:24.897090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:24.904830 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f743b6f-99fe-489e-a121-430e977b3e2f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.154564 Sep 13 17:29:24.905409 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3715/7482] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:24 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:25.928289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:25.928948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:25.935913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:25.936422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:25.936874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:25.937583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:25.938641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:25.939414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:26.073343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:26.081354 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c892186-02f9-46d6-8e5a-2d263e18dd11 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.156986 Sep 13 17:29:26.081954 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3768/7483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:25 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:27.105734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:27.106581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:27.113838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:27.114347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:27.114789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:27.115487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:27.115949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:27.116379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:27.246642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:27.255787 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ee9eccd-c28b-4e40-b4d9-5cb8505c9937 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.154767 Sep 13 17:29:27.256373 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3716/7484] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:27 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:28.280119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:28.280772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:28.288940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:28.289441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:28.289928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:28.290636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:28.291103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:28.291541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:28.425446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:28.433132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0de003e1-d2c3-4fb3-ada3-106c2b17e12b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.156872 Sep 13 17:29:28.433710 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3769/7485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:28 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:29.457714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:29.458260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:29.465183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:29.465670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:29.466149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:29.466851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:29.467317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:29.467746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:29.598964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:29.606917 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7003f571-310b-4e93-b680-af5b46cd203e tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.154174 Sep 13 17:29:29.607495 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3717/7486] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:29 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:30.630152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:30.630787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:30.637673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:30.638217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:30.638680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:30.639395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:30.639879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:30.640332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:30.783532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:30.791417 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3af3c910-2f2c-44e9-bcc2-6150ce8dc349 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.165243 Sep 13 17:29:30.792032 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3770/7487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:30 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:31.815268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:31.815949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:31.823018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:31.823509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:31.823952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:31.824655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:31.825122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:31.825554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:31.960442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:31.968236 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-07a2974f-f33b-42e2-badd-7beee6e99c59 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.156979 Sep 13 17:29:31.969180 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3718/7488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:31 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:32.992694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:32.993325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:33.000300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:33.000836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:33.002012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:33.002672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:33.003146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:33.003587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:33.137357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:33.145023 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7212b807-0fbc-41de-91b7-7f0963ba46bd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.156337 Sep 13 17:29:33.145619 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3771/7489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:32 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:34.169045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:34.169696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:34.177413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:34.177949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:34.178403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:34.179101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:34.179568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:34.180004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:34.182564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=88 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:34.309013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:34.317145 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d156f8ac-96f1-4a0d-b755-72a38841e12a tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1520 microversion: 2.1 time: 0.152286 Sep 13 17:29:34.317728 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3719/7490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:34 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:35.218024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae539913-d343-45f3-9871-72b89c3f7e39", "name": "network-vif-unplugged", "status": "completed", "tag": "87f01871-94b8-4560-8143-a119826d0df1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:35.228256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:35.228758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:35.229209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:35.241470 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] Creating event network-vif-unplugged:87f01871-94b8-4560-8143-a119826d0df1 for instance ae539913-d343-45f3-9871-72b89c3f7e39 on n-h2-857467-1 Sep 13 17:29:35.246860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] Instance ae539913-d343-45f3-9871-72b89c3f7e39 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:29:35.258348 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d6569078-89cb-4747-86ce-bc77b1caa4d2 req-57417347-da64-4b42-b28d-81a3be18f525 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093551 Sep 13 17:29:35.258980 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3772/7491] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:35.340656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:35.341279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:35.349283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:35.349778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:35.350276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:35.350987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:35.351450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:35.351883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:35.615376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:35.626300 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d184d250-70a9-4de6-bc34-eb785b718d93 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1519 microversion: 2.1 time: 0.289543 Sep 13 17:29:35.627224 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3720/7492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:35 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:36.652211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:36.652916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:36.659085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:36.659581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:36.660067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:36.660774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:36.661242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:36.661713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:36.791692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:36.800378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed846546-fddc-4e92-b516-df5d530f4c2b tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1517 microversion: 2.1 time: 0.153244 Sep 13 17:29:36.800954 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3773/7493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:36 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:37.274346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae539913-d343-45f3-9871-72b89c3f7e39", "tag": "87f01871-94b8-4560-8143-a119826d0df1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:37.285354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:37.285863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:37.286294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:37.298013 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] Creating event network-changed:87f01871-94b8-4560-8143-a119826d0df1 for instance ae539913-d343-45f3-9871-72b89c3f7e39 on n-h2-857467-1 Sep 13 17:29:37.303453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] Instance ae539913-d343-45f3-9871-72b89c3f7e39 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:29:37.314071 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1cdd9e4d-c944-42fa-9a1b-05771e2d2bc6 req-0065061c-441b-4ea9-a04f-1feca00fe024 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043879 Sep 13 17:29:37.314652 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3721/7494] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:37.824744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:37.825387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:37.833128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:37.833637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:37.834126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:37.834837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:37.835311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:37.835757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:37.839908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=82 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:37.972708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:37.980349 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8a9dcb16-ae17-40de-bdaa-c7cf73e46a94 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1517 microversion: 2.1 time: 0.159585 Sep 13 17:29:37.980916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3774/7495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:37 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:39.006607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:39.007974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:39.014781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:39.015374 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:39.016005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:39.016913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:39.018153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:39.018935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:39.286261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:39.296892 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2521a4e4-6bbb-49a0-bc22-f70f4fc4a052 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1514 microversion: 2.1 time: 0.295956 Sep 13 17:29:39.297478 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3722/7496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:38 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:39.320557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:39.321108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:39.328200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:39.328700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:39.329153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:39.329934 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:39.330473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:39.330907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:39.392736 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3c0e19cb-f331-44ff-ae88-bba6263249e7 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "POST /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39/action" status: 204 len: 0 microversion: 2.1 time: 0.076038 Sep 13 17:29:39.394108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3775/7497] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:29:39 2022] POST /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:29:39.404110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:39.405120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:39.412633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:39.413169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:39.413592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:39.414495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:39.414966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:39.415409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:39.686299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:39.694832 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a405bcd-ff0c-4dd1-a70a-47f5ea4418f8 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1514 microversion: 2.1 time: 0.295709 Sep 13 17:29:39.695419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3723/7498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:39 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:40.718835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:40.719556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:40.730114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:40.730636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:40.731174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:40.731900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:40.732379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:40.732833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:40.874729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:40.883250 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9402db47-2446-4a05-8f09-9b86356286c2 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1506 microversion: 2.1 time: 0.168690 Sep 13 17:29:40.883835 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3776/7499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:40 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:40.907759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:40.908415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:40.917929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:40.918689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:40.919126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:40.919835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:40.920293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:40.920724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.061916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:41.070727 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d13368e-159d-4079-baca-d0c5b874dbc6 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1506 microversion: 2.1 time: 0.166767 Sep 13 17:29:41.071249 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3724/7500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:40 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:41.092708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:41.093342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:41.099416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.099924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.100385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.101099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.101583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.102074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.239379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:41.247203 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3aa4c478-a0dc-4cb4-a454-86d590bee4e9 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1506 microversion: 2.1 time: 0.158373 Sep 13 17:29:41.248015 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3777/7501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:41 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:41.271672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:41.272176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:41.278110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.278598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.279042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.279738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.280199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.280634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.306685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:29:41.383587 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83141966-b95a-467f-9aae-2ea8e3a31800 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 204 len: 0 microversion: 2.1 time: 0.115477 Sep 13 17:29:41.384100 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3725/7502] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:29:41 2022] DELETE /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:29:41.398766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:41.399283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:41.402406 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:29:41.402637 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 (ip 10.222.0.61) !!! Sep 13 17:29:41.413326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.413857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.414326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.415056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.415536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.415987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.445534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:29:41.489314 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.compute.api [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Instance is already in deleting state, ignoring this request Sep 13 17:29:41.490114 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35d74c43-1834-4967-bf8c-00a3f01f0edd tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 204 len: 0 microversion: 2.1 time: 0.095265 Sep 13 17:29:41.490718 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3778/7503] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:29:41 2022] DELETE /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:29:41.499243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:41.499996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:41.506486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.506982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.507430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.508129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:41.508595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:41.509034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:41.637425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:41.645893 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a3adf00-8646-42b6-ba4b-810ccbe3d173 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1512 microversion: 2.1 time: 0.150825 Sep 13 17:29:41.646469 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3726/7504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:41 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:42.669101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:42.669734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:42.676820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:42.677333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:42.677790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:42.678539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:42.679014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:42.679460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:42.757915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-04a1415c-9d98-4cc7-8632-05788a5b0eff req-9fc13de0-8d51-4f30-8e59-b77e8d726651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae539913-d343-45f3-9871-72b89c3f7e39", "name": "network-vif-plugged", "status": "completed", "tag": "87f01871-94b8-4560-8143-a119826d0df1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:42.768082 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:29:42.768672 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:29:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 13 17:29:42.776761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-04a1415c-9d98-4cc7-8632-05788a5b0eff req-9fc13de0-8d51-4f30-8e59-b77e8d726651 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:42.777255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-04a1415c-9d98-4cc7-8632-05788a5b0eff req-9fc13de0-8d51-4f30-8e59-b77e8d726651 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:42.777699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-04a1415c-9d98-4cc7-8632-05788a5b0eff req-9fc13de0-8d51-4f30-8e59-b77e8d726651 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:42.791166 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-04a1415c-9d98-4cc7-8632-05788a5b0eff req-9fc13de0-8d51-4f30-8e59-b77e8d726651 service nova] Creating event network-vif-plugged:87f01871-94b8-4560-8143-a119826d0df1 for instance ae539913-d343-45f3-9871-72b89c3f7e39 on n-h2-857467-1 Sep 13 17:29:42.796298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-04a1415c-9d98-4cc7-8632-05788a5b0eff req-9fc13de0-8d51-4f30-8e59-b77e8d726651 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042528 Sep 13 17:29:42.797259 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3727/7505] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:42.831892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedcbd54b710468a9e0bcf14663c8a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec956728a813448c8cf78fcfcc90679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:42.840239 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c6a3b061-e313-4d57-8495-f2ccb50605da tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 200 len: 1512 microversion: 2.1 time: 0.175252 Sep 13 17:29:42.840983 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3779/7506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:42 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:43.416497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-93ba648a-6d7d-4f60-9cf9-a9fa912e4507 req-647bcd6d-cfe9-4433-ada0-6a5a2836b5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae539913-d343-45f3-9871-72b89c3f7e39", "name": "network-vif-deleted", "tag": "87f01871-94b8-4560-8143-a119826d0df1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:43.423248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:43.431617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-93ba648a-6d7d-4f60-9cf9-a9fa912e4507 req-647bcd6d-cfe9-4433-ada0-6a5a2836b5d5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:43.432674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-93ba648a-6d7d-4f60-9cf9-a9fa912e4507 req-647bcd6d-cfe9-4433-ada0-6a5a2836b5d5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:43.433337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-93ba648a-6d7d-4f60-9cf9-a9fa912e4507 req-647bcd6d-cfe9-4433-ada0-6a5a2836b5d5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:43.445718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-93ba648a-6d7d-4f60-9cf9-a9fa912e4507 req-647bcd6d-cfe9-4433-ada0-6a5a2836b5d5 service nova] Creating event network-vif-deleted:87f01871-94b8-4560-8143-a119826d0df1 for instance ae539913-d343-45f3-9871-72b89c3f7e39 on n-h2-857467-1 Sep 13 17:29:43.450652 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-93ba648a-6d7d-4f60-9cf9-a9fa912e4507 req-647bcd6d-cfe9-4433-ada0-6a5a2836b5d5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039104 Sep 13 17:29:43.451304 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3728/7507] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:43.865065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:43.865698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: ae539913-d343-45f3-9871-72b89c3f7e39] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:43.872599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:43.873103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:43.873556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:43.874302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:43.874780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:43.875226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:43.888880 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] HTTP exception thrown: Instance ae539913-d343-45f3-9871-72b89c3f7e39 could not be found. Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Request method failure captured: Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 HTTP/1.1 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL2h14mC2w_S7XW9MZN3sfmqTK5qbbyKaVEQHUFnomH09OZaq_XgX4fLQw-JIXKY560iTkVj09dYz2VFQeG2KNaQtZcPOUI1wsSBACnwsMHH42NS6H3oAidiNTbZ7uAqPtCv0hYpAfTKy-aUtmOjlSgkIFKY2yKEiifP5GwakklIQ_w Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ec956728a813448c8cf78fcfcc90679c Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ec956728a813448c8cf78fcfcc90679c Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerDiskConfigTestJSON-1956852189-project Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fedcbd54b710468a9e0bcf14663c8a88 Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerDiskConfigTestJSON-1956852189-project Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ae539913-d343-45f3-9871-72b89c3f7e39 could not be found. Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ae539913-d343-45f3-9871-72b89c3f7e39'} Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae539913-d343-45f3-9871-72b89c3f7e39 could not be found. Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae539913-d343-45f3-9871-72b89c3f7e39 could not be found. Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:29:43.890609 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae539913-d343-45f3-9871-72b89c3f7e39 could not be found. Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Returning 404 to user: Instance ae539913-d343-45f3-9871-72b89c3f7e39 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c40ee734-ce74-4081-9bf1-84c8140741d3 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39" status: 404 len: 111 microversion: 2.1 time: 0.031788 Sep 13 17:29:43.895497 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3780/7508] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:43 2022] GET /compute/v2.1/servers/ae539913-d343-45f3-9871-72b89c3f7e39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:29:43.902219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cd38a881-25d7-4a91-b828-cfd63248b65d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '.version_select at 0x7fbeb45d4dc0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:43.924074 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cd38a881-25d7-4a91-b828-cfd63248b65d tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7804108" status: 202 len: 0 microversion: 2.1 time: 0.026845 Sep 13 17:29:43.924691 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3729/7509] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Sep 13 17:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7804108 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:29:44.550355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:44.550902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:44.552918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=36 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:44.559363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:44.559895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:44.560355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:44.561115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:44.561584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:44.562054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:44.577025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] HTTP exception thrown: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Request method failure captured: Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 HTTP/1.1 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL2h14mC2w_S7XW9MZN3sfmqTK5qbbyKaVEQHUFnomH09OZaq_XgX4fLQw-JIXKY560iTkVj09dYz2VFQeG2KNaQtZcPOUI1wsSBACnwsMHH42NS6H3oAidiNTbZ7uAqPtCv0hYpAfTKy-aUtmOjlSgkIFKY2yKEiifP5GwakklIQ_w Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ec956728a813448c8cf78fcfcc90679c Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ec956728a813448c8cf78fcfcc90679c Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerDiskConfigTestJSON-1956852189-project Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: fedcbd54b710468a9e0bcf14663c8a88 Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerDiskConfigTestJSON-1956852189-project Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'b81560ae-d421-4aa5-adf7-cd1f3f834719'} Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:29:44.578646 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Returning 404 to user: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-17197343-4c20-4fbc-8511-4ed401d78c0f tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 404 len: 111 microversion: 2.1 time: 0.033715 Sep 13 17:29:44.583801 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3781/7510] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:29:44 2022] DELETE /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:29:44.589804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:44.590613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] [instance: b81560ae-d421-4aa5-adf7-cd1f3f834719] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:44.597556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:44.598424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:44.598878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:44.599580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:44.600047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:44.600482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:44.614115 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] HTTP exception thrown: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Request method failure captured: Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 HTTP/1.1 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL2h14mC2w_S7XW9MZN3sfmqTK5qbbyKaVEQHUFnomH09OZaq_XgX4fLQw-JIXKY560iTkVj09dYz2VFQeG2KNaQtZcPOUI1wsSBACnwsMHH42NS6H3oAidiNTbZ7uAqPtCv0hYpAfTKy-aUtmOjlSgkIFKY2yKEiifP5GwakklIQ_w Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ec956728a813448c8cf78fcfcc90679c Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec956728a813448c8cf78fcfcc90679c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ec956728a813448c8cf78fcfcc90679c Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1956852189 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerDiskConfigTestJSON-1956852189-project Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: fedcbd54b710468a9e0bcf14663c8a88 Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerDiskConfigTestJSON-1956852189-project Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'b81560ae-d421-4aa5-adf7-cd1f3f834719'} Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:29:44.615769 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] Returning 404 to user: Instance b81560ae-d421-4aa5-adf7-cd1f3f834719 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d59d74a-b431-487c-a8c9-7c461fa312f1 tempest-ServerDiskConfigTestJSON-1956852189 tempest-ServerDiskConfigTestJSON-1956852189-project] 10.222.0.61 "GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719" status: 404 len: 111 microversion: 2.1 time: 0.031718 Sep 13 17:29:44.620345 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3730/7511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:44 2022] GET /compute/v2.1/servers/b81560ae-d421-4aa5-adf7-cd1f3f834719 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:29:53.387383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79cfed36-51e5-4f40-9239-be8059325cc2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'create', calling method: .version_select at 0x7fbeac7e99d0>, body: {"keypair": {"name": "tempest-keypair-51890898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvpZKnZScXWQl9acgCxv4S5qinkt4Yp0UotgnxH0/jjDSFQPN+jUqg/oWwW4+pe8RDMOnK8QsT+B+9e09wOemT8rRfnhiyzKoxk2T38iSqOMGgPEIrHaw78zAnpZ62nWg=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:53.406723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-79cfed36-51e5-4f40-9239-be8059325cc2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:29:53.413028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-79cfed36-51e5-4f40-9239-be8059325cc2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:29:53.443304 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79cfed36-51e5-4f40-9239-be8059325cc2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.208846 Sep 13 17:29:53.443913 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3782/7512] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:29:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:54.807809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1483334810", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "079fe657-fd0a-4189-9ba9-9a051ebbfacb"}], "security_groups": [{"name": "tempest-securitygroup--543111308"}], "key_name": "tempest-keypair-51890898", "user_data": "}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:54.816982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:54.817633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:54.928225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] validate_networks() for [('079fe657-fd0a-4189-9ba9-9a051ebbfacb', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:29:55.399398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:29:55.399825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:29:55.400463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:29:55.401048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:29:55.401466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:29:55.415152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:55.415672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:55.416245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:55.416995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:55.417518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:55.417997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:55.439001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:29:55.444523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:29:55.457882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:29:55.460237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:29:55.509297 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f34484c9-e837-411e-9dfe-4729d2c71993 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.706316 Sep 13 17:29:55.510162 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3731/7513] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:29:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:29:55.518831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:29:55.528061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf6d9d65-9646-457b-ba1c-e978fe283e83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:55.528807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf6d9d65-9646-457b-ba1c-e978fe283e83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:55.598042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf6d9d65-9646-457b-ba1c-e978fe283e83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:55.605908 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf6d9d65-9646-457b-ba1c-e978fe283e83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1237 microversion: 2.1 time: 0.088650 Sep 13 17:29:55.607041 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3783/7514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:55 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:56.630664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:56.631302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:56.638848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:56.639353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:56.640133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:56.640871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:56.641347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:56.642074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:56.743681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:56.754287 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-afa14a23-5a15-4f92-bc59-3d7406e53b0f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1297 microversion: 2.1 time: 0.128188 Sep 13 17:29:56.755266 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3732/7515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:56 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:57.783710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:57.784340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:57.792326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:57.792835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:57.793553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:57.794304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:57.794774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:57.795244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:57.934629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:57.942822 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2dabfdc0-8d3a-4a72-b28c-a6cbbc0f348b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.163237 Sep 13 17:29:57.943405 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3784/7516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:57 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:29:58.195976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d8a49fd1-5a09-4730-bcea-f337bb29c78f req-b9e4d8b4-a1eb-4188-9c82-f65be9fcfba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:29:58.207713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d8a49fd1-5a09-4730-bcea-f337bb29c78f req-b9e4d8b4-a1eb-4188-9c82-f65be9fcfba4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:58.208206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d8a49fd1-5a09-4730-bcea-f337bb29c78f req-b9e4d8b4-a1eb-4188-9c82-f65be9fcfba4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:58.208942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d8a49fd1-5a09-4730-bcea-f337bb29c78f req-b9e4d8b4-a1eb-4188-9c82-f65be9fcfba4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:58.222943 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d8a49fd1-5a09-4730-bcea-f337bb29c78f req-b9e4d8b4-a1eb-4188-9c82-f65be9fcfba4 service nova] Creating event network-changed:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h2-857467-1 Sep 13 17:29:58.227811 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d8a49fd1-5a09-4730-bcea-f337bb29c78f req-b9e4d8b4-a1eb-4188-9c82-f65be9fcfba4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035723 Sep 13 17:29:58.228928 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3733/7517] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:29:58.965538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:29:58.966207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:29:58.973362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:58.973923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:58.974385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:58.975102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:29:58.975580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:29:58.976023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:29:59.106851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:29:59.115263 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-07c00b6f-1029-4c34-980e-cc79c2359706 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.153635 Sep 13 17:29:59.115838 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3785/7518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:29:58 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:00.139530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:00.140231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:00.147238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:00.147723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:00.148162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:00.148852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:00.149310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:00.149739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:00.283080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:00.291681 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fd5e8605-8f9c-4caf-a60d-1cb7e2ead9c6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.157194 Sep 13 17:30:00.292254 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3734/7519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:00 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:01.315343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:01.316550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:01.323318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:01.323815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:01.324265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:01.324968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:01.325436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:01.325892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:01.466629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:01.474583 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-25916241-7ba8-44bf-a8f3-7793fd237ade tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.163190 Sep 13 17:30:01.475190 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3786/7520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:01 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:02.498605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:02.499262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:02.506833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:02.507332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:02.507782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:02.508484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:02.508960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:02.509397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:02.642800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:02.651741 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-355551ae-ec84-415e-8dff-687a21a047bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.156981 Sep 13 17:30:02.652527 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3735/7521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:02 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:03.675421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:03.675991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:03.682998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:03.683510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:03.683963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:03.684673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:03.685156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:03.685601 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:03.819705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:03.827351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d53b8221-89e2-4dea-be42-043d3ff0c9fa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.156086 Sep 13 17:30:03.827930 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3787/7522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:03 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:04.824567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-946c3f97-73eb-444c-a7d1-fa4e9c86a678 req-e7adbab9-155a-4000-8a85-565a7e0fae0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "name": "network-vif-plugged", "status": "completed", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:30:04.835353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-946c3f97-73eb-444c-a7d1-fa4e9c86a678 req-e7adbab9-155a-4000-8a85-565a7e0fae0a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:04.835878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-946c3f97-73eb-444c-a7d1-fa4e9c86a678 req-e7adbab9-155a-4000-8a85-565a7e0fae0a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:04.836765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-946c3f97-73eb-444c-a7d1-fa4e9c86a678 req-e7adbab9-155a-4000-8a85-565a7e0fae0a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:04.851518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:04.851983 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-946c3f97-73eb-444c-a7d1-fa4e9c86a678 req-e7adbab9-155a-4000-8a85-565a7e0fae0a service nova] Creating event network-vif-plugged:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h2-857467-1 Sep 13 17:30:04.852363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:04.857689 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-946c3f97-73eb-444c-a7d1-fa4e9c86a678 req-e7adbab9-155a-4000-8a85-565a7e0fae0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036776 Sep 13 17:30:04.858798 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3736/7523] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:30:04.859487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:04.860100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:04.860662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:04.861483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:04.862406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:04.863941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:05.001031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:05.009256 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1b069c1-716b-4b50-bf58-23c83773ec0e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.162264 Sep 13 17:30:05.009876 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3788/7524] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:04 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:30:06.031877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:30:06.032678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:30:06.038674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:06.039425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:06.047513 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:06.048015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:06.048464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:06.049222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:06.049697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:06.051227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:06.194328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:06.202287 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af9f9843-b106-4c80-98fc-65034208414f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1362 microversion: 2.1 time: 0.171327 Sep 13 17:30:06.202867 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3737/7525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:06 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:07.226260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:07.226888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:07.229808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:30:07.234953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:07.235445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:07.235897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:07.236595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:07.237069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:07.237709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:07.371860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:30:07.379557 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cbf59858-8ced-493d-bd83-dcff41c8d8ad tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1549 microversion: 2.1 time: 0.158057 Sep 13 17:30:07.380134 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3789/7526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:30:07 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:30:07.402248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:30:07.402778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:30:07.410122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:07.410800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:07.411242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:07.411935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:07.412396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:07.412826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:07.492856 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7cc48ac9-88ec-4556-bb3f-77422218025c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094327 Sep 13 17:30:07.493559 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3738/7527] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 17:30:07 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:30:08.756964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-7afff5e0-249e-4a51-b774-a384c1b50cc0 req-832f3ca1-fb5f-436a-928c-d614f38eeefe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:30:08.767426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7afff5e0-249e-4a51-b774-a384c1b50cc0 req-832f3ca1-fb5f-436a-928c-d614f38eeefe service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:30:08.768010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7afff5e0-249e-4a51-b774-a384c1b50cc0 req-832f3ca1-fb5f-436a-928c-d614f38eeefe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:30:08.768529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7afff5e0-249e-4a51-b774-a384c1b50cc0 req-832f3ca1-fb5f-436a-928c-d614f38eeefe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:30:08.780910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-7afff5e0-249e-4a51-b774-a384c1b50cc0 req-832f3ca1-fb5f-436a-928c-d614f38eeefe service nova] Creating event network-changed:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h2-857467-1 Sep 13 17:30:08.787239 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-7afff5e0-249e-4a51-b774-a384c1b50cc0 req-832f3ca1-fb5f-436a-928c-d614f38eeefe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034112 Sep 13 17:30:08.787851 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3790/7528] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:31:24.211371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:24.212174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=34 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:24.218250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:24.218864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:24.229418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.229938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.230379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.231075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.231539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.231965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.366419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:24.374314 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e045e5a6-82ef-4d0b-9766-64183df840b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1667 microversion: 2.1 time: 0.166062 Sep 13 17:31:24.374895 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3739/7529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:24 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:24.395386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:24.396261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=38 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:24.397219 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:31:24.397388 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 (ip 10.222.0.61) !!! Sep 13 17:31:24.404098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:24.404810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:24.414499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.415574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.416039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.416756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.417236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.417682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.558252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:24.565929 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-292f1750-87e9-4fcf-82f2-b4d9b0159c42 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1667 microversion: 2.1 time: 0.173230 Sep 13 17:31:24.566448 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3791/7530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:24 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:24.589264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:24.589918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:24.595849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.596346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.596786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.597487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.597985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.598423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.735336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:24.743546 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-346ebb2a-4e20-4fc1-a971-17b20e3e1fe8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1667 microversion: 2.1 time: 0.159062 Sep 13 17:31:24.744134 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3740/7531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:24 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:24.766890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:31:24.769122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:24.775719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.776211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.776660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.777355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.777818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.778278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.808474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:24.816361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Old instance type m1.heat2, new instance type m1.heat {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:31:24.823372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:31:24.823803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:31:24.824288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:31:24.824711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:31:24.825132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:31:24.889307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c21b9a74-a69f-4700-ba09-3a0eb3fce3db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164/action" status: 202 len: 0 microversion: 2.1 time: 0.126412 Sep 13 17:31:24.889965 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3792/7532] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:31:24 2022] POST /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:31:24.898015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:24.898631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:24.905187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.905654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.906128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:24.906831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:24.907291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:24.907721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:25.083255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:25.091797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-58fb2f95-3c3a-47af-8380-4fa127dc8318 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1676 microversion: 2.1 time: 0.197712 Sep 13 17:31:25.092426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3741/7533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:24 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:26.116799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:26.117432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:26.125387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:26.125918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:26.126377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:26.127097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:26.127572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:26.128013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:26.260495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:26.268396 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a184cefa-e88e-4dc5-8ab6-820ecddfcb49 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1676 microversion: 2.1 time: 0.156353 Sep 13 17:31:26.268988 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3793/7534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:26 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:27.291646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:27.292387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:27.299454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:27.299939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:27.300380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:27.301075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:27.301535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:27.301999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:27.431115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:27.438844 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-88d2f340-45a0-4fd4-883b-f5e5daeef71b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1676 microversion: 2.1 time: 0.151152 Sep 13 17:31:27.439424 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3742/7535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:27 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:28.463669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:28.464303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:28.471220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:28.471736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:28.472307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:28.473025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:28.473508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:28.473986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:28.607380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:28.615102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abcdc58b-526e-4385-9db7-3eb67caff8e4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1676 microversion: 2.1 time: 0.156003 Sep 13 17:31:28.615684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3794/7536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:28 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:29.638729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:29.639337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:29.646213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:29.646698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:29.647133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:29.647823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:29.648288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:29.648718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:29.787252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:29.797372 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c0e97056-45c0-45a4-aa8f-2490ec813319 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1676 microversion: 2.1 time: 0.162548 Sep 13 17:31:29.798008 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3743/7537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:29 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:30.820673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:30.821540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:30.828978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:30.829500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:30.830062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:30.830813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:30.831274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:30.831723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:30.967000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:30.974979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba75df65-1887-4d89-b3fd-3fb7db10a794 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1676 microversion: 2.1 time: 0.158144 Sep 13 17:31:30.975677 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3795/7538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:30 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:31.999830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:32.000453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:32.007538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:32.008025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:32.009185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:32.009915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:32.010381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:32.010812 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:32.145377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:32.153366 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-812097f1-b79a-437d-ae8b-0ec10bcf59a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.157784 Sep 13 17:31:32.153962 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3744/7539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:31 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:33.179032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:33.179589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:33.187997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:33.188511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:33.188971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:33.189697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:33.190219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:33.190672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:33.322468 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:33.331025 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d8c1b08a-d7b4-42ae-ab74-4896f7c9ea14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.157104 Sep 13 17:31:33.331632 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3796/7540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:33 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:34.356326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:34.356871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:34.363848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:34.364333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:34.364771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:34.365464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:34.365953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:34.366383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:34.496362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:34.504316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-520ba1c2-5522-4a4d-9e18-f27cee0a8f59 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.152457 Sep 13 17:31:34.504902 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3745/7541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:34 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:35.527454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:35.528103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:35.535085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:35.535586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:35.536035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:35.536741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:35.537219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:35.537661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:35.669380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:35.677112 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5aebbf72-39fe-4fca-b38f-b196cfa5d82e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.153898 Sep 13 17:31:35.677687 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3797/7542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:35 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:36.700622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:36.701189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:36.708047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:36.708534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:36.708973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:36.709662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:36.710147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:36.710576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:36.843174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:36.851393 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d2cbc4ca-3cf9-4232-ad0b-2f1d3e01c95c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.154741 Sep 13 17:31:36.852514 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3746/7543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:36 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:37.880519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:37.881154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:37.888854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:37.889358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:37.889814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:37.890558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:37.891033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:37.891485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:38.030995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:38.038786 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-011c831f-e3f7-44d0-96f3-ed0f669f2d82 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.162135 Sep 13 17:31:38.039372 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3798/7544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:37 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:39.062680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:39.063301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:39.070346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:39.070843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:39.071275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:39.071973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:39.072432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:39.072889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:39.209775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:39.217533 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e785fa3-8b9a-4e50-9188-3bf8d61633b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.158779 Sep 13 17:31:39.218158 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3747/7545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:39 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:40.242209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:40.243341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:40.250281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:40.250780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:40.251230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:40.251930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:40.252398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:40.252836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:40.384038 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:40.391672 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87d36ae7-f746-46be-8613-7c06aa76ef5b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.154154 Sep 13 17:31:40.392247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3799/7546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:40 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:41.415384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:41.416013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:41.423156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:41.423654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:41.424107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:41.424843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:41.425310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:41.425752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:41.561004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:41.568827 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-896bc2dc-66e8-42b7-b72a-dbfdcebc723c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.157532 Sep 13 17:31:41.569451 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3748/7547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:41 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:42.593130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:42.593768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:42.600983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:42.601612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:42.602864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:42.603595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:42.604084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:42.604538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:42.737197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:42.745149 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-112d5c11-c114-4a26-a3f1-03f435e00464 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.155980 Sep 13 17:31:42.745726 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3800/7548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:42 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:43.769216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:43.769857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:43.777623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:43.778148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:43.778603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:43.779346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:43.779816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:43.780258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:43.910461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:43.919586 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5ebbf76d-8e32-4ecb-bcaf-579c8261c5b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.154293 Sep 13 17:31:43.920175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3749/7549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:43 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:44.943377 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:44.943937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:44.950915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:44.951425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:44.951888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:44.952605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:44.953087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:44.953537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:45.086361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:45.094318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dba8dbdb-47fb-4db3-be53-4cf982298181 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.155040 Sep 13 17:31:45.094979 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3801/7550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:44 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:46.119147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:46.119762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:46.126711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:46.127201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:46.127645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:46.128343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:46.128802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:46.129233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:46.259229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:46.267020 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55a33e46-17c7-4a2b-877a-47d3a4c244db tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.152465 Sep 13 17:31:46.267598 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3750/7551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:46 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:47.290736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:47.291368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:47.298618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:47.299126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:47.299580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:47.300300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:47.300776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:47.301220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:47.430071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:47.437725 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d7e437b3-36e4-480e-a346-645a7138a0e5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1681 microversion: 2.1 time: 0.151146 Sep 13 17:31:47.438339 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3802/7552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:47 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:48.462315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:48.462870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:48.469362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:48.469887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:48.470338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:48.471059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:48.471539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:48.471973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:48.482566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "name": "network-vif-unplugged", "status": "completed", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:31:48.493445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:48.493944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:48.494454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:48.507506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] Creating event network-vif-unplugged:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h1-857467-1 Sep 13 17:31:48.513923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] Instance 0442efaa-1956-4033-8c2f-5836a3aad164 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:31:48.525155 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-8a0e237a-e408-40b0-9f84-695441ddba01 req-0c57fc2d-2ed2-43c7-a7df-a37c242c1d58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046207 Sep 13 17:31:48.525780 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3803/7553] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:31:48.790327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:48.798862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-87cb54cf-1b3c-4f07-98f0-ea9ecf0dc678 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1680 microversion: 2.1 time: 0.341061 Sep 13 17:31:48.799462 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3751/7554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:48 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1680 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:49.824124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:49.824843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:49.830971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:49.831476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:49.831932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:49.832639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:49.833116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:49.833563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:50.285509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:50.293126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9a95855-62ea-4562-920d-4752eca22d99 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1678 microversion: 2.1 time: 0.474460 Sep 13 17:31:50.293697 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3804/7555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:49 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1678 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:50.575435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:31:50.585637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:50.586221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:50.586684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:50.598412 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] Creating event network-changed:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h1-857467-1 Sep 13 17:31:50.604186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] Instance 0442efaa-1956-4033-8c2f-5836a3aad164 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:31:50.614792 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-646c1188-2048-419d-b9c8-3787c8c91a7c req-9c6d00cd-5d1d-4887-8c36-6cc6f424c109 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043883 Sep 13 17:31:50.615393 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3752/7556] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:31:51.316642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:51.317273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:51.324151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:51.324656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:51.325110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:51.325818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:51.326320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:51.326767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:51.456222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:51.463921 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-066aa4b8-f6e7-48b4-b16d-a9d3ad138afc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1678 microversion: 2.1 time: 0.151181 Sep 13 17:31:51.464485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3805/7557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:51 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:52.488944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:52.489648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:52.495856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:52.496343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:52.496787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:52.497480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:52.498009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:52.498444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:52.724832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:52.734768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68679bdd-57fa-4696-aa96-d24fca4f08a5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1678 microversion: 2.1 time: 0.251002 Sep 13 17:31:52.735724 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3753/7558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:52 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:53.760065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:53.760736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:53.767920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:53.768425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:53.768878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:53.769589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:53.770093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:53.770538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:53.790699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:53.910006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:53.918289 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b33af075-731f-4e5b-b312-351047e175ca tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1675 microversion: 2.1 time: 0.163000 Sep 13 17:31:53.918867 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3806/7559] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:53 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:53.943098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:31:53.943655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:53.951190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:53.951686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:53.952139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:53.952853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:53.953436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:53.953894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:54.006285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:54.017483 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f1f33cde-02e0-418c-a8c9-98f4416c835f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164/action" status: 204 len: 0 microversion: 2.1 time: 0.078308 Sep 13 17:31:54.018216 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3754/7560] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:31:53 2022] POST /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:31:54.026880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:54.027522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:54.033659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:54.034200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:54.034660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:54.035381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:54.035886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:54.036330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:54.177309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:54.185966 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-21d27bbb-84aa-412e-b883-18db96f13080 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1675 microversion: 2.1 time: 0.163250 Sep 13 17:31:54.186573 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3807/7561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:54 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:55.212280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:55.213048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:55.215014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=33 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:55.220703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:55.221196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:55.221638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:55.222381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:55.222845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:55.223278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:55.361938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:55.370265 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-df51ec73-aebb-4b54-99c6-20fcb662e2f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1675 microversion: 2.1 time: 0.163755 Sep 13 17:31:55.370903 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3755/7562] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:55 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:55.497519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "name": "network-vif-plugged", "status": "completed", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:31:55.503455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=39 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:31:55.509741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:55.510287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:55.510783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:55.522614 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] Creating event network-vif-plugged:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h1-857467-1 Sep 13 17:31:55.527880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] Instance 0442efaa-1956-4033-8c2f-5836a3aad164 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:31:55.538505 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4fc3ac8c-670b-4177-9451-64c25a64faba req-0aa55140-0424-464b-8f83-c2c605578cbd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044733 Sep 13 17:31:55.539923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3808/7563] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:31:56.394216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:56.394833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:56.402633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.403120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.403562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.404258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.404717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.405149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.537430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:56.545484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-45b759a9-1ec3-47ac-8f54-da9a9982beb5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1667 microversion: 2.1 time: 0.155253 Sep 13 17:31:56.546098 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3756/7564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:56 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:56.569558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:56.570900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:56.577112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.577611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.578103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.578817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.579421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.579874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.718335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:56.725961 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f5c71580-ad50-459e-aa76-0856dd950d83 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1667 microversion: 2.1 time: 0.161378 Sep 13 17:31:56.726602 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3809/7565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:56 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:56.749397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:56.750157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:56.756235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.756733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.757198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.757991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.758496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.758949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.893937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:56.902795 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39cda13a-c3b7-463b-92d5-b8551cc2bc44 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1667 microversion: 2.1 time: 0.157351 Sep 13 17:31:56.903384 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3757/7566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:56 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:56.924967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:56.925415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:56.931581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.932079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.932531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.933307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:56.933780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:56.934272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:56.959325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:31:57.039372 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7bb40245-1d0b-4bc9-9659-2d3617330bfa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 204 len: 0 microversion: 2.1 time: 0.117689 Sep 13 17:31:57.040117 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3810/7567] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:31:56 2022] DELETE /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:31:57.048667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:57.049419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:57.055489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:57.056018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:57.056483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:57.057186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:57.057645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:57.058107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:57.188027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:57.196502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2cd261b-8cad-42fd-a72e-97c24f46c87d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1673 microversion: 2.1 time: 0.151576 Sep 13 17:31:57.197097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3758/7568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:57 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:58.221184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:58.221984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:58.229704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:58.230268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:58.230792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:58.231533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:58.232043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:58.232549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:58.363385 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:58.371196 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4fc351b2-fbf7-48f7-878e-0f38fd036007 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1673 microversion: 2.1 time: 0.154316 Sep 13 17:31:58.371772 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3811/7569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:58 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:31:59.396804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-81e1a5e3-4a66-41c1-831f-504d6f54580a req-c41a24f4-b495-4475-977f-aa3187100d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442efaa-1956-4033-8c2f-5836a3aad164", "name": "network-vif-deleted", "tag": "c52f5b1f-c357-47e2-b152-e9e48617b697"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:31:59.397347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:31:59.397720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:31:59.407833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:59.408682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:59.409077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:59.409798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:59.410298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:59.410925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:59.415221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81e1a5e3-4a66-41c1-831f-504d6f54580a req-c41a24f4-b495-4475-977f-aa3187100d96 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:31:59.415707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81e1a5e3-4a66-41c1-831f-504d6f54580a req-c41a24f4-b495-4475-977f-aa3187100d96 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:31:59.416149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-81e1a5e3-4a66-41c1-831f-504d6f54580a req-c41a24f4-b495-4475-977f-aa3187100d96 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:31:59.441635 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-81e1a5e3-4a66-41c1-831f-504d6f54580a req-c41a24f4-b495-4475-977f-aa3187100d96 service nova] Creating event network-vif-deleted:c52f5b1f-c357-47e2-b152-e9e48617b697 for instance 0442efaa-1956-4033-8c2f-5836a3aad164 on n-h1-857467-1 Sep 13 17:31:59.447111 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-81e1a5e3-4a66-41c1-831f-504d6f54580a req-c41a24f4-b495-4475-977f-aa3187100d96 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053893 Sep 13 17:31:59.447880 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3759/7570] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:31:59.491306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:31:59.502843 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-958b39d5-0b74-4491-a9d4-c3e83741f156 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 200 len: 1606 microversion: 2.1 time: 0.109720 Sep 13 17:31:59.503431 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3812/7571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:31:59 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 1606 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:00.528735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:00.529445 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:00.535583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:00.536071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:00.536509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:00.537200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:00.537662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:00.538126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:00.551614 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 HTTP/1.1 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '0442efaa-1956-4033-8c2f-5836a3aad164'} Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:32:00.553208 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c21dc072-3a91-4cbe-9a9a-fb91996b8586 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 404 len: 111 microversion: 2.1 time: 0.031080 Sep 13 17:32:00.558488 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3760/7572] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:00 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:32:00.571460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:00.572148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:00.578202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:00.578705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:00.579159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:00.579868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:00.580349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:00.580796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:00.593977 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 HTTP/1.1 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '0442efaa-1956-4033-8c2f-5836a3aad164'} Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:32:00.595658 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a81f5574-a9fb-4eb7-8b2f-bf428dae9203 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 404 len: 111 microversion: 2.1 time: 0.031268 Sep 13 17:32:00.600287 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3813/7573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:00 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:32:00.645684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-168848452", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "079fe657-fd0a-4189-9ba9-9a051ebbfacb"}], "security_groups": [{"name": "tempest-securitygroup--543111308"}], "key_name": "tempest-keypair-51890898", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:32:00.749941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] validate_networks() for [('079fe657-fd0a-4189-9ba9-9a051ebbfacb', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:32:01.129298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:32:01.129726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:32:01.130321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:32:01.130744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:32:01.131160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:32:01.140335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:01.140825 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:01.141272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:01.142053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:01.142521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:01.142956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:01.160567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:32:01.166892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:32:01.180031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:32:01.182337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:32:01.228997 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f90b04a6-0564-44ee-8a5f-c477510a2c85 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.587114 Sep 13 17:32:01.229662 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3761/7574] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:32:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:32:01.241370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d33f28f8-98d7-45bb-976f-e0a5715cf5cd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:01.242209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d33f28f8-98d7-45bb-976f-e0a5715cf5cd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:01.296443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d33f28f8-98d7-45bb-976f-e0a5715cf5cd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:01.303452 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d33f28f8-98d7-45bb-976f-e0a5715cf5cd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1236 microversion: 2.1 time: 0.066112 Sep 13 17:32:01.304029 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3814/7575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:01 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:02.329267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27c15c61-c1d9-442a-8338-54f003a20e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:02.329911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27c15c61-c1d9-442a-8338-54f003a20e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:02.388396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-27c15c61-c1d9-442a-8338-54f003a20e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:02.395828 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27c15c61-c1d9-442a-8338-54f003a20e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1236 microversion: 2.1 time: 0.071239 Sep 13 17:32:02.396392 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3762/7576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:02 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:03.420790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-455ea92f-cf5c-4697-a9dd-657062de86e9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:03.421460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-455ea92f-cf5c-4697-a9dd-657062de86e9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:03.480822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-455ea92f-cf5c-4697-a9dd-657062de86e9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:03.488104 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-455ea92f-cf5c-4697-a9dd-657062de86e9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1236 microversion: 2.1 time: 0.071928 Sep 13 17:32:03.488759 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3815/7577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:03 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:04.511733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dfe2a5e8-340b-450d-a326-b2844660bfb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:04.512354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dfe2a5e8-340b-450d-a326-b2844660bfb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:04.567167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dfe2a5e8-340b-450d-a326-b2844660bfb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:04.574642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dfe2a5e8-340b-450d-a326-b2844660bfb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1236 microversion: 2.1 time: 0.066858 Sep 13 17:32:04.575426 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3763/7578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:04 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:05.598523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:05.599157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:05.607471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:05.608072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:05.608559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:05.609312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:05.609818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:05.610346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:05.672163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:05.680409 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-65c47466-188b-45a6-92c2-f6ed3a8347d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1240 microversion: 2.1 time: 0.085136 Sep 13 17:32:05.681014 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3816/7579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:05 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:06.704377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:06.705003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:06.712985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:06.713527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:06.714012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:06.714774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:06.715286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:06.715731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:06.814636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:06.822884 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e39c6e8c-998f-4eb3-a5a4-f209e9109f18 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1294 microversion: 2.1 time: 0.122592 Sep 13 17:32:06.823484 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3764/7580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:06 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:07.846769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:07.847521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:07.856903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:07.857754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:07.858435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:07.859237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:07.860072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:07.860724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:07.903478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d2ad5b69-bde4-498b-b3ee-660ed0d498aa req-f27f536d-9cf8-4a52-9134-baa6f3e144dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:32:07.919989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d2ad5b69-bde4-498b-b3ee-660ed0d498aa req-f27f536d-9cf8-4a52-9134-baa6f3e144dd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:07.920593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d2ad5b69-bde4-498b-b3ee-660ed0d498aa req-f27f536d-9cf8-4a52-9134-baa6f3e144dd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:07.921330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d2ad5b69-bde4-498b-b3ee-660ed0d498aa req-f27f536d-9cf8-4a52-9134-baa6f3e144dd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:07.952589 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d2ad5b69-bde4-498b-b3ee-660ed0d498aa req-f27f536d-9cf8-4a52-9134-baa6f3e144dd service nova] Creating event network-changed:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h2-857467-1 Sep 13 17:32:07.966511 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d2ad5b69-bde4-498b-b3ee-660ed0d498aa req-f27f536d-9cf8-4a52-9134-baa6f3e144dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067518 Sep 13 17:32:07.967267 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3765/7581] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:32:08.015989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:08.025250 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc756910-e5d1-4d89-877f-43c33682c954 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1361 microversion: 2.1 time: 0.182177 Sep 13 17:32:08.025867 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3817/7582] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:07 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:09.050324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:09.051060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:09.057329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:09.057817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:09.058312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:09.059017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:09.059473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:09.059909 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:09.196637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:09.204422 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62bcce0b-ecd2-42ed-bc51-2d2e0f4f2e8c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1361 microversion: 2.1 time: 0.159231 Sep 13 17:32:09.204999 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3766/7583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:09 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:10.229670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:10.230327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:10.237257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:10.237755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:10.238243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:10.238946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:10.239422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:10.239864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:10.374827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:10.382428 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c326716-7203-4b28-96f3-d255f4daa0bf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1361 microversion: 2.1 time: 0.156671 Sep 13 17:32:10.383017 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3818/7584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:10 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:11.406796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:11.407405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:11.410249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:32:11.415850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:11.416357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:11.416810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:11.417533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:11.418035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:11.418477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:11.551385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:11.559968 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94e17105-20d3-4e6d-b6a5-ab5ec46fb111 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1361 microversion: 2.1 time: 0.157102 Sep 13 17:32:11.560682 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3767/7585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:11 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:12.584057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:12.584700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:12.592041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:12.592523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:12.592974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:12.593677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:12.594183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:12.594625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:12.996951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:13.005551 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e9c175e7-ddbe-424b-8bed-a2bdafd885d0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1361 microversion: 2.1 time: 0.425545 Sep 13 17:32:13.006247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3819/7586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:12 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:13.486161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-06d3148c-ab83-4627-8b24-4659725a16f7 req-f48ccdf0-d2f3-4ad5-84c9-95aa7a42ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "name": "network-vif-plugged", "status": "completed", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:32:13.496730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-06d3148c-ab83-4627-8b24-4659725a16f7 req-f48ccdf0-d2f3-4ad5-84c9-95aa7a42ea0e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:13.497218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-06d3148c-ab83-4627-8b24-4659725a16f7 req-f48ccdf0-d2f3-4ad5-84c9-95aa7a42ea0e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:13.497649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-06d3148c-ab83-4627-8b24-4659725a16f7 req-f48ccdf0-d2f3-4ad5-84c9-95aa7a42ea0e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:13.509888 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-06d3148c-ab83-4627-8b24-4659725a16f7 req-f48ccdf0-d2f3-4ad5-84c9-95aa7a42ea0e service nova] Creating event network-vif-plugged:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h2-857467-1 Sep 13 17:32:13.514911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-06d3148c-ab83-4627-8b24-4659725a16f7 req-f48ccdf0-d2f3-4ad5-84c9-95aa7a42ea0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Sep 13 17:32:13.515519 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3768/7587] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:32:14.030589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:14.031212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:14.033173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:32:14.039253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:14.040513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:14.041094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:14.041796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:14.042291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:14.042730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:14.175081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:14.183106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a9486025-0810-4da0-9282-47301b3bcd0b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1361 microversion: 2.1 time: 0.156549 Sep 13 17:32:14.183670 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3820/7588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:14 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:15.205304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=10 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:32:15.209510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:15.210254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:15.217234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:15.217734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:15.218197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:15.218896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:15.219363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:15.219798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:15.354143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:32:15.362066 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be3dbb00-cf21-48c4-8392-b9dacdc1c73c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1549 microversion: 2.1 time: 0.158490 Sep 13 17:32:15.362651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3769/7589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:32:15 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:32:15.386453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:32:15.386988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:32:15.393849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:15.394362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:15.394819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:15.395531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:15.396008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:15.396452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:15.474911 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc78ac6d-20d7-48d6-9837-9469413e2083 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093943 Sep 13 17:32:15.475516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3821/7590] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 17:32:15 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:32:16.516000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a5960bc5-bb87-4d32-8f4f-8a6bc4543b0c req-2b3c2ca1-5ee3-4164-bfb5-3c83191b3815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:32:16.525943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5960bc5-bb87-4d32-8f4f-8a6bc4543b0c req-2b3c2ca1-5ee3-4164-bfb5-3c83191b3815 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:32:16.526431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5960bc5-bb87-4d32-8f4f-8a6bc4543b0c req-2b3c2ca1-5ee3-4164-bfb5-3c83191b3815 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:32:16.526878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a5960bc5-bb87-4d32-8f4f-8a6bc4543b0c req-2b3c2ca1-5ee3-4164-bfb5-3c83191b3815 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:32:16.537946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a5960bc5-bb87-4d32-8f4f-8a6bc4543b0c req-2b3c2ca1-5ee3-4164-bfb5-3c83191b3815 service nova] Creating event network-changed:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h2-857467-1 Sep 13 17:32:16.544903 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a5960bc5-bb87-4d32-8f4f-8a6bc4543b0c req-2b3c2ca1-5ee3-4164-bfb5-3c83191b3815 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086871 Sep 13 17:32:16.545523 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3770/7591] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:33:30.487322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:33:30.488099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:33:30.489171 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:33:30.489319 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action (ip 10.222.0.61) !!! Sep 13 17:33:30.496300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b980a6c-009c-4319-b052-95071d45a23c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:30.505866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b980a6c-009c-4319-b052-95071d45a23c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:30.506384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b980a6c-009c-4319-b052-95071d45a23c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:30.506845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b980a6c-009c-4319-b052-95071d45a23c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:30.530922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b980a6c-009c-4319-b052-95071d45a23c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Going to try to stop instance {{(pid=122328) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 17:33:30.571184 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b980a6c-009c-4319-b052-95071d45a23c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action" status: 202 len: 0 microversion: 2.1 time: 0.086260 Sep 13 17:33:30.571793 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3822/7592] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:33:30 2022] POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:33:30.579167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:33:30.579939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=60 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:33:30.580958 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:33:30.581128 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a (ip 10.222.0.61) !!! Sep 13 17:33:30.586325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:30.587038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:30.598171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:30.598906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:30.599348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:30.600062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:30.600527 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:30.600961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:30.803603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:30.811900 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a60a66bb-6913-489d-a7ca-2b7369344316 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.235002 Sep 13 17:33:30.812510 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3771/7593] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:30 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:31.839479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:31.840142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:31.846418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:31.846930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:31.847389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:31.848108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:31.848590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:31.849040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:32.034376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:32.042745 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d803797-c4ca-46f2-933c-bfae298543c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.208720 Sep 13 17:33:32.043312 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3823/7594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:31 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:33.067202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:33.067831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:33.075510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:33.076004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:33.076453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:33.077158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:33.077627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:33.078090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:33.207172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:33.215198 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-642d387d-f956-4b43-857b-ba03c37ab0b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.151928 Sep 13 17:33:33.215788 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3772/7595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:33 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:34.238771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:34.239400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:34.246670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:34.247175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:34.247631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:34.248339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:34.248814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:34.249258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:34.385962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:34.393661 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-82e3799c-45ae-4b76-b348-242a73520812 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.158941 Sep 13 17:33:34.394265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3824/7596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:34 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:35.418196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:35.418726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:35.425856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:35.426348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:35.426789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:35.427488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:35.427955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:35.428387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:35.561637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:35.569445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ab9c7afc-ddc2-4454-ba1a-91110a475943 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.155324 Sep 13 17:33:35.570069 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3773/7597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:35 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:33:36.594672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:36.595297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:36.602176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:36.602675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:36.603126 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:36.603877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:36.604346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:36.604780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:36.738204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:36.746011 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87d533fe-8f7d-4786-a4f6-78ba094f4a77 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.155457 Sep 13 17:33:36.746584 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3825/7598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:36 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:37.769851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:37.770477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:37.777980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:37.778472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:37.778912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:37.779609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:37.780100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:37.780534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:37.911096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:37.918972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e0c0eb1c-9cf1-4b13-8eee-93b740780029 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.153013 Sep 13 17:33:37.919807 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3774/7599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:37 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:38.944906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:38.945547 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:38.953235 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:38.953750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:38.954238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:38.954969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:38.955450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:38.955900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:39.084316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:39.092851 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-730247b3-30bc-4ccb-95c1-b6ad5f6f52d2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.153394 Sep 13 17:33:39.093466 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3826/7600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:38 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:40.116031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:40.116650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:40.124273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:40.124755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:40.125193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:40.125906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:40.126370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:40.126802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:40.254681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:40.263231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b4fa9a8-d6c6-467a-84ae-dbbccc10a88f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.151281 Sep 13 17:33:40.263821 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3775/7601] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:40 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:41.287285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:41.287875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:41.295994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:41.296497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:41.296954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:41.297665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:41.298166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:41.298611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:41.431595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:41.439419 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4766ec8b-2c39-49b2-8ead-b1ee9a114c14 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1654 microversion: 2.1 time: 0.156141 Sep 13 17:33:41.439992 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3827/7602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:41 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:41.462067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:41.464969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:41.471794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:41.472288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:41.472731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:41.473424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:41.473911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:41.474343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:41.502516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:41.507826 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:33:41.514459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:33:41.514881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:33:41.515356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:33:41.515769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:33:41.516180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:33:41.582346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cfdf6376-810f-40b0-80c5-19c476530cc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action" status: 202 len: 0 microversion: 2.1 time: 0.124057 Sep 13 17:33:41.582899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3776/7603] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:33:41 2022] POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:33:41.591679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:41.592318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:41.598579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:41.599250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:41.599705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:41.600419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:41.600921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:41.601364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:41.739188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:41.747716 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b1b56fa-ced6-436a-97e9-c97a56e52055 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.160607 Sep 13 17:33:41.748309 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3828/7604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:41 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:42.772829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:42.773440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:42.780020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:42.780504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:42.780944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:42.781633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:42.782121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:42.782555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:42.924268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:42.932705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-309b82d3-7565-4ad0-92f8-883143bd76f8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1677 microversion: 2.1 time: 0.164615 Sep 13 17:33:42.933658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3777/7605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:42 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:43.957279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:43.957972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:43.965580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:43.966116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:43.966570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:43.967285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:43.967761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:43.968208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:44.104341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:44.112132 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cd4e4ecc-99ba-4607-937c-de05982eea4c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1682 microversion: 2.1 time: 0.158843 Sep 13 17:33:44.112721 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3829/7606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:43 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:45.135703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:45.136332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:45.143367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:45.143866 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:45.144315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:45.145030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:45.145507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:45.145979 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:45.286884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:45.296007 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6dcdaa9-44bf-485e-8a25-38e5db99d497 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1682 microversion: 2.1 time: 0.164241 Sep 13 17:33:45.296594 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3778/7607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:45 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:46.320080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:46.320730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:46.325262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "name": "network-vif-unplugged", "status": "completed", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:46.328346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:46.329066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:46.329623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:46.330454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:46.330977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:46.331429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:46.339887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:46.340396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:46.340835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:46.353946 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] Creating event network-vif-unplugged:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h1-857467-1 Sep 13 17:33:46.360560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:33:46.372650 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d797507d-8793-4d9c-a27b-486cc1c149f5 req-65c45686-57f7-4eac-a008-4238b3826f71 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051096 Sep 13 17:33:46.373265 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3779/7608] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:33:46.470359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:46.478323 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-98a99ffd-26bf-4c91-983f-98f2f584610b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1681 microversion: 2.1 time: 0.162305 Sep 13 17:33:46.479729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3830/7609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:46 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:47.505306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:47.506039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:47.513379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:47.513892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:47.514337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:47.515023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:47.515483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:47.515911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:47.649960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:47.657923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bbb8d584-db0d-42d1-9559-ef03d0775fd7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1679 microversion: 2.1 time: 0.156841 Sep 13 17:33:47.658499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3780/7610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:47 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:48.388771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:48.398355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:48.398847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:48.399291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:48.411298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] Creating event network-changed:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h1-857467-1 Sep 13 17:33:48.417089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:33:48.428020 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-af0cd07a-4b58-4115-be37-f7bc96a0b553 req-2faf4837-e3bc-457c-ae27-2d679e895885 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042945 Sep 13 17:33:48.428611 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3831/7611] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:33:48.681339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:48.682119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:48.689010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:48.689543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:48.690052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:48.690771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:48.691244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:48.691688 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:48.914883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:48.923068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b37bbc8-317c-4cfa-b151-018b774fcbb6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1679 microversion: 2.1 time: 0.245658 Sep 13 17:33:48.923851 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3781/7612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:48 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:49.951883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:49.954093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:49.965527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:49.966283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:49.966766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:49.967671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:49.968358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:49.969015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:50.133812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:50.141939 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f4695034-d29c-4f9b-b265-ed05b6ac946f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1675 microversion: 2.1 time: 0.198154 Sep 13 17:33:50.142878 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3832/7613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:49 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:50.167394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:50.168096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:50.178613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:50.178959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:50.179478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:50.180201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:50.180667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:50.181106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:50.241395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6481c09-1393-4a66-837c-19fe8f48f6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action" status: 204 len: 0 microversion: 2.1 time: 0.079554 Sep 13 17:33:50.242118 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3782/7614] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:33:50 2022] POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:33:50.251953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:50.252604 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:50.259039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:50.259646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:50.260778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:50.262461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:50.262947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:50.263587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:50.407918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:50.415997 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b0d1bfa-d7ff-49e9-a0b0-3e0d6ba92af3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1675 microversion: 2.1 time: 0.168139 Sep 13 17:33:50.416677 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3833/7615] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:50 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:51.441209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:51.441952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:51.448577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:51.449065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:51.449508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:51.450240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:51.450736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:51.451168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:51.598292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:51.606526 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-885b4aae-d3fe-4486-984a-59251900ec62 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1675 microversion: 2.1 time: 0.170387 Sep 13 17:33:51.607108 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3783/7616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:51 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:52.016899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d70a7e2e-8539-4bb2-b86f-a9ba38d0f743 req-e5a2d624-c6ae-4b2c-8d23-6d67dc3ecd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "name": "network-vif-plugged", "status": "completed", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:52.028230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d70a7e2e-8539-4bb2-b86f-a9ba38d0f743 req-e5a2d624-c6ae-4b2c-8d23-6d67dc3ecd8a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:52.028718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d70a7e2e-8539-4bb2-b86f-a9ba38d0f743 req-e5a2d624-c6ae-4b2c-8d23-6d67dc3ecd8a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:52.029176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d70a7e2e-8539-4bb2-b86f-a9ba38d0f743 req-e5a2d624-c6ae-4b2c-8d23-6d67dc3ecd8a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:52.041591 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d70a7e2e-8539-4bb2-b86f-a9ba38d0f743 req-e5a2d624-c6ae-4b2c-8d23-6d67dc3ecd8a service nova] Creating event network-vif-plugged:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h1-857467-1 Sep 13 17:33:52.047119 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d70a7e2e-8539-4bb2-b86f-a9ba38d0f743 req-e5a2d624-c6ae-4b2c-8d23-6d67dc3ecd8a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034080 Sep 13 17:33:52.047736 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3834/7617] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:33:52.630412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:52.631065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:52.639179 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:52.639671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:52.640113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:52.640822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:52.642861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:52.643392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:52.812827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:52.820698 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d14179f1-c65d-4033-89f4-08b395ce9981 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1654 microversion: 2.1 time: 0.194155 Sep 13 17:33:52.821278 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3784/7618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:52 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1654 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:52.844362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:52.845071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:52.851272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:52.851771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:52.852224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:52.852927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:52.853525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:52.854011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:52.986159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:52.993744 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d955f48-b91a-4797-a7aa-8ab2c1c2a367 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1654 microversion: 2.1 time: 0.153698 Sep 13 17:33:52.994958 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3835/7619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:52 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:53.017134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-45ea61ef-21ec-48f3-b5e0-7a4ebf9d24a8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:53.023094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45ea61ef-21ec-48f3-b5e0-7a4ebf9d24a8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:53.023579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45ea61ef-21ec-48f3-b5e0-7a4ebf9d24a8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:53.024015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-45ea61ef-21ec-48f3-b5e0-7a4ebf9d24a8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:53.038087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:33:53.049462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-45ea61ef-21ec-48f3-b5e0-7a4ebf9d24a8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Going to try to start instance {{(pid=122327) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 17:33:53.091568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-45ea61ef-21ec-48f3-b5e0-7a4ebf9d24a8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action" status: 202 len: 0 microversion: 2.1 time: 0.078224 Sep 13 17:33:53.092177 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3785/7620] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:33:53 2022] POST /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:33:53.100577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:53.101206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:53.108762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:53.109302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:53.109881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:53.110633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:53.111179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:53.111556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:53.261370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:53.270242 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-caf432fa-1249-419c-8a4a-605b45252f70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1663 microversion: 2.1 time: 0.173518 Sep 13 17:33:53.270843 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3836/7621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:53 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1663 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:33:54.296788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:54.297566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:54.304312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:54.304843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:54.305280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:54.306013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:54.306506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:54.307041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:54.445951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:54.453864 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f3a31b23-85e8-4c30-a44f-ea322019139f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1663 microversion: 2.1 time: 0.163261 Sep 13 17:33:54.454425 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3786/7622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:54 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:55.477098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:55.477749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:55.485132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:55.485638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:55.486123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:55.486840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:55.487325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:55.487772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:55.617179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:55.625553 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7805f1df-cda4-45b1-81bc-79bd52843ffa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1667 microversion: 2.1 time: 0.152401 Sep 13 17:33:55.626159 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3837/7623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:55 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:55.648338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:55.648858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:55.656295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:55.656791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:55.657244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:55.657985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:55.658456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:55.658902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:55.684973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:33:55.762779 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c6e4908-e9f7-4b6c-9b70-085eacc8af4d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 204 len: 0 microversion: 2.1 time: 0.117862 Sep 13 17:33:55.763594 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3787/7624] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:33:55 2022] DELETE /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:33:55.771881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:55.772515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:55.778897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:55.779400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:55.779854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:55.780558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:55.781034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:55.781478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:55.801398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:33:55.921961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:55.929845 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2547dccc-1dd8-43f6-b835-c71901a1821c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1673 microversion: 2.1 time: 0.161825 Sep 13 17:33:55.930435 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3838/7625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:55 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:56.954591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:56.955360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:56.962139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:56.962628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:56.963111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:56.963774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:56.964234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:56.964665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:57.105326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:57.113263 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a5a7c813-7f3a-4993-bd26-7f71b01b82c5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1673 microversion: 2.1 time: 0.162996 Sep 13 17:33:57.113885 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3788/7626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:56 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:58.139835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:58.140506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:58.147886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:58.147984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:58.148409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:58.149279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:58.149760 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:58.150862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:58.219367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:33:58.229510 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c51b1f61-7ca1-419c-8e0e-412ea14dd6bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 200 len: 1606 microversion: 2.1 time: 0.095427 Sep 13 17:33:58.230352 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3839/7627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:58 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:33:58.429745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-6e66e422-73a3-4597-9b07-63d98f0ef967 req-dac760c8-6679-4f36-9eed-f4a4dc3d1e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da3bbe8-b348-4871-a2e1-dca9d6664e2a", "name": "network-vif-deleted", "tag": "d98c1764-ea85-49a0-8540-5a5a2065ddbf"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:58.440247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6e66e422-73a3-4597-9b07-63d98f0ef967 req-dac760c8-6679-4f36-9eed-f4a4dc3d1e86 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:58.440765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6e66e422-73a3-4597-9b07-63d98f0ef967 req-dac760c8-6679-4f36-9eed-f4a4dc3d1e86 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:58.441323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-6e66e422-73a3-4597-9b07-63d98f0ef967 req-dac760c8-6679-4f36-9eed-f4a4dc3d1e86 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:58.453591 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-6e66e422-73a3-4597-9b07-63d98f0ef967 req-dac760c8-6679-4f36-9eed-f4a4dc3d1e86 service nova] Creating event network-vif-deleted:d98c1764-ea85-49a0-8540-5a5a2065ddbf for instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a on n-h1-857467-1 Sep 13 17:33:58.458990 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-6e66e422-73a3-4597-9b07-63d98f0ef967 req-dac760c8-6679-4f36-9eed-f4a4dc3d1e86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Sep 13 17:33:58.459822 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3789/7628] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:33:59.252762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:59.253393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:59.261157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:59.261663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:59.262140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:59.262897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:59.263373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:59.263819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:59.279103 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a HTTP/1.1 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9da3bbe8-b348-4871-a2e1-dca9d6664e2a'} Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:33:59.280821 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:33:59.285592 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-63433216-17ba-4f82-91ab-9e8ef7d31a4a tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 404 len: 111 microversion: 2.1 time: 0.033477 Sep 13 17:33:59.286295 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3840/7629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:59 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:33:59.307461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:33:59.308342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:33:59.314921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:59.315420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:59.315862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:59.316601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:33:59.317257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:33:59.317694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:33:59.331745 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a HTTP/1.1 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9da3bbe8-b348-4871-a2e1-dca9d6664e2a'} Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:33:59.333430 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27cd7279-1b6c-4ed0-a786-f75bffa94691 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 404 len: 111 microversion: 2.1 time: 0.032636 Sep 13 17:33:59.337650 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3790/7630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:33:59 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:33:59.384431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1483488926", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "079fe657-fd0a-4189-9ba9-9a051ebbfacb"}], "security_groups": [{"name": "tempest-securitygroup--543111308"}], "key_name": "tempest-keypair-51890898", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:33:59.520756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] validate_networks() for [('079fe657-fd0a-4189-9ba9-9a051ebbfacb', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:33:59.987997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:33:59.988443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:33:59.988972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:33:59.989559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:33:59.990043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:33:59.999920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:00.000424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:00.000882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:00.001632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:00.002166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:00.002616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:00.021770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:34:00.027467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:34:00.039670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:34:00.044287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:34:00.101222 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08587167-07b7-4ce3-96bc-b805db903bd3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720530 Sep 13 17:34:00.101920 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3841/7631] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:33:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:34:00.113715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee84b327-281f-4fb9-b70c-fd682c9d564e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:00.114363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee84b327-281f-4fb9-b70c-fd682c9d564e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:00.171940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee84b327-281f-4fb9-b70c-fd682c9d564e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:00.179803 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee84b327-281f-4fb9-b70c-fd682c9d564e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1237 microversion: 2.1 time: 0.069948 Sep 13 17:34:00.180371 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3791/7632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:00 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:01.204629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:01.205256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:01.208743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:34:01.214289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:01.214855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:01.215318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:01.216047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:01.216557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:01.217058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:01.281046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:01.288810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7039e37-c59d-48c8-b3cc-a382f5369492 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1307 microversion: 2.1 time: 0.088220 Sep 13 17:34:01.289387 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3842/7633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:01 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:02.313239 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:02.313885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:02.316955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:34:02.322989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:02.323617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:02.324072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:02.324963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:02.325602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:02.326075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:02.572947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:02.580686 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da68ac8c-5c4e-4f0f-9b23-f9207b0c28b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.271348 Sep 13 17:34:02.581269 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3792/7634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:02 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:02.729066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-460a90b7-6202-4042-aa55-9c3fa06a53c0 req-47397651-f501-42c0-bcb4-516b4964b1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:34:02.740907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-460a90b7-6202-4042-aa55-9c3fa06a53c0 req-47397651-f501-42c0-bcb4-516b4964b1af service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:02.741595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-460a90b7-6202-4042-aa55-9c3fa06a53c0 req-47397651-f501-42c0-bcb4-516b4964b1af service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:02.742260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-460a90b7-6202-4042-aa55-9c3fa06a53c0 req-47397651-f501-42c0-bcb4-516b4964b1af service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:02.753907 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-460a90b7-6202-4042-aa55-9c3fa06a53c0 req-47397651-f501-42c0-bcb4-516b4964b1af service nova] Creating event network-changed:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:34:02.758866 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-460a90b7-6202-4042-aa55-9c3fa06a53c0 req-47397651-f501-42c0-bcb4-516b4964b1af service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034961 Sep 13 17:34:02.759975 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3843/7635] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:34:03.605244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:03.605876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:03.612745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:03.613263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:03.613705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:03.614444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:03.614907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:03.615334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:03.743000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:03.751551 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d723210-9252-4c77-bf71-19d7338f88d5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.150716 Sep 13 17:34:03.752124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3793/7636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:03 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:04.775540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:04.776312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:04.783736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:04.784247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:04.784713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:04.785435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:04.785951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:04.786403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:04.924140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:04.932351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bdd1c05d-8339-43a1-acb2-066e3cdeffc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.161211 Sep 13 17:34:04.932930 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3844/7637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:04 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:05.956572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:05.957189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:05.965164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:05.965659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:05.966258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:05.966965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:05.967432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:05.967869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:06.105337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:06.113070 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d74fc4bc-35b4-4961-b54c-9b1b25111b6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.160362 Sep 13 17:34:06.113658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3794/7638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:05 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:07.140137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:07.140771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:07.147652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:07.148160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:07.148619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:07.149330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:07.149805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:07.151092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:07.283259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:07.291395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9e4c00dc-5f5a-4b90-96df-1f824cb4c2be tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.154595 Sep 13 17:34:07.292113 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3845/7639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:07 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:08.166860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3b233c64-9024-4be1-b44e-394d8e4ae47f req-17620a46-d1b3-4b77-bf3d-596b3c4b7d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "name": "network-vif-plugged", "status": "completed", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:34:08.177517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3b233c64-9024-4be1-b44e-394d8e4ae47f req-17620a46-d1b3-4b77-bf3d-596b3c4b7d55 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:08.178035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3b233c64-9024-4be1-b44e-394d8e4ae47f req-17620a46-d1b3-4b77-bf3d-596b3c4b7d55 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:08.178470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3b233c64-9024-4be1-b44e-394d8e4ae47f req-17620a46-d1b3-4b77-bf3d-596b3c4b7d55 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:08.189710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3b233c64-9024-4be1-b44e-394d8e4ae47f req-17620a46-d1b3-4b77-bf3d-596b3c4b7d55 service nova] Creating event network-vif-plugged:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:34:08.194863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3b233c64-9024-4be1-b44e-394d8e4ae47f req-17620a46-d1b3-4b77-bf3d-596b3c4b7d55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088614 Sep 13 17:34:08.195524 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3795/7640] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:34:08.318001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:08.319368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:08.327839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:08.328356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:08.328819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:08.329556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:08.330071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:08.330524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:08.470229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:08.478524 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d4ffab5-bd28-4aa6-be93-739c9e0ac3da tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.164685 Sep 13 17:34:08.479222 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3846/7641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:08 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:09.503408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:09.504116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:09.512244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:09.512733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:09.513175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:09.513912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:09.514382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:09.514840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:09.647758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:09.656049 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a9aee84-2fd7-46f6-ab6f-313ade24caf6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1362 microversion: 2.1 time: 0.156909 Sep 13 17:34:09.656658 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3796/7642] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:09 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:10.683202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:34:10.683976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:34:10.688198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:10.688822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:10.695706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:10.696144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:10.696594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:10.698159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:10.698631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:10.699081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:10.835013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:34:10.843291 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0fc6d6e5-7909-40b7-bdc6-d60875ca6b25 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1550 microversion: 2.1 time: 0.162419 Sep 13 17:34:10.843874 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3847/7643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:34:10 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:34:10.866085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:34:10.866601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:34:10.869119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:34:10.875419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:10.875913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:10.876355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:10.877057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:10.877523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:10.877997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:10.962822 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a2f3b540-a4e4-4a5e-9b7b-4f8bd09a37ee tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100289 Sep 13 17:34:10.963520 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3797/7644] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 17:34:10 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:34:11.899297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-e49817a4-8f81-45f8-b79f-c9bfab53208b req-46466d69-1758-4d6e-acca-632356d77ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:34:11.909996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e49817a4-8f81-45f8-b79f-c9bfab53208b req-46466d69-1758-4d6e-acca-632356d77ec3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:34:11.910507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e49817a4-8f81-45f8-b79f-c9bfab53208b req-46466d69-1758-4d6e-acca-632356d77ec3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:34:11.910961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-e49817a4-8f81-45f8-b79f-c9bfab53208b req-46466d69-1758-4d6e-acca-632356d77ec3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:34:11.922940 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-e49817a4-8f81-45f8-b79f-c9bfab53208b req-46466d69-1758-4d6e-acca-632356d77ec3 service nova] Creating event network-changed:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:34:11.927996 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-e49817a4-8f81-45f8-b79f-c9bfab53208b req-46466d69-1758-4d6e-acca-632356d77ec3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032400 Sep 13 17:34:11.928671 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3848/7645] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:23.709050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=11 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:23.709781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:23.765018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:23.767423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:23.773449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:23.773973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:23.774425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:23.775128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:23.775593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:23.776025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:23.804687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:23.810853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Old instance type m1.heat2, new instance type m1.heat {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:35:23.817385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:35:23.817813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:35:23.818317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:35:23.818732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:35:23.819147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:35:23.882313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-540d9f79-6836-43d3-a62d-359174dd5be4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619/action" status: 202 len: 0 microversion: 2.1 time: 0.175687 Sep 13 17:35:23.882931 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3798/7646] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:35:23 2022] POST /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:35:23.890850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=13 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:23.892096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=46 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:23.899521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:23.900326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:23.908850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:23.909357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:23.909819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:23.910786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:23.911272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:23.911723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:24.048827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:24.059093 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-028c5e61-ac09-4e97-81f1-c3b088cb57f3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1677 microversion: 2.1 time: 0.170446 Sep 13 17:35:24.071746 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3849/7647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:23 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:25.083793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:25.084686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:25.092256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:25.092668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:25.093118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:25.093841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:25.094316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:25.094747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:25.275947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:25.284546 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c6237d84-ff44-46fc-a16a-af4176d7007c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1677 microversion: 2.1 time: 0.206006 Sep 13 17:35:25.285149 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3799/7648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:25 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:26.308830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:26.309373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:26.316335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:26.316842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:26.317302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:26.318061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:26.318541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:26.318986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:26.454674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:26.463229 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f92bda91-6eed-4295-b86d-df5611a4ab6b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.157938 Sep 13 17:35:26.464076 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3850/7649] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:26 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:27.488428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:27.489053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:27.496084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:27.496568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:27.497008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:27.497754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:27.498248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:27.498681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:27.632592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:27.640538 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9d9c32e-d9fa-4dc6-bc55-0d7e2a1bc269 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.156101 Sep 13 17:35:27.641113 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3800/7650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:27 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:28.663793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:28.664460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:28.671759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:28.672266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:28.672725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:28.673440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:28.673946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:28.674399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:28.806645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:28.814539 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7170ba64-a1ea-40e3-b50b-dcb4d544241e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.154699 Sep 13 17:35:28.815137 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3851/7651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:28 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:29.839277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:29.839894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:29.846723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:29.847210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:29.847648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:29.848343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:29.848802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:29.849231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:29.977329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:29.986810 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c76d7d0d-9a04-4999-863f-0f44dee06f60 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.152090 Sep 13 17:35:29.987395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3801/7652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:29 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:31.010459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:31.011268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:31.018031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:31.018532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:31.018986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:31.019689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:31.020164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:31.020605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:31.152872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:31.160793 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-459689fe-9e65-467b-aac0-a98400aabd35 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.154321 Sep 13 17:35:31.161368 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3852/7653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:31 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:32.185095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:32.185717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:32.192585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:32.193077 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:32.193519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:32.194248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:32.194717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:32.195152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:32.330916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:32.338833 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-70908d3f-6c05-4790-b703-0889cab8b3bd tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.158123 Sep 13 17:35:32.339419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3802/7654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:32 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:33.363345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:33.363994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:33.371007 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:33.371514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:33.371975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:33.372736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:33.373222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:33.373674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:33.503905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:33.512359 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9132701a-8494-4bc6-9ac2-3d343b840da9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.153224 Sep 13 17:35:33.512951 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3853/7655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:33 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:34.536026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:34.536647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:34.543904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:34.544394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:34.544836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:34.545800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:34.546288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:34.546720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:34.939002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:34.946757 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4ca9d7aa-c5fe-4d32-9a5b-61e76ea04c45 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.414657 Sep 13 17:35:34.947327 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3803/7656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:34 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:35.970581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:35.971213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:35.978451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:35.978954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:35.979481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:35.980144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:35.980618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:35.981059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:36.111977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:36.120383 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac2fae67-b660-4759-a0eb-fdb738d4f8b2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.153352 Sep 13 17:35:36.120962 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3854/7657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:35 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:37.143846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:37.144461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:37.151259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:37.151740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:37.152181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:37.152876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:37.153336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:37.153765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:37.287528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:37.296440 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e054ea2-cb68-42d5-bab4-78b1dc404dc7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.156414 Sep 13 17:35:37.297013 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3804/7658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:37 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:38.323973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:38.324562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:38.331773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:38.332285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:38.333074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:38.333810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:38.334311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:38.334754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:38.484553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:38.492421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e96f2eb-de70-4daf-8ffd-f92de981282c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1682 microversion: 2.1 time: 0.173346 Sep 13 17:35:38.493001 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3855/7659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:38 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:38.933511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "name": "network-vif-unplugged", "status": "completed", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:38.942912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:38.943392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:38.943901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:38.955640 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] Creating event network-vif-unplugged:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h1-857467-1 Sep 13 17:35:38.961112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] Instance 473f401d-fc0e-4e4d-a9af-764aee800619 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:35:38.974584 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-814300d6-38f7-40c6-8a60-71e5581b80eb req-c6ec103f-e4b4-490f-8cb2-68b6c16d6773 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100086 Sep 13 17:35:38.975546 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3805/7660] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:39.516393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:39.517032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:39.524349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:39.524858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:39.525313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:39.526106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:39.526577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:39.527041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:39.663511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:39.671871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76736063-6b45-4479-b996-7d034a83028f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1681 microversion: 2.1 time: 0.159310 Sep 13 17:35:39.672465 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3856/7661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:39 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:40.696819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:40.697574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:40.707256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:40.707748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:40.708195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:40.708900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:40.709365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:40.709802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:40.844413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:40.852390 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a310dd7d-4d4e-427a-a742-d1d9398b3e9e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1679 microversion: 2.1 time: 0.159852 Sep 13 17:35:40.852966 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3806/7662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:40 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:40.993388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:41.003918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:41.004421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:41.004871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:41.019428 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] Creating event network-changed:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h1-857467-1 Sep 13 17:35:41.024650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] Instance 473f401d-fc0e-4e4d-a9af-764aee800619 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:35:41.036018 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-993c9d1a-09ca-48f6-91ab-b34f1936585b req-9f206235-e1f3-4b9c-8246-172de6a7a6c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046751 Sep 13 17:35:41.036631 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3857/7663] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:41.876636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:41.877233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:41.884069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:41.884556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:41.885657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:41.886385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:41.886845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:41.887275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:42.017206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:42.025119 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-81105faa-7626-4db2-9891-94354097ba38 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1679 microversion: 2.1 time: 0.152552 Sep 13 17:35:42.025695 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3807/7664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:41 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:43.050135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:43.050920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:43.057537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.058129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.058594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.059315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.059799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.060248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.199218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:43.207150 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5bcc9661-d651-424f-bfd0-8ee258704de0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1676 microversion: 2.1 time: 0.162355 Sep 13 17:35:43.207924 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3858/7665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:43 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:43.230284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:43.230852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:43.239042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.239545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.239990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.240702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.241167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.241598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.280347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.280753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.281195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.281964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.282679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.283112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.303312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:35:43.309052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:35:43.413301 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2faff3de-0911-4afc-bb0b-44d32bc458cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619/action" status: 202 len: 0 microversion: 2.1 time: 0.186838 Sep 13 17:35:43.413956 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3808/7666] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:35:43 2022] POST /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:35:43.422874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:43.423514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:43.429666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.430212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.430747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.431549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:43.432657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:43.433190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:43.566340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:43.574867 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00898edc-1ce0-4d0b-a28a-f515d089b6b1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.156369 Sep 13 17:35:43.575445 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3859/7667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:43 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:44.599765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:44.600471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:44.607508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:44.607997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:44.608440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:44.609146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:44.609607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:44.610074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:44.690636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "name": "network-vif-plugged", "status": "completed", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:44.704149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:44.705155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:44.705799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:44.727969 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] Creating event network-vif-plugged:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h1-857467-1 Sep 13 17:35:44.734774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] Instance 473f401d-fc0e-4e4d-a9af-764aee800619 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:35:44.746983 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f4b055ff-1578-478c-8857-9950cb18b0f8 req-c6cfe6e5-14ec-4f37-a17b-8df6625046bc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069344 Sep 13 17:35:44.748175 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3860/7668] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:44.776913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:44.785177 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc8ed74e-0cdb-4c5e-b557-34f1c98219c3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.190695 Sep 13 17:35:44.785751 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3809/7669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:44 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:45.811491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:45.812202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:45.818337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:45.818842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:45.819295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:45.819999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:45.820472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:45.820915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:45.955634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:45.963982 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a4aa69c4-6072-4092-bf35-5a2bba6157b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.157878 Sep 13 17:35:45.964772 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3861/7670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:45 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:46.648200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "name": "network-vif-unplugged", "status": "completed", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:46.659286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:46.659785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:46.660234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:46.672624 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] Creating event network-vif-unplugged:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:35:46.675278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:46.679273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] Instance 473f401d-fc0e-4e4d-a9af-764aee800619 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:35:46.690290 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e17dc299-31b1-4f3b-aa69-bf7c1a472e8a req-c4406ad7-b680-4e56-a503-0e8d14ad273f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045862 Sep 13 17:35:46.690923 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3810/7671] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:46.988541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:46.989179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:46.997548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:46.998372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:46.999164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:47.000218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:47.001082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:47.001875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:47.154524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:47.163194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fbcb29a5-0082-41fa-a149-9275f24b90b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.178494 Sep 13 17:35:47.163803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3862/7672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:46 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:48.191729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:48.192397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:48.198949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:48.199446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:48.199896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:48.200605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:48.201078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:48.201517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:48.329402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:48.337235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5c709f09-6288-4e8e-930a-096000a890f0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.151689 Sep 13 17:35:48.337820 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3811/7673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:48 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:48.706051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:48.716636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:48.717136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:48.717588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:48.730098 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] Creating event network-changed:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:35:48.735300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] Instance 473f401d-fc0e-4e4d-a9af-764aee800619 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:35:48.746049 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b1c5150d-a84b-4871-a49f-cc204b094e62 req-7652dd0a-872e-45f0-96a5-e98e476e887e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043721 Sep 13 17:35:48.746653 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3863/7674] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:49.360489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:49.361139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:49.367966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:49.368454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:49.368898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:49.370173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:49.370640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:49.371075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:49.506958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:49.515579 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89fe7cb5-4fd6-42bf-bcc2-1483bbef3f1d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.159028 Sep 13 17:35:49.516165 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3812/7675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:49 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:50.540317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:50.541348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:50.547816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:50.548324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:50.548781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:50.549499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:50.550009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:50.550457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:50.688831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:50.698082 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dbd148a3-b268-4969-b783-630b91f1b5f5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1675 microversion: 2.1 time: 0.162186 Sep 13 17:35:50.698675 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3864/7676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:50 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:51.721548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:51.722214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:51.729821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:51.730346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:51.730793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:51.731502 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:51.731977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:51.732416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:51.863690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:51.872488 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2ee0d1ef-52bd-4921-8d23-cdf6d1df3077 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1668 microversion: 2.1 time: 0.155094 Sep 13 17:35:51.873077 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3813/7677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:51 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:51.895204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:51.895842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:51.902739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:51.903249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:51.903712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:51.904427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:51.904911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:51.905361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.039499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:52.048199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0b2f9b9e-2235-42bb-aee4-ae0ae2240212 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1668 microversion: 2.1 time: 0.156903 Sep 13 17:35:52.048795 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3865/7678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:51 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:35:52.071024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:52.071639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:52.078127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.078617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.079062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.079759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.080221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.080656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.214123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:52.221812 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-473300c7-b070-495d-82d2-6e0434c885e7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1668 microversion: 2.1 time: 0.154688 Sep 13 17:35:52.222409 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3814/7679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:52 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:52.246091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:52.246605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:52.252602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.253103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.253550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.254288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.254750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.255194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.273393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=100 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:52.281998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:35:52.356318 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bfee9671-fefa-4baf-95e0-6696b674425d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 204 len: 0 microversion: 2.1 time: 0.114129 Sep 13 17:35:52.357143 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3866/7680] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:35:52 2022] DELETE /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:35:52.367119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:52.368130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:52.374328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.374830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.375280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.375989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.376457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.376898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.507079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:52.514951 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1f337375-cc5f-445f-9c91-04bddd18ebfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1674 microversion: 2.1 time: 0.153418 Sep 13 17:35:52.515534 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3815/7681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:52 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:52.695895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-bd79c9a0-5aa8-45cb-b505-dcd7f1ce4f66 req-3942d90a-b1a4-43db-ac91-9b5169bad7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "name": "network-vif-plugged", "status": "completed", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:52.705933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bd79c9a0-5aa8-45cb-b505-dcd7f1ce4f66 req-3942d90a-b1a4-43db-ac91-9b5169bad7ee service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:52.706529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bd79c9a0-5aa8-45cb-b505-dcd7f1ce4f66 req-3942d90a-b1a4-43db-ac91-9b5169bad7ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:52.707001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-bd79c9a0-5aa8-45cb-b505-dcd7f1ce4f66 req-3942d90a-b1a4-43db-ac91-9b5169bad7ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:52.719968 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-bd79c9a0-5aa8-45cb-b505-dcd7f1ce4f66 req-3942d90a-b1a4-43db-ac91-9b5169bad7ee service nova] Creating event network-vif-plugged:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:35:52.725284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-bd79c9a0-5aa8-45cb-b505-dcd7f1ce4f66 req-3942d90a-b1a4-43db-ac91-9b5169bad7ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Sep 13 17:35:52.725923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3867/7682] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:53.538920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:53.539545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:53.543199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:53.548911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:53.549407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:53.549878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:53.550586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:53.551053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:53.551491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:53.689175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:53.696975 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76525f29-2574-4f70-9cb6-d6d356dba5b0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1674 microversion: 2.1 time: 0.162155 Sep 13 17:35:53.697818 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3816/7683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:53 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:54.721534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:54.722367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:54.725301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:54.731006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:54.731599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:54.732128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:54.732941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:54.733489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:54.734036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:54.759454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-869fb3eb-31f4-4b9c-b6c6-1c4491730abc req-3d887977-629e-4b77-ae9c-24b6d8492436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473f401d-fc0e-4e4d-a9af-764aee800619", "name": "network-vif-deleted", "tag": "9e85feba-bfc6-4315-9e90-25e273673690"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:54.775262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:35:54.778395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-869fb3eb-31f4-4b9c-b6c6-1c4491730abc req-3d887977-629e-4b77-ae9c-24b6d8492436 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:54.779001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-869fb3eb-31f4-4b9c-b6c6-1c4491730abc req-3d887977-629e-4b77-ae9c-24b6d8492436 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:54.779589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-869fb3eb-31f4-4b9c-b6c6-1c4491730abc req-3d887977-629e-4b77-ae9c-24b6d8492436 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:54.804899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:54.809603 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-869fb3eb-31f4-4b9c-b6c6-1c4491730abc req-3d887977-629e-4b77-ae9c-24b6d8492436 service nova] Creating event network-vif-deleted:9e85feba-bfc6-4315-9e90-25e273673690 for instance 473f401d-fc0e-4e4d-a9af-764aee800619 on n-h2-857467-1 Sep 13 17:35:54.814581 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3541b712-ca8f-42ce-93ea-a0ed82e0fd7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 200 len: 1607 microversion: 2.1 time: 0.097359 Sep 13 17:35:54.815269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-869fb3eb-31f4-4b9c-b6c6-1c4491730abc req-3d887977-629e-4b77-ae9c-24b6d8492436 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064489 Sep 13 17:35:54.815456 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3868/7684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:54 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 1607 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:54.816423 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3817/7685] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:35:55.839456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:55.840132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:55.847203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:55.847715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:55.848179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:55.848902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:55.849393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:55.849866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:55.866113 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 HTTP/1.1 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '473f401d-fc0e-4e4d-a9af-764aee800619'} Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:35:55.867851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e02715f-6ad2-4404-a01d-246fcc0a0b4b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 404 len: 111 microversion: 2.1 time: 0.034631 Sep 13 17:35:55.877351 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3869/7686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:55 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:35:55.889889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:55.890623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:55.897131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:55.897728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:55.898366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:55.899211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:55.899689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:55.900132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:55.914467 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 HTTP/1.1 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '473f401d-fc0e-4e4d-a9af-764aee800619'} Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:35:55.916805 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-addd1214-af59-4e37-8c92-755f4411afb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 404 len: 111 microversion: 2.1 time: 0.034127 Sep 13 17:35:55.921653 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3818/7687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:55 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:35:55.968329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1619814131", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "079fe657-fd0a-4189-9ba9-9a051ebbfacb"}], "security_groups": [{"name": "tempest-securitygroup--543111308"}], "key_name": "tempest-keypair-51890898", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:56.081861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] validate_networks() for [('079fe657-fd0a-4189-9ba9-9a051ebbfacb', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:35:56.449656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:35:56.450130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:35:56.450623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:35:56.451050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:35:56.451507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:35:56.460508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:56.461009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:56.461461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:56.462234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:56.462805 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:56.463752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:56.480527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:35:56.485689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:35:56.498554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:35:56.500848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:35:56.547500 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7e79d660-5326-462f-97f6-83b20e2d302f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.583452 Sep 13 17:35:56.548157 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3870/7688] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:35:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:35:56.559837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-209e53e2-92e7-41f1-96c8-40c1f4b61fc9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:56.560460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-209e53e2-92e7-41f1-96c8-40c1f4b61fc9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:56.617555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-209e53e2-92e7-41f1-96c8-40c1f4b61fc9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:56.626019 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-209e53e2-92e7-41f1-96c8-40c1f4b61fc9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1237 microversion: 2.1 time: 0.070314 Sep 13 17:35:56.626604 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3819/7689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:56 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:57.653481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:57.654367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:57.662236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:57.662837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:57.663368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:57.664261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:57.665273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:57.665858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:57.733576 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:57.741562 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3fc821b-030f-478b-babc-714b1ed3355c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1307 microversion: 2.1 time: 0.094834 Sep 13 17:35:57.742151 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3871/7690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:57 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:35:58.766678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:35:58.767467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:35:58.775357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:58.775855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:58.776916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:58.777662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:58.778155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:58.778590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:58.970585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:35:58.978447 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-353b0c15-02b2-4d9b-82af-135162481f28 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.215690 Sep 13 17:35:58.979610 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3820/7691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:58 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:35:59.115941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fc086d7e-50b5-4660-9e33-47cc7770e2af req-4bf32718-eaa1-4813-96c2-7515fb8b2c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:35:59.127794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fc086d7e-50b5-4660-9e33-47cc7770e2af req-4bf32718-eaa1-4813-96c2-7515fb8b2c79 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:35:59.128401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fc086d7e-50b5-4660-9e33-47cc7770e2af req-4bf32718-eaa1-4813-96c2-7515fb8b2c79 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:35:59.128927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fc086d7e-50b5-4660-9e33-47cc7770e2af req-4bf32718-eaa1-4813-96c2-7515fb8b2c79 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:35:59.143732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fc086d7e-50b5-4660-9e33-47cc7770e2af req-4bf32718-eaa1-4813-96c2-7515fb8b2c79 service nova] Creating event network-changed:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:35:59.148728 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fc086d7e-50b5-4660-9e33-47cc7770e2af req-4bf32718-eaa1-4813-96c2-7515fb8b2c79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Sep 13 17:35:59.149591 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3872/7692] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:36:00.002512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:00.003176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:00.010233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:00.011369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:00.011988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:00.012704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:00.013181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:00.013625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:00.149103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:00.157295 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0c66b7a9-b27b-4d49-b4a9-39caa07b8aaa tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.158805 Sep 13 17:36:00.157926 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3821/7693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:35:59 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:01.182472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:01.183232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:01.189430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:01.189968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:01.190430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:01.191132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:01.191607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:01.192052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:01.325304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:01.332962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32cbd75e-99e1-4882-9022-cfcbf8b719e8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.155627 Sep 13 17:36:01.333533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3873/7694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:36:01 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:02.357504 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:02.358146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:02.365044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:02.365536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:02.366025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:02.366729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:02.367195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:02.367628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:02.497926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:02.506170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8fb89b08-95c2-4a7e-b779-c917adf6af2c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.153359 Sep 13 17:36:02.506775 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3822/7695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:36:02 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:03.531259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:03.531887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:03.539068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:03.539574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:03.540025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:03.540736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:03.541211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:03.541799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:03.669066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:03.676962 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed16dfe4-e927-4920-b30e-75a6c721e016 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.149637 Sep 13 17:36:03.677536 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3874/7696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:36:03 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:04.700875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:04.701549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:04.708488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:04.708968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:04.709442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:04.710183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:04.710668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:04.711098 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:04.749363 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-4b59c4ec-0256-49f2-a4ed-72dbb29a05ff req-9ade4f1d-dd40-4cb1-af56-0c3727b6a543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "name": "network-vif-plugged", "status": "completed", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:36:04.759939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4b59c4ec-0256-49f2-a4ed-72dbb29a05ff req-9ade4f1d-dd40-4cb1-af56-0c3727b6a543 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:04.761020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4b59c4ec-0256-49f2-a4ed-72dbb29a05ff req-9ade4f1d-dd40-4cb1-af56-0c3727b6a543 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:04.761569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-4b59c4ec-0256-49f2-a4ed-72dbb29a05ff req-9ade4f1d-dd40-4cb1-af56-0c3727b6a543 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:04.773315 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-4b59c4ec-0256-49f2-a4ed-72dbb29a05ff req-9ade4f1d-dd40-4cb1-af56-0c3727b6a543 service nova] Creating event network-vif-plugged:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:36:04.779073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-4b59c4ec-0256-49f2-a4ed-72dbb29a05ff req-9ade4f1d-dd40-4cb1-af56-0c3727b6a543 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034186 Sep 13 17:36:04.780395 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3875/7697] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:36:04.844795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:04.853324 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-13ab4dbb-65da-4e21-bbb8-81c1a6d9e35d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.156276 Sep 13 17:36:04.859622 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3823/7698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:36:04 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:05.879111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:05.879829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:05.886848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:05.887353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:05.887815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:05.888528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:05.889009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:05.889521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:06.027185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:06.035037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-01ded45b-9327-49e5-9ef4-c78e87a8d64c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1362 microversion: 2.1 time: 0.161164 Sep 13 17:36:06.035628 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3876/7699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:36:05 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:07.059854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:07.060482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:07.063313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:36:07.069952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:07.070462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:07.071165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:07.071891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:07.072359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:07.072799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:07.207649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:36:07.215544 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a3f1cad-a6bd-4e11-a8fd-ba309c284413 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1550 microversion: 2.1 time: 0.159950 Sep 13 17:36:07.216141 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3824/7700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:36:07 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:36:07.238569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:36:07.239089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:36:07.241131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:36:07.241894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:36:07.249367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:07.249946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:07.250412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:07.251132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:07.251624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:07.252055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:07.334575 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2558156e-3953-4198-8809-ece98a36270d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098069 Sep 13 17:36:07.334575 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3877/7701] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Sep 13 17:36:07 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:36:08.576045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e6e09aa8-8eaf-4f23-940a-b9b964d416c8 req-e4598609-3bad-4691-96cf-0a5fa0b907a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:36:08.586448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e6e09aa8-8eaf-4f23-940a-b9b964d416c8 req-e4598609-3bad-4691-96cf-0a5fa0b907a4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:36:08.586940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e6e09aa8-8eaf-4f23-940a-b9b964d416c8 req-e4598609-3bad-4691-96cf-0a5fa0b907a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:36:08.587384 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e6e09aa8-8eaf-4f23-940a-b9b964d416c8 req-e4598609-3bad-4691-96cf-0a5fa0b907a4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:36:08.599733 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e6e09aa8-8eaf-4f23-940a-b9b964d416c8 req-e4598609-3bad-4691-96cf-0a5fa0b907a4 service nova] Creating event network-changed:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:36:08.604812 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e6e09aa8-8eaf-4f23-940a-b9b964d416c8 req-e4598609-3bad-4691-96cf-0a5fa0b907a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033044 Sep 13 17:36:08.605637 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3825/7702] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:37:22.183418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:22.184207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:22.185706 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:37:22.185875 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 (ip 10.222.0.61) !!! Sep 13 17:37:22.191560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:22.192182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:22.203880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:22.204382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:22.204838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:22.205548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:22.206053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:22.206513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:22.336592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:22.344510 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9a08980c-aa19-4caf-9807-c00f996f055c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1668 microversion: 2.1 time: 0.164264 Sep 13 17:37:22.345090 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3878/7703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:22 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:22.365647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=19 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:22.366515 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=72 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:22.368012 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:37:22.368158 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-volume_attachments (ip 10.222.0.61) !!! Sep 13 17:37:22.373524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73a85123-d7ab-4ad7-b2fd-44a5d4392050"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:37:22.376022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:22.385157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:22.385664 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:22.386142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:22.386856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:22.387325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:22.387765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:22.657928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1cd989d1-616e-4aa0-861e-f73563e59531 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294189 Sep 13 17:37:22.658567 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3826/7704] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:37:22 2022] POST /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:37:34.448615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:37:34.451102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:34.453955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:34.454641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:34.460221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:34.460727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:34.461183 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:34.461952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:34.462718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:34.463213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:34.506510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:34.513434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Old instance type m1.heat2, new instance type m1.heat {{(pid=122328) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:37:34.520500 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:37:34.520939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:37:34.521429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:37:34.521875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:37:34.522309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:37:34.586959 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4343a037-f820-4406-849d-d9876799e913 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/action" status: 202 len: 0 microversion: 2.1 time: 0.143164 Sep 13 17:37:34.587854 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3879/7705] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:37:34 2022] POST /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:37:34.594197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:34.595013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:37:34.599277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:34.600021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:34.609019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:34.609512 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:34.609988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:34.610709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:34.611210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:34.611609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:34.789270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:34.803175 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fdf04664-13fa-4d00-a516-77844b9a4dab tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1723 microversion: 2.1 time: 0.210936 Sep 13 17:37:34.804571 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3827/7706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:34 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:35.830109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:35.830738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:35.837735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:35.838275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:35.838734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:35.839442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:35.839912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:35.840352 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:35.974838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:35.983642 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d366f558-df11-4d17-bfec-b7f0f4f19864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1723 microversion: 2.1 time: 0.158810 Sep 13 17:37:35.984227 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3880/7707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:35 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:37.007678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:37.008294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:37.015666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:37.016155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:37.016603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:37.017299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:37.017768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:37.018228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:37.148322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:37.157568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a9b23552-7493-4b59-b728-4327c1559efc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1723 microversion: 2.1 time: 0.153847 Sep 13 17:37:37.158182 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3828/7708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:37 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:38.181430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:38.182079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:38.189010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:38.189516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:38.189997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:38.190711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:38.191181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:38.191620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:38.322310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:38.331137 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a52116b2-aebf-4e6b-b089-93287956819e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1723 microversion: 2.1 time: 0.153824 Sep 13 17:37:38.331729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3881/7709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:38 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:39.356110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:39.356747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:39.364310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:39.364821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:39.365380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:39.366290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:39.366898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:39.367351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:39.502357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:39.510868 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-68623a28-293d-418a-a6c4-83aa292ef659 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.159639 Sep 13 17:37:39.511457 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3829/7710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:39 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:37:40.535565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:40.536186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:40.544160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:40.544665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:40.545118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:40.546112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:40.546587 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:40.547034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:40.680231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:40.689332 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e92028f7-12fb-41b1-8f60-deb41a8082b9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.157619 Sep 13 17:37:40.689990 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3882/7711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:40 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:41.713897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:41.714559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:41.721428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:41.721976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:41.722408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:41.723105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:41.723573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:41.724009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:41.854829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:41.863119 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7605cd6f-2dab-4000-b806-820a06b6c90f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.153644 Sep 13 17:37:41.863690 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3830/7712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:41 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:42.890610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:42.891154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:42.898073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:42.898585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:42.899047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:42.899947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:42.900435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:42.900891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:43.029521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:43.037711 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fce60aab-3749-4e44-ad98-78f2e687856e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.151172 Sep 13 17:37:43.038420 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3883/7713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:42 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:44.062774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:44.063394 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:44.070245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:44.070734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:44.072024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:44.072732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:44.073196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:44.073629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:44.220064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:44.229637 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3355ea7a-f3a5-4637-a569-d141e0835cf5 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.170780 Sep 13 17:37:44.230251 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3831/7714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:44 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:45.252589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:45.253230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:45.260439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:45.260951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:45.261417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:45.262175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:45.262662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:45.263116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:45.396360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:45.405638 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7273a560-03c8-4ddb-a00a-76ab1bb9ac7e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.156940 Sep 13 17:37:45.406257 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3884/7715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:45 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:46.430071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:46.431291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:46.438259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:46.438748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:46.439189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:46.439887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:46.440347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:46.440779 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:46.571220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:46.579710 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7c2b8461-a931-4e42-99a1-204d918032d3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.153704 Sep 13 17:37:46.580281 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3832/7716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:46 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:47.603840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:47.604419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:47.610477 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:47.610986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:47.611442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:47.612154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:47.612634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:47.613083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:47.751367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:47.760198 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9bb8e4b3-44cc-41b4-97b5-eb7003bdacd9 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.161108 Sep 13 17:37:47.760770 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3885/7717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:47 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:48.783472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:48.784090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:48.791442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:48.791932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:48.792375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:48.793108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:48.793601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:48.794066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:48.923208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:48.932316 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95da4054-b309-4bfe-a65f-55408cd6688d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.152769 Sep 13 17:37:48.932897 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3833/7718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:48 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:49.955105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:49.955738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:49.963215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:49.963711 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:49.964162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:49.964869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:49.965343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:49.965783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:50.098525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:50.110226 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26ec7659-5b22-41c6-8d0f-f5f4b2478343 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.158907 Sep 13 17:37:50.110812 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3886/7719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:49 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:51.134391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:51.135014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:51.142051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:51.142549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:51.142999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:51.143705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:51.144177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:51.144619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:51.276966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:51.285371 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5f0b393e-2b0c-4419-8f28-85f89f674e56 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.154954 Sep 13 17:37:51.285982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3834/7720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:51 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:52.310665 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:52.311240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:52.318186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:52.318691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:52.319144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:52.319847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:52.320321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:52.320761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:52.454602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:52.463257 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-655ad2af-ed4c-437a-acfd-bf7e40706dc4 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.156565 Sep 13 17:37:52.463856 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3887/7721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:52 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:53.487075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:53.487729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:53.495666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:53.496157 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:53.496624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:53.497309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:53.497772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:53.498232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:53.631279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:53.639681 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-76ade2cb-326e-4088-9cb5-f65f746bed6f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.156656 Sep 13 17:37:53.640264 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3835/7722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:53 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:54.663553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:54.664188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:54.671682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:54.672189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:54.672674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:54.673391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:54.673906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:54.674359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:54.804244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:54.813309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-aa2c7a4e-3b76-4edb-8069-4acadd712208 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.153704 Sep 13 17:37:54.813912 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3888/7723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:54 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:55.837254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:55.838047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:55.844865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:55.845358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:55.845890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:55.846635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:55.847106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:55.847540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:55.995344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:56.003863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e8fd2f13-4c21-4393-9efe-ce17f01e34ac tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.171279 Sep 13 17:37:56.004445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3836/7724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:55 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:57.029994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:57.030632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:57.037911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:57.038420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:57.038882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:57.039634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:57.040324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:57.040776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:57.179692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:57.188355 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-580f330e-4c4d-4533-91df-24dcb4925b66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1728 microversion: 2.1 time: 0.162518 Sep 13 17:37:57.188943 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3889/7725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:57 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:37:58.213257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:58.213895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:58.221084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:58.221575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:58.222051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:58.222754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:58.223218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:58.223648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:58.231615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "name": "network-vif-unplugged", "status": "completed", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:37:58.242586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:58.243507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:58.244150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:58.256689 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] Creating event network-vif-unplugged:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h2-857467-1 Sep 13 17:37:58.262659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:37:58.274302 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ebb58f31-2f8f-41ca-b56c-6877cffaff84 req-c08831ed-ae2d-401e-b45e-cf39decbae2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046987 Sep 13 17:37:58.275321 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3890/7726] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:37:58.500258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:58.509124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ca2f476b-ce40-43cc-8bd8-7976d74d86e1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1727 microversion: 2.1 time: 0.299850 Sep 13 17:37:58.509706 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3837/7727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:58 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1727 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:37:59.535022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:37:59.535746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:37:59.542193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:59.542704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:59.543161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:59.543875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:37:59.544359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:37:59.544811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:37:59.677301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:37:59.686638 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f4e60a4-795a-4e3f-a2fc-71ab27f4368c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.157052 Sep 13 17:37:59.687240 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3891/7728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:37:59 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:00.324285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:00.335265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:00.335691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:00.336135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:00.350449 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] Creating event network-changed:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h2-857467-1 Sep 13 17:38:00.356605 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:38:00.368487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5bc3ff85-e2d0-4ce7-8cbf-73d0d9ada78c req-cf4ef2c1-404a-4896-92f8-406c60d715ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047625 Sep 13 17:38:00.369508 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3838/7729] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:38:00.712370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:00.713048 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:00.720175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:00.720687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:00.721148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:00.721899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:00.722389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:00.722839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:00.872733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:00.882117 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1a1162b6-720f-47ba-a1d5-0b60f06c5f90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.174318 Sep 13 17:38:00.882953 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3892/7730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:00 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:01.909840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:01.910588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:01.918829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:01.919326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:01.919775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:01.920487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:01.921232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:01.921654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:02.060185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:02.068912 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-82162428-64b1-409e-bce4-9290c3562a1b tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.163580 Sep 13 17:38:02.069536 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3839/7731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:01 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:03.092187 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:03.092816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:03.099794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:03.100297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:03.100753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:03.101509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:03.102554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:03.103003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:03.246621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:03.255665 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c0629203-57f9-4739-9def-249b8d3203b6 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.167001 Sep 13 17:38:03.255941 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3893/7732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:03 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:04.279439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:04.280065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:04.286946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:04.287442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:04.287898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:04.288591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:04.289060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:04.289523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:04.418079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:04.426701 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-79f2b6a7-3e40-4ff9-914b-0772cf3c2f23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.151204 Sep 13 17:38:04.427292 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3840/7733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:04 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:05.452946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:05.453593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:05.456540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=35 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:05.463155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:05.463669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:05.464136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:05.464882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:05.465419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:05.465880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:05.470472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:05.598285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:05.606733 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39be20ba-3ffe-4be2-b098-ef4e09dfc91e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.158865 Sep 13 17:38:05.607329 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3894/7734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:05 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:06.630768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:06.631407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:06.634254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=29 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:06.640002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:06.640491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:06.640935 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:06.641638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:06.642152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:06.642587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:06.645500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=83 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:07.101260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:07.109766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a21192d4-dfbc-4a4f-822f-3bf3cba06c01 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.482985 Sep 13 17:38:07.110369 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3841/7735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:06 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:08.133655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:08.134393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:08.142040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:08.142544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:08.143425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:08.144140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:08.144615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:08.145061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:08.279649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:08.287894 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-080bbd08-5d61-4b7f-9df2-2d741f9a0dfe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.158533 Sep 13 17:38:08.288476 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3895/7736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:08 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:09.312563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:09.313124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:09.320148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:09.320720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:09.321369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:09.322112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:09.322585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:09.323022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:09.454055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:09.462988 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f0c29609-e948-431b-9c79-336e1ffc2974 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.154441 Sep 13 17:38:09.463569 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3842/7737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:09 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:10.487808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:10.488451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:10.496319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:10.496831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:10.497289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:10.498069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:10.498544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:10.498990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:10.628257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:10.636764 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-08504e38-5cfc-45b3-b317-87a8a2e56c23 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.152975 Sep 13 17:38:10.637351 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3896/7738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:10 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:11.660432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:11.661053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:11.668086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:11.668577 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:11.669021 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:11.669726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:11.670217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:11.670653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:11.802166 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:11.811154 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6da273ab-f776-40c4-ad2e-3b01ea029d73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.154606 Sep 13 17:38:11.811754 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3843/7739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:11 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:12.835532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:12.836802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:12.843802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:12.844316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:12.844777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:12.845493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:12.846021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:12.846470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:12.976354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:12.984835 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f58b1df-31a4-4d8a-a842-964a0167a1fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1725 microversion: 2.1 time: 0.153277 Sep 13 17:38:12.985426 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3897/7740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:12 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:14.009218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:14.009899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:14.016748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.017242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.017690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.018424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.018892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.019328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.156834 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:14.165495 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aceae8c3-069c-440a-ac78-f0a6e1cb1088 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1722 microversion: 2.1 time: 0.161196 Sep 13 17:38:14.166113 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3844/7741] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:14 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:14.189272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:14.189925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:14.197580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.198121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.198584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.199303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.199786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.200239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.240599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.241111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.241572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.242875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.243354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.243807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.265109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:38:14.270349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Getting quotas for user 2bb0ba449d40457bbc4a7b23850b9c2e and project b7d039eee8804a7cb21e09b2ab4f063e. Resources: {'ram', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:38:14.371505 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fd9f24b9-83c7-421a-8225-0610163fb417 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "POST /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/action" status: 202 len: 0 microversion: 2.1 time: 0.185949 Sep 13 17:38:14.372111 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3898/7742] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:38:14 2022] POST /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:38:14.380365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:14.381078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:14.387858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.388679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.388970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.389777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:14.390293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:14.390887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:14.592072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:14.600428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d20bd006-2c50-430b-b222-d3e40f1def5d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.224058 Sep 13 17:38:14.601009 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3845/7743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:14 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:15.390186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "name": "network-vif-plugged", "status": "completed", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:15.403428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:15.403942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:15.404405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:15.415993 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] Creating event network-vif-plugged:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h2-857467-1 Sep 13 17:38:15.422027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:38:15.439506 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-6e408ebc-a85d-428f-a490-c506b1c80b37 req-c9e77905-aefc-449c-a069-7212427f9bfe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054752 Sep 13 17:38:15.440819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3899/7744] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:38:15.624696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:15.625348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:15.632322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:15.633396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:15.634012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:15.634720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:15.635218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:15.635651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:15.772097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:15.781536 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5b5eeeaf-bc26-4748-a5c5-de8df6450cce tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.160587 Sep 13 17:38:15.782554 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3846/7745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:15 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:38:16.808193 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:16.809391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:16.816887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:16.817371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:16.817846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:16.818861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:16.819438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:16.819887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:16.966780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:16.975189 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-348588d1-a831-4944-9880-8a64ea1bdc6e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.171370 Sep 13 17:38:16.975788 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3900/7746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:16 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:17.999429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:17.999961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:18.006269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:18.006762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:18.007212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:18.008564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:18.009348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:18.009796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:18.151363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:18.159688 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4d71110-31dc-462d-a859-a28ae2ccea70 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.164586 Sep 13 17:38:18.160272 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3847/7747] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:17 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:19.188042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:19.188683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:19.195297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:19.195826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:19.196329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:19.197053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:19.197534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:19.198021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:19.348917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:19.356312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "name": "network-vif-unplugged", "status": "completed", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:19.360497 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bbe396ae-d3b1-4435-98d3-c2a897ce9a90 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.176477 Sep 13 17:38:19.376237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:19.376237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:19.376237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:19.378016 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3901/7748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:19 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:19.386888 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] Creating event network-vif-unplugged:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:38:19.393782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:38:19.406023 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-8cbebba2-aeba-4622-959a-834c1af8e4e9 req-0f7e5d93-66e2-48fb-a136-4dc5e7100ce5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056581 Sep 13 17:38:19.407066 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3848/7749] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:38:20.196210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:20.206634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:20.207248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:20.207716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:20.221143 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] Creating event network-changed:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:38:20.227390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:38:20.238523 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-760a05a4-b34c-46ce-90ab-5afbcec80d33 req-db54a7d2-c75f-44ad-88ed-46c4b30c491d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045987 Sep 13 17:38:20.239156 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3902/7750] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:38:20.386994 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:20.387711 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:20.393966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:20.394465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:20.394911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:20.395622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:20.396089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:20.396528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:20.672668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:20.683342 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1e5b5fc3-37a3-4005-b7df-1832203f7c10 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.301846 Sep 13 17:38:20.684025 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3849/7751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:20 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:21.709277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:21.710032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:21.717621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:21.718167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:21.718632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:21.719362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:21.719953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:21.720312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:21.861314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:21.870134 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1ee7b80-d7b9-4887-9902-62707d9bc186 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.164981 Sep 13 17:38:21.870732 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3903/7752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:21 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:22.894613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:22.895144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:22.903293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:22.903792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:22.904241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:22.904948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:22.905418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:22.905881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:23.040968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:23.049572 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6945c5ed-1930-47b1-bac8-e3ca9a41279c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.159040 Sep 13 17:38:23.050175 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3850/7753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:22 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:24.073130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:24.073766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:24.080745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:24.081251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:24.081725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:24.082444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:24.082915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:24.083362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:24.216245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:24.224542 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-56f18ddd-402e-443d-b4eb-5c514b3832b8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.155380 Sep 13 17:38:24.225123 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3904/7754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:24 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:38:25.249101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:25.249723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:25.256815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:25.257326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:25.258774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:25.259514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:25.260228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:25.260886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:25.514061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:25.523241 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4f0d28c6-dbde-4696-9b18-a95f900a87a0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.277947 Sep 13 17:38:25.524484 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3851/7755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:25 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:26.547877 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:26.548494 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:26.550487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:26.556675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:26.557178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:26.557638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:26.558376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:26.558850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:26.559295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:26.696044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:26.704439 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3ea3167-b720-476b-9493-2d674f82aa66 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.160844 Sep 13 17:38:26.705031 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3905/7756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:26 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:38:27.728896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:27.729634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:27.736798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:27.737329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:27.737776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:27.738532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:27.738982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:27.739432 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:27.871333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:27.879769 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1edf4a85-0ab7-4ee1-91c1-27f03eaf752e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.155664 Sep 13 17:38:27.880379 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3852/7757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:27 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:28.957664 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:28.958316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:28.965704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:28.966239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:28.966693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:28.967398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:28.967870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:28.968312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:29.099382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:29.108173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-90a0ac52-f82c-4bd6-a6a9-10a09ea02ca0 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.154396 Sep 13 17:38:29.108760 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3906/7758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:28 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:30.132216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:30.133113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:30.140132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:30.140621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:30.141060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:30.141756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:30.142247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:30.142679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:30.287035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:30.296548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55757424-1606-4ff3-9254-bbd499980eb2 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.168574 Sep 13 17:38:30.297126 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3853/7759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:30 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:31.321693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:31.322438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:31.329538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:31.330093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:31.330555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:31.331283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:31.331768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:31.332221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:31.461970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:31.470321 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4273b08b-06fc-435f-b4fb-10d3a70f3c3c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.153743 Sep 13 17:38:31.470915 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3907/7760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:31 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:32.493907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:32.494523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:32.501444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:32.501968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:32.502420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:32.503130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:32.503604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:32.504055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:32.678807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:32.688235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-25d26efd-35a8-4bc0-9ec7-ac3e73ffb953 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.198293 Sep 13 17:38:32.688985 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3854/7761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:32 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:33.713626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:33.714199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:33.721066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:33.721570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:33.722054 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:33.722756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:33.723226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:33.723667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:33.739249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:33.903220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:33.911421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b4ba3232-7170-450b-b201-ecef71a0d970 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1721 microversion: 2.1 time: 0.202555 Sep 13 17:38:33.911995 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3908/7762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:33 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:34.935639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:34.936266 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:34.943334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:34.943847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:34.944291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:34.945063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:34.945525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:34.945990 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.076099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:35.084387 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e5a56a5-76eb-4b4a-bede-5e9baacdc6c8 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1714 microversion: 2.1 time: 0.152656 Sep 13 17:38:35.085189 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3855/7763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:34 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:35.108198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:35.108835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:35.115886 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.116393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.116883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.117598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.118101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.118545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.247056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:35.255326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6001f43a-8dd1-48ab-92f3-49d38bd417fe tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1714 microversion: 2.1 time: 0.151162 Sep 13 17:38:35.255905 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3909/7764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:35 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:35.278813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:35.279431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:35.285492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.286015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.286457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.287152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.287611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.288043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.423619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:35.431976 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1556b0ff-b2fb-4849-9f9a-400605a633b3 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1714 microversion: 2.1 time: 0.157175 Sep 13 17:38:35.432553 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3856/7765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:35 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:35.456165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:35.456611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:35.463741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.464256 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.464718 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.465453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.465944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.466391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.490938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:38:35.552608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:35.570408 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2bd12bee-c6ed-4e09-96e7-9e8b16bca731 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 204 len: 0 microversion: 2.1 time: 0.117375 Sep 13 17:38:35.571334 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3910/7766] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:38:35 2022] DELETE /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:38:35.579517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:35.580140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:35.587276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.587798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.588242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.588941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.589475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.589946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.719371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:35.727776 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1ed15634-5053-4384-a36d-ad0cb9ee7e6d tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1720 microversion: 2.1 time: 0.152140 Sep 13 17:38:35.728355 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3857/7767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:35 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:35.950825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9883c8f2-8e59-4263-bef5-873a5d07da70 req-76019f48-9c16-4f00-9a45-513bd77d83b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "name": "network-vif-plugged", "status": "completed", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:35.960581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9883c8f2-8e59-4263-bef5-873a5d07da70 req-76019f48-9c16-4f00-9a45-513bd77d83b9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:35.961339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9883c8f2-8e59-4263-bef5-873a5d07da70 req-76019f48-9c16-4f00-9a45-513bd77d83b9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:35.961803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9883c8f2-8e59-4263-bef5-873a5d07da70 req-76019f48-9c16-4f00-9a45-513bd77d83b9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:35.976173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9883c8f2-8e59-4263-bef5-873a5d07da70 req-76019f48-9c16-4f00-9a45-513bd77d83b9 service nova] Creating event network-vif-plugged:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:38:35.981106 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9883c8f2-8e59-4263-bef5-873a5d07da70 req-76019f48-9c16-4f00-9a45-513bd77d83b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Sep 13 17:38:35.981729 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3911/7768] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:38:36.752061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:36.752632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:36.755367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=34 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:36.761237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:36.761751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:36.762217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:36.762914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:36.763376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:36.763809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:36.766579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=100 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:36.900218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:36.908500 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc015820-1ede-4206-b95e-0341f62cc45f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1720 microversion: 2.1 time: 0.160556 Sep 13 17:38:36.909097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3858/7769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:36 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:37.934341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:37.935345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:37.944069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:37.945010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:37.945543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:37.946361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:37.947029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:37.947489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:38.019044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:38.031111 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-471723d7-2189-4937-be63-39f418ac3ed7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1653 microversion: 2.1 time: 0.102478 Sep 13 17:38:38.031960 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3912/7770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:37 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1653 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:38.217925 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5335ac98-70c1-450b-a106-fe49b2891a80 req-86a47a63-2da3-4578-96fb-191af718f43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e57c4-db11-4a2b-9e39-82114ab6b484", "name": "network-vif-deleted", "tag": "9cefa13e-2d30-466d-9186-a080e2d0f6b1"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:38.229802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5335ac98-70c1-450b-a106-fe49b2891a80 req-86a47a63-2da3-4578-96fb-191af718f43e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:38.230494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5335ac98-70c1-450b-a106-fe49b2891a80 req-86a47a63-2da3-4578-96fb-191af718f43e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:38.230983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5335ac98-70c1-450b-a106-fe49b2891a80 req-86a47a63-2da3-4578-96fb-191af718f43e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:38.244011 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5335ac98-70c1-450b-a106-fe49b2891a80 req-86a47a63-2da3-4578-96fb-191af718f43e service nova] Creating event network-vif-deleted:9cefa13e-2d30-466d-9186-a080e2d0f6b1 for instance 549e57c4-db11-4a2b-9e39-82114ab6b484 on n-h1-857467-1 Sep 13 17:38:38.249670 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5335ac98-70c1-450b-a106-fe49b2891a80 req-86a47a63-2da3-4578-96fb-191af718f43e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Sep 13 17:38:38.250551 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3859/7771] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:38:39.057333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:39.059264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:39.070955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:39.071486 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:39.071958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:39.072799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:39.073293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:39.073746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:39.145521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:39.155255 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5e24ebca-daa7-403c-9a51-f6a0e8db3a8f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1368 microversion: 2.1 time: 0.103094 Sep 13 17:38:39.155997 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3913/7772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:39 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:40.182317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:40.183070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:40.189419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:40.189940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:40.190383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:40.191092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:40.191563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:40.192002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:40.260829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:40.269384 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f01a14e2-c9d2-4d3b-a58c-ca43cf5430cf tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1368 microversion: 2.1 time: 0.093250 Sep 13 17:38:40.269989 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3860/7773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:40 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:41.292924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:41.293565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:41.301076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:41.301618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:41.302229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:41.302953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:41.303430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:41.303906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:41.366824 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:41.375307 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7fe22c6a-dd37-4b79-a6cd-c88c2a911b24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1368 microversion: 2.1 time: 0.086582 Sep 13 17:38:41.375900 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3914/7774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:41 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:42.400297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:42.400942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:42.408210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:42.408705 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:42.409147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:42.409886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:42.410358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:42.410818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:42.446095 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:42.446623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:42.447071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:42.447534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lazy-loading 'fault' on Instance uuid 549e57c4-db11-4a2b-9e39-82114ab6b484 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:38:42.488385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb0ba449d40457bbc4a7b23850b9c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d039eee8804a7cb21e09b2ab4f063e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:42.497583 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ee620f7-533e-49be-a20d-6bd2ea48deb1 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 200 len: 1373 microversion: 2.1 time: 0.102417 Sep 13 17:38:42.498191 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3861/7775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:42 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 1373 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:43.522091 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:43.522908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:43.530114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:43.530709 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:43.531237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:43.532079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:43.532597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:43.533133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:43.547666 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 HTTP/1.1 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '549e57c4-db11-4a2b-9e39-82114ab6b484'} Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:43.549441 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0696ed11-c03c-46e2-b43b-3d1276fcebcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 404 len: 111 microversion: 2.1 time: 0.032926 Sep 13 17:38:43.555204 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3915/7776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:43 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:43.614048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:43.616274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:43.623838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:43.624335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:43.624787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:43.625497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:43.626009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:43.626455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:43.642889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-volume_attachments HTTP/1.1 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': '549e57c4-db11-4a2b-9e39-82114ab6b484'} Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:43.646299 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4d1ec5ab-ff06-4ebd-adaa-ff01fb175864 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038663 Sep 13 17:38:43.650951 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3862/7777] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:38:43 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:46.976984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:46.977514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:46.984513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:46.985026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:46.985499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:46.986244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:46.986736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:46.987190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.001765 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 HTTP/1.1 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '549e57c4-db11-4a2b-9e39-82114ab6b484'} Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.003412 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-df8315a6-29a1-4343-a2da-172077e3138e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 404 len: 111 microversion: 2.1 time: 0.032042 Sep 13 17:38:47.009214 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3916/7778] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:38:46 2022] DELETE /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.015928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.016574 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 549e57c4-db11-4a2b-9e39-82114ab6b484] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.023631 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.024140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.024596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.025332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.025808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.026357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.041768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 HTTP/1.1 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '549e57c4-db11-4a2b-9e39-82114ab6b484'} Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.043407 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 549e57c4-db11-4a2b-9e39-82114ab6b484 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-272afe9a-b22b-48e1-881f-dc6cfa2e5a24 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484" status: 404 len: 111 microversion: 2.1 time: 0.033331 Sep 13 17:38:47.048791 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3863/7779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:47 2022] GET /compute/v2.1/servers/549e57c4-db11-4a2b-9e39-82114ab6b484 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.059181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.060397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.066975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.067562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.068177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.069018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.070247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.070778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.085248 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 HTTP/1.1 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '473f401d-fc0e-4e4d-a9af-764aee800619'} Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.087045 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.091732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ac732093-d772-485f-9961-feec071a299e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 404 len: 111 microversion: 2.1 time: 0.034450 Sep 13 17:38:47.093250 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3917/7780] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:38:47 2022] DELETE /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.097956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.098576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 473f401d-fc0e-4e4d-a9af-764aee800619] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.104900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.105385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.105848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.106541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.107001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.107440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.121806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 HTTP/1.1 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '473f401d-fc0e-4e4d-a9af-764aee800619'} Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.123373 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 473f401d-fc0e-4e4d-a9af-764aee800619 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cc36c7d2-5927-4257-bcd8-05963d4cae73 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619" status: 404 len: 111 microversion: 2.1 time: 0.030858 Sep 13 17:38:47.127607 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3864/7781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:47 2022] GET /compute/v2.1/servers/473f401d-fc0e-4e4d-a9af-764aee800619 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.133896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.134408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.140905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.141422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.141955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.143229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.143759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.144490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.159259 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a HTTP/1.1 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '9da3bbe8-b348-4871-a2e1-dca9d6664e2a'} Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.160910 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-de55c409-5fd0-4d6b-ac6e-5d8e3ed1465f tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 404 len: 111 microversion: 2.1 time: 0.032948 Sep 13 17:38:47.165108 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3918/7782] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:38:47 2022] DELETE /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 17:38:47.171524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.172184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 9da3bbe8-b348-4871-a2e1-dca9d6664e2a] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.178273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.178767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.179876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.180587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.181060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.181497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.198551 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a HTTP/1.1 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '9da3bbe8-b348-4871-a2e1-dca9d6664e2a'} Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.200131 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 9da3bbe8-b348-4871-a2e1-dca9d6664e2a could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f67954a-e002-4e79-baa2-f9c514a61dcc tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a" status: 404 len: 111 microversion: 2.1 time: 0.034317 Sep 13 17:38:47.207928 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3865/7783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:47 2022] GET /compute/v2.1/servers/9da3bbe8-b348-4871-a2e1-dca9d6664e2a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.213487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.214105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.220564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.221149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.221675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.222478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.223057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.223584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.242003 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 HTTP/1.1 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '0442efaa-1956-4033-8c2f-5836a3aad164'} Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.244911 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a37c42da-0279-4dfb-8e58-b2bbf407256c tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 404 len: 111 microversion: 2.1 time: 0.037913 Sep 13 17:38:47.254387 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3919/7784] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:38:47 2022] DELETE /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.257906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.258538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] [instance: 0442efaa-1956-4033-8c2f-5836a3aad164] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:47.264746 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.265240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.265686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.266438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:47.266881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:47.267312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:47.281332 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] HTTP exception thrown: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Request method failure captured: Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 HTTP/1.1 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIL4RBIxfUd82Gte7Qip60vLY-Ua0EipF9JGMBNrzpyvPtIZN3woY7Ny5LzY-XIGDEo-Z-nLxOdXko-rK1dNziF9GVIhxOsjp0aXKHvTo_f9JocGV4MvZFf7hAGIb-Tvxmzt1ZgQ7TActjENUcnLRY-oZbwUoBf0GrzXeINQbt6mUCbc Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b7d039eee8804a7cb21e09b2ab4f063e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: b7d039eee8804a7cb21e09b2ab4f063e Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServerActionsTestJSON-464055556 Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 2bb0ba449d40457bbc4a7b23850b9c2e Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServerActionsTestJSON-464055556-project Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '0442efaa-1956-4033-8c2f-5836a3aad164'} Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:38:47.282899 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Returning 404 to user: Instance 0442efaa-1956-4033-8c2f-5836a3aad164 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-aaba2f01-1618-4c0f-a5bc-be3bfb2f3db7 tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164" status: 404 len: 111 microversion: 2.1 time: 0.031456 Sep 13 17:38:47.288124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3866/7785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:47 2022] GET /compute/v2.1/servers/0442efaa-1956-4033-8c2f-5836a3aad164 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:38:47.295347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d7849b38-c287-4e3e-bb0b-3def8db35f8e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] Calling method '.version_select at 0x7fbeb96ca0d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:47.319572 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d7849b38-c287-4e3e-bb0b-3def8db35f8e tempest-ServerActionsTestJSON-464055556 tempest-ServerActionsTestJSON-464055556-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51890898" status: 202 len: 0 microversion: 2.1 time: 0.027898 Sep 13 17:38:47.323504 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3920/7786] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Sep 13 17:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51890898 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:38:57.075152 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1039378579", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "329c0b66-520d-4870-bfc0-d28fc4277a76"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:38:57.129221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] validate_networks() for [('329c0b66-520d-4870-bfc0-d28fc4277a76', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:38:57.272637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=31 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:57.573053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:38:57.573489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:38:57.574002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:38:57.574424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:38:57.574846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:38:57.584110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:57.584599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:57.585075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:57.586029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:57.586528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:57.586960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:57.604875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Getting quotas for project 10dabcb4436f4ae6b5f6f65e62694c6d. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:38:57.610608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Getting quotas for user 8b6d47618fc749c594a353a9b0d9fb45 and project 10dabcb4436f4ae6b5f6f65e62694c6d. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:38:57.623914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:38:57.626319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:38:57.670496 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:38:58.679409 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38278. Sep 13 17:38:58.683784 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21602ff4-e9f7-4e53-8820-0d7d2bccf1c2 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.727258 Sep 13 17:38:58.690515 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3867/7787] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:38:58.693974 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:58.696081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:38:58.703691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b08b0d8e-7299-4235-bc02-fd2725b7595a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:58.704351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b08b0d8e-7299-4235-bc02-fd2725b7595a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:58.775726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b08b0d8e-7299-4235-bc02-fd2725b7595a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:58.791182 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b08b0d8e-7299-4235-bc02-fd2725b7595a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1217 microversion: 2.1 time: 0.099131 Sep 13 17:38:58.793187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3921/7788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:58 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:38:59.817269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:38:59.817917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:38:59.825560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:59.825917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:59.826360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:59.827068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:38:59.827530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:38:59.827992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:38:59.896163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:38:59.904969 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a705d25-dbb4-4b8f-bff9-416951d3ef4d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1269 microversion: 2.1 time: 0.092530 Sep 13 17:38:59.906445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3868/7789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:38:59 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:00.929333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:00.929895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:00.936732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:00.937243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:00.937863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:00.938779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:00.939260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:00.939708 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:01.088915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:01.097631 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8720229e-28c6-40ed-896d-d35a3ba93e60 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.172877 Sep 13 17:39:01.098379 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3922/7790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:00 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:01.401135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5c37830f-8b49-4c5b-9215-d35607a90cb6 req-efdd39e9-62dc-4d1a-84f6-b82881695431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4740d7b-9c90-4ae2-927d-98ef44cf523f", "tag": "230fe047-80fa-4791-bd4c-fe0854b52a0d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:01.417358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5c37830f-8b49-4c5b-9215-d35607a90cb6 req-efdd39e9-62dc-4d1a-84f6-b82881695431 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:01.417965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5c37830f-8b49-4c5b-9215-d35607a90cb6 req-efdd39e9-62dc-4d1a-84f6-b82881695431 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:01.418410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5c37830f-8b49-4c5b-9215-d35607a90cb6 req-efdd39e9-62dc-4d1a-84f6-b82881695431 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:01.431116 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5c37830f-8b49-4c5b-9215-d35607a90cb6 req-efdd39e9-62dc-4d1a-84f6-b82881695431 service nova] Creating event network-changed:230fe047-80fa-4791-bd4c-fe0854b52a0d for instance e4740d7b-9c90-4ae2-927d-98ef44cf523f on n-h2-857467-1 Sep 13 17:39:01.436110 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5c37830f-8b49-4c5b-9215-d35607a90cb6 req-efdd39e9-62dc-4d1a-84f6-b82881695431 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041355 Sep 13 17:39:01.436824 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3869/7791] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:39:02.123662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:02.124301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:02.131232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:02.132095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:02.132647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:02.133365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:02.133861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:02.134314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:02.264033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:02.271812 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-be37c310-567f-46ef-8117-6ed5c2233756 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.152233 Sep 13 17:39:02.273008 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3923/7792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:02 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:03.297523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:03.298255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:03.305959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:03.306404 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:03.306850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:03.307560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:03.308030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:03.308467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:03.439687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:03.447576 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b00d18c3-3b23-475e-b71b-509a795b7f8b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.156033 Sep 13 17:39:03.448167 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3870/7793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:03 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:04.470982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:04.471616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:04.478943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:04.479445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:04.479899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:04.480602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:04.481074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:04.481518 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:04.614289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:04.622706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-485407bc-71e4-44be-9b48-628dc36e95e1 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.155603 Sep 13 17:39:04.623303 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3924/7794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:04 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:39:05.648181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:05.649630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:05.656670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:05.657165 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:05.657608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:05.658364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:05.658832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:05.659270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:05.798549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:05.807999 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0196abf2-57e0-4fda-ba3f-55bfc19ea513 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.164517 Sep 13 17:39:05.808499 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3871/7795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:05 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:06.831019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:06.831648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:06.838750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:06.839253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:06.839705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:06.840413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:06.840887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:06.841330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:06.970407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:06.978564 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0deef33-e732-4df6-ae47-e959acd63a17 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.151542 Sep 13 17:39:06.979158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3925/7796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:06 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:07.612665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:07.618430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:07.721852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-fce59cac-0a90-490e-9a55-30aebc55c19c req-bafc0bd9-0de8-4cb1-a73a-2504102965ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4740d7b-9c90-4ae2-927d-98ef44cf523f", "name": "network-vif-plugged", "status": "completed", "tag": "230fe047-80fa-4791-bd4c-fe0854b52a0d"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:07.726937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:07.733265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fce59cac-0a90-490e-9a55-30aebc55c19c req-bafc0bd9-0de8-4cb1-a73a-2504102965ce service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:07.733748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fce59cac-0a90-490e-9a55-30aebc55c19c req-bafc0bd9-0de8-4cb1-a73a-2504102965ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:07.734224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-fce59cac-0a90-490e-9a55-30aebc55c19c req-bafc0bd9-0de8-4cb1-a73a-2504102965ce service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:07.745014 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-fce59cac-0a90-490e-9a55-30aebc55c19c req-bafc0bd9-0de8-4cb1-a73a-2504102965ce service nova] Creating event network-vif-plugged:230fe047-80fa-4791-bd4c-fe0854b52a0d for instance e4740d7b-9c90-4ae2-927d-98ef44cf523f on n-h2-857467-1 Sep 13 17:39:07.750018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-fce59cac-0a90-490e-9a55-30aebc55c19c req-bafc0bd9-0de8-4cb1-a73a-2504102965ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143057 Sep 13 17:39:07.750611 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3872/7797] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:39:08.003895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:08.004586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:08.012035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:08.012543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:08.013010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:08.013724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:08.014265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:08.014714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:08.149658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:08.157468 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0410f8ff-c6b0-4a9e-9a02-2c4d7d60543c tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.157570 Sep 13 17:39:08.158084 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3926/7798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:07 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:09.182759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:09.183477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:09.189759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:09.190287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:09.190740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:09.191495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:09.191966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:09.192402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:09.332104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:09.340766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-61b3a838-2e68-4761-baba-3e3884e16298 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1317 microversion: 2.1 time: 0.163517 Sep 13 17:39:09.341363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3873/7799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:09 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:39:10.363706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:10.364346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:10.366289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:10.372378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:10.372883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:10.373348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:10.374094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:10.374573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:10.375024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:10.511417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:10.519202 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebfc3b9c-db4e-46ff-a18a-1d9cb7ba3fa8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.159535 Sep 13 17:39:10.519791 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3927/7800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:10 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:10.579621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929828135", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "329c0b66-520d-4870-bfc0-d28fc4277a76"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:10.632207 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] validate_networks() for [('329c0b66-520d-4870-bfc0-d28fc4277a76', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:39:11.003678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:39:11.004135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:39:11.004634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:39:11.005048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:39:11.005462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:39:11.014827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:11.015313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:11.015753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:11.016482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:11.016941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:11.017372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:11.034386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Getting quotas for project 10dabcb4436f4ae6b5f6f65e62694c6d. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:39:11.039704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Getting quotas for user 8b6d47618fc749c594a353a9b0d9fb45 and project 10dabcb4436f4ae6b5f6f65e62694c6d. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:39:11.052125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:39:11.054992 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:39:11.101721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f5a75b23-1941-4127-b6f9-a71b9bfb67cb tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525902 Sep 13 17:39:11.102465 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3874/7801] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:39:11.113440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b49e618a-64d2-4ee7-b728-0144aafbe990 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:11.114097 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b49e618a-64d2-4ee7-b728-0144aafbe990 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:11.170437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b49e618a-64d2-4ee7-b728-0144aafbe990 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:11.177610 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b49e618a-64d2-4ee7-b728-0144aafbe990 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1216 microversion: 2.1 time: 0.068047 Sep 13 17:39:11.178765 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3928/7802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:11 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:12.202217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:12.202839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:12.210626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:12.211131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:12.211576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:12.212291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:12.212757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:12.213194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:12.293194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:12.301712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-12713677-dad4-4191-88d0-fa18f183ac83 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1276 microversion: 2.1 time: 0.104613 Sep 13 17:39:12.302461 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3875/7803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:12 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:13.325040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:13.325818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:13.333633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:13.334179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:13.335146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:13.336251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:13.336737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:13.337188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:13.474301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:13.482952 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f9c97396-1ccb-489a-810a-d2d93257d207 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.161924 Sep 13 17:39:13.483551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3929/7804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:13 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:13.707033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d90b71bc-07f5-4068-bc87-e82715abb96c req-02dc9932-adea-4bd4-b260-5f1541fe2437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce647eeb-9059-4252-a445-8a43e141838d", "tag": "314aa41d-97ee-4085-b4d6-9d2228713310"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:13.719333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d90b71bc-07f5-4068-bc87-e82715abb96c req-02dc9932-adea-4bd4-b260-5f1541fe2437 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:13.719822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d90b71bc-07f5-4068-bc87-e82715abb96c req-02dc9932-adea-4bd4-b260-5f1541fe2437 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:13.720257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d90b71bc-07f5-4068-bc87-e82715abb96c req-02dc9932-adea-4bd4-b260-5f1541fe2437 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:13.733574 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d90b71bc-07f5-4068-bc87-e82715abb96c req-02dc9932-adea-4bd4-b260-5f1541fe2437 service nova] Creating event network-changed:314aa41d-97ee-4085-b4d6-9d2228713310 for instance ce647eeb-9059-4252-a445-8a43e141838d on n-h1-857467-1 Sep 13 17:39:13.738804 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d90b71bc-07f5-4068-bc87-e82715abb96c req-02dc9932-adea-4bd4-b260-5f1541fe2437 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035707 Sep 13 17:39:13.739419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3876/7805] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:39:14.506473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:14.507113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:14.514058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:14.514568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:14.515025 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:14.515734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:14.516211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:14.516661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:14.645872 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:14.654858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d4d8951-68d1-4077-ae7f-2fb446d73741 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.152023 Sep 13 17:39:14.655916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3930/7806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:14 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:15.683000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:15.683709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:15.690063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:15.690548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:15.690989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:15.691689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:15.692148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:15.692601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:15.827613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:15.835650 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8871c0f5-cf2b-45de-9625-2635df3b7332 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.158788 Sep 13 17:39:15.836227 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3877/7807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:15 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:16.866199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:16.866811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:16.874367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:16.874869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:16.875320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:16.876027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:16.876498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:16.876936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:17.011921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:17.019777 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6cd43cce-ed6b-4910-b5c0-891afe9835d5 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.157557 Sep 13 17:39:17.020361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3931/7808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:16 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:18.043783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:18.044470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:18.052759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:18.053264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:18.053712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:18.054661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:18.055526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:18.056336 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:18.199331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:18.207367 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-190f1919-01f1-4a09-80b9-78d95a5782dc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.168155 Sep 13 17:39:18.207964 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3878/7809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:18 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:19.231034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:19.231671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:19.237979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:19.238483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:19.238939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:19.239649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:19.240129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:19.240625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:19.372531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:19.381089 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f152740c-fb61-4d28-8e3f-31f884a2de5e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.154089 Sep 13 17:39:19.381861 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3932/7810] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:19 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:20.071108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-24977470-fc2c-4bc1-8c51-a1223420c074 req-ddb57ff2-52cb-4f2d-917e-08838e072a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce647eeb-9059-4252-a445-8a43e141838d", "name": "network-vif-plugged", "status": "completed", "tag": "314aa41d-97ee-4085-b4d6-9d2228713310"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:20.082794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-24977470-fc2c-4bc1-8c51-a1223420c074 req-ddb57ff2-52cb-4f2d-917e-08838e072a50 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:20.083307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-24977470-fc2c-4bc1-8c51-a1223420c074 req-ddb57ff2-52cb-4f2d-917e-08838e072a50 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:20.083742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-24977470-fc2c-4bc1-8c51-a1223420c074 req-ddb57ff2-52cb-4f2d-917e-08838e072a50 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:20.097553 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-24977470-fc2c-4bc1-8c51-a1223420c074 req-ddb57ff2-52cb-4f2d-917e-08838e072a50 service nova] Creating event network-vif-plugged:314aa41d-97ee-4085-b4d6-9d2228713310 for instance ce647eeb-9059-4252-a445-8a43e141838d on n-h1-857467-1 Sep 13 17:39:20.103665 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-24977470-fc2c-4bc1-8c51-a1223420c074 req-ddb57ff2-52cb-4f2d-917e-08838e072a50 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036911 Sep 13 17:39:20.104494 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3879/7811] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:39:20.404956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:20.405626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:20.412626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:20.413135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:20.413595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:20.414416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:20.414902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:20.415353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:20.545277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:20.553298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13c4a335-5659-466d-a8cd-f237220f2ace tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1316 microversion: 2.1 time: 0.152310 Sep 13 17:39:20.553911 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3933/7812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:20 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:21.573893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:21.574685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:21.580153 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:21.581376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:21.590835 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:21.591697 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:21.592099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:21.593007 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:21.593536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:21.594306 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:21.742480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:21.751176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6039ec5-63f1-4d57-8475-3b79abb14b4a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1506 microversion: 2.1 time: 0.178195 Sep 13 17:39:21.751841 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3880/7813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:21 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:21.774233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:21.774790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:21.776597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:21.782888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:21.783391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:21.783862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:21.784616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:21.785280 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:21.785855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:21.811736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:39:21.891725 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0908d547-259c-4039-b4cd-b77d2bd3622d tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 204 len: 0 microversion: 2.1 time: 0.121757 Sep 13 17:39:21.892930 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3934/7814] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:39:21 2022] DELETE /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:39:21.901883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:21.902517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:21.908612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:21.909104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:21.909554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:21.910314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:21.910781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:21.911220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:22.051757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:22.060087 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d62f3fca-190c-4305-95ea-c5c5b89bc856 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1512 microversion: 2.1 time: 0.162991 Sep 13 17:39:22.060717 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3881/7815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:21 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:39:23.085003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:23.086674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:23.093676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:23.094207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:23.094695 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:23.095430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:23.095897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:23.096332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:23.235434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:23.243358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e4922fa7-f4cb-4a78-abdc-e0b83c508726 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1512 microversion: 2.1 time: 0.162690 Sep 13 17:39:23.243983 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3935/7816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:23 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:24.248172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-dc765825-780b-423f-9093-398d350d9405 req-cf4d43f2-f222-4834-af0c-ba413a5ec717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce647eeb-9059-4252-a445-8a43e141838d", "name": "network-vif-deleted", "tag": "314aa41d-97ee-4085-b4d6-9d2228713310"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:24.261521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dc765825-780b-423f-9093-398d350d9405 req-cf4d43f2-f222-4834-af0c-ba413a5ec717 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:24.262469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dc765825-780b-423f-9093-398d350d9405 req-cf4d43f2-f222-4834-af0c-ba413a5ec717 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:24.262986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dc765825-780b-423f-9093-398d350d9405 req-cf4d43f2-f222-4834-af0c-ba413a5ec717 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:24.269115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:24.269858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:24.283905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:24.286563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:24.290221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:24.291131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:24.291640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:24.292095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:24.297138 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-dc765825-780b-423f-9093-398d350d9405 req-cf4d43f2-f222-4834-af0c-ba413a5ec717 service nova] Creating event network-vif-deleted:314aa41d-97ee-4085-b4d6-9d2228713310 for instance ce647eeb-9059-4252-a445-8a43e141838d on n-h1-857467-1 Sep 13 17:39:24.303881 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-dc765825-780b-423f-9093-398d350d9405 req-cf4d43f2-f222-4834-af0c-ba413a5ec717 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059205 Sep 13 17:39:24.305071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3882/7817] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:39:24.379579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:24.388382 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ae713590-bb11-4e1a-b450-40b0d69886f3 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 200 len: 1301 microversion: 2.1 time: 0.124762 Sep 13 17:39:24.389258 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3936/7818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:24 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:39:25.415755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:25.416395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:25.424085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.424578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.425024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.425730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.426223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.426660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.441175 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] HTTP exception thrown: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d HTTP/1.1 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ce647eeb-9059-4252-a445-8a43e141838d'} Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:25.442838 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 404 to user: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ff0c4b8-a0cf-4b19-a32b-7dfe00c8bd0a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 404 len: 111 microversion: 2.1 time: 0.033367 Sep 13 17:39:25.448510 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3883/7819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:25 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:39:25.454533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:25.455217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:25.462913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.463422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.463883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.464603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.465079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.465663 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.593789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:25.597316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:25.602580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3245bbd-6be9-4d8f-92f1-e47b887cf98e tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.151989 Sep 13 17:39:25.603164 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3937/7820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:25 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:25.625002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc831d4d-9778-4f2e-8d4e-1a7b432fbd77 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:25.627354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bc831d4d-9778-4f2e-8d4e-1a7b432fbd77 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e9b30142-db28-472e-8163-5bedfffaccca] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:25.633334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-bc831d4d-9778-4f2e-8d4e-1a7b432fbd77 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] HTTP exception thrown: Instance e9b30142-db28-472e-8163-5bedfffaccca could not be found. Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc831d4d-9778-4f2e-8d4e-1a7b432fbd77 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/e9b30142-db28-472e-8163-5bedfffaccca/action HTTP/1.1 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 32 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: {"resize": {"flavorRef": "452"}} Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance e9b30142-db28-472e-8163-5bedfffaccca could not be found. Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e9b30142-db28-472e-8163-5bedfffaccca', 'body': {'resize': {'flavorRef': '452'}}} Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b30142-db28-472e-8163-5bedfffaccca could not be found. Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:39:25.634953 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b30142-db28-472e-8163-5bedfffaccca could not be found. Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b30142-db28-472e-8163-5bedfffaccca could not be found. Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bc831d4d-9778-4f2e-8d4e-1a7b432fbd77 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 404 to user: Instance e9b30142-db28-472e-8163-5bedfffaccca could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bc831d4d-9778-4f2e-8d4e-1a7b432fbd77 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "POST /compute/v2.1/servers/e9b30142-db28-472e-8163-5bedfffaccca/action" status: 404 len: 111 microversion: 2.1 time: 0.015445 Sep 13 17:39:25.639863 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3884/7821] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:39:25 2022] POST /compute/v2.1/servers/e9b30142-db28-472e-8163-5bedfffaccca/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:39:25.645130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:25.645769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:25.653321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.653882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.654316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.655029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.655508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.655957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.787966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:25.796120 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4453cdfc-1a5b-4326-8b32-126b5614154b tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.155345 Sep 13 17:39:25.796973 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3938/7822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:25 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:25.819556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:25.820765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:25.827749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.828221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.828669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.829357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:25.829817 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:25.830272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:25.963136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:25.971058 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-61ed2766-3ce5-4d82-839a-418f34a06d52 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.155409 Sep 13 17:39:25.971636 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3885/7823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:25 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:25.994207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "252e55dc-f8a2-4fda-86f2-fbe2afa83c0f"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:25.996544 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.002610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.003127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.003593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.004316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.004801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.005254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.034227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:26.039063 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] HTTP exception thrown: Flavor 252e55dc-f8a2-4fda-86f2-fbe2afa83c0f could not be found. Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: request: POST /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f/action HTTP/1.1 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 65 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: {"resize": {"flavorRef": "252e55dc-f8a2-4fda-86f2-fbe2afa83c0f"}} Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: exception: Flavor 252e55dc-f8a2-4fda-86f2-fbe2afa83c0f could not be found. Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e4740d7b-9c90-4ae2-927d-98ef44cf523f', 'body': {'resize': {'flavorRef': '252e55dc-f8a2-4fda-86f2-fbe2afa83c0f'}}} Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:26.041122 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 252e55dc-f8a2-4fda-86f2-fbe2afa83c0f could not be found. Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 252e55dc-f8a2-4fda-86f2-fbe2afa83c0f could not be found. Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 252e55dc-f8a2-4fda-86f2-fbe2afa83c0f could not be found. Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 400 to user: Flavor 252e55dc-f8a2-4fda-86f2-fbe2afa83c0f could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-072e4c7d-33ed-40f8-98ca-9706d339eee6 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "POST /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f/action" status: 400 len: 107 microversion: 2.1 time: 0.053148 Sep 13 17:39:26.049102 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3939/7824] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:39:25 2022] POST /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 17:39:26.056271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.056899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.063181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.063708 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.064154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.064861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.065324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.066089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.200533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:26.208432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-841ccfe3-dd00-489e-8d5c-3424521c19fc tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.158700 Sep 13 17:39:26.209014 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3886/7825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:26 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:26.233814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.234487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.240619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.241124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.241639 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.242452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.243159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.243635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.375558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:26.384045 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4eb21570-f1b0-4dfc-85cb-34cfdf91527a tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.154201 Sep 13 17:39:26.384641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3940/7826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:26 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:26.407044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d424a074-a9ea-4967-88b0-61cd561b37bf tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d424a074-a9ea-4967-88b0-61cd561b37bf tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: request: POST /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f/action HTTP/1.1 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 29 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: {"resize": {"flavorRef": ""}} Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'e4740d7b-9c90-4ae2-927d-98ef44cf523f', 'body': {'resize': {'flavorRef': ''}}} Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise error Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi '' Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.410690 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d424a074-a9ea-4967-88b0-61cd561b37bf tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d424a074-a9ea-4967-88b0-61cd561b37bf tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "POST /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f/action" status: 400 len: 113 microversion: 2.1 time: 0.009210 Sep 13 17:39:26.416541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3887/7827] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:39:26 2022] POST /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 17:39:26.422016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.422658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.428806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.429312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.429776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.430710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.431189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.431637 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.568487 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:26.577022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ee1c14d0-730b-493c-baae-f002d50710d8 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1506 microversion: 2.1 time: 0.159035 Sep 13 17:39:26.577523 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3941/7828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:26 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:26.604922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.605437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.612692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.613189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.613637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.614383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.614856 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.615293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.629137 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] HTTP exception thrown: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d HTTP/1.1 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'ce647eeb-9059-4252-a445-8a43e141838d'} Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:39:26.630757 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 404 to user: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-add802ef-d06a-4363-9ff2-87f546565202 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 404 len: 111 microversion: 2.1 time: 0.032085 Sep 13 17:39:26.636114 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3888/7829] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:39:26 2022] DELETE /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:39:26.641433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.642198 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: ce647eeb-9059-4252-a445-8a43e141838d] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.648167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.648674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.649133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.649911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.650389 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.650839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.664636 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] HTTP exception thrown: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d HTTP/1.1 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'ce647eeb-9059-4252-a445-8a43e141838d'} Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:26.666221 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 404 to user: Instance ce647eeb-9059-4252-a445-8a43e141838d could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32a20290-cd6a-4806-88a9-4e0d4d5e7a00 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d" status: 404 len: 111 microversion: 2.1 time: 0.030081 Sep 13 17:39:26.671005 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3942/7830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:26 2022] GET /compute/v2.1/servers/ce647eeb-9059-4252-a445-8a43e141838d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:39:26.677059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.677572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.684114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.684613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.685062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.685762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.686257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.686695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.712613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:39:26.762241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:26.794311 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3960bb79-dcd3-46ac-adb2-f583a4c3a450 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 204 len: 0 microversion: 2.1 time: 0.120823 Sep 13 17:39:26.794933 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3889/7831] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:39:26 2022] DELETE /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:39:26.803463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:26.804125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:26.811219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.811726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.812216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.812927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:26.813405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:26.813871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:26.942556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:26.951572 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c2e4490-8d3d-492a-b616-fd2b4e734d36 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1512 microversion: 2.1 time: 0.152111 Sep 13 17:39:26.952157 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3943/7832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:26 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:27.975958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:27.977094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:27.984676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:27.985311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:27.985703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:27.986506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:27.986971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:27.987403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:28.122706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:28.130443 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d25d13ee-674a-41e8-8823-fc9003f9e2bd tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1512 microversion: 2.1 time: 0.158826 Sep 13 17:39:28.131027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3890/7833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:27 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:39:28.866563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c9058a1e-dcee-4696-9fa0-9a4a8579b992 req-d98f2145-4081-4be7-ab87-6659a82d8923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4740d7b-9c90-4ae2-927d-98ef44cf523f", "name": "network-vif-deleted", "tag": "230fe047-80fa-4791-bd4c-fe0854b52a0d"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:39:28.873807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:39:28.880339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c9058a1e-dcee-4696-9fa0-9a4a8579b992 req-d98f2145-4081-4be7-ab87-6659a82d8923 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:28.880847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c9058a1e-dcee-4696-9fa0-9a4a8579b992 req-d98f2145-4081-4be7-ab87-6659a82d8923 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:28.881297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c9058a1e-dcee-4696-9fa0-9a4a8579b992 req-d98f2145-4081-4be7-ab87-6659a82d8923 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:28.894853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c9058a1e-dcee-4696-9fa0-9a4a8579b992 req-d98f2145-4081-4be7-ab87-6659a82d8923 service nova] Creating event network-vif-deleted:230fe047-80fa-4791-bd4c-fe0854b52a0d for instance e4740d7b-9c90-4ae2-927d-98ef44cf523f on n-h2-857467-1 Sep 13 17:39:28.901056 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c9058a1e-dcee-4696-9fa0-9a4a8579b992 req-d98f2145-4081-4be7-ab87-6659a82d8923 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038275 Sep 13 17:39:28.902004 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3944/7834] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:39:29.154145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:29.154765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:29.161684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:29.162325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:29.162768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:29.163465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:29.164519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:29.164949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:29.195860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:29.196345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:29.196782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:29.197230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lazy-loading 'fault' on Instance uuid e4740d7b-9c90-4ae2-927d-98ef44cf523f {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:39:29.239974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b6d47618fc749c594a353a9b0d9fb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10dabcb4436f4ae6b5f6f65e62694c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:39:29.248052 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ae0dca16-a24c-4141-bd22-4b4d5eabe8a7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 200 len: 1307 microversion: 2.1 time: 0.097854 Sep 13 17:39:29.248643 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3891/7835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:29 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:39:30.272806 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:39:30.273520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] [instance: e4740d7b-9c90-4ae2-927d-98ef44cf523f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:39:30.280327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:30.280865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:30.281321 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:30.282071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:39:30.282552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:39:30.283002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:39:30.297372 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] HTTP exception thrown: Instance e4740d7b-9c90-4ae2-927d-98ef44cf523f could not be found. Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Request method failure captured: Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f HTTP/1.1 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMAwFkU1lopaZJTawc70lQ4mytqDIMHo8lHgDNrbCa7_XwYRyrrU25I7CJearUGtkrEzYdWCdlEzHb_Bi4jdB5lMib0oARVsYM6C0Ypjw5pk1PttPs1fLynLpgdHPirljK99lroeom-udmgsx1c2ez2eNMZTgxrniwglZztL8FbJJb8 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10dabcb4436f4ae6b5f6f65e62694c6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 10dabcb4436f4ae6b5f6f65e62694c6d Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-ServersNegativeTestJSON-275298419 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 8b6d47618fc749c594a353a9b0d9fb45 Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-ServersNegativeTestJSON-275298419-project Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e4740d7b-9c90-4ae2-927d-98ef44cf523f could not be found. Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e4740d7b-9c90-4ae2-927d-98ef44cf523f'} Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4740d7b-9c90-4ae2-927d-98ef44cf523f could not be found. Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4740d7b-9c90-4ae2-927d-98ef44cf523f could not be found. Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:39:30.299042 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4740d7b-9c90-4ae2-927d-98ef44cf523f could not be found. Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] Returning 404 to user: Instance e4740d7b-9c90-4ae2-927d-98ef44cf523f could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-81a664b6-089f-4eb4-8fff-c9b9d15211b7 tempest-ServersNegativeTestJSON-275298419 tempest-ServersNegativeTestJSON-275298419-project] 10.222.0.61 "GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f" status: 404 len: 111 microversion: 2.1 time: 0.032793 Sep 13 17:39:30.306146 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3945/7836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:39:30 2022] GET /compute/v2.1/servers/e4740d7b-9c90-4ae2-927d-98ef44cf523f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:40:00.500154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:00.501302 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:00.703570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54ca73ea-738f-4e32-ac4b-73a1ffaa8acd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: .version_select at 0x7fbeb4db7e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2082667081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLek8P7YphIsLdUborg1ihPu1f6Qi1w8rW3LeM32PfcJBpowH2tho+EMHdVFCy8B1KNJG22vf7517K1RRvuSZnBeJ+F7d+/YdaAkjmK4j7zxnz99CO3+NOo7Pa/fQ/4h6A=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:00.721622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-54ca73ea-738f-4e32-ac4b-73a1ffaa8acd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for project 5b5f901151674241a914cc41a8989893. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:40:00.728215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-54ca73ea-738f-4e32-ac4b-73a1ffaa8acd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for user 14b33d78e2004ce58ea40e2e7ab3af6a and project 5b5f901151674241a914cc41a8989893. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:40:00.761162 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54ca73ea-738f-4e32-ac4b-73a1ffaa8acd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.266190 Sep 13 17:40:00.761998 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3892/7837] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:40:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:00.820789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2133588494", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2082667081", "networks": [{"uuid": "9ca1cc4c-7c5b-45b1-8f14-429d4fa98792"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:00.833169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:00.834153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=34 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:00.905990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] validate_networks() for [('9ca1cc4c-7c5b-45b1-8f14-429d4fa98792', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:40:01.414701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:40:01.415146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:40:01.415674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:40:01.416110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:40:01.416743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:40:01.425792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:01.427015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:01.427512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:01.428274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:01.428951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:01.429408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:01.446453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for project 5b5f901151674241a914cc41a8989893. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:40:01.451807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for user 14b33d78e2004ce58ea40e2e7ab3af6a and project 5b5f901151674241a914cc41a8989893. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:40:01.466492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:40:01.468902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:40:01.518804 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-89c5de03-ee39-486e-a601-f92323177b18 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702518 Sep 13 17:40:01.525989 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3946/7838] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:40:01.534002 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-624e44c3-ae6a-4f1f-98b2-46b5436f917e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:01.534895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-624e44c3-ae6a-4f1f-98b2-46b5436f917e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:01.598270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-624e44c3-ae6a-4f1f-98b2-46b5436f917e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:01.608078 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-624e44c3-ae6a-4f1f-98b2-46b5436f917e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1263 microversion: 2.1 time: 0.080309 Sep 13 17:40:01.608904 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3893/7839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:01 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:02.632957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:02.633594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:02.641120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:02.641629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:02.642415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:02.643147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:02.643624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:02.644076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:02.744056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:02.753199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a258dd95-a741-418a-ab20-d0245811921a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1323 microversion: 2.1 time: 0.125111 Sep 13 17:40:02.754553 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3947/7840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:02 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1323 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:03.777916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:03.778813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:03.786078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:03.786665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:03.787182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:03.788734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:03.789301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:03.789960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:04.024395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:04.032844 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-20fc2e53-318d-49db-a943-8727167fbccb tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.258945 Sep 13 17:40:04.033439 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3894/7841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:03 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:04.266892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c54934df-1816-44ef-8708-1f0679d2caeb req-fa4b66d1-b212-4568-89db-f4fa151ff609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478f8cfc-15f3-43be-8c4d-3008a6d2fcb3", "tag": "439dc32e-48fa-4900-9a1c-55cd2cb2675c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:04.282047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c54934df-1816-44ef-8708-1f0679d2caeb req-fa4b66d1-b212-4568-89db-f4fa151ff609 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:04.287357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c54934df-1816-44ef-8708-1f0679d2caeb req-fa4b66d1-b212-4568-89db-f4fa151ff609 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:04.288729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c54934df-1816-44ef-8708-1f0679d2caeb req-fa4b66d1-b212-4568-89db-f4fa151ff609 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:04.302707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c54934df-1816-44ef-8708-1f0679d2caeb req-fa4b66d1-b212-4568-89db-f4fa151ff609 service nova] Creating event network-changed:439dc32e-48fa-4900-9a1c-55cd2cb2675c for instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 on n-h1-857467-1 Sep 13 17:40:04.312105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c54934df-1816-44ef-8708-1f0679d2caeb req-fa4b66d1-b212-4568-89db-f4fa151ff609 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045617 Sep 13 17:40:04.312801 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3948/7842] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:05.057204 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:05.058549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:05.065985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:05.066494 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:05.066946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:05.067679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:05.068149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:05.068590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:05.206755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:05.215141 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5439e9fc-0be3-468b-8672-5133bd468120 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.162369 Sep 13 17:40:05.215757 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3895/7843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:05 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:06.239742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:06.240454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:06.248000 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:06.248505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:06.248964 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:06.249693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:06.250191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:06.250632 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:06.387229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:06.395190 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61fa357b-9cd7-4771-bad5-dbc690cc1e8a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.160567 Sep 13 17:40:06.398160 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3949/7844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:06 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:07.420334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:07.421111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:07.430555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:07.431065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:07.431511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:07.432439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:07.433079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:07.433685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:07.729182 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:07.737328 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d9ff71df-9d8d-45b6-98ff-bf9c3ea0048e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.321212 Sep 13 17:40:07.737941 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3896/7845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:07 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:08.762022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:08.762907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:08.771734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:08.772803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:08.773265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:08.774094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:08.774574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:08.775017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:08.913997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:08.921966 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b94a9859-26d9-4f51-83ea-e9ace4b7c2d5 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.164128 Sep 13 17:40:08.922564 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3950/7846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:08 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:09.945338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:09.945993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:09.953873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:09.954368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:09.954807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:09.955542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:09.956003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:09.956434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:10.093348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:10.101498 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8ef07cd0-f675-4653-a82c-1b3920cb3d33 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.160747 Sep 13 17:40:10.102123 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3897/7847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:09 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:10.357640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-efab4b3c-36e1-4af8-b23e-9b62c59bb702 req-adbd3dc9-37f1-4b82-855b-f6f4efb0f73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478f8cfc-15f3-43be-8c4d-3008a6d2fcb3", "name": "network-vif-plugged", "status": "completed", "tag": "439dc32e-48fa-4900-9a1c-55cd2cb2675c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:10.368286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-efab4b3c-36e1-4af8-b23e-9b62c59bb702 req-adbd3dc9-37f1-4b82-855b-f6f4efb0f73c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:10.368787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-efab4b3c-36e1-4af8-b23e-9b62c59bb702 req-adbd3dc9-37f1-4b82-855b-f6f4efb0f73c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:10.369258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-efab4b3c-36e1-4af8-b23e-9b62c59bb702 req-adbd3dc9-37f1-4b82-855b-f6f4efb0f73c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:10.380588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-efab4b3c-36e1-4af8-b23e-9b62c59bb702 req-adbd3dc9-37f1-4b82-855b-f6f4efb0f73c service nova] Creating event network-vif-plugged:439dc32e-48fa-4900-9a1c-55cd2cb2675c for instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 on n-h1-857467-1 Sep 13 17:40:10.386202 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-efab4b3c-36e1-4af8-b23e-9b62c59bb702 req-adbd3dc9-37f1-4b82-855b-f6f4efb0f73c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032257 Sep 13 17:40:10.387018 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3951/7848] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:11.125532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:11.126203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:11.133255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:11.133745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:11.134214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:11.134911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:11.135373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:11.135808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:11.271602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:11.280173 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1a842907-0f89-4660-808a-f18056b65edf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1363 microversion: 2.1 time: 0.158541 Sep 13 17:40:11.280761 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3898/7849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:11 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:12.301991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:12.302795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:12.306942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:12.307654 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:12.314723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:12.315224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:12.315673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:12.316369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:12.316839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:12.317308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:12.767745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:12.775586 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b1ec1e08-401b-4af4-8e25-382bdeba5721 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1554 microversion: 2.1 time: 0.475410 Sep 13 17:40:12.776162 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3952/7850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:12 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1554 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:40:12.798769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:12.799388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:12.801271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:12.808415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:12.808912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:12.809355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:12.810090 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:12.810558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:12.810997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:12.940099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:12.948123 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bd1afb9-79ab-4956-b043-eaf57a7b27e1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1554 microversion: 2.1 time: 0.153577 Sep 13 17:40:12.948719 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3899/7851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:12 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:14.621230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef01b9a1-61bf-4cb4-b5fe-c0a388203b06"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:14.623655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:14.630492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:14.630994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:14.631627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:14.632447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:14.632922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:14.633368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:14.893599 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3dd3f52-0c15-44fb-9a3b-180a614a6185 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276147 Sep 13 17:40:14.894261 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3953/7852] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:40:14 2022] POST /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:25.626212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:25.626747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:25.628741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:25.629489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=36 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:25.635548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:25.636046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:25.636493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:25.637202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:25.637669 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:25.638170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:25.720057 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lazy-loading 'services' on Instance uuid 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:40:25.795488 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-072ea7a8-6f4c-4f41-adf3-406c56eb2e98 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments/ef01b9a1-61bf-4cb4-b5fe-c0a388203b06" status: 202 len: 0 microversion: 2.1 time: 0.173463 Sep 13 17:40:25.796842 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3900/7853] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:40:25 2022] DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments/ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:40:25.804454 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:25.805272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:25.810014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:25.812881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:25.821115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:25.821636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:25.822130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:25.822864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:25.823346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:25.823800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:25.859991 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-af34097f-f16c-482a-bb59-753d98729912 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058445 Sep 13 17:40:25.860751 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3954/7854] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:40:25 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:26.874011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:26.876402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:26.884972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:26.885464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:26.885929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:26.887035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:26.887501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:26.887939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:26.925984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-94d1e987-3958-4fd5-976c-334471f70a7d tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056862 Sep 13 17:40:26.926581 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3901/7855] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:40:26 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:40:27.939725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:27.942036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:27.949717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:27.950423 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:27.951202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:27.951992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:27.952476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:27.952933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:27.986347 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c9197e3-1b33-4ca9-b80b-22e77f363a7b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050575 Sep 13 17:40:27.987221 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3955/7856] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:40:27 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:28.999268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:29.001563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:29.009421 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:29.010004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:29.010453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:29.011155 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:29.011617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:29.012045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:29.044277 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a54d0cd0-a523-4671-95a1-2d6374011db4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048957 Sep 13 17:40:29.044737 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3902/7857] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:40:28 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:30.057213 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:30.059714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:30.066835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:30.067343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:30.067799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:30.069343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:30.070101 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:30.070558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:30.107157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-13962344-43b7-490f-8d98-3c4ec42c7768 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054252 Sep 13 17:40:30.108119 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3956/7858] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:40:30 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:31.119295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:31.121579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:31.128495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:31.128983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:31.129430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:31.130159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:31.130625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:31.131056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:31.160531 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-acad1f05-62f2-4c39-97eb-b3be4f1c757b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045473 Sep 13 17:40:31.161097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3903/7859] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:40:31 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 17:40:31.173188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:31.173724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:31.180813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:31.181320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:31.181779 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:31.182520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:31.183041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:31.183492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:31.259153 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] HTTP exception thrown: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 is not attached to volume ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Request method failure captured: Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments/ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 HTTP/1.1 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMBrFBzZwUZ1A2XG-aY4tSrM0UMButkIGvYAP6q2h5XD2GBXVS5-aKqmryS2AYV3bqTMfQlA-xhym6Pw1ULcKqzfPpNBgNwKLnic6Qm9iqNqsfhWAYZSHADJ3hJeok9C478698nTz5xQsKpqjoKZxTFjCNuSrOEl7EThGLeQGeebIJg Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b5f901151674241a914cc41a8989893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 14b33d78e2004ce58ea40e2e7ab3af6a Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 is not attached to volume ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '478f8cfc-15f3-43be-8c4d-3008a6d2fcb3', 'id': 'ef01b9a1-61bf-4cb4-b5fe-c0a388203b06'} Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ef01b9a1-61bf-4cb4-b5fe-c0a388203b06. Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 is not attached to volume ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:40:31.267371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 is not attached to volume ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Returning 404 to user: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 is not attached to volume ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3259ccfe-85e5-40c6-97eb-d5fea6c014f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments/ef01b9a1-61bf-4cb4-b5fe-c0a388203b06" status: 404 len: 154 microversion: 2.1 time: 0.100025 Sep 13 17:40:31.272168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3957/7860] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:40:31 2022] DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3/os-volume_attachments/ef01b9a1-61bf-4cb4-b5fe-c0a388203b06 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:40:34.652508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:34.653209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:34.662771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:34.663640 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:34.664403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:34.665188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:34.665660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:34.666131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:34.696079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:40:34.775893 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9b28d920-3e30-436e-b574-19d8c246e0a3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 204 len: 0 microversion: 2.1 time: 0.128572 Sep 13 17:40:34.779734 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3904/7861] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:40:34 2022] DELETE /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:40:34.784996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:34.785641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:34.793447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:34.793989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:34.794451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:34.795192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:34.795657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:34.796111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:34.931551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:34.939560 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38cd0af7-9b85-4a70-afe7-2b3307dbf863 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1560 microversion: 2.1 time: 0.158447 Sep 13 17:40:34.940137 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3958/7862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:34 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:35.964446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:35.965074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:35.972105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:35.972600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:35.973044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:35.973744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:35.974249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:35.974672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:36.113267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:36.121182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3ec5cb25-0de2-4aca-963a-48a76c85a6e3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1560 microversion: 2.1 time: 0.161752 Sep 13 17:40:36.121761 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3905/7863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:35 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:37.147395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:37.148113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:37.159516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:37.160203 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:37.161017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:37.162226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:37.164242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:37.164865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:37.195508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-edc5ea85-dbd9-4cc1-8c6d-45ab933a9d31 req-dae5d232-daa8-4cc0-b189-bcda8abc271e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478f8cfc-15f3-43be-8c4d-3008a6d2fcb3", "name": "network-vif-deleted", "tag": "439dc32e-48fa-4900-9a1c-55cd2cb2675c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:37.210923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-edc5ea85-dbd9-4cc1-8c6d-45ab933a9d31 req-dae5d232-daa8-4cc0-b189-bcda8abc271e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:37.211521 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-edc5ea85-dbd9-4cc1-8c6d-45ab933a9d31 req-dae5d232-daa8-4cc0-b189-bcda8abc271e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:37.213328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-edc5ea85-dbd9-4cc1-8c6d-45ab933a9d31 req-dae5d232-daa8-4cc0-b189-bcda8abc271e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:37.227111 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-edc5ea85-dbd9-4cc1-8c6d-45ab933a9d31 req-dae5d232-daa8-4cc0-b189-bcda8abc271e service nova] Creating event network-vif-deleted:439dc32e-48fa-4900-9a1c-55cd2cb2675c for instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 on n-h1-857467-1 Sep 13 17:40:37.233338 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-edc5ea85-dbd9-4cc1-8c6d-45ab933a9d31 req-dae5d232-daa8-4cc0-b189-bcda8abc271e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041508 Sep 13 17:40:37.234242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3906/7864] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:37.262830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:37.272217 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-badc42ad-ce97-4e70-b0db-dc3a8a6dd347 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 200 len: 1518 microversion: 2.1 time: 0.131392 Sep 13 17:40:37.278082 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3959/7865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:37 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 1518 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:38.296808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:38.297561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:38.304682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:38.305173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:38.306308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:38.307020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:38.307491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:38.307934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:38.322334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] HTTP exception thrown: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 could not be found. Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Request method failure captured: Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 HTTP/1.1 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMBrFBzZwUZ1A2XG-aY4tSrM0UMButkIGvYAP6q2h5XD2GBXVS5-aKqmryS2AYV3bqTMfQlA-xhym6Pw1ULcKqzfPpNBgNwKLnic6Qm9iqNqsfhWAYZSHADJ3hJeok9C478698nTz5xQsKpqjoKZxTFjCNuSrOEl7EThGLeQGeebIJg Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b5f901151674241a914cc41a8989893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 14b33d78e2004ce58ea40e2e7ab3af6a Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 could not be found. Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '478f8cfc-15f3-43be-8c4d-3008a6d2fcb3'} Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 could not be found. Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 could not be found. Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:40:38.323929 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 could not be found. Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Returning 404 to user: Instance 478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a0c83725-90e9-4f53-9b92-097f52014b6a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3" status: 404 len: 111 microversion: 2.1 time: 0.033183 Sep 13 17:40:38.328450 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3907/7866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:38 2022] GET /compute/v2.1/servers/478f8cfc-15f3-43be-8c4d-3008a6d2fcb3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:40:38.334505 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f629faaa-c5e5-428f-9ce2-ed229502db70 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '.version_select at 0x7fbeb5ae3b80>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:38.354684 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f629faaa-c5e5-428f-9ce2-ed229502db70 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2082667081" status: 202 len: 0 microversion: 2.1 time: 0.024123 Sep 13 17:40:38.355280 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3960/7867] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Sep 13 17:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2082667081 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:40:38.373104 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-367170f4-5efd-4c48-b8b6-d5ef20379198 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: .version_select at 0x7fbeb4da9820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2057127778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5Td3pzBO7tmzF6jF3FGWPu3hbCzmzuax11xY8x2ed/vZri1wQn5FBQ5xeyjwxhP2YbWGDW23dWYqmEY0ex3YUPJmRmyS22LLss0/uYdBnWGu3ynNZyta5lHLuz8+hOmA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:38.389075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-367170f4-5efd-4c48-b8b6-d5ef20379198 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for project 5b5f901151674241a914cc41a8989893. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:40:38.394235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-367170f4-5efd-4c48-b8b6-d5ef20379198 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for user 14b33d78e2004ce58ea40e2e7ab3af6a and project 5b5f901151674241a914cc41a8989893. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:40:38.417712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-367170f4-5efd-4c48-b8b6-d5ef20379198 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048519 Sep 13 17:40:38.418341 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3908/7868] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:40:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:38.473218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-675820323", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2057127778", "networks": [{"uuid": "9ca1cc4c-7c5b-45b1-8f14-429d4fa98792"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:38.526450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] validate_networks() for [('9ca1cc4c-7c5b-45b1-8f14-429d4fa98792', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:40:38.903812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:40:38.904259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:40:38.904788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:40:38.905222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:40:38.905660 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:40:38.914661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:38.915166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:38.915630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:38.916386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:38.916866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:38.917315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:38.934827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for project 5b5f901151674241a914cc41a8989893. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:40:38.940169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for user 14b33d78e2004ce58ea40e2e7ab3af6a and project 5b5f901151674241a914cc41a8989893. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:40:38.953022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:40:38.955381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:40:39.001066 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d014370b-0c9a-4c7e-b976-dcf7af2bc524 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531734 Sep 13 17:40:39.001743 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3961/7869] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:40:39.014299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0ffe3e1d-32b9-4c58-9b9f-ad8fbeae1740 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:39.014949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0ffe3e1d-32b9-4c58-9b9f-ad8fbeae1740 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:39.076621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0ffe3e1d-32b9-4c58-9b9f-ad8fbeae1740 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:39.083718 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0ffe3e1d-32b9-4c58-9b9f-ad8fbeae1740 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1262 microversion: 2.1 time: 0.073891 Sep 13 17:40:39.084334 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3909/7870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:39 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:40.110017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:40.110661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:40.118772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:40.119308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:40.119768 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:40.120511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:40.121189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:40.121638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:40.189645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:40.198491 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1422e38c-67c5-4473-b411-3bf228f99da0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1332 microversion: 2.1 time: 0.093771 Sep 13 17:40:40.199144 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3962/7871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:40 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:41.222735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:41.223391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:41.230975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:41.231468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:41.231910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:41.232610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:41.233069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:41.233503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:41.432862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:41.441122 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2eda6612-0e11-4782-9aef-5a146952abd1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1362 microversion: 2.1 time: 0.222462 Sep 13 17:40:41.441791 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3910/7872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:41 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:41.595214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3ddbb5a1-c234-4970-9ab8-33e043f317ad req-9d97951e-6b80-43a3-aa13-fdd33d19ac28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bc00f9-9ab2-414e-9f4e-ccb8327660db", "tag": "fb295f1d-f2b0-475f-8ac2-e8d6038d002a"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:41.606029 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3ddbb5a1-c234-4970-9ab8-33e043f317ad req-9d97951e-6b80-43a3-aa13-fdd33d19ac28 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:41.606542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3ddbb5a1-c234-4970-9ab8-33e043f317ad req-9d97951e-6b80-43a3-aa13-fdd33d19ac28 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:41.607001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3ddbb5a1-c234-4970-9ab8-33e043f317ad req-9d97951e-6b80-43a3-aa13-fdd33d19ac28 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:41.622191 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3ddbb5a1-c234-4970-9ab8-33e043f317ad req-9d97951e-6b80-43a3-aa13-fdd33d19ac28 service nova] Creating event network-changed:fb295f1d-f2b0-475f-8ac2-e8d6038d002a for instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db on n-h2-857467-1 Sep 13 17:40:41.627507 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3ddbb5a1-c234-4970-9ab8-33e043f317ad req-9d97951e-6b80-43a3-aa13-fdd33d19ac28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101811 Sep 13 17:40:41.628128 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3963/7873] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:42.464750 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:42.465413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:42.472329 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:42.472820 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:42.473269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:42.474012 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:42.474484 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:42.474921 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:42.610134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:42.618034 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9563b0c8-3d0a-4b26-8a10-d9da7f0f879e tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1362 microversion: 2.1 time: 0.157353 Sep 13 17:40:42.618697 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3911/7874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:42 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:43.641360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:43.642107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:43.649667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:43.650727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:43.651192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:43.651892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:43.652374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:43.652820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:43.781955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:43.789752 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f76b112-a4cb-48be-8044-10358e7ff763 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1362 microversion: 2.1 time: 0.152618 Sep 13 17:40:43.790733 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3964/7875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:43 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:44.815677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:44.816300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:44.824194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:44.824689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:44.825133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:44.825860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:44.826327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:44.826764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:44.962181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:44.970805 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b9bfff96-aef0-41c7-aaa6-db9ced82b539 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1362 microversion: 2.1 time: 0.159067 Sep 13 17:40:44.971351 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3912/7876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:44 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:45.995524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:45.996170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:46.003542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:46.004056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:46.004510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:46.005238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:46.005712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:46.006182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:46.151738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:46.159910 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7011301e-0fef-42d8-bfd0-cc583dad58d3 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1362 microversion: 2.1 time: 0.169381 Sep 13 17:40:46.160516 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3965/7877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:45 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:46.232032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-dde65729-9976-458a-b57f-ed89f8ea7fa4 req-d8ea2c6b-4942-445b-af46-03d45a7c0f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bc00f9-9ab2-414e-9f4e-ccb8327660db", "name": "network-vif-plugged", "status": "completed", "tag": "fb295f1d-f2b0-475f-8ac2-e8d6038d002a"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:46.243458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dde65729-9976-458a-b57f-ed89f8ea7fa4 req-d8ea2c6b-4942-445b-af46-03d45a7c0f63 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:46.245376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dde65729-9976-458a-b57f-ed89f8ea7fa4 req-d8ea2c6b-4942-445b-af46-03d45a7c0f63 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:46.245874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-dde65729-9976-458a-b57f-ed89f8ea7fa4 req-d8ea2c6b-4942-445b-af46-03d45a7c0f63 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:46.257378 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-dde65729-9976-458a-b57f-ed89f8ea7fa4 req-d8ea2c6b-4942-445b-af46-03d45a7c0f63 service nova] Creating event network-vif-plugged:fb295f1d-f2b0-475f-8ac2-e8d6038d002a for instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db on n-h2-857467-1 Sep 13 17:40:46.262775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-dde65729-9976-458a-b57f-ed89f8ea7fa4 req-d8ea2c6b-4942-445b-af46-03d45a7c0f63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035521 Sep 13 17:40:46.263554 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3913/7878] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:40:47.184084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:47.184748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:47.191769 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:47.192276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:47.192737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:47.193451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:47.193959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:47.194409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:47.325023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:47.332829 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4d817902-0576-4edd-8c7b-2789c7cf56d1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1362 microversion: 2.1 time: 0.153650 Sep 13 17:40:47.333429 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3966/7879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:47 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:48.358016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:48.358647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:48.365030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:48.365514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:48.365997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:48.366704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:48.367173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:48.367612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:48.515113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:48.523262 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3bbce060-2c70-4abc-898e-16b915ff3529 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1553 microversion: 2.1 time: 0.170725 Sep 13 17:40:48.523835 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3914/7880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:48 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:48.547651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:40:48.548452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:48.554794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:48.555329 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:48.555782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:48.556515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:48.557139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:48.557588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:48.689527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:40:48.698149 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e7a4a17d-0d01-4c0f-a86d-3c1fb6e89d85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1553 microversion: 2.1 time: 0.155042 Sep 13 17:40:48.698727 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3967/7881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:40:48 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:40:50.197707 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:40:50.200126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:40:50.202156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:40:50.208194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:50.208684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:50.209132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:50.209859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:40:50.210322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:40:50.210751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:40:50.466235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cf8021cc-7cbc-452f-9bef-0336d6330bc2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272597 Sep 13 17:40:50.466852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3915/7882] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:40:50 2022] POST /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:01.187840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:01.188345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:01.190393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:01.191067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:01.193117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:01.193938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=70 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:01.202291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:01.202797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:01.203254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:01.204033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:01.204507 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:01.205012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:01.286317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lazy-loading 'services' on Instance uuid 85bc00f9-9ab2-414e-9f4e-ccb8327660db {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:41:01.356268 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5230623e-8ee8-49d0-abb3-4b6541585e72 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments/02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1" status: 202 len: 0 microversion: 2.1 time: 0.172223 Sep 13 17:41:01.356872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3968/7883] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:41:01 2022] DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments/02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 17:41:01.364080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:01.364923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:01.369821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:01.372405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:01.381357 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:01.381982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:01.382465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:01.383216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:01.383683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:01.384156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:01.419182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-87df7ce7-116a-44f1-9653-dfe027060ed0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056955 Sep 13 17:41:01.419873 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3916/7884] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:01 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:41:02.434349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:02.436759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:02.443188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:02.443698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:02.444159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:02.444879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:02.445368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:02.445819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:02.477421 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60ca9c70-fcdd-4ee9-ad30-e57c5d9b9e67 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049237 Sep 13 17:41:02.478563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3969/7885] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:02 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:03.489796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:03.492100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:03.499867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:03.500509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:03.500974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:03.501728 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:03.502244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:03.502683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:03.536298 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fca4cf5e-5366-4a2e-af00-bdf620c2365b tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050476 Sep 13 17:41:03.536899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3917/7886] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:03 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:04.550285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:04.552651 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:04.559867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:04.560379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:04.560843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:04.561572 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:04.562100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:04.562536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:04.597622 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f67ad5ca-cdb2-4bb1-ac2e-b048b9c66d7f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051591 Sep 13 17:41:04.598247 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3970/7887] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:04 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:05.610940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:05.613033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:05.620130 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:05.620643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:05.621085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:05.621784 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:05.622271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:05.622700 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:05.657809 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-42697493-7c1c-41e8-9a9b-355bf0340a44 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051401 Sep 13 17:41:05.658449 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3918/7888] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:05 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:06.670856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:06.673354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:06.680343 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:06.680840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:06.681301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:06.682060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:06.682536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:06.682981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:06.712986 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-abc9a446-ce48-48c1-8fa6-4d3a8c076d68 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045462 Sep 13 17:41:06.713598 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3971/7889] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:06 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 17:41:06.724385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:06.724964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:06.732607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:06.733108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:06.733559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:06.734294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:06.734767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:06.735210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:06.812715 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] HTTP exception thrown: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db is not attached to volume 02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Request method failure captured: Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments/02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 HTTP/1.1 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMBrFBzZwUZ1A2XG-aY4tSrM0UMButkIGvYAP6q2h5XD2GBXVS5-aKqmryS2AYV3bqTMfQlA-xhym6Pw1ULcKqzfPpNBgNwKLnic6Qm9iqNqsfhWAYZSHADJ3hJeok9C478698nTz5xQsKpqjoKZxTFjCNuSrOEl7EThGLeQGeebIJg Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b5f901151674241a914cc41a8989893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 14b33d78e2004ce58ea40e2e7ab3af6a Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db is not attached to volume 02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': '85bc00f9-9ab2-414e-9f4e-ccb8327660db', 'id': '02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1'} Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1. Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db is not attached to volume 02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:06.814696 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db is not attached to volume 02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Returning 404 to user: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db is not attached to volume 02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2aaf241e-13d8-4354-a5bd-aa86bee1f1f8 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments/02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1" status: 404 len: 154 microversion: 2.1 time: 0.095958 Sep 13 17:41:06.819071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3919/7890] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:41:06 2022] DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db/os-volume_attachments/02b7bb80-d9f7-4882-bc5c-0c57c04b5ca1 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:41:10.169332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:10.169996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:10.177342 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:10.177986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:10.178509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:10.179332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:10.179870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:10.180381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:10.208482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:41:10.291079 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b28e290-e913-4d11-ad5e-51fb453444aa tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 204 len: 0 microversion: 2.1 time: 0.125413 Sep 13 17:41:10.291613 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3972/7891] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:41:10 2022] DELETE /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:41:10.300400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:10.301224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:10.309961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:10.310458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:10.310906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:10.311737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:10.312208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:10.312643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:10.448223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:10.456407 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d9f0425-a379-4def-8bc0-3b98dd9b24dd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1559 microversion: 2.1 time: 0.160380 Sep 13 17:41:10.457069 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3920/7892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:10 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:11.480388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:11.481119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:11.488310 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:11.488821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:11.489286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:11.490045 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:11.490524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:11.490973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:11.627409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:11.635847 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-29cb17f5-614d-41af-a465-95a9ccf1d9cf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1559 microversion: 2.1 time: 0.159916 Sep 13 17:41:11.636440 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3973/7893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:11 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:12.659256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:12.659774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:12.668229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:12.668737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:12.669181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:12.670114 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:12.670742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:12.671368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:12.747845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-01b1a0b3-e1f9-4297-88dc-8d15073a3604 req-953d5b7f-d707-45b4-be5d-1d7040a0b7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bc00f9-9ab2-414e-9f4e-ccb8327660db", "name": "network-vif-deleted", "tag": "fb295f1d-f2b0-475f-8ac2-e8d6038d002a"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:12.760615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-01b1a0b3-e1f9-4297-88dc-8d15073a3604 req-953d5b7f-d707-45b4-be5d-1d7040a0b7e8 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:12.761135 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-01b1a0b3-e1f9-4297-88dc-8d15073a3604 req-953d5b7f-d707-45b4-be5d-1d7040a0b7e8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:12.762214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-01b1a0b3-e1f9-4297-88dc-8d15073a3604 req-953d5b7f-d707-45b4-be5d-1d7040a0b7e8 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:12.763056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:12.772272 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1df8fb12-56aa-42a0-af6d-229ba1bf6308 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 200 len: 1517 microversion: 2.1 time: 0.117006 Sep 13 17:41:12.773152 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3921/7894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:12 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 1517 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:12.774740 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-01b1a0b3-e1f9-4297-88dc-8d15073a3604 req-953d5b7f-d707-45b4-be5d-1d7040a0b7e8 service nova] Creating event network-vif-deleted:fb295f1d-f2b0-475f-8ac2-e8d6038d002a for instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db on n-h2-857467-1 Sep 13 17:41:12.780016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-01b1a0b3-e1f9-4297-88dc-8d15073a3604 req-953d5b7f-d707-45b4-be5d-1d7040a0b7e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 Sep 13 17:41:12.780749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3974/7895] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:13.796232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:13.797145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: 85bc00f9-9ab2-414e-9f4e-ccb8327660db] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:13.804046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:13.804533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:13.804977 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:13.806378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:13.806847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:13.807281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:13.820757 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] HTTP exception thrown: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db could not be found. Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Request method failure captured: Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db HTTP/1.1 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMBrFBzZwUZ1A2XG-aY4tSrM0UMButkIGvYAP6q2h5XD2GBXVS5-aKqmryS2AYV3bqTMfQlA-xhym6Pw1ULcKqzfPpNBgNwKLnic6Qm9iqNqsfhWAYZSHADJ3hJeok9C478698nTz5xQsKpqjoKZxTFjCNuSrOEl7EThGLeQGeebIJg Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b5f901151674241a914cc41a8989893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 14b33d78e2004ce58ea40e2e7ab3af6a Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db could not be found. Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '85bc00f9-9ab2-414e-9f4e-ccb8327660db'} Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db could not be found. Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db could not be found. Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:13.822417 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db could not be found. Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Returning 404 to user: Instance 85bc00f9-9ab2-414e-9f4e-ccb8327660db could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4df60711-5530-43ab-b19a-f6f21f0490ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db" status: 404 len: 111 microversion: 2.1 time: 0.031706 Sep 13 17:41:13.826896 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3922/7896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:13 2022] GET /compute/v2.1/servers/85bc00f9-9ab2-414e-9f4e-ccb8327660db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:41:13.834273 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f67b7467-ecf8-4810-9a97-6018bb81b209 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '.version_select at 0x7fbeb980d670>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:13.855516 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f67b7467-ecf8-4810-9a97-6018bb81b209 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2057127778" status: 202 len: 0 microversion: 2.1 time: 0.026392 Sep 13 17:41:13.856105 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3975/7897] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Sep 13 17:41:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2057127778 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:41:13.873696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b165f7f9-08b5-4df1-9e42-eb44364cb5e0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: .version_select at 0x7fbeb95aa5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1139252182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQTJjrf0oR9ahc8ix3xlE7BnWPqnvDJWoR29m9XmxM8b/cVB5LIx0sQirBWyMC0RQ5UUXjvjMCjKKSYl+nomt4xpRbi8GwQwQZYJMhnrKV2OTOpNoFZDDu8gfm1CwOi4A=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:13.889407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b165f7f9-08b5-4df1-9e42-eb44364cb5e0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for project 5b5f901151674241a914cc41a8989893. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:41:13.894616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-b165f7f9-08b5-4df1-9e42-eb44364cb5e0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for user 14b33d78e2004ce58ea40e2e7ab3af6a and project 5b5f901151674241a914cc41a8989893. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:41:13.919295 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b165f7f9-08b5-4df1-9e42-eb44364cb5e0 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049773 Sep 13 17:41:13.919899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3923/7898] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:41:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:13.970266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-225435931", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1139252182", "networks": [{"uuid": "9ca1cc4c-7c5b-45b1-8f14-429d4fa98792"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:14.023716 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] validate_networks() for [('9ca1cc4c-7c5b-45b1-8f14-429d4fa98792', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:41:14.399173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:41:14.400316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:41:14.400994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:41:14.401420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:41:14.401876 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:41:14.410671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:14.411169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:14.411616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:14.412354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:14.412825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:14.413268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:14.431127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for project 5b5f901151674241a914cc41a8989893. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:41:14.436415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Getting quotas for user 14b33d78e2004ce58ea40e2e7ab3af6a and project 5b5f901151674241a914cc41a8989893. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:41:14.449970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:41:14.452412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:41:14.499173 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a20ea959-ae66-452a-9cca-8e170c523808 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532880 Sep 13 17:41:14.499841 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3976/7899] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:41:14.513016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6da11450-15c6-4e90-88f6-040b468b60b1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:14.514245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6da11450-15c6-4e90-88f6-040b468b60b1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:14.571815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6da11450-15c6-4e90-88f6-040b468b60b1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:14.579452 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6da11450-15c6-4e90-88f6-040b468b60b1 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1262 microversion: 2.1 time: 0.072319 Sep 13 17:41:14.580069 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3924/7900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:14 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:15.605429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:15.606207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:15.616552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:15.617154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:15.617705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:15.619067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:15.619754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:15.620216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:15.684830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:15.692691 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b5521b3-4bcf-4201-b03e-4468adb03eef tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1332 microversion: 2.1 time: 0.093343 Sep 13 17:41:15.693284 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3977/7901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:15 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:16.716471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:16.717224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:16.724278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:16.724769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:16.725209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:16.725936 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:16.726396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:16.726827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:16.925319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:16.933451 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62bf51d8-4b5f-4151-b76c-593c3eb7887f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.220899 Sep 13 17:41:16.934079 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3925/7902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:16 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:16.991188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-91b13d38-0ff9-4e55-ba18-626d23673577 req-eca2c8d9-53ea-4270-a4ae-f3e700524b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb17a5c7-99f5-492b-ba1d-d4f282c01d68", "tag": "5996c6b3-d1e9-4f64-9878-01bb064f6d0a"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:17.001763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-91b13d38-0ff9-4e55-ba18-626d23673577 req-eca2c8d9-53ea-4270-a4ae-f3e700524b2f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:17.002316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-91b13d38-0ff9-4e55-ba18-626d23673577 req-eca2c8d9-53ea-4270-a4ae-f3e700524b2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:17.003459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-91b13d38-0ff9-4e55-ba18-626d23673577 req-eca2c8d9-53ea-4270-a4ae-f3e700524b2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:17.016715 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-91b13d38-0ff9-4e55-ba18-626d23673577 req-eca2c8d9-53ea-4270-a4ae-f3e700524b2f service nova] Creating event network-changed:5996c6b3-d1e9-4f64-9878-01bb064f6d0a for instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 on n-h2-857467-1 Sep 13 17:41:17.021790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-91b13d38-0ff9-4e55-ba18-626d23673577 req-eca2c8d9-53ea-4270-a4ae-f3e700524b2f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034225 Sep 13 17:41:17.022440 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3978/7903] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:17.956952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:17.957477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:17.964193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:17.964683 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:17.965131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:17.965918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:17.966330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:17.966770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:18.101058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:18.109806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5602d6d8-6d5f-4e9c-ab72-dc26c4f21f63 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.157155 Sep 13 17:41:18.110407 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3926/7904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:17 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:19.136320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:19.137949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:19.145216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:19.145753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:19.146236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:19.146958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:19.147443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:19.147890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:19.314220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:19.323201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7eabc7d-60ab-4284-850a-d898ae8117a6 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.193023 Sep 13 17:41:19.323797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3979/7905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:19 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:20.347169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:20.347748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:20.354737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:20.355228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:20.355671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:20.356406 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:20.356874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:20.357311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:20.486097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:20.495051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7f6b1838-0679-442f-a5fe-836c287edc82 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.151924 Sep 13 17:41:20.495636 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3927/7906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:20 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:41:21.518672 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:21.519312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:21.527118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:21.527633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:21.528102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:21.528821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:21.529302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:21.529754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:21.677011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:21.685026 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53b45b24-9bd0-4e23-a187-72fcc90f74de tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.170351 Sep 13 17:41:21.685598 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3980/7907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:21 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:22.708547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:22.709163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:22.716576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:22.716918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:22.717352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:22.718243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:22.718722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:22.719208 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:22.849113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:22.857231 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-236bf280-be22-4862-ad2e-ab6ec2813c85 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.152815 Sep 13 17:41:22.857750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3928/7908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:22 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:23.880418 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:23.881046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:23.888141 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:23.888638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:23.889088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:23.889791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:23.890288 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:23.890729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:24.027057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:24.034886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2df9b99-aa62-48e4-a287-a5818e116dc9 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.158398 Sep 13 17:41:24.035470 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3981/7909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:23 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:24.247473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ebd4de37-6d97-4acd-82d2-852a383b26c2 req-1614f244-d4af-4753-98b5-44d24b154b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb17a5c7-99f5-492b-ba1d-d4f282c01d68", "name": "network-vif-plugged", "status": "completed", "tag": "5996c6b3-d1e9-4f64-9878-01bb064f6d0a"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:24.258263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ebd4de37-6d97-4acd-82d2-852a383b26c2 req-1614f244-d4af-4753-98b5-44d24b154b97 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:24.259169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ebd4de37-6d97-4acd-82d2-852a383b26c2 req-1614f244-d4af-4753-98b5-44d24b154b97 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:24.259169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ebd4de37-6d97-4acd-82d2-852a383b26c2 req-1614f244-d4af-4753-98b5-44d24b154b97 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:24.270904 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ebd4de37-6d97-4acd-82d2-852a383b26c2 req-1614f244-d4af-4753-98b5-44d24b154b97 service nova] Creating event network-vif-plugged:5996c6b3-d1e9-4f64-9878-01bb064f6d0a for instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 on n-h2-857467-1 Sep 13 17:41:24.276607 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ebd4de37-6d97-4acd-82d2-852a383b26c2 req-1614f244-d4af-4753-98b5-44d24b154b97 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Sep 13 17:41:24.277550 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3929/7910] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:25.059620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:25.060164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:25.062176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:25.062856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:25.069427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:25.069958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:25.070413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:25.071129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:25.071602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:25.072042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:25.202313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:25.209988 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4c93df91-1fe1-42aa-8c74-45f3317cf63f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1362 microversion: 2.1 time: 0.154947 Sep 13 17:41:25.210570 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3982/7911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:25 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:26.230469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:26.235892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:26.236599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:26.243119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:26.243607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:26.244592 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:26.245353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:26.245838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:26.246281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:26.375197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:26.383178 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-80de19fe-0f87-4f87-810c-640729a7ece4 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1553 microversion: 2.1 time: 0.153708 Sep 13 17:41:26.383772 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3930/7912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:26 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:26.406234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:26.406866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:26.413816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:26.414456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:26.414914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:26.415620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:26.416119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:26.416562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:26.549184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:26.558047 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-62e8ecee-3873-417f-aa82-688ebd0351ea tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1553 microversion: 2.1 time: 0.155570 Sep 13 17:41:26.558750 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3983/7913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:26 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:28.049723 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32c118e7-82e1-487c-9353-b33ecb014c11"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:28.052309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:28.060434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:28.060930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:28.061375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:28.062120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:28.062579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:28.063032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:28.321414 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d954dfea-a344-4c53-83f2-ebb8d2487110 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "POST /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275808 Sep 13 17:41:28.322078 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3931/7914] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:41:28 2022] POST /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:39.051538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:39.052247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:39.057297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:39.058810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:39.066426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:39.066945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:39.067410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:39.068146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:39.068627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:39.069077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:39.152867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lazy-loading 'services' on Instance uuid bb17a5c7-99f5-492b-ba1d-d4f282c01d68 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:41:39.224374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-99af52bf-aa58-4270-a869-c5b6c42dde36 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments/32c118e7-82e1-487c-9353-b33ecb014c11" status: 202 len: 0 microversion: 2.1 time: 0.178189 Sep 13 17:41:39.224981 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3984/7915] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:41:39 2022] DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments/32c118e7-82e1-487c-9353-b33ecb014c11 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:41:39.235008 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:39.237489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:39.240477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:39.241177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:41:39.247444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:39.247942 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:39.248376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:39.249083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:39.249543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:39.250009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:39.286498 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5e40cc27-1e16-429c-901c-ab245a7f0137 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056943 Sep 13 17:41:39.287235 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3932/7916] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:39 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:40.300799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:40.303267 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:40.311349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:40.311863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:40.312319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:40.313040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:40.313513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:40.313989 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:40.346261 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-af78ca27-e5d9-4004-a8df-8df7b7a56c99 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050086 Sep 13 17:41:40.346849 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3985/7917] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:40 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:41.359146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:41.361276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:41.368906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:41.369407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:41.369863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:41.371127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:41.371591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:41.372025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:41.404889 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec19897b-6304-43af-a2c3-bce6d38daccd tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049942 Sep 13 17:41:41.405488 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3933/7918] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:41 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:42.418274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:42.421265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:42.428551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:42.429060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:42.429523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:42.430274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:42.430752 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:42.431202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:42.461807 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bc0dfe90-1d7b-49cc-881f-91ea9bd4a533 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048092 Sep 13 17:41:42.462342 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3986/7919] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:42 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:43.475964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:43.478190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:43.484446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:43.484944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:43.485388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:43.486123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:43.486587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:43.487264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:43.520673 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a2cc7b7-86dd-423b-96de-5d9326cb8248 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049609 Sep 13 17:41:43.521477 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3934/7920] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:43 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:41:44.533367 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:44.535667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:44.543282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:44.543797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:44.544264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:44.545059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:44.545515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:44.546012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:44.576952 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-654ca47b-6968-4247-ad49-1f819f42d723 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047636 Sep 13 17:41:44.577534 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3987/7921] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:41:44 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 17:41:44.588787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:44.590037 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:44.596969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:44.597460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:44.597938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:44.598649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:44.599115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:44.599553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:44.682540 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] HTTP exception thrown: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 is not attached to volume 32c118e7-82e1-487c-9353-b33ecb014c11 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Request method failure captured: Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: request: DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments/32c118e7-82e1-487c-9353-b33ecb014c11 HTTP/1.1 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMBrFBzZwUZ1A2XG-aY4tSrM0UMButkIGvYAP6q2h5XD2GBXVS5-aKqmryS2AYV3bqTMfQlA-xhym6Pw1ULcKqzfPpNBgNwKLnic6Qm9iqNqsfhWAYZSHADJ3hJeok9C478698nTz5xQsKpqjoKZxTFjCNuSrOEl7EThGLeQGeebIJg Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b5f901151674241a914cc41a8989893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 14b33d78e2004ce58ea40e2e7ab3af6a Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 is not attached to volume 32c118e7-82e1-487c-9353-b33ecb014c11 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'server_id': 'bb17a5c7-99f5-492b-ba1d-d4f282c01d68', 'id': '32c118e7-82e1-487c-9353-b33ecb014c11'} Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 32c118e7-82e1-487c-9353-b33ecb014c11. Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 is not attached to volume 32c118e7-82e1-487c-9353-b33ecb014c11 Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:44.684248 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 is not attached to volume 32c118e7-82e1-487c-9353-b33ecb014c11 Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Returning 404 to user: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 is not attached to volume 32c118e7-82e1-487c-9353-b33ecb014c11 {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5fe991a5-8c23-4091-aee6-1a9d3f5a8faf tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments/32c118e7-82e1-487c-9353-b33ecb014c11" status: 404 len: 154 microversion: 2.1 time: 0.101271 Sep 13 17:41:44.688911 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3935/7922] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:41:44 2022] DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68/os-volume_attachments/32c118e7-82e1-487c-9353-b33ecb014c11 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:41:48.040801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:48.041383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:48.048206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:48.048770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:48.049229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:48.049990 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:48.050462 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:48.050902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:48.079858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:41:48.160404 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c5b975b-d506-4bb7-ab72-b08f1524ec4f tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 204 len: 0 microversion: 2.1 time: 0.123358 Sep 13 17:41:48.160813 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3988/7923] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:41:48 2022] DELETE /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:41:48.173109 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:48.173742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:48.180396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:48.180958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:48.181486 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:48.182282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:48.182865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:48.183398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:48.322508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:48.331502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c67cebca-6d70-43c1-bcb4-b3a5b12cc3be tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1559 microversion: 2.1 time: 0.165708 Sep 13 17:41:48.332083 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3936/7924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:48 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:49.356217 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:49.356942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:49.363997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:49.364506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:49.365021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:49.365737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:49.366246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:49.366696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:49.506839 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:49.514820 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3448c70d-07f6-4286-8b80-a6c21a69dc2a tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1559 microversion: 2.1 time: 0.163024 Sep 13 17:41:49.515404 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3989/7925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:49 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:50.469608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1163c9de-ab1a-45bb-9f7e-a7206b28be89 req-37b65588-70a3-480f-9461-8653323c115b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb17a5c7-99f5-492b-ba1d-d4f282c01d68", "name": "network-vif-deleted", "tag": "5996c6b3-d1e9-4f64-9878-01bb064f6d0a"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:41:50.480198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1163c9de-ab1a-45bb-9f7e-a7206b28be89 req-37b65588-70a3-480f-9461-8653323c115b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:50.481272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1163c9de-ab1a-45bb-9f7e-a7206b28be89 req-37b65588-70a3-480f-9461-8653323c115b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:50.481918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1163c9de-ab1a-45bb-9f7e-a7206b28be89 req-37b65588-70a3-480f-9461-8653323c115b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:50.497916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1163c9de-ab1a-45bb-9f7e-a7206b28be89 req-37b65588-70a3-480f-9461-8653323c115b service nova] Creating event network-vif-deleted:5996c6b3-d1e9-4f64-9878-01bb064f6d0a for instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 on n-h2-857467-1 Sep 13 17:41:50.503433 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1163c9de-ab1a-45bb-9f7e-a7206b28be89 req-37b65588-70a3-480f-9461-8653323c115b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039470 Sep 13 17:41:50.504793 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3937/7926] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:41:50.538219 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:50.539457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:50.546783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:50.548024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:50.548495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:50.549309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:50.549782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:50.550327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:50.618952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b33d78e2004ce58ea40e2e7ab3af6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b5f901151674241a914cc41a8989893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:41:50.627635 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f150972b-3c8a-4937-bbf3-0509789c93f2 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 200 len: 1347 microversion: 2.1 time: 0.093732 Sep 13 17:41:50.628224 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3990/7927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:50 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:41:51.653341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:51.653988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] [instance: bb17a5c7-99f5-492b-ba1d-d4f282c01d68] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:41:51.660273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:51.660762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:51.661203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:51.661959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:41:51.662429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:41:51.662865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:41:51.677102 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] HTTP exception thrown: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 could not be found. Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Request method failure captured: Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 HTTP/1.1 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMBrFBzZwUZ1A2XG-aY4tSrM0UMButkIGvYAP6q2h5XD2GBXVS5-aKqmryS2AYV3bqTMfQlA-xhym6Pw1ULcKqzfPpNBgNwKLnic6Qm9iqNqsfhWAYZSHADJ3hJeok9C478698nTz5xQsKpqjoKZxTFjCNuSrOEl7EThGLeQGeebIJg Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b5f901151674241a914cc41a8989893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b5f901151674241a914cc41a8989893"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 5b5f901151674241a914cc41a8989893 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-416518677 Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 14b33d78e2004ce58ea40e2e7ab3af6a Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestEncryptedCinderVolumes-416518677-project Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 could not be found. Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': 'bb17a5c7-99f5-492b-ba1d-d4f282c01d68'} Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 could not be found. Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 could not be found. Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:41:51.679217 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 could not be found. Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Returning 404 to user: Instance bb17a5c7-99f5-492b-ba1d-d4f282c01d68 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b5638e30-e1da-4d17-9e1f-f905ca508f86 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68" status: 404 len: 111 microversion: 2.1 time: 0.033664 Sep 13 17:41:51.684308 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3938/7928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:41:51 2022] GET /compute/v2.1/servers/bb17a5c7-99f5-492b-ba1d-d4f282c01d68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:41:51.690009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36b3a0f1-bbd0-495b-9241-47483ee8b823 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] Calling method '.version_select at 0x7fbeb97a28b0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:41:51.712186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36b3a0f1-bbd0-495b-9241-47483ee8b823 tempest-TestEncryptedCinderVolumes-416518677 tempest-TestEncryptedCinderVolumes-416518677-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1139252182" status: 202 len: 0 microversion: 2.1 time: 0.026051 Sep 13 17:41:51.712815 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3991/7929] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Sep 13 17:41:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1139252182 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:42:18.248673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8a228f8c-c7d5-43dd-acfc-1ab74359e7b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'create', calling method: .version_select at 0x7fbeb54a8160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-878782885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJnbPFL2WVyEB3bfElhtl6oqY393FmvwTzxjYvoBW+COm1KtyNZV1C7iqvb30sAYjv61oSLPrLbUqNFsXCiRqNJCLs04tQ1pkFh4zzr4h0nU1OsxZ2XQ12qweMRBZ1AJA=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:18.254603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=14 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:18.255292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=34 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:18.267699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8a228f8c-c7d5-43dd-acfc-1ab74359e7b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:42:18.272816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8a228f8c-c7d5-43dd-acfc-1ab74359e7b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for user 6c144723ac4e42b6959afa5fe3d4153f and project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:42:18.298868 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8a228f8c-c7d5-43dd-acfc-1ab74359e7b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054333 Sep 13 17:42:18.299470 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3939/7930] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:42:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:42:18.349914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1431552246", "imageRef": "43f6bc05-b33f-4862-80a5-dacd66dd9b34", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-878782885", "networks": [{"uuid": "62ddcf05-f0a6-4c5b-ac70-2d44352bf7cc"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:18.359979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:18.360800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:18.406582 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] validate_networks() for [('62ddcf05-f0a6-4c5b-ac70-2d44352bf7cc', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:42:18.783701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:42:18.784508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:42:18.785347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:42:18.786066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:42:18.786543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:42:18.799297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:18.800082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:18.800553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:18.801625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:18.802557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:18.803023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:18.830846 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:42:18.838687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for user 6c144723ac4e42b6959afa5fe3d4153f and project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:42:18.860636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:42:18.864082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43f6bc05-b33f-4862-80a5-dacd66dd9b34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:42:18.926298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-03a583ef-307e-41fa-b52b-46db2b2b8715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580112 Sep 13 17:42:18.927478 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3992/7931] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:42:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:42:18.944813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d8f0f7a-ca4f-4495-adf8-172f0c212df6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:18.946495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d8f0f7a-ca4f-4495-adf8-172f0c212df6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:19.022019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7d8f0f7a-ca4f-4495-adf8-172f0c212df6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:19.035470 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d8f0f7a-ca4f-4495-adf8-172f0c212df6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1258 microversion: 2.1 time: 0.096730 Sep 13 17:42:19.041021 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3940/7932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:18 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:20.068744 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:20.069415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:20.076927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:20.077430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:20.077913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:20.078619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:20.079090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:20.079537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:20.141766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:20.150671 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-744212e9-f50f-4d7d-a4af-a45337dec71d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1310 microversion: 2.1 time: 0.086964 Sep 13 17:42:20.151261 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3993/7933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:20 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:21.174466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:21.175898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:21.184764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:21.185694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:21.186173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:21.186884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:21.187344 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:21.187952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:21.331786 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:21.343084 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83324cba-e64d-404c-994e-6310af3293d1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.172770 Sep 13 17:42:21.357855 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3941/7934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:21 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:22.367966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:22.368796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:22.377006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:22.377525 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:22.378012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:22.378758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:22.379220 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:22.379728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:22.524911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:22.533212 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-92e8640c-697d-4de6-a41d-047dceabd396 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.169167 Sep 13 17:42:22.533810 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3994/7935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:22 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:23.556996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:23.557698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:23.565045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:23.565551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:23.566027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:23.566752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:23.567221 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:23.567660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:23.707847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:23.717092 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf4618d8-653c-48a8-b8f1-452068ba8361 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.164248 Sep 13 17:42:23.717875 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3942/7936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:23 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:24.741003 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:24.742516 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:24.751534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:24.752087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:24.752548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:24.753285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:24.753764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:24.754265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:24.896619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:24.905116 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-36cd751b-08f1-46e6-a36d-da96f9c351b1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.168409 Sep 13 17:42:24.905925 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3995/7937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:24 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:25.929075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:25.929718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:25.932756 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:42:25.932910 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c (ip 10.222.0.61) !!! Sep 13 17:42:25.944540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:25.945144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:25.945657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:25.946553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:25.947048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:25.948092 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:26.096039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:26.104210 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40cb00e2-e53a-462d-976b-76f443a488d7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.179545 Sep 13 17:42:26.105004 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3943/7938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:25 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:27.129010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:27.129647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:27.137024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:27.137533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:27.138022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:27.138858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:27.139398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:27.139858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:27.280175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:27.288378 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b7bd72e-2e70-4726-b4bc-3abaa062cdd3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.163267 Sep 13 17:42:27.288972 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3996/7939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:27 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:28.313201 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:28.313788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:28.321128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:28.321617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:28.322091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:28.322798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:28.323256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:28.323682 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:28.472301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:28.480160 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f6df4a42-95c3-48b5-bb01-fb3b838b460f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.171553 Sep 13 17:42:28.480753 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3944/7940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:28 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:29.504044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:29.504678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:29.507403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:29.508306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:29.515566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:29.516076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:29.516530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:29.517241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:29.517717 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:29.518192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:29.657445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:29.665200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6d6d3cd-8c1b-45a7-b043-e0075a273744 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.165066 Sep 13 17:42:29.665788 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3997/7941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:29 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:30.689719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:30.690377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:30.692232 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:30.698348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:30.698781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:30.699225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:30.699927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:30.700391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:30.701454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:30.831730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:30.839521 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d2c95499-2f71-4c1c-a69e-a05379b3b54e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.154251 Sep 13 17:42:30.840101 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3945/7942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:30 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:31.862920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:31.863556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:31.870504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:31.871012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:31.871464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:31.872177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:31.872657 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:31.873096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:32.008324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:32.031285 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-61892022-1fea-4cda-8081-2e1fc3738cfe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.171870 Sep 13 17:42:32.032410 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3998/7943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:31 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:32.243177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-aa260bac-ac11-4779-8a8a-e35f0640ff00 req-76e6904a-54d8-469a-8c9f-555409741d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:32.254725 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-aa260bac-ac11-4779-8a8a-e35f0640ff00 req-76e6904a-54d8-469a-8c9f-555409741d34 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:32.255219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-aa260bac-ac11-4779-8a8a-e35f0640ff00 req-76e6904a-54d8-469a-8c9f-555409741d34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:32.255655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-aa260bac-ac11-4779-8a8a-e35f0640ff00 req-76e6904a-54d8-469a-8c9f-555409741d34 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:32.267977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-aa260bac-ac11-4779-8a8a-e35f0640ff00 req-76e6904a-54d8-469a-8c9f-555409741d34 service nova] Creating event network-changed:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:42:32.273470 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-aa260bac-ac11-4779-8a8a-e35f0640ff00 req-76e6904a-54d8-469a-8c9f-555409741d34 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034129 Sep 13 17:42:32.274123 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3946/7944] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:42:33.056636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:33.057279 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:33.065447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:33.065996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:33.066464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:33.067191 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:33.067678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:33.068132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:33.195356 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:33.203360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba7256cf-0a13-40d1-b0c0-54969a1abbee tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.150698 Sep 13 17:42:33.203941 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 3999/7945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:33 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:34.227470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:34.228173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:34.235142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:34.235632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:34.236070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:34.236823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:34.237265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:34.237693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:34.366836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:34.375240 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-310899fd-2610-4b08-a65b-776998e07e1f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.153004 Sep 13 17:42:34.375816 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3947/7946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:34 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:35.397802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:35.398456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:35.406195 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:35.406693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:35.407145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:35.407849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:35.408320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:35.408762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:35.541740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:35.549975 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-06053e65-e8f4-4d51-9a7c-2232a6f3ad51 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.156042 Sep 13 17:42:35.550705 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4000/7947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:35 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:36.574671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:36.575305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:36.582321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:36.582810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:36.583252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:36.583955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:36.584416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:36.584849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:36.729608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:36.737604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1b70f7a7-9372-44a7-86f2-8b13e344d636 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.166990 Sep 13 17:42:36.738224 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3948/7948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:36 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:37.760741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:37.761380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:37.768698 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:37.769274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:37.769737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:37.770484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:37.770992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:37.771440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:37.899360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:37.907730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ddc0d7e4-a902-4ed9-8067-93e1e8fe44e2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.151015 Sep 13 17:42:37.908305 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4001/7949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:37 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:38.782731 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-96cb5ab2-015f-4d27-ba85-9e087a8b70ab req-d28fa8cf-5ef6-493d-be40-72e8f3b3feef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "name": "network-vif-plugged", "status": "completed", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:38.795125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-96cb5ab2-015f-4d27-ba85-9e087a8b70ab req-d28fa8cf-5ef6-493d-be40-72e8f3b3feef service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:38.795634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-96cb5ab2-015f-4d27-ba85-9e087a8b70ab req-d28fa8cf-5ef6-493d-be40-72e8f3b3feef service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:38.796115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-96cb5ab2-015f-4d27-ba85-9e087a8b70ab req-d28fa8cf-5ef6-493d-be40-72e8f3b3feef service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:38.807674 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-96cb5ab2-015f-4d27-ba85-9e087a8b70ab req-d28fa8cf-5ef6-493d-be40-72e8f3b3feef service nova] Creating event network-vif-plugged:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:42:38.813640 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-96cb5ab2-015f-4d27-ba85-9e087a8b70ab req-d28fa8cf-5ef6-493d-be40-72e8f3b3feef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036760 Sep 13 17:42:38.814368 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3949/7950] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:42:38.931588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:38.932226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:38.939719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:38.940233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:38.940692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:38.941424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:38.941936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:38.942390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:39.078149 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:39.086123 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0f47d3d9-a349-4b73-b1e9-23fe1a0957f1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.158493 Sep 13 17:42:39.086716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4002/7951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:38 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:40.111143 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:40.111858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:40.118436 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:40.118933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:40.119382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:40.120096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:40.120559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:40.120995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:40.255107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:40.263657 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d55ab124-8c65-4507-9bd0-e0065fc14685 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1358 microversion: 2.1 time: 0.157159 Sep 13 17:42:40.264541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3950/7952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:40 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:41.287358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:41.288113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:41.295610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.296109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.296560 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.297521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.298050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.298495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.430786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:41.438558 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-af797e81-cc11-4745-9d69-b843dffde265 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1547 microversion: 2.1 time: 0.155210 Sep 13 17:42:41.439762 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4003/7953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:41 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:41.461666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:41.462314 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:41.469218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.469698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.470174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.470863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.471323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.471752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.600000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:41.608445 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b44f3131-76d3-496e-b9c8-bb98f4b3ad01 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1547 microversion: 2.1 time: 0.150682 Sep 13 17:42:41.609020 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3951/7954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:41 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:41.631284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:41.636615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:41.637594 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Searching by: {'deleted': False, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 17:42:41.643605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.644098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.644548 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.645287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.645755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.646301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.671339 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 17:42:41.697707 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b3d9f149-b59c-4fc3-8f7a-cd4a75c4d8fe tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070634 Sep 13 17:42:41.698327 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4004/7955] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 17:42:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:42:41.710400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:41.711029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:41.717580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.718103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.718551 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.719249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:41.719715 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:41.720187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:41.847253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:41.855256 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-bf4e2bd2-4b06-41c8-b714-a1112dc6376b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1547 microversion: 2.1 time: 0.148717 Sep 13 17:42:41.855771 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3952/7956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:41 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:43.402955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50f785e5-9307-4977-a11b-3bfba2922298"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:43.406018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:43.412830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:43.413333 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:43.413786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:43.414521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:43.414988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:43.415430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:43.671298 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dad5e3f3-f006-47fa-bff1-145e666d68de tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272060 Sep 13 17:42:43.671922 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4005/7957] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:42:43 2022] POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:42:56.726203 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:42:56.726840 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:56.728968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:56.729634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=64 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:56.736448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:56.737011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:56.737458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:56.738185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:56.738647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:56.739132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:56.867749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:42:56.876799 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8dadb642-e068-41ad-9fef-3779a4054715 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1593 microversion: 2.1 time: 0.154757 Sep 13 17:42:56.877372 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3953/7958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:42:56 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:42:58.856328 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:58.857648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:58.858656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:42:59.004359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-77e1abf1-68a8-4389-9547-6b1fb7b0acb9 req-4d00f480-5019-430b-8908-5263865c322e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:59.016450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-77e1abf1-68a8-4389-9547-6b1fb7b0acb9 req-4d00f480-5019-430b-8908-5263865c322e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:59.017089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-77e1abf1-68a8-4389-9547-6b1fb7b0acb9 req-4d00f480-5019-430b-8908-5263865c322e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:59.017736 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-77e1abf1-68a8-4389-9547-6b1fb7b0acb9 req-4d00f480-5019-430b-8908-5263865c322e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:59.032475 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-77e1abf1-68a8-4389-9547-6b1fb7b0acb9 req-4d00f480-5019-430b-8908-5263865c322e service nova] Creating event network-changed:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:42:59.038922 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-77e1abf1-68a8-4389-9547-6b1fb7b0acb9 req-4d00f480-5019-430b-8908-5263865c322e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184018 Sep 13 17:42:59.039655 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4006/7959] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:42:59.896809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-48801762"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:42:59.897405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:42:59.904198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:59.904869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:59.905864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:42:59.906576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:42:59.907036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:42:59.907468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:43:00.036923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.network.security_group_api [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Adding security group 91721aa8-2b84-45ee-a879-53098334643b to port 88f151fb-8d1d-4153-8a7f-7063a47d6fe7 Sep 13 17:43:00.362601 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1a57d71-8e10-43ae-b303-8237473875d3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action" status: 202 len: 0 microversion: 2.1 time: 0.470092 Sep 13 17:43:00.366340 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3954/7960] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:42:59 2022] POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:43:00.372299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:43:00.373023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:43:00.373637 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-22732033-20dc-437a-a151-fdf188e6ba7f req-75f9bf58-0091-4986-be55-e16a339bb46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:43:00.380531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:43:00.381099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:43:00.381700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:43:00.382465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:43:00.382942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:43:00.383388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:43:00.384061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22732033-20dc-437a-a151-fdf188e6ba7f req-75f9bf58-0091-4986-be55-e16a339bb46a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:43:00.385039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22732033-20dc-437a-a151-fdf188e6ba7f req-75f9bf58-0091-4986-be55-e16a339bb46a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:43:00.385039 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-22732033-20dc-437a-a151-fdf188e6ba7f req-75f9bf58-0091-4986-be55-e16a339bb46a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:43:00.397319 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-22732033-20dc-437a-a151-fdf188e6ba7f req-75f9bf58-0091-4986-be55-e16a339bb46a service nova] Creating event network-changed:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:43:00.402992 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-22732033-20dc-437a-a151-fdf188e6ba7f req-75f9bf58-0091-4986-be55-e16a339bb46a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033255 Sep 13 17:43:00.403979 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3955/7961] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:43:00.544116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:43:00.555278 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8f3f7edb-ef11-4773-bed6-d9dbd08967d9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1757 microversion: 2.1 time: 0.187213 Sep 13 17:43:00.555963 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4007/7962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:43:00 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:45:13.231082 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 13 17:45:13.233150 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 13 17:45:13.233717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:45:13.235160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:45:13.236348 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:45:13.236489 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action (ip 10.222.0.61) !!! Sep 13 17:45:13.243423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:45:13.245734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:45:13.255288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:45:13.255821 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:45:13.256272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:45:13.256978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:45:13.257450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:45:13.257914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:45:13.332825 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0cfe798c-6868-489b-a65d-1e8a0959cb0a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action" status: 202 len: 0 microversion: 2.1 time: 0.103833 Sep 13 17:45:13.333392 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3956/7963] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:45:13 2022] POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:45:13.340166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:45:13.341042 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:45:13.342274 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:45:13.342591 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c (ip 10.222.0.61) !!! Sep 13 17:45:13.344317 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:45:13.344456 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c (ip 10.222.0.61) !!! Sep 13 17:45:13.349089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:45:13.349723 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:45:13.359830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:45:13.360364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:45:13.360804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:45:13.361527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:45:13.362032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:45:13.362481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:45:13.576588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:45:13.586281 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60c11fe0-b2df-4b1f-ab00-21e417367708 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1759 microversion: 2.1 time: 0.248215 Sep 13 17:45:13.586796 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4008/7964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:45:13 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1759 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:45:14.614237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:45:14.615005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:45:14.623956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:45:14.624473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:45:14.625101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:45:14.626183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:45:14.626657 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:45:14.627100 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:45:14.634912 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39510. Sep 13 17:45:14.635622 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39508. Sep 13 17:45:14.826360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:45:14.835664 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4a8b855-4388-4c0b-9323-d7357d627a27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1757 microversion: 2.1 time: 0.228231 Sep 13 17:45:14.836242 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3957/7965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:45:14 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:46:54.521350 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 17:46:54.522435 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 17:46:54.522940 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:46:54.523729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:46:54.524514 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:46:54.524657 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:46:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action (ip 10.222.0.61) !!! Sep 13 17:46:54.530481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-48801762"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:46:54.531032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:46:54.542465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:54.542972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:54.543425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:54.544131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:54.544602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:54.545043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:54.678850 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.network.security_group_api [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Removing security group 91721aa8-2b84-45ee-a879-53098334643b from port 88f151fb-8d1d-4153-8a7f-7063a47d6fe7 Sep 13 17:46:54.982435 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fb99a719-2ddc-4c1d-98d6-29ed1475d0c5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action" status: 202 len: 0 microversion: 2.1 time: 0.462913 Sep 13 17:46:54.983069 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4009/7966] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:46:54 2022] POST /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:46:54.993148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-c7de4203-f784-4198-af57-4580101af19e req-5b3e7f83-4ec7-4ff2-b811-68a49461ad52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:46:55.003717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:46:55.005444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:46:55.005812 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:46:55.006009 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:46:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 13 17:46:55.009775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c7de4203-f784-4198-af57-4580101af19e req-5b3e7f83-4ec7-4ff2-b811-68a49461ad52 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:55.010387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c7de4203-f784-4198-af57-4580101af19e req-5b3e7f83-4ec7-4ff2-b811-68a49461ad52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:55.010946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-c7de4203-f784-4198-af57-4580101af19e req-5b3e7f83-4ec7-4ff2-b811-68a49461ad52 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:55.032495 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-c7de4203-f784-4198-af57-4580101af19e req-5b3e7f83-4ec7-4ff2-b811-68a49461ad52 service nova] Creating event network-changed:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:46:55.038721 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-c7de4203-f784-4198-af57-4580101af19e req-5b3e7f83-4ec7-4ff2-b811-68a49461ad52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050315 Sep 13 17:46:55.039934 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3958/7967] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:46:56.137757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:46:56.138318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:46:56.152693 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39578. Sep 13 17:46:56.155588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:56.156093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:56.156546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:56.157407 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:56.157909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:56.158554 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:56.159193 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39580. Sep 13 17:46:56.251497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lazy-loading 'services' on Instance uuid 20623583-8785-4deb-9137-56ff4216004c {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:46:56.333666 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6296a5c4-0d21-4939-84cd-f2bdca79eade tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments/50f785e5-9307-4977-a11b-3bfba2922298" status: 202 len: 0 microversion: 2.1 time: 0.200835 Sep 13 17:46:56.334314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4010/7968] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:46:56 2022] DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments/50f785e5-9307-4977-a11b-3bfba2922298 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:46:56.343757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:46:56.346265 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:46:56.358181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:56.359611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:56.360172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:56.360997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:56.361564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:56.362124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:56.397269 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f4c4fdef-bb72-421d-9522-2736266c72a7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057772 Sep 13 17:46:56.398857 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3959/7969] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:46:56 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:46:57.072904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-f09e260c-0e94-4888-a818-6a6a57ba19df req-c3685f29-1e52-4cec-9dd3-0c40f48c40ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:46:57.083568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f09e260c-0e94-4888-a818-6a6a57ba19df req-c3685f29-1e52-4cec-9dd3-0c40f48c40ee service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:57.084083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f09e260c-0e94-4888-a818-6a6a57ba19df req-c3685f29-1e52-4cec-9dd3-0c40f48c40ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:57.084742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-f09e260c-0e94-4888-a818-6a6a57ba19df req-c3685f29-1e52-4cec-9dd3-0c40f48c40ee service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:57.097571 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-f09e260c-0e94-4888-a818-6a6a57ba19df req-c3685f29-1e52-4cec-9dd3-0c40f48c40ee service nova] Creating event network-changed:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:46:57.102697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-f09e260c-0e94-4888-a818-6a6a57ba19df req-c3685f29-1e52-4cec-9dd3-0c40f48c40ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043833 Sep 13 17:46:57.103392 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4011/7970] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:46:57.410286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:46:57.412480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:46:57.419594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:57.420085 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:57.420526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:57.421234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:57.421690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:57.422335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:57.456023 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e7e5acd8-3b2e-4649-8fa2-59c74ab88fe9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Sep 13 17:46:57.457351 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3960/7971] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:46:57 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:46:58.470492 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:46:58.473372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:46:58.480148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:58.480699 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:58.481184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:58.481947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:58.482439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:58.482891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:58.515662 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e9095685-4bce-49b4-aafa-061b4190a430 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050531 Sep 13 17:46:58.516581 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4012/7972] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:46:58 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:46:59.529096 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:46:59.531428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:46:59.539509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:59.540048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:59.540479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:59.541181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:46:59.541646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:46:59.542131 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:46:59.575780 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5afa5902-2261-42e8-9759-523e0257bc27 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050912 Sep 13 17:46:59.576564 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3961/7973] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:46:59 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:00.588675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:00.590947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:00.598513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:00.599274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:00.599811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:00.600532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:00.601002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:00.601443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:00.632315 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4808dbda-c71e-4d6f-a0dd-72a61f531bd4 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047636 Sep 13 17:47:00.633073 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4013/7974] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:47:00 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:01.644718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:01.646968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:01.654420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:01.654954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:01.655407 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:01.656142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:01.656634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:01.657078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:01.689653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-519c9f58-8796-43e7-b52c-242d614d5b6e tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048943 Sep 13 17:47:01.690257 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3962/7975] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:47:01 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 17:47:01.701778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:01.702349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:01.709589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:01.710133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:01.710597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:01.711304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:01.711780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:01.712232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:01.787576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] HTTP exception thrown: Instance 20623583-8785-4deb-9137-56ff4216004c is not attached to volume 50f785e5-9307-4977-a11b-3bfba2922298 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Request method failure captured: Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments/50f785e5-9307-4977-a11b-3bfba2922298 HTTP/1.1 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMDr0IiwGNtuFwQiMsooFutrc26J_hJj3AOKQKyq46gxdgmh26Zngwb_jsX5WGMJOD-8Lg-KTtdSqCrvPueVQ5VFOOzcWmAMpDQ4EHSQxr-MaXIUO1dvlcCd_ioVtlYDC8W0eveRJz_8iv4LluxqYPECuURST7M-nDV5eLhCFfJUKeI Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c144723ac4e42b6959afa5fe3d4153f Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 20623583-8785-4deb-9137-56ff4216004c is not attached to volume 50f785e5-9307-4977-a11b-3bfba2922298 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': '20623583-8785-4deb-9137-56ff4216004c', 'id': '50f785e5-9307-4977-a11b-3bfba2922298'} Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 50f785e5-9307-4977-a11b-3bfba2922298. Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20623583-8785-4deb-9137-56ff4216004c is not attached to volume 50f785e5-9307-4977-a11b-3bfba2922298 Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:47:01.789232 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20623583-8785-4deb-9137-56ff4216004c is not attached to volume 50f785e5-9307-4977-a11b-3bfba2922298 Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Returning 404 to user: Instance 20623583-8785-4deb-9137-56ff4216004c is not attached to volume 50f785e5-9307-4977-a11b-3bfba2922298 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ad7807f4-ea43-429c-b6fd-35fcda93c44d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments/50f785e5-9307-4977-a11b-3bfba2922298" status: 404 len: 154 microversion: 2.1 time: 0.093071 Sep 13 17:47:01.793959 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4014/7976] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:47:01 2022] DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c/os-volume_attachments/50f785e5-9307-4977-a11b-3bfba2922298 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:47:05.043496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:05.044004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:05.051875 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:05.052379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:05.052876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:05.053539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:05.054035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:05.054469 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:05.081807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:47:05.165894 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-406c615c-6042-4681-8b7e-90b7ce85aaca tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 204 len: 0 microversion: 2.1 time: 0.125423 Sep 13 17:47:05.166903 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3963/7977] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:47:05 2022] DELETE /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:47:05.176978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:05.177667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:05.186520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:05.187247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:05.187735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:05.188577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:05.189056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:05.189527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:05.329585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:05.338606 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c780c847-6961-4d2e-9604-0ab2ace83107 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1553 microversion: 2.1 time: 0.166894 Sep 13 17:47:05.339193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4015/7978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:05 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:47:06.365316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:06.365971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:06.373569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:06.374093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:06.374537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:06.375271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:06.375736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:06.376174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:06.513047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:06.521176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-db4e4f28-7242-40eb-baee-f3ef135f91c3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1553 microversion: 2.1 time: 0.161359 Sep 13 17:47:06.521754 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3964/7979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:06 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:07.546104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:07.547685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:07.559868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:07.560485 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:07.560879 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:07.561633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:07.562157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:07.562608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:07.628818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-191e83e1-669c-4984-a556-c3f1579049d8 req-e4a9627c-6840-4f66-9900-b5b4a9317482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20623583-8785-4deb-9137-56ff4216004c", "name": "network-vif-deleted", "tag": "88f151fb-8d1d-4153-8a7f-7063a47d6fe7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:07.634079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:07.639956 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-191e83e1-669c-4984-a556-c3f1579049d8 req-e4a9627c-6840-4f66-9900-b5b4a9317482 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:07.641076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-191e83e1-669c-4984-a556-c3f1579049d8 req-e4a9627c-6840-4f66-9900-b5b4a9317482 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:07.641757 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-191e83e1-669c-4984-a556-c3f1579049d8 req-e4a9627c-6840-4f66-9900-b5b4a9317482 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:07.646888 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-157edb10-4d90-4616-b09e-fdf7157a7263 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 200 len: 1511 microversion: 2.1 time: 0.105001 Sep 13 17:47:07.647941 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4016/7980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:07 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 1511 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:07.656100 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-191e83e1-669c-4984-a556-c3f1579049d8 req-e4a9627c-6840-4f66-9900-b5b4a9317482 service nova] Creating event network-vif-deleted:88f151fb-8d1d-4153-8a7f-7063a47d6fe7 for instance 20623583-8785-4deb-9137-56ff4216004c on n-h2-857467-1 Sep 13 17:47:07.661177 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-191e83e1-669c-4984-a556-c3f1579049d8 req-e4a9627c-6840-4f66-9900-b5b4a9317482 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101919 Sep 13 17:47:07.662177 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3965/7981] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:47:08.721355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:08.722015 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: 20623583-8785-4deb-9137-56ff4216004c] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:08.728415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:08.728927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:08.729388 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:08.730138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:08.730652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:08.731105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:08.744927 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] HTTP exception thrown: Instance 20623583-8785-4deb-9137-56ff4216004c could not be found. Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Request method failure captured: Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c HTTP/1.1 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMDr0IiwGNtuFwQiMsooFutrc26J_hJj3AOKQKyq46gxdgmh26Zngwb_jsX5WGMJOD-8Lg-KTtdSqCrvPueVQ5VFOOzcWmAMpDQ4EHSQxr-MaXIUO1dvlcCd_ioVtlYDC8W0eveRJz_8iv4LluxqYPECuURST7M-nDV5eLhCFfJUKeI Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c144723ac4e42b6959afa5fe3d4153f Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 20623583-8785-4deb-9137-56ff4216004c could not be found. Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '20623583-8785-4deb-9137-56ff4216004c'} Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20623583-8785-4deb-9137-56ff4216004c could not be found. Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20623583-8785-4deb-9137-56ff4216004c could not be found. Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:47:08.746673 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20623583-8785-4deb-9137-56ff4216004c could not be found. Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Returning 404 to user: Instance 20623583-8785-4deb-9137-56ff4216004c could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c420be61-8339-4831-9051-ed5eb9f9998f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c" status: 404 len: 111 microversion: 2.1 time: 0.078371 Sep 13 17:47:08.752371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4017/7982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:08 2022] GET /compute/v2.1/servers/20623583-8785-4deb-9137-56ff4216004c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:47:08.758791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5825abb5-0ec3-455e-ac48-4eec295031c2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '.version_select at 0x7fbeb4cbd8b0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:08.783532 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5825abb5-0ec3-455e-ac48-4eec295031c2 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-878782885" status: 202 len: 0 microversion: 2.1 time: 0.030181 Sep 13 17:47:08.784096 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3966/7983] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Sep 13 17:47:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-878782885 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:47:18.016253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dbaf3002-6d92-45fc-9aca-a135a7c61bea tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'create', calling method: .version_select at 0x7fbeb51583a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1925591056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6XMEkKaIK2cDNxKTscsT+hAT7esO0zTTFW4KeFbXsGr9/2qxGLOCpCaGU9NJRwjAJS+kWq+2+ABwokBcNZM8967E7mB78AiaSzMCpcn78StK1rYS7mu5xCwMERAJ83Kw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:18.033382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-dbaf3002-6d92-45fc-9aca-a135a7c61bea tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:47:18.039508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-dbaf3002-6d92-45fc-9aca-a135a7c61bea tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for user 6c144723ac4e42b6959afa5fe3d4153f and project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:47:18.067690 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dbaf3002-6d92-45fc-9aca-a135a7c61bea tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055202 Sep 13 17:47:18.068309 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4018/7984] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:47:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:18.123400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:18.127807 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1954405711", "imageRef": "93d00d79-1ec6-4fdf-9caf-4ade5631d93a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1925591056", "networks": [{"uuid": "62ddcf05-f0a6-4c5b-ac70-2d44352bf7cc"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:18.180718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] validate_networks() for [('62ddcf05-f0a6-4c5b-ac70-2d44352bf7cc', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:47:18.607612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:47:18.608049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:47:18.608534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:47:18.608953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:47:18.609376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:47:18.618975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:18.619647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:18.619918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:18.620668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:18.621134 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:18.621571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:18.639991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:47:18.645655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Getting quotas for user 6c144723ac4e42b6959afa5fe3d4153f and project 60077ab124f04a4e83f4416ba5f4deeb. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:47:18.665848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:47:18.668260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93d00d79-1ec6-4fdf-9caf-4ade5631d93a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:47:18.713877 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f905491f-28b4-4fa8-a7b1-5ce514803577 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592381 Sep 13 17:47:18.714549 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3967/7985] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:47:18.726495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-97d41738-01d3-4539-ab4c-ff9298d9a015 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:18.727214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-97d41738-01d3-4539-ab4c-ff9298d9a015 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:18.736246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:18.787006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-97d41738-01d3-4539-ab4c-ff9298d9a015 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:18.794529 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-97d41738-01d3-4539-ab4c-ff9298d9a015 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1259 microversion: 2.1 time: 0.072894 Sep 13 17:47:18.795314 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4019/7986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:18 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:19.820372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:19.821195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:19.829371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:19.830332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:19.830787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:19.831501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:19.831968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:19.832405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:19.903917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:19.912809 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-796f4c69-9704-4f87-baa1-30cb93670290 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1319 microversion: 2.1 time: 0.098217 Sep 13 17:47:19.913419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3968/7987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:19 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:20.938129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:20.939918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:20.952417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:20.954960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:20.955424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:20.956192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:20.956666 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:20.957116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:21.131303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:21.140236 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-42630692-a364-4a54-9bd6-8e2318f3de35 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.206631 Sep 13 17:47:21.141578 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4020/7988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:20 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:22.167211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:22.168260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:22.175912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:22.176405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:22.177617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:22.178765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:22.179525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:22.179976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:22.353524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:22.362419 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3a76abd2-d9fd-4086-b87c-4532a683f5f9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.201962 Sep 13 17:47:22.363035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3969/7989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:22 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:23.387617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:23.388162 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:23.395241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:23.396296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:23.396776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:23.397595 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:23.398090 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:23.398534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:23.543892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:23.552953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-964aafb3-7d4e-4c6c-b883-8e546ae6eb8a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.168872 Sep 13 17:47:23.561919 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4021/7990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:23 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:24.576387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:24.577031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:24.585698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:24.586253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:24.586716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:24.587441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:24.587917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:24.588354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:24.784488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:24.793432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3bb10d29-5f3c-4d8c-b585-faf88a4554ed tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.220676 Sep 13 17:47:24.794143 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3970/7991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:24 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:25.820306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:25.821026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:25.823684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:25.829426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:25.829980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:25.830434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:25.831164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:25.831640 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:25.832084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:25.973316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:25.982651 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-98892c00-05f5-4ab0-be95-d7eca63094a3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.169264 Sep 13 17:47:25.983587 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4022/7992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:25 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:27.005896 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:27.006612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:27.009927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:27.015338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:27.015941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:27.016451 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:27.017281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:27.017815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:27.018335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:27.180127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:27.190612 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f812b4e0-3046-409f-8e3f-97b54e1392b8 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.188845 Sep 13 17:47:27.192844 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3971/7993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:27 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:28.220168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:28.220800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:28.227712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:28.228210 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:28.228661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:28.229370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:28.229861 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:28.230307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:28.356706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:28.365508 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-44b3ef95-bc70-4f35-8ff2-3cfbe3eb1041 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.148535 Sep 13 17:47:28.366191 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4023/7994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:28 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:29.391036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:29.391658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:29.394380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:29.395052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:29.401634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:29.402154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:29.402739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:29.403489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:29.403949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:29.404501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:29.538470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:29.546112 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-879d8f77-cd45-44c2-99cd-a7745ebbe439 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.159035 Sep 13 17:47:29.546691 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3972/7995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:29 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:47:30.378479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3466f47b-1bd1-45f1-8a73-7b336c85e6ca req-be9047ca-b3e4-44d1-8386-1853130c1336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:30.383630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:30.393338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3466f47b-1bd1-45f1-8a73-7b336c85e6ca req-be9047ca-b3e4-44d1-8386-1853130c1336 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:30.393890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3466f47b-1bd1-45f1-8a73-7b336c85e6ca req-be9047ca-b3e4-44d1-8386-1853130c1336 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:30.394351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3466f47b-1bd1-45f1-8a73-7b336c85e6ca req-be9047ca-b3e4-44d1-8386-1853130c1336 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:30.415618 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3466f47b-1bd1-45f1-8a73-7b336c85e6ca req-be9047ca-b3e4-44d1-8386-1853130c1336 service nova] Creating event network-changed:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:47:30.421177 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3466f47b-1bd1-45f1-8a73-7b336c85e6ca req-be9047ca-b3e4-44d1-8386-1853130c1336 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046444 Sep 13 17:47:30.421818 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4024/7996] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:30.570744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:30.571499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:30.578719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:30.579209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:30.579647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:30.580353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:30.580813 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:30.581241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:30.806954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:30.814845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-027cea2e-b80d-475e-830b-5a7f19ded080 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.248723 Sep 13 17:47:30.815444 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3973/7997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:30 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:31.840112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:31.840847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:31.847144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:31.847650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:31.848111 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:31.848873 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:31.849510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:31.850075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:31.986381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:31.994840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3079dd59-de5c-431e-87f3-efe54049df40 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.159979 Sep 13 17:47:31.995438 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4025/7998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:31 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:47:33.018400 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:33.019022 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:33.026572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:33.027062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:33.027508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:33.028215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:33.028676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:33.029107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:33.229575 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:33.237554 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-83fbac1e-ac06-41ef-a894-fa8377098527 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.223283 Sep 13 17:47:33.238171 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3974/7999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:33 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:34.260720 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:34.261364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:34.268341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:34.268847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:34.269305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:34.270055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:34.270543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:34.270992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:34.402598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:34.410375 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-395bb09d-1739-4fde-a9f9-4ce77f36be7b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.153678 Sep 13 17:47:34.411018 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4026/8000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:34 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:47:35.434797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:35.435360 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:35.442213 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:35.443343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:35.443939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:35.444644 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:35.445118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:35.445537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:35.576830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:35.584972 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2368ee21-e951-4dc6-b280-c40b93e0c57b tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.154464 Sep 13 17:47:35.585557 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3975/8001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:35 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:36.608499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:36.609068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:36.616085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:36.616584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:36.617036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:36.617739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:36.618244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:36.618684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:36.754068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:36.761992 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-60793a73-2a42-42bf-8629-0501033c945d tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.157511 Sep 13 17:47:36.762663 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4027/8002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:36 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:37.785341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:37.785995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:37.793033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:37.793520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:37.794019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:37.794714 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:37.795173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:37.795601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:37.926526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:37.935169 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3aa11a04-6325-4442-8cd9-22f7db7635be tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.153737 Sep 13 17:47:37.935755 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3976/8003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:37 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:38.315625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-513eac0c-6ad4-449d-8ec4-b4abc20846e0 req-15af4448-e6e1-46e3-b610-4bc5b2de2c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "name": "network-vif-plugged", "status": "completed", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:38.326777 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-513eac0c-6ad4-449d-8ec4-b4abc20846e0 req-15af4448-e6e1-46e3-b610-4bc5b2de2c74 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:38.327278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-513eac0c-6ad4-449d-8ec4-b4abc20846e0 req-15af4448-e6e1-46e3-b610-4bc5b2de2c74 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:38.327749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-513eac0c-6ad4-449d-8ec4-b4abc20846e0 req-15af4448-e6e1-46e3-b610-4bc5b2de2c74 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:38.340156 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-513eac0c-6ad4-449d-8ec4-b4abc20846e0 req-15af4448-e6e1-46e3-b610-4bc5b2de2c74 service nova] Creating event network-vif-plugged:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:47:38.345305 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-513eac0c-6ad4-449d-8ec4-b4abc20846e0 req-15af4448-e6e1-46e3-b610-4bc5b2de2c74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108352 Sep 13 17:47:38.345931 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4028/8004] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:38.957679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:38.958297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:38.965138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:38.965618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:38.966094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:38.966778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:38.967236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:38.967663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:39.096409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:39.105036 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7654881b-d0b4-45e6-a063-5bd025378603 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1359 microversion: 2.1 time: 0.151303 Sep 13 17:47:39.105621 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3977/8005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:38 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:40.130495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:40.131816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:40.138287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.138809 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.139261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.139985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.140466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.140926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.275063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:40.282945 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed71a69d-4209-49fc-ad35-0d48529de416 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1548 microversion: 2.1 time: 0.157860 Sep 13 17:47:40.283530 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4029/8006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:40 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:40.306310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:40.306929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:40.314139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.314568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.315009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.315709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.316169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.316598 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.456261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:40.464085 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f20e4ad-b56d-4bef-a512-41276cd0aede tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1548 microversion: 2.1 time: 0.162357 Sep 13 17:47:40.464659 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3978/8007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:40 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:40.486855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:40.492621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:40.493410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Searching by: {'deleted': False, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb'} {{(pid=122328) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 17:47:40.498962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.499461 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.499918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.500674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.501151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.501600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.525467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.multi_cell_list [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122328) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 17:47:40.552618 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d6762903-239a-4f33-ae03-42003c9e8af9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069704 Sep 13 17:47:40.553200 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4030/8008] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Sep 13 17:47:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:40.564890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:40.565447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:40.571431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.571916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.572359 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.573052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:40.573509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:40.573974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:40.703882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:40.712199 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b03f7beb-dbae-45c3-8b90-0e0b5bf1fa80 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1548 microversion: 2.1 time: 0.151238 Sep 13 17:47:40.712776 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3979/8009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:40 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:42.230858 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d44a1d07-e73d-4c30-9aea-f418185d3ce5"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:42.233244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:42.240177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:42.240680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:42.241140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:42.241878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:42.242365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:42.242815 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:42.498442 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8046048d-8729-4c97-a6fe-1969995facf3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271207 Sep 13 17:47:42.499323 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4031/8010] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Sep 13 17:47:42 2022] POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:53.274071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:53.274753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:53.276965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=17 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:53.277663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=74 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:53.283704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:53.284200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:53.284648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:53.285351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:53.285818 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:53.286285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:53.416566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:53.425313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fcf5af34-94b4-4fce-a6c4-8769bb5973d6 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1594 microversion: 2.1 time: 0.155710 Sep 13 17:47:53.425907 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3980/8011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:53 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:55.324122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:55.324920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=19 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:55.325643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:47:55.329682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b9c3d058-1123-455a-8b37-0bb3b374eeb5 req-ecd5bdb6-49e8-43f8-a93c-c65a53831d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:55.342216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b9c3d058-1123-455a-8b37-0bb3b374eeb5 req-ecd5bdb6-49e8-43f8-a93c-c65a53831d02 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:55.342715 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b9c3d058-1123-455a-8b37-0bb3b374eeb5 req-ecd5bdb6-49e8-43f8-a93c-c65a53831d02 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:55.343177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b9c3d058-1123-455a-8b37-0bb3b374eeb5 req-ecd5bdb6-49e8-43f8-a93c-c65a53831d02 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:55.356319 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b9c3d058-1123-455a-8b37-0bb3b374eeb5 req-ecd5bdb6-49e8-43f8-a93c-c65a53831d02 service nova] Creating event network-changed:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:47:55.361657 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b9c3d058-1123-455a-8b37-0bb3b374eeb5 req-ecd5bdb6-49e8-43f8-a93c-c65a53831d02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039255 Sep 13 17:47:55.362561 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4032/8012] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:47:56.476496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1596436244"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:56.477570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:56.489558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:56.491443 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:56.491880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:56.492612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:56.493081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:56.493516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:56.627346 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.network.security_group_api [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Adding security group 30033305-9809-4051-9ed2-c4ede4ee9906 to port 4961fcf3-ad39-4001-a07e-15092c393558 Sep 13 17:47:56.946728 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-39c62916-aaa0-4840-b7d8-aa135c942ca7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action" status: 202 len: 0 microversion: 2.1 time: 0.479044 Sep 13 17:47:56.947389 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3981/8013] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:47:56 2022] POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:47:56.957802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:47:56.958596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:47:56.965394 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:56.965728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:56.966662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:56.967112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:56.967626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:56.968680 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:57.166966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:47:57.177877 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-53e8c2a1-3c0e-4f5b-9016-2e0b0cfe39c7 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1758 microversion: 2.1 time: 0.225359 Sep 13 17:47:57.179586 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4033/8014] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:47:56 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:47:57.376197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b555e405-8967-4850-9903-3defd31e8f6b req-98e1e470-a2a4-43a7-ad85-075af2e8115c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:47:57.385676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b555e405-8967-4850-9903-3defd31e8f6b req-98e1e470-a2a4-43a7-ad85-075af2e8115c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:47:57.386189 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b555e405-8967-4850-9903-3defd31e8f6b req-98e1e470-a2a4-43a7-ad85-075af2e8115c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:47:57.386628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b555e405-8967-4850-9903-3defd31e8f6b req-98e1e470-a2a4-43a7-ad85-075af2e8115c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:47:57.398492 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b555e405-8967-4850-9903-3defd31e8f6b req-98e1e470-a2a4-43a7-ad85-075af2e8115c service nova] Creating event network-changed:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:47:57.403689 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b555e405-8967-4850-9903-3defd31e8f6b req-98e1e470-a2a4-43a7-ad85-075af2e8115c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031215 Sep 13 17:47:57.404295 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3982/8015] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:48:45.354274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:48:45.356565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:45.358704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:48:45.359517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=8 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:48:45.360797 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:48:45.360947 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:48:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action (ip 10.222.0.61) !!! Sep 13 17:48:45.370227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:45.370762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:45.371221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:45.371947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:45.372422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:45.372867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:45.449440 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cec5b757-9470-4ea0-be29-f4aa53180005 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action" status: 202 len: 0 microversion: 2.1 time: 0.099623 Sep 13 17:48:45.450140 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4034/8016] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:48:45 2022] POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:48:45.456836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:48:45.457793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:48:45.463668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:45.464402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:45.472670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:45.473177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:45.473630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:45.474381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:45.474854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:45.475298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:45.715332 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:45.723820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-87a787c5-5a1d-4495-ba5a-8531b1dad2c9 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1750 microversion: 2.1 time: 0.269278 Sep 13 17:48:45.724424 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3983/8017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:45 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1750 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:46.748930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:46.749647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:46.755895 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:46.756401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:46.756857 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:46.757570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:46.758071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:46.758563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:46.902885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:46.911219 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2b8d8351-8d18-4e09-90d2-c4d07a3073ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.167556 Sep 13 17:48:46.911798 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4035/8018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:46 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:47.936192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:47.936729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:47.943565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:47.944047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:47.944483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:47.945173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:47.945633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:47.946174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:48.088578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:48.096998 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9978a868-ea2e-4e6c-8acd-dbd31fe537ba tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.164852 Sep 13 17:48:48.097574 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3984/8019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:47 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:49.121930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:49.122570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:49.129442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:49.129981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:49.130438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:49.131145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:49.131622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:49.132068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:49.277327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:49.285782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b0e1d45-7535-4a1a-893d-9c4b9d8336ff tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.168356 Sep 13 17:48:49.286400 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4036/8020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:49 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:50.310528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:50.311110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:50.318081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:50.318580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:50.319030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:50.319740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:50.320396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:50.320667 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:50.471674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:50.480075 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-03953b72-0c99-4982-9b3b-358d3ad8ec0f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.173548 Sep 13 17:48:50.480664 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3985/8021] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:50 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:51.504422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:51.505057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:51.512618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:51.513118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:51.513573 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:51.514316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:51.514787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:51.515232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:51.660114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:51.669653 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0436922-0cbe-4106-ace6-aad299218a64 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.169340 Sep 13 17:48:51.670281 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4037/8022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:51 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:52.693628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:52.694303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:52.701205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:52.701692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:52.702171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:52.702860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:52.703325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:52.703755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:52.849968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:52.858657 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-258a2a59-d64d-4fbd-a6e9-ba47edd86406 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.168996 Sep 13 17:48:52.859229 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3986/8023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:52 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:53.882268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:53.882813 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:53.889646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:53.890175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:53.890633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:53.891344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:53.891814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:53.892254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:54.034743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:54.043926 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-419f723f-ab34-4542-9129-8b7d84fd37a1 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.165723 Sep 13 17:48:54.044506 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4038/8024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:53 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:55.067966 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:55.068618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:55.076364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:55.076861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:55.077312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:55.078050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:55.078520 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:55.078963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:55.224485 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:55.233411 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-913ef9cc-1fbd-4dcb-856b-397eda651546 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.169422 Sep 13 17:48:55.234017 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3987/8025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:55 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:56.257659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:56.258315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:56.265164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:56.265668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:56.266154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:56.266865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:56.267347 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:56.267788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:56.416209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:56.425302 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3220537a-7c53-4c6e-8b41-a30afa3b9850 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1755 microversion: 2.1 time: 0.171578 Sep 13 17:48:56.425924 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4039/8026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:56 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:48:57.449273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:48:57.449880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:48:57.456861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:57.457356 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:57.457806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:57.458539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:48:57.459349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:48:57.459506 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:48:57.612137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:48:57.620477 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-119cdda7-90c9-43a5-9a47-64399fa9a65f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1758 microversion: 2.1 time: 0.175840 Sep 13 17:48:57.621059 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3988/8027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:48:57 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:49:46.173504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1596436244"}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:49:46.174124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:46.176415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:49:46.177114 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:49:46.184061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:46.184570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:46.185041 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:46.185759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:46.186271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:46.186722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:46.314532 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.network.security_group_api [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Removing security group 30033305-9809-4051-9ed2-c4ede4ee9906 from port 4961fcf3-ad39-4001-a07e-15092c393558 Sep 13 17:49:46.622098 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-78242e92-b9e5-4c3f-9452-4a5fd1944083 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action" status: 202 len: 0 microversion: 2.1 time: 0.452673 Sep 13 17:49:46.622883 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4040/8028] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:49:46 2022] POST /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:49:46.633593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:49:46.634547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=36 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:49:46.724225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a005e245-f7d1-4705-beaa-2128335c0340 req-89cfe9af-0ddd-47bc-ac6d-dd639e6e6837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:49:46.738472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a005e245-f7d1-4705-beaa-2128335c0340 req-89cfe9af-0ddd-47bc-ac6d-dd639e6e6837 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:46.739036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a005e245-f7d1-4705-beaa-2128335c0340 req-89cfe9af-0ddd-47bc-ac6d-dd639e6e6837 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:46.739562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a005e245-f7d1-4705-beaa-2128335c0340 req-89cfe9af-0ddd-47bc-ac6d-dd639e6e6837 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:46.752953 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a005e245-f7d1-4705-beaa-2128335c0340 req-89cfe9af-0ddd-47bc-ac6d-dd639e6e6837 service nova] Creating event network-changed:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:49:46.758698 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a005e245-f7d1-4705-beaa-2128335c0340 req-89cfe9af-0ddd-47bc-ac6d-dd639e6e6837 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129945 Sep 13 17:49:46.760391 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3989/8029] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:49:48.013344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:48.014404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:48.020579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:48.021095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:48.021559 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:48.022317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:48.022800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:48.023255 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:48.106143 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lazy-loading 'services' on Instance uuid e0b34c05-a363-4c73-a762-ce4dd00cf175 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:49:48.183620 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3767286b-c473-46c2-9b1e-483a5d6dbe17 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments/d44a1d07-e73d-4c30-9aea-f418185d3ce5" status: 202 len: 0 microversion: 2.1 time: 0.176024 Sep 13 17:49:48.184238 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4041/8030] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:49:48 2022] DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments/d44a1d07-e73d-4c30-9aea-f418185d3ce5 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:49:48.194720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:48.198509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:48.205186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:48.205675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:48.206375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:48.207330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:48.207797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:48.208227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:48.245051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5271a75e-79dd-4923-9ca9-94b04e39c1fd tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055419 Sep 13 17:49:48.249009 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3990/8031] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:49:48 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:49:48.777907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fee274ee-fa63-44c7-ae2a-90d7ee41a02d req-3adfdc2a-b344-40c6-8f6c-eb476a2468d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:49:48.787866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fee274ee-fa63-44c7-ae2a-90d7ee41a02d req-3adfdc2a-b344-40c6-8f6c-eb476a2468d4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:48.788374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fee274ee-fa63-44c7-ae2a-90d7ee41a02d req-3adfdc2a-b344-40c6-8f6c-eb476a2468d4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:48.788830 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fee274ee-fa63-44c7-ae2a-90d7ee41a02d req-3adfdc2a-b344-40c6-8f6c-eb476a2468d4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:48.801321 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fee274ee-fa63-44c7-ae2a-90d7ee41a02d req-3adfdc2a-b344-40c6-8f6c-eb476a2468d4 service nova] Creating event network-changed:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:49:48.807146 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fee274ee-fa63-44c7-ae2a-90d7ee41a02d req-3adfdc2a-b344-40c6-8f6c-eb476a2468d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033614 Sep 13 17:49:48.807870 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4042/8032] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:49:49.258729 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:49.261684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:49.269303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:49.269961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:49.270511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:49.271341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:49.271931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:49.272474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:49.319320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b29a879-0584-46d1-b529-3e9e5feae52c tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064689 Sep 13 17:49:49.324604 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3991/8033] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:49:49 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:49:50.333968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:50.336208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:50.343335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:50.343850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:50.344315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:50.345059 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:50.345540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:50.346027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:50.378498 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-643a31b3-26a0-40b6-a518-42f4e4b42e83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050572 Sep 13 17:49:50.379112 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4043/8034] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:49:50 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:49:51.391892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:51.394474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:51.403247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:51.403734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:51.404173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:51.404916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:51.405373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:51.405803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:51.436385 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cfd795bc-86d4-4555-b07e-7ab68175aa83 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048475 Sep 13 17:49:51.436887 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3992/8035] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:49:51 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:49:52.449069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:52.451269 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:52.458324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:52.458871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:52.459330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:52.460053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:52.460528 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:52.460977 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:52.495016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6156f16c-fb5a-43cc-9bf2-0cab69775a9f tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050209 Sep 13 17:49:52.495597 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4044/8036] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:49:52 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:49:53.507517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:53.509873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:53.516975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:53.517460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:53.517960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:53.518658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:53.519116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:53.519548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:53.549205 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-649a1039-c61e-478e-a4b3-6fb729eab90a tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045688 Sep 13 17:49:53.549773 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3993/8037] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Sep 13 17:49:53 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 17:49:53.560797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:53.561307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:53.568348 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:53.568862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:53.569326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:53.570078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:53.570562 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:53.571017 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:53.646254 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] HTTP exception thrown: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 is not attached to volume d44a1d07-e73d-4c30-9aea-f418185d3ce5 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Request method failure captured: Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: request: DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments/d44a1d07-e73d-4c30-9aea-f418185d3ce5 HTTP/1.1 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMDr0IiwGNtuFwQiMsooFutrc26J_hJj3AOKQKyq46gxdgmh26Zngwb_jsX5WGMJOD-8Lg-KTtdSqCrvPueVQ5VFOOzcWmAMpDQ4EHSQxr-MaXIUO1dvlcCd_ioVtlYDC8W0eveRJz_8iv4LluxqYPECuURST7M-nDV5eLhCFfJUKeI Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c144723ac4e42b6959afa5fe3d4153f Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 is not attached to volume d44a1d07-e73d-4c30-9aea-f418185d3ce5 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'server_id': 'e0b34c05-a363-4c73-a762-ce4dd00cf175', 'id': 'd44a1d07-e73d-4c30-9aea-f418185d3ce5'} Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d44a1d07-e73d-4c30-9aea-f418185d3ce5. Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 is not attached to volume d44a1d07-e73d-4c30-9aea-f418185d3ce5 Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:49:53.647899 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 is not attached to volume d44a1d07-e73d-4c30-9aea-f418185d3ce5 Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Returning 404 to user: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 is not attached to volume d44a1d07-e73d-4c30-9aea-f418185d3ce5 {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-321ec470-3648-43f6-b719-fbfacdc41fb5 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments/d44a1d07-e73d-4c30-9aea-f418185d3ce5" status: 404 len: 154 microversion: 2.1 time: 0.092778 Sep 13 17:49:53.653200 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4045/8038] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Sep 13 17:49:53 2022] DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175/os-volume_attachments/d44a1d07-e73d-4c30-9aea-f418185d3ce5 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:49:56.901447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:56.901984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:56.908947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:56.909440 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:56.909988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:56.910702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:56.911172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:56.911609 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:56.937624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:49:57.023846 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-694de80a-b293-492e-88df-245e0490f9fb tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 204 len: 0 microversion: 2.1 time: 0.126529 Sep 13 17:49:57.024366 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3994/8039] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:49:56 2022] DELETE /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:49:57.033061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:57.033795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:57.040450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:57.041080 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:57.041774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:57.042598 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:57.043152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:57.043692 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:57.180543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:49:57.189296 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ff84011-229e-436b-a158-7d0f8c401fde tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1554 microversion: 2.1 time: 0.160320 Sep 13 17:49:57.190029 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4046/8040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:49:57 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:49:58.215027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:58.215733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:58.223236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:58.223754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:58.224190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:58.224880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:58.225367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:58.225796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:58.358690 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:49:58.366563 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6fdbba87-47cd-4007-abd5-8ab927d88e89 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1554 microversion: 2.1 time: 0.155990 Sep 13 17:49:58.367145 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3995/8041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:49:58 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:49:59.391075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:49:59.391726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:49:59.398936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:59.399455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:59.399915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:59.401419 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:59.402013 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:59.402478 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:59.484721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c144723ac4e42b6959afa5fe3d4153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60077ab124f04a4e83f4416ba5f4deeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:49:59.494853 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b273256-92cb-4e0d-8618-a5d0f8d39cc3 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 200 len: 1512 microversion: 2.1 time: 0.107762 Sep 13 17:49:59.495453 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4047/8042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:49:59 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:49:59.504478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-170826f8-00c5-4896-a7c9-78025a395f88 req-c662ed9d-0e82-41ab-9245-6ef89cbf0cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b34c05-a363-4c73-a762-ce4dd00cf175", "name": "network-vif-deleted", "tag": "4961fcf3-ad39-4001-a07e-15092c393558"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:49:59.515190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-170826f8-00c5-4896-a7c9-78025a395f88 req-c662ed9d-0e82-41ab-9245-6ef89cbf0cfd service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:49:59.515679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-170826f8-00c5-4896-a7c9-78025a395f88 req-c662ed9d-0e82-41ab-9245-6ef89cbf0cfd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:49:59.516125 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-170826f8-00c5-4896-a7c9-78025a395f88 req-c662ed9d-0e82-41ab-9245-6ef89cbf0cfd service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:49:59.528419 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-170826f8-00c5-4896-a7c9-78025a395f88 req-c662ed9d-0e82-41ab-9245-6ef89cbf0cfd service nova] Creating event network-vif-deleted:4961fcf3-ad39-4001-a07e-15092c393558 for instance e0b34c05-a363-4c73-a762-ce4dd00cf175 on n-h1-857467-1 Sep 13 17:49:59.533862 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-170826f8-00c5-4896-a7c9-78025a395f88 req-c662ed9d-0e82-41ab-9245-6ef89cbf0cfd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Sep 13 17:49:59.534974 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3996/8043] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:50:00.518625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:00.519260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [instance: e0b34c05-a363-4c73-a762-ce4dd00cf175] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:00.527035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:00.527532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:00.527985 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:00.528691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:00.529163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:00.529607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:00.543176 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] HTTP exception thrown: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 could not be found. Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Request method failure captured: Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 HTTP/1.1 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMDr0IiwGNtuFwQiMsooFutrc26J_hJj3AOKQKyq46gxdgmh26Zngwb_jsX5WGMJOD-8Lg-KTtdSqCrvPueVQ5VFOOzcWmAMpDQ4EHSQxr-MaXIUO1dvlcCd_ioVtlYDC8W0eveRJz_8iv4LluxqYPECuURST7M-nDV5eLhCFfJUKeI Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/60077ab124f04a4e83f4416ba5f4deeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 60077ab124f04a4e83f4416ba5f4deeb Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127104657 Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 6c144723ac4e42b6959afa5fe3d4153f Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestMinimumBasicScenario-2127104657-project Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 could not be found. Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'e0b34c05-a363-4c73-a762-ce4dd00cf175'} Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 could not be found. Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 could not be found. Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:50:00.544722 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 could not be found. Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Returning 404 to user: Instance e0b34c05-a363-4c73-a762-ce4dd00cf175 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-eaf3be47-f7fc-4da0-9a64-4fa08867ecc0 tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175" status: 404 len: 111 microversion: 2.1 time: 0.031532 Sep 13 17:50:00.549889 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4048/8044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:00 2022] GET /compute/v2.1/servers/e0b34c05-a363-4c73-a762-ce4dd00cf175 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:50:00.556533 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-262e18b4-4665-4f11-8fa7-0d816d888eab tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] Calling method '.version_select at 0x7fbeb49df1f0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:00.560902 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-262e18b4-4665-4f11-8fa7-0d816d888eab tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [de99044e-09cb-488b-ae7e-aa33529f8677] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:50:01.571306 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-262e18b4-4665-4f11-8fa7-0d816d888eab tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] [de99044e-09cb-488b-ae7e-aa33529f8677] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40030. Sep 13 17:50:01.591959 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-262e18b4-4665-4f11-8fa7-0d816d888eab tempest-TestMinimumBasicScenario-2127104657 tempest-TestMinimumBasicScenario-2127104657-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1925591056" status: 202 len: 0 microversion: 2.1 time: 1.040714 Sep 13 17:50:01.592578 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3997/8045] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Sep 13 17:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1925591056 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:50:10.469645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b82053f3-29df-4a7f-8d4e-dbaf4b68a77b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: .version_select at 0x7fbeb4847820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2117346306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOI2YpLAK9/4xhrnh08sEd+zxspy7NLFCLsjhVxk6pxo6CAkKNlREWqU4o9iPY4ynquJpIavXBJAs/u68OsShtI+ZlsixWrZGI7ZtHrfbcYFV3zD2E0Y+ntGZJyywNqBg=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:50:10.486098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b82053f3-29df-4a7f-8d4e-dbaf4b68a77b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:50:10.491618 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b82053f3-29df-4a7f-8d4e-dbaf4b68a77b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:50:10.516904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b82053f3-29df-4a7f-8d4e-dbaf4b68a77b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.235722 Sep 13 17:50:10.517514 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4049/8046] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:50:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:50:16.519243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1459572830", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "c4c672fe-e893-41d7-a039-39ca9afa4da7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2117346306", "security_groups": [{"name": "tempest-secgroup-smoke-630029411"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:50:16.529766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:16.530619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:16.789113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] validate_networks() for [('c4c672fe-e893-41d7-a039-39ca9afa4da7', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:50:17.239217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:50:17.239570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:50:17.240233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:50:17.240693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:50:17.241124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:50:17.254180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:17.255487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:17.256310 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:17.257448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:17.258376 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:17.259148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:17.281070 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:50:17.287036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:50:17.303058 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:50:17.305943 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:50:17.353037 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:50:18.362110 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40204. Sep 13 17:50:18.367335 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1855d0c8-c31c-4fc3-ad02-4c82c223bf97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.852194 Sep 13 17:50:18.368057 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3998/8047] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:50:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:50:18.377004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:18.382239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b432a01b-f9a2-4d96-9058-1beda03bafa0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:18.383018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b432a01b-f9a2-4d96-9058-1beda03bafa0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:18.388714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:18.517457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b432a01b-f9a2-4d96-9058-1beda03bafa0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:18.528213 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b432a01b-f9a2-4d96-9058-1beda03bafa0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1267 microversion: 2.1 time: 0.151959 Sep 13 17:50:18.529689 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4050/8048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:18 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:19.554658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:19.555292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:19.562937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:19.563437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:19.563884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:19.564599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:19.565064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:19.565499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:19.639645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:19.649077 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9f6aac94-9219-4258-b05b-f9c51f9d8ff1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1319 microversion: 2.1 time: 0.099523 Sep 13 17:50:19.649684 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 3999/8049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:19 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:20.675152 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:20.675810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:20.684416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:20.684923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:20.685376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:20.686263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:20.686740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:20.687185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:20.846432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:20.855945 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d70edb93-71dd-4dac-805f-af5157e2eee4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.184848 Sep 13 17:50:20.861947 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4051/8050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:20 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:21.508296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-58539c1b-82c6-4cd9-8db0-c1b585398dee req-530bcf90-7427-4c94-9366-1d39382f7788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37eb3ba1-cdf9-41aa-9e15-7324e7beafba", "tag": "bbb6b716-4da1-452b-999c-63d2fb5b0ead"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:50:21.525793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-58539c1b-82c6-4cd9-8db0-c1b585398dee req-530bcf90-7427-4c94-9366-1d39382f7788 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:21.526319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-58539c1b-82c6-4cd9-8db0-c1b585398dee req-530bcf90-7427-4c94-9366-1d39382f7788 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:21.526978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-58539c1b-82c6-4cd9-8db0-c1b585398dee req-530bcf90-7427-4c94-9366-1d39382f7788 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:21.538673 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-58539c1b-82c6-4cd9-8db0-c1b585398dee req-530bcf90-7427-4c94-9366-1d39382f7788 service nova] Creating event network-changed:bbb6b716-4da1-452b-999c-63d2fb5b0ead for instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba on n-h2-857467-1 Sep 13 17:50:21.544268 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-58539c1b-82c6-4cd9-8db0-c1b585398dee req-530bcf90-7427-4c94-9366-1d39382f7788 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039860 Sep 13 17:50:21.544888 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4000/8051] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:50:21.880816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:21.881610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:21.889655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:21.890344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:21.890862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:21.891814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:21.892303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:21.892759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:22.035026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:22.043369 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ed18646b-e7b0-4c4c-a95a-aa7c2dbab3a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.166647 Sep 13 17:50:22.043975 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4052/8052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:21 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:50:23.067829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:23.068541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:23.076234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:23.076722 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:23.077163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:23.077876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:23.078338 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:23.078769 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:23.215719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:23.223475 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-baa19c21-1601-4723-9dd6-2a89264f98fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.159940 Sep 13 17:50:23.224062 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4001/8053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:23 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:24.246955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:24.247585 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:24.254435 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:24.254938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:24.255390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:24.256098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:24.256575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:24.257012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:24.394753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:24.405116 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8b328b01-ac1d-42ce-806e-4abf3ceea6e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.162809 Sep 13 17:50:24.405710 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4053/8054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:24 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:25.427632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:25.428268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:25.435663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:25.436163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:25.436616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:25.437328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:25.437799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:25.438269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:25.569226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:25.577125 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0aa6bc13-08a8-41b1-8bed-a484bd24f257 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.153490 Sep 13 17:50:25.577709 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4002/8055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:25 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:26.601313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:26.602068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:26.609786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:26.610319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:26.610773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:26.611506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:26.611979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:26.612421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:26.747316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:26.755193 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00c1400b-4f63-4128-b840-673e9c3e6dc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.158004 Sep 13 17:50:26.768235 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4054/8056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:26 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:27.779087 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:27.779710 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:27.782591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:27.783389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:27.789449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:27.789974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:27.790425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:27.791284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:27.791749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:27.792234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:27.951362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:27.959648 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f86348f1-b4a8-4719-8354-7b6334ad8094 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.184721 Sep 13 17:50:27.960245 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4003/8057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:27 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:28.983340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:28.983996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:28.986855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:50:28.992448 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:28.992970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:28.993480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:28.994866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:28.995371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:28.995821 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:29.007275 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-60c6195a-5d19-40b5-9157-f07dfb5ac813 req-9025cb0a-f4a7-4bda-b6ba-052447886234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eb3ba1-cdf9-41aa-9e15-7324e7beafba", "name": "network-vif-plugged", "status": "completed", "tag": "bbb6b716-4da1-452b-999c-63d2fb5b0ead"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:50:29.021853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-60c6195a-5d19-40b5-9157-f07dfb5ac813 req-9025cb0a-f4a7-4bda-b6ba-052447886234 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:29.023510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-60c6195a-5d19-40b5-9157-f07dfb5ac813 req-9025cb0a-f4a7-4bda-b6ba-052447886234 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:29.023510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-60c6195a-5d19-40b5-9157-f07dfb5ac813 req-9025cb0a-f4a7-4bda-b6ba-052447886234 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:29.034399 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-60c6195a-5d19-40b5-9157-f07dfb5ac813 req-9025cb0a-f4a7-4bda-b6ba-052447886234 service nova] Creating event network-vif-plugged:bbb6b716-4da1-452b-999c-63d2fb5b0ead for instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba on n-h2-857467-1 Sep 13 17:50:29.043538 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-60c6195a-5d19-40b5-9157-f07dfb5ac813 req-9025cb0a-f4a7-4bda-b6ba-052447886234 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040516 Sep 13 17:50:29.044401 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4004/8058] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:50:29.140919 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:29.148979 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9d1125cf-6800-4d5a-8871-2172eb059fc1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.169751 Sep 13 17:50:29.149716 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4055/8059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:28 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:30.174145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:30.174853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:30.181862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:30.182412 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:30.182897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:30.183601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:30.184068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:30.184508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:30.326142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:30.334233 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e129781-be82-4e89-9fb6-eb075a0f92af tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1392 microversion: 2.1 time: 0.165304 Sep 13 17:50:30.335058 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4005/8060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:30 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:31.358218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:31.358761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:31.365687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:31.366231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:31.366686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:31.367644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:31.368118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:31.368558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:31.507924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:31.516413 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-bdf24ae5-000d-491f-bec8-771717c00556 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1564 microversion: 2.1 time: 0.162506 Sep 13 17:50:31.516995 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4056/8061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:31 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:31.538833 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:31.539459 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:31.546675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:31.547178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:31.547630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:31.548341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:31.548814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:31.549256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:31.683449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:31.691634 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-591e64fb-3040-404d-865c-94b5c231f2be tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1564 microversion: 2.1 time: 0.156723 Sep 13 17:50:31.692257 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4006/8062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:31 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:50:33.398481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:50:33.404535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-97a71b33-ab9a-47d0-8d48-b53a4597dd5b req-fb5073e3-9ec4-4235-9e8a-c5588b4fefc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37eb3ba1-cdf9-41aa-9e15-7324e7beafba", "tag": "bbb6b716-4da1-452b-999c-63d2fb5b0ead"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:50:33.409209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:50:33.418949 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:33.419482 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:33.419954 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:33.420703 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:33.421386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:33.421561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-97a71b33-ab9a-47d0-8d48-b53a4597dd5b req-fb5073e3-9ec4-4235-9e8a-c5588b4fefc7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:50:33.421868 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:33.422678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-97a71b33-ab9a-47d0-8d48-b53a4597dd5b req-fb5073e3-9ec4-4235-9e8a-c5588b4fefc7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:50:33.423206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-97a71b33-ab9a-47d0-8d48-b53a4597dd5b req-fb5073e3-9ec4-4235-9e8a-c5588b4fefc7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:50:33.437872 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-97a71b33-ab9a-47d0-8d48-b53a4597dd5b req-fb5073e3-9ec4-4235-9e8a-c5588b4fefc7 service nova] Creating event network-changed:bbb6b716-4da1-452b-999c-63d2fb5b0ead for instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba on n-h2-857467-1 Sep 13 17:50:33.443336 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-97a71b33-ab9a-47d0-8d48-b53a4597dd5b req-fb5073e3-9ec4-4235-9e8a-c5588b4fefc7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043097 Sep 13 17:50:33.444223 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4007/8063] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:50:33.570704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:50:33.579358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94b93337-373c-4fc0-89c4-43e0bcff7a61 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1564 microversion: 2.1 time: 0.185165 Sep 13 17:50:33.589158 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4057/8064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:50:33 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:09.200540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:09.201243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=44 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:09.205617 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:09.207932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:09.216055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:09.216545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:09.216991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:09.217691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:09.218185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:09.218624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:09.285666 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-59d0407c-0f77-4379-b9e9-a8424cb2b7de tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action" status: 200 len: 24566 microversion: 2.1 time: 0.087774 Sep 13 17:51:09.286383 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4008/8065] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:51:09 2022] POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action => generated 24566 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:51:39.796532 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=17 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:39.797314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=42 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:39.801373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:39.801961 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:39.809465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:39.810014 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:39.810479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:39.811196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:39.811678 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:39.812130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:39.884874 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28a6a9bc-5534-447c-9c0f-26a81f396eff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action" status: 202 len: 0 microversion: 2.1 time: 0.089888 Sep 13 17:51:39.885456 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4058/8066] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:51:39 2022] POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 17:51:39.894709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:39.895446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:39.897953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:39.898624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:39.906164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:39.906658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:39.907138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:39.907908 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:39.908493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:39.908934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:40.051453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:40.060395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-618a4788-f698-4f86-ac7d-58e4f7f374a5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1687 microversion: 2.1 time: 0.170447 Sep 13 17:51:40.060982 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4009/8067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:39 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:41.084955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:41.085677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:41.093107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:41.093616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:41.094115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:41.094829 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:41.095306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:41.095754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:41.232057 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:41.239831 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c4f5a6ed-9830-4036-a9e8-4eb3a46cd23f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1667 microversion: 2.1 time: 0.160230 Sep 13 17:51:41.240407 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4059/8068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:41 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:42.333274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:42.335420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:42.343841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:42.344331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:42.344776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:42.345465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:42.345961 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:42.346396 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:42.410605 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4514541f-c587-4544-8a84-34c1acc944c1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action" status: 200 len: 32645 microversion: 2.1 time: 0.081188 Sep 13 17:51:42.411268 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4010/8069] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:51:42 2022] POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action => generated 32645 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:51:42.423376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:42.423932 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:42.431121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:42.431619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:42.432074 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:42.432811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:42.433432 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:42.434291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:42.500697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-085af858-eecb-4e62-a698-0652be757e33 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action" status: 202 len: 0 microversion: 2.1 time: 0.081177 Sep 13 17:51:42.504619 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4060/8070] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:51:42 2022] POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:51:42.511083 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:42.512546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:42.520066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:42.520755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:42.521284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:42.522129 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:42.522627 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:42.523167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:42.662268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:42.670456 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e75ba625-9efc-42f5-b25d-daddd1a82594 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1674 microversion: 2.1 time: 0.163840 Sep 13 17:51:42.671047 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4011/8071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:42 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:43.695710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:43.696456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:43.703878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:43.704368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:43.704818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:43.705522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:43.706024 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:43.706469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:43.842332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:43.850105 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0319f208-bb5f-4762-80a7-3ab54e0350b1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1682 microversion: 2.1 time: 0.158762 Sep 13 17:51:43.850712 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4061/8072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:43 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:43.954078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:43.956293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:43.966849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:43.967349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:43.967801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:43.968514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:43.968991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:43.969429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:44.030638 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-061bcbce-cffe-4cec-b3fe-58af083652c0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action" status: 200 len: 35960 microversion: 2.1 time: 0.080478 Sep 13 17:51:44.031299 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4012/8073] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:51:43 2022] POST /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba/action => generated 35960 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:51:45.078620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:45.079735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:45.085613 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-3bc61272-fa46-4f5f-a611-5a7f091a10e3 req-236bf5ca-81e0-49f0-9a99-42bb9d48b1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37eb3ba1-cdf9-41aa-9e15-7324e7beafba", "tag": "bbb6b716-4da1-452b-999c-63d2fb5b0ead"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:45.094900 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:45.095420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:45.095943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:45.096684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:45.097293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:45.097756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:45.098923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3bc61272-fa46-4f5f-a611-5a7f091a10e3 req-236bf5ca-81e0-49f0-9a99-42bb9d48b1e7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:45.099638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3bc61272-fa46-4f5f-a611-5a7f091a10e3 req-236bf5ca-81e0-49f0-9a99-42bb9d48b1e7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:45.100303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-3bc61272-fa46-4f5f-a611-5a7f091a10e3 req-236bf5ca-81e0-49f0-9a99-42bb9d48b1e7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:45.113502 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-3bc61272-fa46-4f5f-a611-5a7f091a10e3 req-236bf5ca-81e0-49f0-9a99-42bb9d48b1e7 service nova] Creating event network-changed:bbb6b716-4da1-452b-999c-63d2fb5b0ead for instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba on n-h2-857467-1 Sep 13 17:51:45.119018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-3bc61272-fa46-4f5f-a611-5a7f091a10e3 req-236bf5ca-81e0-49f0-9a99-42bb9d48b1e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037466 Sep 13 17:51:45.120397 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4013/8074] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:51:45.133260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:51:45.227322 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7b5ec5a7-5d5d-43f0-a9f0-74aaaf1f56b5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 204 len: 0 microversion: 2.1 time: 0.152397 Sep 13 17:51:45.228737 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4062/8075] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:51:45 2022] DELETE /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:51:45.240369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:45.241078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:45.248303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:45.248972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:45.249420 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:45.250156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:45.250622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:45.251051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:45.396766 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:45.405429 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ec005214-789d-4cfe-a7ef-5af0337740f5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1688 microversion: 2.1 time: 0.171764 Sep 13 17:51:45.406076 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4014/8076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:45 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:46.430986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:46.431724 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:46.440060 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:46.440568 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:46.441027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:46.441742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:46.442254 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:46.442700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:46.580062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:46.587903 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-52e07cd5-a147-4252-8216-b4224ce148e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1688 microversion: 2.1 time: 0.161613 Sep 13 17:51:46.588493 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4063/8077] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:46 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:47.510970 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9465c4fe-4c4a-4de6-9456-d32b30d1e3f0 req-3e52811d-8dc0-400b-887f-4c7a1cab0f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eb3ba1-cdf9-41aa-9e15-7324e7beafba", "name": "network-vif-deleted", "tag": "bbb6b716-4da1-452b-999c-63d2fb5b0ead"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:47.523585 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9465c4fe-4c4a-4de6-9456-d32b30d1e3f0 req-3e52811d-8dc0-400b-887f-4c7a1cab0f73 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:47.524071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9465c4fe-4c4a-4de6-9456-d32b30d1e3f0 req-3e52811d-8dc0-400b-887f-4c7a1cab0f73 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:47.524509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9465c4fe-4c4a-4de6-9456-d32b30d1e3f0 req-3e52811d-8dc0-400b-887f-4c7a1cab0f73 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:47.537076 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9465c4fe-4c4a-4de6-9456-d32b30d1e3f0 req-3e52811d-8dc0-400b-887f-4c7a1cab0f73 service nova] Creating event network-vif-deleted:bbb6b716-4da1-452b-999c-63d2fb5b0ead for instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba on n-h2-857467-1 Sep 13 17:51:47.542295 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9465c4fe-4c4a-4de6-9456-d32b30d1e3f0 req-3e52811d-8dc0-400b-887f-4c7a1cab0f73 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035142 Sep 13 17:51:47.542901 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4015/8078] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:51:47.611638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:47.612890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:47.620231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:47.620738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:47.621196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:47.622099 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:47.622498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:47.622878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:47.658901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:47.659402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:47.659860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:47.660325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lazy-loading 'fault' on Instance uuid 37eb3ba1-cdf9-41aa-9e15-7324e7beafba {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:51:47.702243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:47.710073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-26cb014e-1367-46c6-8ac4-e1d77b77757c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 200 len: 1357 microversion: 2.1 time: 0.102329 Sep 13 17:51:47.710822 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4064/8079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:47 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:51:48.737020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:48.737806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 37eb3ba1-cdf9-41aa-9e15-7324e7beafba] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:48.743978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:48.744471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:48.744917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:48.745621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:48.746132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:48.746568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:48.760334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] HTTP exception thrown: Instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba could not be found. Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Request method failure captured: Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba HTTP/1.1 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMLRG4AwEZ8CfUkq0lipC59vawLMNS4uWY3q9gN_s2DoQH_LKoO9qoHhpAx55JxfHRq8QXMjPT36o-z2kgRTMCue4P6PYTgx35S8ZpL-jmRMsM8i9aa4sflLoseOnHs22e1-HZ_K_aEZA-XokTsdeKaZnHNDEk5cz14rIbJhqUukVtU Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: d09a323c97974562b5f2278ebf558e86 Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba could not be found. Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '37eb3ba1-cdf9-41aa-9e15-7324e7beafba'} Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba could not be found. Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba could not be found. Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:51:48.761976 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba could not be found. Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Returning 404 to user: Instance 37eb3ba1-cdf9-41aa-9e15-7324e7beafba could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c8585a2a-7899-40c2-a7ce-98fc5efa1423 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba" status: 404 len: 111 microversion: 2.1 time: 0.032351 Sep 13 17:51:48.767334 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4016/8080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:48 2022] GET /compute/v2.1/servers/37eb3ba1-cdf9-41aa-9e15-7324e7beafba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:51:52.083928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec656fc6-c1ab-46f3-bd18-9049f0d8d02e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '.version_select at 0x7fbeb4594040>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:52.110304 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec656fc6-c1ab-46f3-bd18-9049f0d8d02e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2117346306" status: 202 len: 0 microversion: 2.1 time: 0.032010 Sep 13 17:51:52.111291 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4065/8081] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Sep 13 17:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2117346306 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:51:52.142146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48131b7e-1d10-434d-a19e-d208fb9b01fd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: .version_select at 0x7fbeb4b20dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-45005194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmoCw07i+hsx0thkFmTiuAN7TQRT3GSYPSKGacNgYZSDwHPwJqNRYd7eVSX6CEqf98iwb1r5jWlbkU98zRyeN7qBs1qhCyqj9ww88GNmKJzwhBBhEMw9wtuamgc8ouEcg=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:52.162260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-48131b7e-1d10-434d-a19e-d208fb9b01fd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:51:52.167503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-48131b7e-1d10-434d-a19e-d208fb9b01fd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:51:52.191685 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48131b7e-1d10-434d-a19e-d208fb9b01fd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055835 Sep 13 17:51:52.192517 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4017/8082] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:51:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:51:57.675275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1085490932", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "4d031935-2d0e-407f-873e-f94548341111"}], "key_name": "tempest-TestNetworkAdvancedServerOps-45005194", "security_groups": [{"name": "tempest-secgroup-smoke-1362271215"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:51:57.720616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:57.833856 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] validate_networks() for [('4d031935-2d0e-407f-873e-f94548341111', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:51:58.441480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:51:58.442276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:51:58.443076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:51:58.443696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:51:58.444308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:51:58.460009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:58.468427 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:58.469466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:58.470849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:51:58.471690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:51:58.472325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:51:58.491860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:51:58.499096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:51:58.513658 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:51:58.517062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:51:58.565553 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [07f25004-ee35-400b-9102-92c166390e75] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:51:59.574239 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [07f25004-ee35-400b-9102-92c166390e75] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40392. Sep 13 17:51:59.579353 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2242850-dd44-453f-b258-06f52a38d6cd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.918715 Sep 13 17:51:59.580300 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4066/8083] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:51:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:51:59.589413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=32 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:51:59.594800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f7b2a85e-a7e8-44c0-876f-6ded63b369c2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:51:59.595874 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f7b2a85e-a7e8-44c0-876f-6ded63b369c2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:51:59.652883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f7b2a85e-a7e8-44c0-876f-6ded63b369c2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:51:59.661653 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f7b2a85e-a7e8-44c0-876f-6ded63b369c2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1265 microversion: 2.1 time: 0.073857 Sep 13 17:51:59.662868 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4018/8084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:51:59 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:00.688796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:00.689384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:00.696551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:00.697065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:00.697524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:00.698270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:00.698937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:00.699646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:00.771763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:00.780839 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe8c8ea9-51fe-4066-a199-4334dcd8f082 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1317 microversion: 2.1 time: 0.097412 Sep 13 17:52:00.792544 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4067/8085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:00 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1317 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:01.804851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:01.805535 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:01.815560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:01.816043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:01.816487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:01.817211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:01.817672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:01.818321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:02.027831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:02.037192 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-307c4956-21a1-4b35-863c-6e8efa905247 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.235866 Sep 13 17:52:02.037783 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4019/8086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:01 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:02.354142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a7142138-5d86-4592-ba08-23065dc3eeca req-99335cbe-f647-45be-bc09-4d19415d84db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b", "tag": "87e380f3-3100-49b4-9601-6e63a7b4027b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:52:02.365776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a7142138-5d86-4592-ba08-23065dc3eeca req-99335cbe-f647-45be-bc09-4d19415d84db service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:02.366304 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a7142138-5d86-4592-ba08-23065dc3eeca req-99335cbe-f647-45be-bc09-4d19415d84db service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:02.366754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a7142138-5d86-4592-ba08-23065dc3eeca req-99335cbe-f647-45be-bc09-4d19415d84db service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:02.378395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a7142138-5d86-4592-ba08-23065dc3eeca req-99335cbe-f647-45be-bc09-4d19415d84db service nova] Creating event network-changed:87e380f3-3100-49b4-9601-6e63a7b4027b for instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b on n-h1-857467-1 Sep 13 17:52:02.383207 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a7142138-5d86-4592-ba08-23065dc3eeca req-99335cbe-f647-45be-bc09-4d19415d84db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032913 Sep 13 17:52:02.383819 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4068/8087] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:52:03.062862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:03.063525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:03.070628 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:03.071124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:03.071569 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:03.072279 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:03.072741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:03.073177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:03.208467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:03.216182 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c3697a19-873d-4b50-8adf-072cf7a23197 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.158306 Sep 13 17:52:03.216780 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4020/8088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:03 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:04.240393 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:04.241106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:04.247351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:04.248250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:04.249075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:04.250205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:04.250690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:04.251138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:04.383746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:04.392731 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1f99aba8-be48-448d-9561-4054aae44d18 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.157417 Sep 13 17:52:04.393312 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4069/8089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:04 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:05.416670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:05.417218 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:05.425958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:05.426788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:05.427250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:05.427965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:05.428441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:05.428878 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:05.565624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:05.573528 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-72d607f2-a3c3-4fb2-82db-0d15a8a8433d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.160988 Sep 13 17:52:05.574152 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4021/8090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:05 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:52:06.597151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:06.597773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:06.604931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:06.605450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:06.605952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:06.607322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:06.607926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:06.608382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:06.740691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:06.748553 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00cef09f-4751-4538-a0df-8dab6833d5e4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.155924 Sep 13 17:52:06.749138 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4070/8091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:06 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:07.771549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:07.772168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:07.779020 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:07.779505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:07.779945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:07.780646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:07.781110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:07.781544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:07.914944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:07.925022 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a180cb4f-3fb9-4cec-8533-895de38429a0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.157364 Sep 13 17:52:07.925749 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4022/8092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:07 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:08.948701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:08.949336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:08.952466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:08.953154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:08.959264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:08.959771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:08.960230 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:08.960944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:08.961429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:08.961906 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:09.102115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:09.110596 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-77574321-de23-4305-928b-fb4e2058a474 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.165886 Sep 13 17:52:09.111187 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4071/8093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:08 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:09.487703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-e4173f6a-9751-4c34-b671-91f42089979c req-98773bed-045d-433b-8ec7-2a3bcc97a9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b", "name": "network-vif-plugged", "status": "completed", "tag": "87e380f3-3100-49b4-9601-6e63a7b4027b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:52:09.499545 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e4173f6a-9751-4c34-b671-91f42089979c req-98773bed-045d-433b-8ec7-2a3bcc97a9e0 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:09.500048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e4173f6a-9751-4c34-b671-91f42089979c req-98773bed-045d-433b-8ec7-2a3bcc97a9e0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:09.500526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-e4173f6a-9751-4c34-b671-91f42089979c req-98773bed-045d-433b-8ec7-2a3bcc97a9e0 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:09.512113 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-e4173f6a-9751-4c34-b671-91f42089979c req-98773bed-045d-433b-8ec7-2a3bcc97a9e0 service nova] Creating event network-vif-plugged:87e380f3-3100-49b4-9601-6e63a7b4027b for instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b on n-h1-857467-1 Sep 13 17:52:09.517461 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-e4173f6a-9751-4c34-b671-91f42089979c req-98773bed-045d-433b-8ec7-2a3bcc97a9e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033710 Sep 13 17:52:09.518117 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4023/8094] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:52:10.135171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:10.135800 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:10.139123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:10.145305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:10.145903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:10.146361 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:10.147120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:10.147546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:10.147994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:10.282926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:10.290695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-355782f1-5abe-4739-b008-ec99a0b3ee7f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1391 microversion: 2.1 time: 0.159974 Sep 13 17:52:10.291275 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4072/8095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:10 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:11.311662 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:11.316666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:11.317370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:11.319252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:11.325238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:11.325734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:11.326198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:11.326889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:11.327350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:11.327782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:11.461128 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:11.469797 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-73499d74-8db4-4a10-9cd6-0c64f3097ac5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1562 microversion: 2.1 time: 0.159081 Sep 13 17:52:11.470395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4024/8096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:11 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:11.492719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:11.493378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:11.500782 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:11.501292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:11.501758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:11.502501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:11.502979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:11.503428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:11.637006 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:11.645706 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-67c5ed74-f719-4b1e-a8d7-a0049a20985c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1562 microversion: 2.1 time: 0.157346 Sep 13 17:52:11.646317 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4073/8097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:11 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:13.574193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:52:13.575547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:13.582847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:13.583411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:13.584074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:13.584797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:13.585478 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:13.585952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:13.640283 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-53f988cd-cd4f-48e9-9c49-4ad9ffb8dad1 req-3f7da134-edf5-4cb7-9b18-f50df14f5784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b", "tag": "87e380f3-3100-49b4-9601-6e63a7b4027b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:52:13.650536 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-53f988cd-cd4f-48e9-9c49-4ad9ffb8dad1 req-3f7da134-edf5-4cb7-9b18-f50df14f5784 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:13.651116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-53f988cd-cd4f-48e9-9c49-4ad9ffb8dad1 req-3f7da134-edf5-4cb7-9b18-f50df14f5784 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:13.651643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-53f988cd-cd4f-48e9-9c49-4ad9ffb8dad1 req-3f7da134-edf5-4cb7-9b18-f50df14f5784 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:13.669782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-53f988cd-cd4f-48e9-9c49-4ad9ffb8dad1 req-3f7da134-edf5-4cb7-9b18-f50df14f5784 service nova] Creating event network-changed:87e380f3-3100-49b4-9601-6e63a7b4027b for instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b on n-h1-857467-1 Sep 13 17:52:13.676735 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-53f988cd-cd4f-48e9-9c49-4ad9ffb8dad1 req-3f7da134-edf5-4cb7-9b18-f50df14f5784 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108361 Sep 13 17:52:13.678169 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4074/8098] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:52:13.782993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:52:13.791750 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35aa0dc6-1105-4a68-b5ca-0739d7ed7c60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1562 microversion: 2.1 time: 0.227496 Sep 13 17:52:13.792478 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4025/8099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:52:13 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:52:45.072142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:52:45.074645 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:52:45.077248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=5 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:45.078076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=42 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:52:45.083832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:45.084350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:45.084808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:45.085546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:52:45.086058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:52:45.086513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:52:45.234815 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e0371418-116e-436b-b463-31722b8625fc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b/action" status: 200 len: 24572 microversion: 2.1 time: 0.166833 Sep 13 17:52:45.235488 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4075/8100] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:52:45 2022] POST /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b/action => generated 24572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:53:15.680651 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 17:53:15.681200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:53:15.681984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=38 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:53:15.686465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:53:15.688659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:15.695365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:15.695851 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:15.696291 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:15.696981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:15.697441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:15.697903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:15.772051 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-65f13965-c3cd-4dbc-866d-61da4e4b82f4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b/action" status: 202 len: 0 microversion: 2.1 time: 0.093317 Sep 13 17:53:15.772700 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4026/8101] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:53:15 2022] POST /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:53:15.784891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:15.785958 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:15.789010 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:53:15.789785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:53:15.796449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:15.796955 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:15.797406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:15.798148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:15.798625 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:15.799068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:15.948156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:15.956833 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c3277c5a-d736-4a92-a53e-967a1e4285d4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1672 microversion: 2.1 time: 0.179446 Sep 13 17:53:15.957428 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4076/8102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:15 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:16.983932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:16.984645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:16.991989 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:16.992501 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:16.992949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:16.993661 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:16.994162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:16.994600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:17.001061 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40478. Sep 13 17:53:17.133480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:17.142307 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fd9059c7-78d0-4de8-bc4a-92c5a80d3a08 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.164275 Sep 13 17:53:17.142887 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4027/8103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:16 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:18.166483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:18.167127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:18.175264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:18.175774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:18.176238 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:18.176951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:18.177434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:18.177910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:18.308278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:18.316170 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c35ce2be-ec7c-4ac9-b748-d4fdf05a7bbe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.153662 Sep 13 17:53:18.316758 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4077/8104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:18 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:19.339951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:19.340563 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:19.347803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:19.348292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:19.348914 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:19.349429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:19.349918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:19.350355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:19.489554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:19.497642 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a7bd7b79-029f-4f02-af11-e1c1b98ecb72 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.161604 Sep 13 17:53:19.498255 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4028/8105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:19 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:20.521670 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:20.522326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:20.529167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:20.530358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:20.530984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:20.531683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:20.532155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:20.532624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:20.666773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:20.674697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9a8ab958-cba4-437c-9e3f-100e46703b1c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.156926 Sep 13 17:53:20.675271 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4078/8106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:20 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:21.698139 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:21.698791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:21.705738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:21.706263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:21.706703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:21.707399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:21.707865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:21.708297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:21.839650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:21.848175 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9076c4c0-07b7-45ed-8a02-b54b44fc60e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.154021 Sep 13 17:53:21.848763 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4029/8107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:21 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:22.872118 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:22.872785 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:22.880495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:22.880999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:22.881457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:22.882209 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:22.882690 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:22.883137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:23.022722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:23.031065 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d52a6073-4da6-4831-9ff4-2177ca3a4f92 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.162916 Sep 13 17:53:23.031642 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4079/8108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:22 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:24.054985 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:24.055790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:24.064229 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:24.064735 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:24.065180 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:24.065967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:24.066433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:24.066873 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:24.203184 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:24.210918 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2fd94ca3-2387-4dde-806f-724204793115 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.159908 Sep 13 17:53:24.211488 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4030/8109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:24 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:53:25.235318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:25.235975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:25.243022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:25.243524 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:25.243980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:25.244688 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:25.245166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:25.245608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:25.377127 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:25.384863 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3df90240-91cd-4bf6-88e1-e8c7c00bd445 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.154503 Sep 13 17:53:25.385445 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4080/8110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:25 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:26.408413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:26.408957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:26.416000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:26.416491 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:26.416939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:26.417642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:26.418140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:26.418581 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:26.551764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:26.559814 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bab730d-4523-4a72-b1f3-ffb739aab678 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1677 microversion: 2.1 time: 0.155855 Sep 13 17:53:26.560386 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4031/8111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:26 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:27.584079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:53:27.584732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:27.591241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:27.591741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:27.592196 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:27.592909 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:27.593380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:27.593820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:27.729795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:53:27.737882 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3b3f19e8-dc92-49fc-9cd1-1b1a3a73279f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1680 microversion: 2.1 time: 0.157753 Sep 13 17:53:27.738472 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4081/8112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:53:27 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:53:59.961927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:53:59.964112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:53:59.966210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:53:59.966886 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:53:59.975107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:59.975604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:59.976049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:53:59.976755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:53:59.977220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:53:59.977663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:00.049771 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95c4dacc-7ed1-4c9d-8957-9625f3e038d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b/action" status: 200 len: 69096 microversion: 2.1 time: 0.091931 Sep 13 17:54:00.050474 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4032/8113] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:53:59 2022] POST /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b/action => generated 69096 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:54:17.304792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:17.305360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:17.307458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-761e3e7a-3c9e-47eb-ae71-28edb2852ac0 req-1932cdec-09b4-4c25-b376-ddab77ea45af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b", "tag": "87e380f3-3100-49b4-9601-6e63a7b4027b"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:17.307978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:17.308561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=36 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:17.309661 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:54:17.309798 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:54:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b (ip 10.222.0.61) !!! Sep 13 17:54:17.311687 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 13 17:54:17.320252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:17.320761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:17.320897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:17.321221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:17.321926 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:17.322469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:17.323130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:17.323722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:17.332142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-761e3e7a-3c9e-47eb-ae71-28edb2852ac0 req-1932cdec-09b4-4c25-b376-ddab77ea45af service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:17.332658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-761e3e7a-3c9e-47eb-ae71-28edb2852ac0 req-1932cdec-09b4-4c25-b376-ddab77ea45af service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:17.333294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-761e3e7a-3c9e-47eb-ae71-28edb2852ac0 req-1932cdec-09b4-4c25-b376-ddab77ea45af service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:17.346669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-761e3e7a-3c9e-47eb-ae71-28edb2852ac0 req-1932cdec-09b4-4c25-b376-ddab77ea45af service nova] Creating event network-changed:87e380f3-3100-49b4-9601-6e63a7b4027b for instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b on n-h1-857467-1 Sep 13 17:54:17.351800 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-761e3e7a-3c9e-47eb-ae71-28edb2852ac0 req-1932cdec-09b4-4c25-b376-ddab77ea45af service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048370 Sep 13 17:54:17.352458 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4033/8114] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:17.354412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:54:17.441194 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0cd0a526-5397-46f2-bb9c-4672c28b0ed7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 204 len: 0 microversion: 2.1 time: 0.140512 Sep 13 17:54:17.442265 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4082/8115] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:54:17 2022] DELETE /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:54:17.451094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:17.451888 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:17.459452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:17.460018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:17.460493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:17.461243 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:17.461709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:17.462222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:17.603293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:17.612788 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49f7a16b-e5c7-4beb-8bf0-a6f1a5567986 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1686 microversion: 2.1 time: 0.165874 Sep 13 17:54:17.613369 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4034/8116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:17 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:18.641081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:18.642410 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:18.649515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:18.650069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:18.650537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:18.651277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:18.651761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:18.652214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:18.794616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:18.803553 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a315f8c6-9afb-495b-8bc5-0eecaea1a2e7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1686 microversion: 2.1 time: 0.166986 Sep 13 17:54:18.804148 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4083/8117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:18 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:19.832919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:19.833639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:19.840699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:19.841195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:19.841642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:19.842388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:19.842859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:19.843654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:19.910510 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:19.918496 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2f99ac3f-b892-4795-968d-ae54f6bad809 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 200 len: 1500 microversion: 2.1 time: 0.090317 Sep 13 17:54:19.919083 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4035/8118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:19 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 1500 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:19.946644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-5ecf8650-3ef1-4821-ab38-f4fa98ed0153 req-04834782-3418-4760-8ee6-28be3049385d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b", "name": "network-vif-deleted", "tag": "87e380f3-3100-49b4-9601-6e63a7b4027b"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:19.957068 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5ecf8650-3ef1-4821-ab38-f4fa98ed0153 req-04834782-3418-4760-8ee6-28be3049385d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:19.957565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5ecf8650-3ef1-4821-ab38-f4fa98ed0153 req-04834782-3418-4760-8ee6-28be3049385d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:19.958067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-5ecf8650-3ef1-4821-ab38-f4fa98ed0153 req-04834782-3418-4760-8ee6-28be3049385d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:19.969366 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-5ecf8650-3ef1-4821-ab38-f4fa98ed0153 req-04834782-3418-4760-8ee6-28be3049385d service nova] Creating event network-vif-deleted:87e380f3-3100-49b4-9601-6e63a7b4027b for instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b on n-h1-857467-1 Sep 13 17:54:19.975199 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-5ecf8650-3ef1-4821-ab38-f4fa98ed0153 req-04834782-3418-4760-8ee6-28be3049385d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032241 Sep 13 17:54:19.975831 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4084/8119] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:20.943462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:20.944082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:20.951029 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:20.951519 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:20.951964 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:20.952658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:20.953121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:20.953558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:20.967567 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] HTTP exception thrown: Instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b could not be found. Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Request method failure captured: Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b HTTP/1.1 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMLRG4AwEZ8CfUkq0lipC59vawLMNS4uWY3q9gN_s2DoQH_LKoO9qoHhpAx55JxfHRq8QXMjPT36o-z2kgRTMCue4P6PYTgx35S8ZpL-jmRMsM8i9aa4sflLoseOnHs22e1-HZ_K_aEZA-XokTsdeKaZnHNDEk5cz14rIbJhqUukVtU Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: d09a323c97974562b5f2278ebf558e86 Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b could not be found. Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b'} Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b could not be found. Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b could not be found. Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:54:20.969209 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b could not be found. Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Returning 404 to user: Instance 4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f9c522a8-3188-458a-8714-7ca5e1c8fb6b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b" status: 404 len: 111 microversion: 2.1 time: 0.032061 Sep 13 17:54:20.974867 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4036/8120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:20 2022] GET /compute/v2.1/servers/4c68150d-626a-4dfe-ae3f-5e6e51cf5f6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:54:23.962425 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-328ba90e-13e3-4269-92ac-d0f4974eb80b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '.version_select at 0x7fbeb98019d0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:23.987678 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-328ba90e-13e3-4269-92ac-d0f4974eb80b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-45005194" status: 202 len: 0 microversion: 2.1 time: 0.030599 Sep 13 17:54:23.988593 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4085/8121] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Sep 13 17:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-45005194 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:54:24.018830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9baf2fae-85cc-4549-bddc-ef8ab10ad0ab tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: .version_select at 0x7fbeb466e040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1382695788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXxUEi/pu4I3mll3RtzzJFDa75F1aaAduh6f+w4tWuhzEXUTK6iB5WENtuCNEeL7k0i1vc1i1QqPBNuIqcm+nJZWftgfPR59L1WBJ+/xVuqr8xSkRFNjoKpFexsOTWplQ=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:24.041091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9baf2fae-85cc-4549-bddc-ef8ab10ad0ab tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:54:24.048235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9baf2fae-85cc-4549-bddc-ef8ab10ad0ab tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:54:24.081354 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9baf2fae-85cc-4549-bddc-ef8ab10ad0ab tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.068744 Sep 13 17:54:24.082353 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4037/8122] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:54:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:54:29.679765 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-570518211", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "6de432a0-183f-431e-9605-db3c352c7686"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1382695788", "security_groups": [{"name": "tempest-secgroup-smoke-1928975827"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:29.819004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] validate_networks() for [('6de432a0-183f-431e-9605-db3c352c7686', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:54:29.963842 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:30.272109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:54:30.273409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:54:30.274521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:54:30.275155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:54:30.275838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:54:30.286943 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:30.287350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:30.288026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:30.288781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:30.289648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:30.290132 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:30.320252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:54:30.326887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:54:30.341927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:54:30.344501 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:54:30.396231 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a8a147bd-8c16-4de6-bba3-5fc92d226a2d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720748 Sep 13 17:54:30.403147 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4086/8123] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:54:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:54:30.409382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e610a5f9-490d-412e-b669-7c7339e05e86 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:30.410081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e610a5f9-490d-412e-b669-7c7339e05e86 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:30.484663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e610a5f9-490d-412e-b669-7c7339e05e86 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:30.499593 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e610a5f9-490d-412e-b669-7c7339e05e86 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1266 microversion: 2.1 time: 0.094168 Sep 13 17:54:30.522917 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4038/8124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:30 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:54:31.525697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:31.526443 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:31.535355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:31.535960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:31.536903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:31.537650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:31.538318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:31.538967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:31.607693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:31.616784 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e6aba2e6-1988-4a76-8db9-c00520dcc4dd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1318 microversion: 2.1 time: 0.096052 Sep 13 17:54:31.617360 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4087/8125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:31 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:32.644272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:32.645045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:32.648335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=16 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:32.660450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:32.661274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:32.661727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:32.662823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:32.663558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:32.664115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:32.741608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:32.750441 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-641e7adb-d74b-4931-9b86-8de2700dc26a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1324 microversion: 2.1 time: 0.112796 Sep 13 17:54:32.751124 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4039/8126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:32 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:54:33.773696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:33.774986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:33.781731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:33.782825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:33.783299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:33.784036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:33.791465 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:33.791953 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:33.990907 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:34.001095 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ec49c2fd-68be-4a64-b6b4-54985e0d0b89 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.231210 Sep 13 17:54:34.002206 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4088/8127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:33 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:34.083437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-97a03a9f-5090-42db-a2f4-7827978167ef req-dcc4a631-02d2-4fdb-8fba-913d474e3ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:34.094136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-97a03a9f-5090-42db-a2f4-7827978167ef req-dcc4a631-02d2-4fdb-8fba-913d474e3ed9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:34.094588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-97a03a9f-5090-42db-a2f4-7827978167ef req-dcc4a631-02d2-4fdb-8fba-913d474e3ed9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:34.095635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-97a03a9f-5090-42db-a2f4-7827978167ef req-dcc4a631-02d2-4fdb-8fba-913d474e3ed9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:34.107761 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-97a03a9f-5090-42db-a2f4-7827978167ef req-dcc4a631-02d2-4fdb-8fba-913d474e3ed9 service nova] Creating event network-changed:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h2-857467-1 Sep 13 17:54:34.113370 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-97a03a9f-5090-42db-a2f4-7827978167ef req-dcc4a631-02d2-4fdb-8fba-913d474e3ed9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 Sep 13 17:54:34.114663 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4040/8128] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:35.026978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:35.027615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:35.035128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:35.035641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:35.036148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:35.036924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:35.037404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:35.037875 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:35.175403 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:35.183124 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-73a2fbdf-9c06-439c-b00e-7c44a33febc9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.160104 Sep 13 17:54:35.183983 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4089/8129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:35 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:36.209190 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:36.209932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:36.216160 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:36.216645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:36.217086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:36.217775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:36.218261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:36.218696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:36.359452 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:36.367505 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-166631c3-23f8-4233-a82f-099b890deef0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.164098 Sep 13 17:54:36.368076 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4041/8130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:36 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:37.390262 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:37.390890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:37.398412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:37.398918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:37.399376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:37.400094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:37.400565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:37.401009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:37.535426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:37.543221 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4e521d23-a6ba-4202-95dd-0cbfd3668f12 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.156937 Sep 13 17:54:37.543806 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4090/8131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:37 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:38.566251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:38.566997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:38.573931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:38.574422 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:38.574871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:38.575567 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:38.576026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:38.576455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:38.710089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:38.717874 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e3f515aa-2623-4893-9fd3-aca7fa2595c8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.155684 Sep 13 17:54:38.718452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4042/8132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:38 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:39.741233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:39.741905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:39.748807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:39.749320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:39.749774 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:39.750519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:39.750992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:39.751437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:39.890314 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:39.898666 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ff491a87-fcee-43d5-bfe4-b4374eb9ebde tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.161944 Sep 13 17:54:39.899286 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4091/8133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:39 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:40.074210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-ff55443e-bbe5-41b7-8572-d47d75a4b936 req-f2ece9b6-9edb-40f1-bdd8-75b02137f4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "name": "network-vif-plugged", "status": "completed", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:40.084957 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ff55443e-bbe5-41b7-8572-d47d75a4b936 req-f2ece9b6-9edb-40f1-bdd8-75b02137f4c3 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:40.085444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ff55443e-bbe5-41b7-8572-d47d75a4b936 req-f2ece9b6-9edb-40f1-bdd8-75b02137f4c3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:40.085906 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-ff55443e-bbe5-41b7-8572-d47d75a4b936 req-f2ece9b6-9edb-40f1-bdd8-75b02137f4c3 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:40.101176 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-ff55443e-bbe5-41b7-8572-d47d75a4b936 req-f2ece9b6-9edb-40f1-bdd8-75b02137f4c3 service nova] Creating event network-vif-plugged:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h2-857467-1 Sep 13 17:54:40.106987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-ff55443e-bbe5-41b7-8572-d47d75a4b936 req-f2ece9b6-9edb-40f1-bdd8-75b02137f4c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098181 Sep 13 17:54:40.107694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4043/8134] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:40.924036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:40.924984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:40.926929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:40.927655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:40.935102 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:40.935608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:40.936066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:40.936778 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:40.937257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:40.937706 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:41.075292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:41.083230 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-084651ae-2c66-44c4-98af-bf52c24e1180 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1392 microversion: 2.1 time: 0.163765 Sep 13 17:54:41.083829 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4092/8135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:40 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:42.103463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:54:42.108555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:42.109274 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:42.116748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:42.117235 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:42.117681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:42.118408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:42.118880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:42.119319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:42.257364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:42.265172 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b1aaaed0-7a25-448b-bb95-1286260eb2ec tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1564 microversion: 2.1 time: 0.162760 Sep 13 17:54:42.265750 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4044/8136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:42 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:42.288816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:42.289452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:42.296451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:42.296960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:42.297415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:42.298154 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:42.298937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:42.299530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:42.443820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:42.452384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8d199ab7-2fa0-44e1-b457-893a3894e5bf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1564 microversion: 2.1 time: 0.167665 Sep 13 17:54:42.452967 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4093/8137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:42 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:54:44.045685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-b31d42f5-8b28-4403-9d45-9258750191b2 req-412ff8ed-849d-4982-a16e-5e648dc88e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:54:44.048796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:54:44.056294 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:54:44.063822 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:44.065059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:44.065623 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:44.066372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:44.066839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:44.067276 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:44.075358 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b31d42f5-8b28-4403-9d45-9258750191b2 req-412ff8ed-849d-4982-a16e-5e648dc88e91 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:54:44.075859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b31d42f5-8b28-4403-9d45-9258750191b2 req-412ff8ed-849d-4982-a16e-5e648dc88e91 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:54:44.076309 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-b31d42f5-8b28-4403-9d45-9258750191b2 req-412ff8ed-849d-4982-a16e-5e648dc88e91 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:54:44.088620 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-b31d42f5-8b28-4403-9d45-9258750191b2 req-412ff8ed-849d-4982-a16e-5e648dc88e91 service nova] Creating event network-changed:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h2-857467-1 Sep 13 17:54:44.094620 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-b31d42f5-8b28-4403-9d45-9258750191b2 req-412ff8ed-849d-4982-a16e-5e648dc88e91 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052691 Sep 13 17:54:44.096416 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4094/8138] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:54:44.216915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:54:44.225806 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3764a708-3570-42aa-b3bd-020ad2ddd31d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1564 microversion: 2.1 time: 0.186455 Sep 13 17:54:44.227111 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4045/8139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:54:44 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:19.530527 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:19.531297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=46 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:19.584925 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:19.587332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:19.593577 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:19.594130 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:19.594588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:19.595296 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:19.595771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:19.596221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:19.664395 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e3ec1f9-ec85-4c84-9e56-db938ef8f0e6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action" status: 200 len: 24566 microversion: 2.1 time: 0.135668 Sep 13 17:55:19.665078 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4095/8140] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:55:19 2022] POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action => generated 24566 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:55:50.096161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:50.097358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=34 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:50.099140 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:55:50.099338 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 17:55:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action (ip 10.222.0.61) !!! Sep 13 17:55:50.104416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:55:50.106792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:50.115298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:50.115795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:50.116242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:50.116960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:50.117430 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:50.117889 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:50.217326 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:50.223632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Old instance type m1.heat2, new instance type m1.heat {{(pid=122327) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 13 17:55:50.230472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:55:50.230902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:55:50.231382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:55:50.231799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:55:50.232223 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:55:50.296808 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c38046c7-2b02-48ca-a411-22cf6a6c5026 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action" status: 202 len: 0 microversion: 2.1 time: 0.202554 Sep 13 17:55:50.297441 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4046/8141] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:55:50 2022] POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:55:50.306346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:50.308026 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:50.310904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:50.311636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:55:50.318336 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:50.318848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:50.319523 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:50.320481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:50.321156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:50.321721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:50.544840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:50.553046 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e970406d-bb3b-4444-b26b-48f170c86e71 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1692 microversion: 2.1 time: 0.251121 Sep 13 17:55:50.553628 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4096/8142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:50 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1692 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:51.580941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:51.581781 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:51.589579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:51.590105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:51.590555 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:51.591272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:51.591768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:51.592222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:51.770433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:51.780241 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-646dc89c-fe1e-4fff-87cd-ccbd2624604a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1692 microversion: 2.1 time: 0.204918 Sep 13 17:55:51.780830 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4047/8143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:51 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:52.804229 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:52.804790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:52.814212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:52.814733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:52.815234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:52.815968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:52.816452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:52.816910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:52.950231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:52.958037 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3d82b130-c899-4c75-9817-49510ba9217f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.157837 Sep 13 17:55:52.958623 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4097/8144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:52 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:53.982305 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:53.982930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:53.989778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:53.990303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:53.990758 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:53.991463 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:53.991932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:53.992370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:54.128050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:54.136229 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-660b41b5-666d-4fda-8566-095aa7aee4bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.158437 Sep 13 17:55:54.137054 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4048/8145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:53 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:55.160400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:55.161027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:55.168433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:55.168933 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:55.169382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:55.170121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:55.170593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:55.171034 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:55.307973 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:55.316286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f555ddb6-4f5a-4c6e-9c9e-2aa967431c6e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.159687 Sep 13 17:55:55.316789 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4098/8146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:55 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:56.340177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:56.340842 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:56.347806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:56.348304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:56.348756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:56.349464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:56.349958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:56.350401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:56.483566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:56.491870 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ee7469bc-3440-4650-b66b-7881a9edf377 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.156279 Sep 13 17:55:56.492461 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4049/8147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:56 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:57.515481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:57.516116 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:57.523239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:57.523726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:57.524180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:57.524892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:57.525365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:57.525820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:57.661504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:57.670056 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d04b349d-3579-47ff-840f-69f5713258bb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.158662 Sep 13 17:55:57.670654 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4099/8148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:57 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:58.693651 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:58.694289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:58.701748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:58.702280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:58.702719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:58.703415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:58.703877 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:58.704307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:58.837987 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:55:58.846047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6396bbe9-67a2-446e-babc-2d5cf7c1225e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.156264 Sep 13 17:55:58.846627 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4050/8149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:58 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:55:59.868647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:55:59.869287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:55:59.876750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:59.877260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:59.877722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:55:59.878493 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:55:59.878979 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:55:59.879430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:00.014903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:00.022667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c26f611c-e12f-4d72-a5ff-5524b9f36246 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.157953 Sep 13 17:56:00.023260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4100/8150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:55:59 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:01.047841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:01.048458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:01.055600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:01.056091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:01.056534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:01.057433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:01.058217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:01.058397 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:01.194618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:01.202916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-af519e05-96db-4a04-92c8-2562a1f30186 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.158972 Sep 13 17:56:01.203502 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4051/8151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:01 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:02.233246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:02.233937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:02.240972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:02.241481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:02.241976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:02.242697 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:02.243174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:02.243622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:02.376565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:02.384301 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1d589b39-35db-4c16-a7bf-a5574a73c5e1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.155658 Sep 13 17:56:02.384901 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4101/8152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:02 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:03.407771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:03.408324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:03.415225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:03.415712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:03.416154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:03.416965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:03.417615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:03.418086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:03.552342 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:03.560499 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fdba749a-bd3a-40f2-ab2f-0c9585951970 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1697 microversion: 2.1 time: 0.156704 Sep 13 17:56:03.561087 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4052/8153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:03 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:56:04.585854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:04.586552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:04.595998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:04.596506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:04.596959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:04.597942 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:04.598433 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:04.598878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:04.799820 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:04.808534 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a73a0d16-3346-4861-9aca-9bbfffe2d3eb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1696 microversion: 2.1 time: 0.227322 Sep 13 17:56:04.809125 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4102/8154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:04 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:05.145000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "name": "network-vif-unplugged", "status": "completed", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:56:05.157387 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:05.158439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:05.158439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:05.172079 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] Creating event network-vif-unplugged:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h1-857467-1 Sep 13 17:56:05.178316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122327) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:56:05.189850 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-af4bcd64-badb-4fc2-8094-77d920ccb7d8 req-896d2e0d-762e-4668-b471-53fab4a25d43 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105471 Sep 13 17:56:05.190587 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4053/8155] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:56:05.832833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:05.833497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:05.840792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:05.841300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:05.841758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:05.842574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:05.843049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:05.843498 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:06.063913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:06.071790 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-89ab11d3-96dd-45b2-95f3-833a4986deed tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1696 microversion: 2.1 time: 0.243131 Sep 13 17:56:06.086005 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4103/8156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:05 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1696 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:07.096562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:07.097269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:07.104509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:07.104995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:07.105435 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:07.106161 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:07.106642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:07.107074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:07.207303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:56:07.222797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:07.223300 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:07.223753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:07.236423 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] Creating event network-changed:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h1-857467-1 Sep 13 17:56:07.241771 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-857467-1', 'n-h1-857467-1'} {{(pid=122328) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 13 17:56:07.245843 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:07.253128 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-fcc5354c-1dff-4f19-8516-4222c0d8c767 req-34e7b322-c4b3-4502-94ca-2136ff5b1e99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050012 Sep 13 17:56:07.253759 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4104/8157] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:56:07.254003 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-59170ad8-865e-4b74-9e4c-fa68db20ee4b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1694 microversion: 2.1 time: 0.161510 Sep 13 17:56:07.254395 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4054/8158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:07 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:08.279887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:08.280617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:08.286880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:08.287392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:08.287855 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:08.288571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:08.289055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:08.289506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:08.424073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:08.431810 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4b5d609e-8ca5-4b77-8442-6f68befb31d1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1694 microversion: 2.1 time: 0.157765 Sep 13 17:56:08.432923 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4105/8159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:08 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:09.456561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:09.457187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:09.464110 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.464601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.465038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.465744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.466233 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.466663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.603119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:09.611759 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed9a0af1-c8fb-456d-880b-748374afa4ad tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1691 microversion: 2.1 time: 0.159119 Sep 13 17:56:09.612363 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4055/8160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:09 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:09.716096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:56:09.716693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:09.723574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.724094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.724557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.725278 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.725759 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.726353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.792587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8472e87e-7ee5-4ccc-bc8f-902159a8081d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action" status: 204 len: 0 microversion: 2.1 time: 0.079934 Sep 13 17:56:09.793168 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4106/8161] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:56:09 2022] POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:56:09.801963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:09.802553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:09.808938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.809517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.810393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.811249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.811718 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.812238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.955346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:09.963768 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55782108-3d0f-4b4d-8571-d5447a1e0d82 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1691 microversion: 2.1 time: 0.165925 Sep 13 17:56:09.965236 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4056/8162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:09 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:09.988168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:09.988896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:09.995447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.995969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.996428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:09.997147 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:09.997629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:09.998115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:10.221179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:10.229291 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ae334e16-9060-40ce-979c-602b72e44363 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1691 microversion: 2.1 time: 0.245648 Sep 13 17:56:10.229892 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4107/8163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:09 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:11.254287 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:11.255089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:11.262804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:11.263292 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:11.263732 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:11.264465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:11.265045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:11.266097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:11.409255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:11.417441 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d87ae611-9cf0-4160-8742-fa9d4b73e27a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1683 microversion: 2.1 time: 0.168086 Sep 13 17:56:11.418071 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4057/8164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:11 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:56:12.621986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a2472af1-78be-465b-83d1-040515cd823e req-98ce67fb-13b0-4d43-9084-a081c9328e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "name": "network-vif-plugged", "status": "completed", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:56:12.636864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a2472af1-78be-465b-83d1-040515cd823e req-98ce67fb-13b0-4d43-9084-a081c9328e21 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:12.637383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a2472af1-78be-465b-83d1-040515cd823e req-98ce67fb-13b0-4d43-9084-a081c9328e21 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:12.637862 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a2472af1-78be-465b-83d1-040515cd823e req-98ce67fb-13b0-4d43-9084-a081c9328e21 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:12.650016 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a2472af1-78be-465b-83d1-040515cd823e req-98ce67fb-13b0-4d43-9084-a081c9328e21 service nova] Creating event network-vif-plugged:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h1-857467-1 Sep 13 17:56:12.657384 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a2472af1-78be-465b-83d1-040515cd823e req-98ce67fb-13b0-4d43-9084-a081c9328e21 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040988 Sep 13 17:56:12.658329 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4108/8165] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:56:41.632247 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:56:41.634588 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:41.637195 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=28 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:41.638043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:41.643419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:41.643912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:41.644355 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:41.645061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:41.645557 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:41.646053 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:41.712481 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-876b6f54-ef22-46fa-bc1e-bf1979123386 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action" status: 200 len: 24580 microversion: 2.1 time: 0.084003 Sep 13 17:56:41.713089 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4058/8166] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:56:41 2022] POST /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192/action => generated 24580 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:56:59.315773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=26 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:59.316557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:59.319101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-0332f341-d166-4c6e-82e3-0f220c7e74a0 req-01d596de-c6ca-44e0-9c0d-d9647b78830e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:56:59.320982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:59.321593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:59.328958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:59.329635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:56:59.330401 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:59.330922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:59.331402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:59.332048 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0332f341-d166-4c6e-82e3-0f220c7e74a0 req-01d596de-c6ca-44e0-9c0d-d9647b78830e service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:59.332181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:59.332681 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:59.332831 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0332f341-d166-4c6e-82e3-0f220c7e74a0 req-01d596de-c6ca-44e0-9c0d-d9647b78830e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:59.333100 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:59.333217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-0332f341-d166-4c6e-82e3-0f220c7e74a0 req-01d596de-c6ca-44e0-9c0d-d9647b78830e service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:59.347775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-0332f341-d166-4c6e-82e3-0f220c7e74a0 req-01d596de-c6ca-44e0-9c0d-d9647b78830e service nova] Creating event network-changed:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h1-857467-1 Sep 13 17:56:59.353117 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-0332f341-d166-4c6e-82e3-0f220c7e74a0 req-01d596de-c6ca-44e0-9c0d-d9647b78830e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038383 Sep 13 17:56:59.353649 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4059/8167] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:56:59.364001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:56:59.457514 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-edad0c90-d993-45e5-ab46-4752e728e211 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 204 len: 0 microversion: 2.1 time: 0.144594 Sep 13 17:56:59.458706 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4109/8168] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:56:59 2022] DELETE /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:56:59.469035 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:56:59.470252 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:56:59.478860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:59.479503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:59.480738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:59.481863 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:56:59.482523 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:56:59.483147 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:56:59.630358 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:56:59.640017 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f976deae-327d-4a66-a019-d548f3e148d2 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1689 microversion: 2.1 time: 0.176711 Sep 13 17:56:59.640791 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4060/8169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:56:59 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:57:00.665184 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:00.665941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:00.673031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:00.673608 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:00.674104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:00.674833 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:00.675319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:00.676020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:00.853786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:00.861612 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ebc8fd57-62d2-4b10-ab0a-e2048b12485b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1689 microversion: 2.1 time: 0.200810 Sep 13 17:57:00.862210 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4110/8170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:00 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:01.520162 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-92f555fc-4ae7-4911-8014-45c49da8a3f9 req-11bc5e8f-741a-46bf-b1e6-998656288a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d0b040-2503-40f5-83eb-7e38dafd6192", "name": "network-vif-deleted", "tag": "5b8f61b4-2aee-4196-9544-248717ea99b2"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:57:01.531341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-92f555fc-4ae7-4911-8014-45c49da8a3f9 req-11bc5e8f-741a-46bf-b1e6-998656288a5a service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:01.531827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-92f555fc-4ae7-4911-8014-45c49da8a3f9 req-11bc5e8f-741a-46bf-b1e6-998656288a5a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:01.532268 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-92f555fc-4ae7-4911-8014-45c49da8a3f9 req-11bc5e8f-741a-46bf-b1e6-998656288a5a service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:01.544118 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-92f555fc-4ae7-4911-8014-45c49da8a3f9 req-11bc5e8f-741a-46bf-b1e6-998656288a5a service nova] Creating event network-vif-deleted:5b8f61b4-2aee-4196-9544-248717ea99b2 for instance 69d0b040-2503-40f5-83eb-7e38dafd6192 on n-h1-857467-1 Sep 13 17:57:01.550845 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-92f555fc-4ae7-4911-8014-45c49da8a3f9 req-11bc5e8f-741a-46bf-b1e6-998656288a5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033700 Sep 13 17:57:01.551476 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4061/8171] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:57:01.888069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:01.888819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:01.895935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:01.896522 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:01.897040 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:01.897863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:01.898413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:01.898871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:01.937948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:01.938445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:01.938910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:01.939399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lazy-loading 'fault' on Instance uuid 69d0b040-2503-40f5-83eb-7e38dafd6192 {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:57:01.985163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:01.993518 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1e11a84d-405d-42fe-a1fa-7dc63a228d91 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 200 len: 1356 microversion: 2.1 time: 0.110163 Sep 13 17:57:01.994118 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4111/8172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:01 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:03.018027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:03.018748 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 69d0b040-2503-40f5-83eb-7e38dafd6192] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:03.025853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:03.026364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:03.027447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:03.028156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:03.028629 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:03.029073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:03.043117 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] HTTP exception thrown: Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 could not be found. Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Request method failure captured: Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 HTTP/1.1 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMLRG4AwEZ8CfUkq0lipC59vawLMNS4uWY3q9gN_s2DoQH_LKoO9qoHhpAx55JxfHRq8QXMjPT36o-z2kgRTMCue4P6PYTgx35S8ZpL-jmRMsM8i9aa4sflLoseOnHs22e1-HZ_K_aEZA-XokTsdeKaZnHNDEk5cz14rIbJhqUukVtU Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: d09a323c97974562b5f2278ebf558e86 Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 could not be found. Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '69d0b040-2503-40f5-83eb-7e38dafd6192'} Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 could not be found. Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 could not be found. Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:57:03.044741 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 could not be found. Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Returning 404 to user: Instance 69d0b040-2503-40f5-83eb-7e38dafd6192 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0a4f8e6a-1132-4298-a57d-c7dd76a2ec55 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192" status: 404 len: 111 microversion: 2.1 time: 0.032541 Sep 13 17:57:03.050075 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4062/8173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:03 2022] GET /compute/v2.1/servers/69d0b040-2503-40f5-83eb-7e38dafd6192 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:57:06.397882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b54976b-7d1f-49d6-9b4e-ef59c0378875 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '.version_select at 0x7fbeb4504ee0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:06.420326 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b54976b-7d1f-49d6-9b4e-ef59c0378875 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1382695788" status: 202 len: 0 microversion: 2.1 time: 0.026193 Sep 13 17:57:06.421019 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4112/8174] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Sep 13 17:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1382695788 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:57:06.450589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fcea4524-b93f-4a43-9eb4-56fff0489dd3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: .version_select at 0x7fbeb45c6430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1769899282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLv0MpgIiQRva4ORN7MjkvylCpOzqLCVVYXCXJzWGTSxrNkBIkhjREqKZWHf6ZeGInOfZEnkuuSGqQ5UeM9/9ntLb5X20yHbsJPrdnnADoygb+0QLIUxBCiK+U83P9BlAg=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:57:06.471127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-fcea4524-b93f-4a43-9eb4-56fff0489dd3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:57:06.476349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-fcea4524-b93f-4a43-9eb4-56fff0489dd3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:57:06.490771 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fcea4524-b93f-4a43-9eb4-56fff0489dd3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [de99044e-09cb-488b-ae7e-aa33529f8677] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:57:07.499032 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-fcea4524-b93f-4a43-9eb4-56fff0489dd3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [de99044e-09cb-488b-ae7e-aa33529f8677] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40824. Sep 13 17:57:07.513646 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fcea4524-b93f-4a43-9eb4-56fff0489dd3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.067919 Sep 13 17:57:07.514304 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4063/8175] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:57:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:57:13.203022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:57:13.207207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1775952092", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "3c0788f2-0822-45ec-9caa-b94489d24d60"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1769899282", "security_groups": [{"name": "tempest-secgroup-smoke-1138767548"}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:57:13.328259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] validate_networks() for [('3c0788f2-0822-45ec-9caa-b94489d24d60', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:57:13.764939 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:57:13.765439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:57:13.765963 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:57:13.766399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:57:13.766850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:57:13.776105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:13.776667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:13.776667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:13.777810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:13.778313 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:13.778758 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:13.800186 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:57:13.806630 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:57:13.824753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:57:13.827276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:57:13.874923 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [07f25004-ee35-400b-9102-92c166390e75] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:57:14.888735 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [07f25004-ee35-400b-9102-92c166390e75] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40874. Sep 13 17:57:14.894365 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8e74cf48-37ba-4d13-aeae-2ca647ec4b06 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.692980 Sep 13 17:57:14.895030 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4113/8176] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:57:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:57:14.907149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-77405191-a92f-4bac-91f5-d94d6a244437 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:14.907899 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-77405191-a92f-4bac-91f5-d94d6a244437 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:14.911043 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:57:14.970433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-77405191-a92f-4bac-91f5-d94d6a244437 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:14.981188 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-77405191-a92f-4bac-91f5-d94d6a244437 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1267 microversion: 2.1 time: 0.077948 Sep 13 17:57:14.981790 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4064/8177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:14 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:16.005306 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:16.006197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:16.014756 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:16.015372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:16.015915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:16.016850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:16.017413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:16.017971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:16.096566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:16.104953 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-64693178-e811-4ac7-941a-eff26e638cff tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1327 microversion: 2.1 time: 0.103415 Sep 13 17:57:16.110747 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4114/8178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:15 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:17.128643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:17.129164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:17.136483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:17.137301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:17.137753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:17.138496 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:17.138965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:17.139410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:17.276844 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:17.284953 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7dc4c5c0-4e3b-48dc-b9a9-f24b0f7a83f6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.160300 Sep 13 17:57:17.285540 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4065/8179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:17 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:17.605331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-10259b84-8255-4cba-aba2-246e770b8beb req-9d3a33f8-ed75-4e5c-8c18-89284a994df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eeac4c9-8f92-445c-8cb6-8346944f0952", "tag": "d73d5580-fd94-43b3-8514-29d380c5a9bf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:57:17.615792 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-10259b84-8255-4cba-aba2-246e770b8beb req-9d3a33f8-ed75-4e5c-8c18-89284a994df4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:17.616399 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-10259b84-8255-4cba-aba2-246e770b8beb req-9d3a33f8-ed75-4e5c-8c18-89284a994df4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:17.616851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-10259b84-8255-4cba-aba2-246e770b8beb req-9d3a33f8-ed75-4e5c-8c18-89284a994df4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:17.632475 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-10259b84-8255-4cba-aba2-246e770b8beb req-9d3a33f8-ed75-4e5c-8c18-89284a994df4 service nova] Creating event network-changed:d73d5580-fd94-43b3-8514-29d380c5a9bf for instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 on n-h2-857467-1 Sep 13 17:57:17.637617 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-10259b84-8255-4cba-aba2-246e770b8beb req-9d3a33f8-ed75-4e5c-8c18-89284a994df4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036599 Sep 13 17:57:17.638263 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4115/8180] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:57:18.309379 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:18.309988 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:18.317101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:18.317596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:18.318145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:18.318850 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:18.319325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:18.319765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:18.457808 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:18.467820 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-077339fc-9b70-48eb-b699-f0d545fa9cf7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.162041 Sep 13 17:57:18.468429 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4066/8181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:18 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:19.491241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:19.491971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:19.499295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:19.499808 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:19.500275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:19.500998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:19.501481 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:19.501960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:19.632530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:19.640948 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-98a741d5-19d4-4fc9-8bd8-b1d60458f8d7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.154107 Sep 13 17:57:19.641535 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4116/8182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:19 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:20.664677 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:20.665202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:20.672158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:20.672658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:20.673103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:20.673800 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:20.674290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:20.674727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:20.808214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:20.817070 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-006321b0-1005-491e-be23-52edf954597c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.156407 Sep 13 17:57:20.817648 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4067/8183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:20 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:21.843446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:21.844082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:21.851351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:21.851869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:21.852332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:21.853056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:21.853538 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:21.854037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:21.991975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:21.999948 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-38fefed8-d5fe-4f2e-bb7a-08923800f8d8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.161083 Sep 13 17:57:22.000538 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4117/8184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:21 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:23.023796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:23.024476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:23.026295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-417aa81d-c402-415f-8c15-b0e2f337eea9 req-84cb0865-2ee6-467c-b569-6bfb44d3a841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eeac4c9-8f92-445c-8cb6-8346944f0952", "name": "network-vif-plugged", "status": "completed", "tag": "d73d5580-fd94-43b3-8514-29d380c5a9bf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:57:23.032767 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:23.033350 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:23.033910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:23.034751 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:23.035220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:23.035749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:23.037968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-417aa81d-c402-415f-8c15-b0e2f337eea9 req-84cb0865-2ee6-467c-b569-6bfb44d3a841 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:23.038463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-417aa81d-c402-415f-8c15-b0e2f337eea9 req-84cb0865-2ee6-467c-b569-6bfb44d3a841 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:23.038926 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-417aa81d-c402-415f-8c15-b0e2f337eea9 req-84cb0865-2ee6-467c-b569-6bfb44d3a841 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:23.056174 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-417aa81d-c402-415f-8c15-b0e2f337eea9 req-84cb0865-2ee6-467c-b569-6bfb44d3a841 service nova] Creating event network-vif-plugged:d73d5580-fd94-43b3-8514-29d380c5a9bf for instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 on n-h2-857467-1 Sep 13 17:57:23.066650 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-417aa81d-c402-415f-8c15-b0e2f337eea9 req-84cb0865-2ee6-467c-b569-6bfb44d3a841 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044387 Sep 13 17:57:23.067366 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4118/8185] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:57:23.183321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:23.192214 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3d5e0f1b-7cdd-4112-9029-9fc6cbb30b24 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.172458 Sep 13 17:57:23.192799 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4068/8186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:23 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:24.212564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:57:24.213382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:57:24.219382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:24.220144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:24.227297 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:24.227802 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:24.228265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:24.228984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:24.229470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:24.229966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:24.364683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:24.372936 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a0680fb7-6b83-4447-b79c-309dafa0d258 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1393 microversion: 2.1 time: 0.161328 Sep 13 17:57:24.373569 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4119/8187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:24 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:25.396824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:25.397468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:25.400454 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:57:25.406470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:25.406960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:25.407408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:25.408106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:25.408604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:25.409036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:25.541026 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:25.549633 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-93a8fb7e-545b-41c8-b337-ed2853a76c97 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1566 microversion: 2.1 time: 0.157017 Sep 13 17:57:25.550253 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4069/8188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:25 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:25.572087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:25.572726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:25.579659 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:25.580167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:25.580627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:25.581353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:25.581902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:25.582305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:25.718428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:25.726332 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-908faf3e-a1ce-46a5-a29a-f624ab975e4e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1566 microversion: 2.1 time: 0.158153 Sep 13 17:57:25.726910 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4120/8189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:25 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:57:27.324924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:57:27.325645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:57:27.338283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:27.338887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:27.339345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:27.340056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:27.340591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:27.341101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:27.390439 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-aa31b331-7ff0-49cd-87e0-de4d05617c4e req-c99fc58b-daa0-449e-84e1-792de29f3db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eeac4c9-8f92-445c-8cb6-8346944f0952", "tag": "d73d5580-fd94-43b3-8514-29d380c5a9bf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:57:27.400533 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-aa31b331-7ff0-49cd-87e0-de4d05617c4e req-c99fc58b-daa0-449e-84e1-792de29f3db2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:57:27.401070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-aa31b331-7ff0-49cd-87e0-de4d05617c4e req-c99fc58b-daa0-449e-84e1-792de29f3db2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:57:27.401526 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-aa31b331-7ff0-49cd-87e0-de4d05617c4e req-c99fc58b-daa0-449e-84e1-792de29f3db2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:57:27.413626 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-aa31b331-7ff0-49cd-87e0-de4d05617c4e req-c99fc58b-daa0-449e-84e1-792de29f3db2 service nova] Creating event network-changed:d73d5580-fd94-43b3-8514-29d380c5a9bf for instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 on n-h2-857467-1 Sep 13 17:57:27.419356 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-aa31b331-7ff0-49cd-87e0-de4d05617c4e req-c99fc58b-daa0-449e-84e1-792de29f3db2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088747 Sep 13 17:57:27.420211 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4121/8190] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:57:27.489811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:57:27.499617 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-160de302-d41b-440b-a425-1f85100e87b6 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1566 microversion: 2.1 time: 0.178730 Sep 13 17:57:27.500583 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4070/8191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:57:27 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:02.839916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:58:02.840908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=38 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:58:02.846341 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:58:02.848814 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:02.858047 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:02.858558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:02.859016 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:02.859735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:02.860214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:02.860661 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:02.930844 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2c5a9461-e23e-4329-9225-c1776d612faf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action" status: 200 len: 24559 microversion: 2.1 time: 0.092954 Sep 13 17:58:02.931793 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4122/8192] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:58:02 2022] POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action => generated 24559 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:58:33.173600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:58:33.174386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=36 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:58:33.178636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6b4bf3ca-04b0-435d-97a7-8575f2e215ca tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:58:33.186653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3ca-04b0-435d-97a7-8575f2e215ca tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:33.187399 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3ca-04b0-435d-97a7-8575f2e215ca tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:33.187838 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3ca-04b0-435d-97a7-8575f2e215ca tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:33.210841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6b4bf3ca-04b0-435d-97a7-8575f2e215ca tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Going to try to stop instance {{(pid=122327) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 17:58:33.252320 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6b4bf3ca-04b0-435d-97a7-8575f2e215ca tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action" status: 202 len: 0 microversion: 2.1 time: 0.081263 Sep 13 17:58:33.253004 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4071/8193] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:58:33 2022] POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:58:33.266957 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:33.267981 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:33.270822 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:58:33.271567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:58:33.277444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:33.277984 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:33.278437 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:33.279153 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:33.279713 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:33.280406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:33.416935 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:33.425066 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-203b132d-e5e1-44a5-b1da-c0431af80cfc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.166652 Sep 13 17:58:33.426000 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4123/8194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:33 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:34.453285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:34.454034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:34.463141 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:34.463671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:34.464118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:34.464847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:34.465318 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:34.465759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:34.606756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:34.615313 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6522f37-800d-4f61-ba5f-4c5a2f4d2ef1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.167767 Sep 13 17:58:34.615899 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4072/8195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:34 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:35.641240 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:35.641966 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:35.648996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:35.649510 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:35.649999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:35.650729 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:35.651205 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:35.651652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:35.798483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:35.806147 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-19d2af2f-6c9b-4228-bb42-09343e15c12d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.169460 Sep 13 17:58:35.806720 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4124/8196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:35 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:36.829923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:36.830558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:36.837383 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:36.837904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:36.838347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:36.839046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:36.839508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:36.839938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:36.973787 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:36.981527 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0bb7a2af-569e-41e6-bcae-7df7f996e59d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.156229 Sep 13 17:58:36.982127 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4073/8197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:36 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:38.004912 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:38.005551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:38.012506 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:38.013019 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:38.013484 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:38.014745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:38.015231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:38.015684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:38.147667 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:38.156185 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2d36b404-9651-4030-950b-2558246f9d54 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.155201 Sep 13 17:58:38.156774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4125/8198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:37 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:39.180066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:39.180594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:39.188073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:39.188558 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:39.189000 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:39.189724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:39.190214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:39.190646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:39.324004 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:39.331742 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a1d6a74d-ae96-4806-9dc2-1706cdd2ebcd tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.155693 Sep 13 17:58:39.332318 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4074/8199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:39 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:40.356237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:40.356780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:40.364208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:40.364719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:40.365178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:40.365913 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:40.366392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:40.366840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:40.506035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:40.513782 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-418fafd3-84e8-4c50-bdc2-d1d7b321bf5f tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.161616 Sep 13 17:58:40.514842 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4126/8200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:40 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:41.538164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:41.538783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:41.545803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:41.546315 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:41.546759 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:41.547455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:41.547915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:41.548345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:41.683380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:41.692126 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-150f274d-a6d2-425b-ae27-1cbe66f6a0db tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.157859 Sep 13 17:58:41.692712 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4075/8201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:41 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:42.716971 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:42.718233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:42.725071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:42.725569 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:42.726055 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:42.726757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:42.727231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:42.727677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:42.864299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:42.872201 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3e6841d5-1e70-47ca-94ce-422b7b2631c3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1694 microversion: 2.1 time: 0.159263 Sep 13 17:58:42.872774 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4127/8202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:42 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:43.896772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:43.897388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:43.904448 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:43.904937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:43.905381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:43.906116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:43.906591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:43.907031 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:44.041417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:44.050071 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-89c1aeb1-5c45-4a15-9229-1825824c3077 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1671 microversion: 2.1 time: 0.157379 Sep 13 17:58:44.050666 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4076/8203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:43 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:58:45.147082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:58:45.149434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:45.156995 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:45.157566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:45.161216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:45.161216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:45.161216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:45.161216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:45.224813 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7c4dfdb1-f8a0-46e2-9cf3-6997d3989fe1 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action" status: 200 len: 38414 microversion: 2.1 time: 0.081522 Sep 13 17:58:45.225485 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4128/8204] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:58:45 2022] POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action => generated 38414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:58:45.237579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-cbce09ed-0e24-452f-8ddf-8b69a4ed26f3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:58:45.244250 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbce09ed-0e24-452f-8ddf-8b69a4ed26f3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:45.244734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbce09ed-0e24-452f-8ddf-8b69a4ed26f3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:45.245177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-cbce09ed-0e24-452f-8ddf-8b69a4ed26f3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:45.268156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-cbce09ed-0e24-452f-8ddf-8b69a4ed26f3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Going to try to start instance {{(pid=122327) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 17:58:45.313544 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-cbce09ed-0e24-452f-8ddf-8b69a4ed26f3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action" status: 202 len: 0 microversion: 2.1 time: 0.079553 Sep 13 17:58:45.314493 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4077/8205] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:58:45 2022] POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:58:45.323192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:45.323987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:45.332732 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:45.333327 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:45.333794 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:45.334584 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:45.335606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:45.335763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:45.534844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:45.542760 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6356cadc-d3e1-46bb-9315-215b09fc9779 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1680 microversion: 2.1 time: 0.223917 Sep 13 17:58:45.543350 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4129/8206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:45 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 17:58:46.569959 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:58:46.570684 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:58:46.577673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:46.578263 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:46.578726 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:46.579457 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:58:46.579933 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:58:46.580348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:58:46.720367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:58:46.728178 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-62e620ea-05cf-452c-9659-ed9ac10cc1e9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1684 microversion: 2.1 time: 0.164052 Sep 13 17:58:46.728749 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4078/8207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:58:46 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:59:18.953084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:59:18.955317 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:18.958233 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=14 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:18.958920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=40 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:18.964834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:18.965344 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:18.965803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:18.966543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:18.967023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:18.967471 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:19.039374 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-65351698-237d-4d09-9d88-6fd73fc559d0 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action" status: 200 len: 62975 microversion: 2.1 time: 0.090264 Sep 13 17:59:19.040046 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4130/8208] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 17:59:18 2022] POST /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952/action => generated 62975 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 17:59:42.908768 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:42.909320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:42.911133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-68da7eb5-2e8d-40aa-be0f-491e9746bc39 req-a2673b7c-95ce-4e74-bdb7-35e323b683c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eeac4c9-8f92-445c-8cb6-8346944f0952", "tag": "d73d5580-fd94-43b3-8514-29d380c5a9bf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:59:42.913071 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=16 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:42.913927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:42.916999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:42.917728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:42.918330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:42.918829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:42.919278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:42.919991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:42.920460 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:42.920894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:42.931285 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 17:59:42.931695 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 17:59:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 13 17:59:42.943292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-68da7eb5-2e8d-40aa-be0f-491e9746bc39 req-a2673b7c-95ce-4e74-bdb7-35e323b683c1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:42.943797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-68da7eb5-2e8d-40aa-be0f-491e9746bc39 req-a2673b7c-95ce-4e74-bdb7-35e323b683c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:42.944470 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-68da7eb5-2e8d-40aa-be0f-491e9746bc39 req-a2673b7c-95ce-4e74-bdb7-35e323b683c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:42.949418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 17:59:42.957014 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-68da7eb5-2e8d-40aa-be0f-491e9746bc39 req-a2673b7c-95ce-4e74-bdb7-35e323b683c1 service nova] Creating event network-changed:d73d5580-fd94-43b3-8514-29d380c5a9bf for instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 on n-h2-857467-1 Sep 13 17:59:42.962399 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-68da7eb5-2e8d-40aa-be0f-491e9746bc39 req-a2673b7c-95ce-4e74-bdb7-35e323b683c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055701 Sep 13 17:59:42.964030 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4131/8209] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 17:59:43.050621 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-343b5785-6c27-4161-b983-0d5161137501 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 204 len: 0 microversion: 2.1 time: 0.145830 Sep 13 17:59:43.051825 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4079/8210] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 17:59:42 2022] DELETE /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 17:59:43.068959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:43.069694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:43.076757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:43.077272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:43.077733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:43.078597 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:43.079077 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:43.079529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:43.221311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:59:43.229140 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fc25858c-a558-4ae6-b535-84f59116463b tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1690 microversion: 2.1 time: 0.171131 Sep 13 17:59:43.229728 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4132/8211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:59:43 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:59:44.254937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:44.255647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:44.262829 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:44.263317 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:44.263762 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:44.264466 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:44.264929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:44.265365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:44.408349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:59:44.416807 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c9b3c17c-edce-4a43-879e-2050d7785803 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1690 microversion: 2.1 time: 0.167616 Sep 13 17:59:44.417618 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4080/8212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:59:44 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:59:45.322881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-51acdaa6-6dcd-4539-90d7-5346b268db20 req-ed2f579d-6511-485d-91ff-04793c112764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eeac4c9-8f92-445c-8cb6-8346944f0952", "name": "network-vif-deleted", "tag": "d73d5580-fd94-43b3-8514-29d380c5a9bf"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:59:45.336911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-51acdaa6-6dcd-4539-90d7-5346b268db20 req-ed2f579d-6511-485d-91ff-04793c112764 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:45.337519 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-51acdaa6-6dcd-4539-90d7-5346b268db20 req-ed2f579d-6511-485d-91ff-04793c112764 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:45.338083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-51acdaa6-6dcd-4539-90d7-5346b268db20 req-ed2f579d-6511-485d-91ff-04793c112764 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:45.352200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-51acdaa6-6dcd-4539-90d7-5346b268db20 req-ed2f579d-6511-485d-91ff-04793c112764 service nova] Creating event network-vif-deleted:d73d5580-fd94-43b3-8514-29d380c5a9bf for instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 on n-h2-857467-1 Sep 13 17:59:45.358991 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-51acdaa6-6dcd-4539-90d7-5346b268db20 req-ed2f579d-6511-485d-91ff-04793c112764 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040159 Sep 13 17:59:45.359730 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4133/8213] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 17:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:59:45.442560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:45.443197 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:45.449919 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:45.450415 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:45.450860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:45.451562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:45.452046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:45.452470 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:45.484361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:45.485785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:45.486289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:45.486754 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lazy-loading 'fault' on Instance uuid 2eeac4c9-8f92-445c-8cb6-8346944f0952 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 17:59:45.529650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:59:45.537596 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-21769687-b798-4c38-96e2-93a43186814c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 200 len: 1357 microversion: 2.1 time: 0.099866 Sep 13 17:59:45.538532 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4081/8214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:59:45 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:59:46.564179 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:46.564920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 2eeac4c9-8f92-445c-8cb6-8346944f0952] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:46.571131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:46.571631 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:46.572085 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:46.572787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:46.573258 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:46.573700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:46.587643 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] HTTP exception thrown: Instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 could not be found. Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Request method failure captured: Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 HTTP/1.1 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMLRG4AwEZ8CfUkq0lipC59vawLMNS4uWY3q9gN_s2DoQH_LKoO9qoHhpAx55JxfHRq8QXMjPT36o-z2kgRTMCue4P6PYTgx35S8ZpL-jmRMsM8i9aa4sflLoseOnHs22e1-HZ_K_aEZA-XokTsdeKaZnHNDEk5cz14rIbJhqUukVtU Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d09a323c97974562b5f2278ebf558e86 Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 could not be found. Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '2eeac4c9-8f92-445c-8cb6-8346944f0952'} Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 could not be found. Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 could not be found. Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:59:46.589319 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 could not be found. Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Returning 404 to user: Instance 2eeac4c9-8f92-445c-8cb6-8346944f0952 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e30b8f5-83f8-4eb5-99e0-568120bf4bdf tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952" status: 404 len: 111 microversion: 2.1 time: 0.032670 Sep 13 17:59:46.594851 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4134/8215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:59:46 2022] GET /compute/v2.1/servers/2eeac4c9-8f92-445c-8cb6-8346944f0952 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 17:59:50.309467 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-273de095-b8cb-4d77-9477-c2a0d5ba8416 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '.version_select at 0x7fbeaff665e0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:50.333977 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-273de095-b8cb-4d77-9477-c2a0d5ba8416 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1769899282" status: 202 len: 0 microversion: 2.1 time: 0.028261 Sep 13 17:59:50.335111 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4082/8216] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Sep 13 17:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1769899282 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 17:59:50.367167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-859769c4-481e-46f4-a715-b01053ec595e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: .version_select at 0x7fbeb4162ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1872803795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4kPrCKT+tcDVqgNklgYkvd0Dals1OYXcqZhpmJDDCwkNNMlMyBn6hA6dVB89N5PI2zo8LNmWjzlwQqtMJdeYoPBJ9IfkE8klbGEfheOngMnKeW+B+/zKqJYOC86NwDrA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:59:50.386168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-859769c4-481e-46f4-a715-b01053ec595e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:59:50.393165 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-859769c4-481e-46f4-a715-b01053ec595e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:59:50.419682 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-859769c4-481e-46f4-a715-b01053ec595e tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057614 Sep 13 17:59:50.420307 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4135/8217] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 17:59:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 17:59:55.945123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:55.950391 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-546704260", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "networks": [{"uuid": "dcc5f032-e0e8-4db4-ac0d-39a003c939fe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1872803795", "security_groups": [{"name": "tempest-secgroup-smoke-648050481"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 17:59:56.092245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] validate_networks() for [('dcc5f032-e0e8-4db4-ac0d-39a003c939fe', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 17:59:56.605309 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 17:59:56.605734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 17:59:56.607242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 17:59:56.608226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 17:59:56.608665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 17:59:56.623847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:56.624346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:56.624792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:56.626145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:56.626944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:56.627372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:56.659245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 17:59:56.665078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Getting quotas for user d09a323c97974562b5f2278ebf558e86 and project 22ba83cecdd44bd7a37d69600a2940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 17:59:56.679094 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 17:59:56.681638 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 17:59:56.732923 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 17:59:57.745804 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [e8afdd5e-d8b8-47d0-b1b9-50f08b4d90bd] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41090. Sep 13 17:59:57.756883 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7cb0039a-78e3-4e73-8930-b037167693c9 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.813690 Sep 13 17:59:57.757652 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4083/8218] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 17:59:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 17:59:57.767043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 17:59:57.772093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7d287e35-aab4-4b4e-a5d2-3a9ef2cd2869 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:57.773355 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7d287e35-aab4-4b4e-a5d2-3a9ef2cd2869 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:57.839032 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7d287e35-aab4-4b4e-a5d2-3a9ef2cd2869 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:59:57.846980 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7d287e35-aab4-4b4e-a5d2-3a9ef2cd2869 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1266 microversion: 2.1 time: 0.081853 Sep 13 17:59:57.847666 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4136/8219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:59:57 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 17:59:58.872536 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 17:59:58.873168 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 17:59:58.880327 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:58.880828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:58.881385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:58.882244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 17:59:58.882897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 17:59:58.883442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 17:59:58.973411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 17:59:58.981716 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0172bee3-3b53-4ce9-99e5-4a4ca91d37c7 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1326 microversion: 2.1 time: 0.114677 Sep 13 17:59:58.982351 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4084/8220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 17:59:58 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:00:00.008350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:00.009177 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:00.017365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:00.018063 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:00.018787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:00.019762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:00.020351 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:00.020978 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:00.163671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:00.171618 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-10aa53b7-951d-469f-a770-46b1bd16279d tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.167145 Sep 13 18:00:00.172683 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4137/8221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:00 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:00.468897 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a6bbf922-8f26-4e67-955c-ee7a2487d0cf req-ef730b60-b231-4d3b-b0d5-8507ec51c567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166ab052-ea18-46b3-843c-a798152af35f", "tag": "a0b6b77a-d633-4dea-b518-037d26f0130e"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:00:00.482455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a6bbf922-8f26-4e67-955c-ee7a2487d0cf req-ef730b60-b231-4d3b-b0d5-8507ec51c567 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:00.482944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a6bbf922-8f26-4e67-955c-ee7a2487d0cf req-ef730b60-b231-4d3b-b0d5-8507ec51c567 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:00.483392 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a6bbf922-8f26-4e67-955c-ee7a2487d0cf req-ef730b60-b231-4d3b-b0d5-8507ec51c567 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:00.499288 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a6bbf922-8f26-4e67-955c-ee7a2487d0cf req-ef730b60-b231-4d3b-b0d5-8507ec51c567 service nova] Creating event network-changed:a0b6b77a-d633-4dea-b518-037d26f0130e for instance 166ab052-ea18-46b3-843c-a798152af35f on n-h1-857467-1 Sep 13 18:00:00.505339 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a6bbf922-8f26-4e67-955c-ee7a2487d0cf req-ef730b60-b231-4d3b-b0d5-8507ec51c567 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040211 Sep 13 18:00:00.506035 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4085/8222] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:00:01.195727 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:01.196299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:01.203888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:01.204397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:01.204854 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:01.205561 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:01.206065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:01.206508 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:01.340460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:01.348763 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-461819a4-7b3d-4f45-99cd-de63a5ec4feb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.157091 Sep 13 18:00:01.349337 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4138/8223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:01 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:02.371393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:02.372097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:02.379258 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:02.379743 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:02.380186 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:02.380885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:02.381345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:02.381778 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:02.511713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:02.519864 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3e1d461d-07a5-42d7-9bc5-05cf66fbbfd4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.152789 Sep 13 18:00:02.520452 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4086/8224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:02 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:03.543571 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:03.544128 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:03.551104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:03.551611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:03.552062 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:03.552770 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:03.553242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:03.553683 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:03.685996 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:03.694216 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1135eb06-2ab2-4983-b119-7d261318902a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.154767 Sep 13 18:00:03.694797 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4139/8225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:03 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:04.718181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:04.719082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:04.725671 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:04.726188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:04.726634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:04.727331 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:04.727790 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:04.728248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:04.861546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:04.869478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-f32497a1-6455-4e61-aecc-b74b2c5db892 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.155276 Sep 13 18:00:04.870097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4087/8226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:04 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:05.893456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:05.894129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:05.901106 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:05.901616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:05.902460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:05.903185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:05.903668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:05.904117 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:06.037441 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:06.045205 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ba835c77-4ac8-4692-8cc6-6215d7d32a66 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.156536 Sep 13 18:00:06.045798 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4140/8227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:05 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:07.069047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:07.069670 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:07.072570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:00:07.073280 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:00:07.079322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:07.079816 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:07.080260 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:07.080969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:07.081441 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:07.081905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:07.222870 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:07.230688 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ac33b65f-978d-4dbf-bc86-3915da4fa7f8 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.165553 Sep 13 18:00:07.231270 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4088/8228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:07 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:07.843610 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:00:07.917798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1425f2a6-4594-4e01-85b7-4795ac0e3e09 req-bb236378-739b-4ec3-957b-fde5f4309f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166ab052-ea18-46b3-843c-a798152af35f", "name": "network-vif-plugged", "status": "completed", "tag": "a0b6b77a-d633-4dea-b518-037d26f0130e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:00:07.929265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1425f2a6-4594-4e01-85b7-4795ac0e3e09 req-bb236378-739b-4ec3-957b-fde5f4309f99 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:07.929763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1425f2a6-4594-4e01-85b7-4795ac0e3e09 req-bb236378-739b-4ec3-957b-fde5f4309f99 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:07.930316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1425f2a6-4594-4e01-85b7-4795ac0e3e09 req-bb236378-739b-4ec3-957b-fde5f4309f99 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:07.945565 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1425f2a6-4594-4e01-85b7-4795ac0e3e09 req-bb236378-739b-4ec3-957b-fde5f4309f99 service nova] Creating event network-vif-plugged:a0b6b77a-d633-4dea-b518-037d26f0130e for instance 166ab052-ea18-46b3-843c-a798152af35f on n-h1-857467-1 Sep 13 18:00:07.950718 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1425f2a6-4594-4e01-85b7-4795ac0e3e09 req-bb236378-739b-4ec3-957b-fde5f4309f99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116390 Sep 13 18:00:07.951352 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4141/8229] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:00:08.254917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:08.255544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:08.262431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:08.262923 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:08.263366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:08.264067 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:08.264528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:08.264963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:08.400717 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:08.409235 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1cfe6e51-83a2-4cd3-bc81-b0a91024d68c tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.158885 Sep 13 18:00:08.409845 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4089/8230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:08 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:09.434176 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:09.434810 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:09.441898 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:09.442408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:09.442864 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:09.443606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:09.444088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:09.444534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:09.585277 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:09.593073 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5dd1fe89-7fa0-44f4-9880-087a198bb020 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1391 microversion: 2.1 time: 0.164247 Sep 13 18:00:09.593656 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4142/8231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:09 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:10.616922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:10.617544 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:10.624431 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:10.624927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:10.625621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:10.626340 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:10.626809 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:10.627244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:10.762858 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:10.770846 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-401c109d-3fe2-4f69-b5cb-545eecf386cb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1564 microversion: 2.1 time: 0.157944 Sep 13 18:00:10.771378 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4090/8232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:10 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:10.793997 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:10.794635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:10.802621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:10.803131 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:10.803590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:10.804303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:10.804780 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:10.805236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:10.937635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:10.945904 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b425ecc0-bce4-42a6-b7a7-d7873c637e60 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1564 microversion: 2.1 time: 0.155873 Sep 13 18:00:10.946489 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4143/8233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:10 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:12.541882 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:00:12.542530 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:12.549197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-db585038-f79b-4fa7-94e9-e69ccd6079b6 req-36b609cd-7f95-441a-bf07-54a7fdee33c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166ab052-ea18-46b3-843c-a798152af35f", "tag": "a0b6b77a-d633-4dea-b518-037d26f0130e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:00:12.566014 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:12.566524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:12.566972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:12.571002 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db585038-f79b-4fa7-94e9-e69ccd6079b6 req-36b609cd-7f95-441a-bf07-54a7fdee33c7 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:12.571509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db585038-f79b-4fa7-94e9-e69ccd6079b6 req-36b609cd-7f95-441a-bf07-54a7fdee33c7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:12.572465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:12.572949 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:12.573393 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:12.578644 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-db585038-f79b-4fa7-94e9-e69ccd6079b6 req-36b609cd-7f95-441a-bf07-54a7fdee33c7 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:12.601450 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-db585038-f79b-4fa7-94e9-e69ccd6079b6 req-36b609cd-7f95-441a-bf07-54a7fdee33c7 service nova] Creating event network-changed:a0b6b77a-d633-4dea-b518-037d26f0130e for instance 166ab052-ea18-46b3-843c-a798152af35f on n-h1-857467-1 Sep 13 18:00:12.611721 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-db585038-f79b-4fa7-94e9-e69ccd6079b6 req-36b609cd-7f95-441a-bf07-54a7fdee33c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066602 Sep 13 18:00:12.612610 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4144/8234] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:00:12.827580 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:00:12.837101 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9c040125-8f53-43a4-80f3-716e21004305 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1564 microversion: 2.1 time: 0.299177 Sep 13 18:00:12.837703 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4091/8235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:00:12 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1564 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:00:44.118542 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:00:44.119312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=40 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:00:44.335742 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:00:44.338271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:00:44.344546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:44.345053 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:44.345499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:44.346338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:00:44.346817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:00:44.347290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:00:44.413972 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-47ce1e22-99f6-4ef8-a985-6b12badbacb4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action" status: 200 len: 24536 microversion: 2.1 time: 0.300364 Sep 13 18:00:44.414545 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4145/8236] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:00:44 2022] POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action => generated 24536 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:01:14.813411 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:14.814447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=46 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:14.818832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:14.819377 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:14.827167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:14.827658 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:14.828103 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:14.828799 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:14.829267 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:14.829702 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:14.854982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lazy-loading 'flavor' on Instance uuid 166ab052-ea18-46b3-843c-a798152af35f {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:01:14.922354 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b960d4f8-dbde-47e6-839a-252d49115921 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action" status: 202 len: 0 microversion: 2.1 time: 0.110917 Sep 13 18:01:14.923013 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4092/8237] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:01:14 2022] POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:01:14.932384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:14.933689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:14.936290 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:14.936968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=4 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:14.943764 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:14.944299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:14.944755 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:14.945474 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:14.945975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:14.946422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:15.196096 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:15.203886 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-214183cd-f6aa-4e43-bc11-ad82954465dc tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1691 microversion: 2.1 time: 0.276074 Sep 13 18:01:15.204471 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4146/8238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:14 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1691 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:16.230654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:16.231365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:16.238999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:16.239480 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:16.239918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:16.240608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:16.241068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:16.241499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:16.429939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:16.437864 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2eae2080-360d-4335-b3e4-8d97a0f2daeb tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1691 microversion: 2.1 time: 0.211497 Sep 13 18:01:16.438445 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4093/8239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:16 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:17.461874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:17.462488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:17.470231 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:17.470741 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:17.471199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:17.471910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:17.472387 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:17.473338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:17.606438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:17.614699 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e09fda9d-c056-4708-be59-cf064cb5ae6a tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1674 microversion: 2.1 time: 0.156548 Sep 13 18:01:17.615287 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4147/8240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:17 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:18.708685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:18.710953 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:18.717584 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:18.718106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:18.718553 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:18.719253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:18.719727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:18.720164 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:18.790200 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3273fc3c-5d14-4b8e-aeb5-c2adc7b1e2a3 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action" status: 200 len: 38085 microversion: 2.1 time: 0.085434 Sep 13 18:01:18.790861 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4094/8241] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:01:18 2022] POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action => generated 38085 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:01:18.803397 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:18.803976 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:18.810892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:18.811398 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:18.811851 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:18.812556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:18.813030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:18.813475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:18.886695 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-732bc7c1-5dcb-436c-beeb-78b5643caebe tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action" status: 202 len: 0 microversion: 2.1 time: 0.087540 Sep 13 18:01:18.887361 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4148/8242] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:01:18 2022] POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:01:18.896373 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:18.897089 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:18.904576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:18.905065 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:18.905507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:18.906236 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:18.906693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:18.907122 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:19.093273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:19.102047 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-35af04da-283c-478e-8bfc-1e5912b127e5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1680 microversion: 2.1 time: 0.210033 Sep 13 18:01:19.102633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4095/8243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:18 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:20.126413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:20.127125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:20.134910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:20.135412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:20.135866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:20.136583 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:20.137058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:20.137503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:20.274122 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:20.281888 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-79197fed-6cd5-4c81-a4e9-3d424549d851 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1680 microversion: 2.1 time: 0.159810 Sep 13 18:01:20.282467 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4149/8244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:20 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:21.307045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:21.307713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:21.314876 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:21.315362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:21.315803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:21.317209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:21.317678 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:21.318138 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:21.458611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:21.466427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5582b87a-4bbb-419c-ba8c-c938fa1fe976 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1683 microversion: 2.1 time: 0.163374 Sep 13 18:01:21.467005 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4096/8245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:21 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:01:21.565098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:21.568318 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:21.575221 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:21.575730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:21.576192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:21.576903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:21.577881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:21.578334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:21.641128 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dfe78056-b1d8-41d1-981f-6d0af71ec121 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action" status: 200 len: 38085 microversion: 2.1 time: 0.080222 Sep 13 18:01:21.641845 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4150/8246] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:01:21 2022] POST /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f/action => generated 38085 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 18:01:22.658427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:22.658965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:22.661275 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-43a6a0fd-a584-4623-834b-1106860ab18b req-23692d90-6318-4b15-92d0-73c4bccd7a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166ab052-ea18-46b3-843c-a798152af35f", "tag": "a0b6b77a-d633-4dea-b518-037d26f0130e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:22.666446 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:22.666945 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:22.667390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:22.668370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:22.668839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:22.669282 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:22.672885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-43a6a0fd-a584-4623-834b-1106860ab18b req-23692d90-6318-4b15-92d0-73c4bccd7a6b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:22.673467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-43a6a0fd-a584-4623-834b-1106860ab18b req-23692d90-6318-4b15-92d0-73c4bccd7a6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:22.674039 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-43a6a0fd-a584-4623-834b-1106860ab18b req-23692d90-6318-4b15-92d0-73c4bccd7a6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:22.685905 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-43a6a0fd-a584-4623-834b-1106860ab18b req-23692d90-6318-4b15-92d0-73c4bccd7a6b service nova] Creating event network-changed:a0b6b77a-d633-4dea-b518-037d26f0130e for instance 166ab052-ea18-46b3-843c-a798152af35f on n-h1-857467-1 Sep 13 18:01:22.692330 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-43a6a0fd-a584-4623-834b-1106860ab18b req-23692d90-6318-4b15-92d0-73c4bccd7a6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035178 Sep 13 18:01:22.694152 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4151/8247] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:01:22.696636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:01:22.783773 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a48f6311-1277-49cd-9a91-a804564d1736 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 204 len: 0 microversion: 2.1 time: 0.128957 Sep 13 18:01:22.785692 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4097/8248] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 18:01:22 2022] DELETE /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:01:22.796211 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:22.797044 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:22.804928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:22.805434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:22.805921 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:22.806641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:22.807457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:22.807911 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:22.953156 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:22.962035 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d1a7c7ef-a94b-47b6-b655-2ee4319eac22 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1689 microversion: 2.1 time: 0.171389 Sep 13 18:01:22.962624 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4152/8249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:22 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:01:23.987976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:23.988996 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:23.997716 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:23.998556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:23.999351 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:24.000241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:24.000720 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:24.001167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:24.232352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:24.240428 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9f6e066c-b8c6-4bea-9f0e-e0a9b906dab5 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1689 microversion: 2.1 time: 0.256776 Sep 13 18:01:24.240940 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4098/8250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:23 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:01:25.189253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-23b01ad4-006a-4a33-b877-e6e0b2da5fa1 req-dc40f12e-6a01-4b92-b557-1df6cd4321ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166ab052-ea18-46b3-843c-a798152af35f", "name": "network-vif-deleted", "tag": "a0b6b77a-d633-4dea-b518-037d26f0130e"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:25.199941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-23b01ad4-006a-4a33-b877-e6e0b2da5fa1 req-dc40f12e-6a01-4b92-b557-1df6cd4321ae service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:25.200447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-23b01ad4-006a-4a33-b877-e6e0b2da5fa1 req-dc40f12e-6a01-4b92-b557-1df6cd4321ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:25.200881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-23b01ad4-006a-4a33-b877-e6e0b2da5fa1 req-dc40f12e-6a01-4b92-b557-1df6cd4321ae service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:25.211858 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-23b01ad4-006a-4a33-b877-e6e0b2da5fa1 req-dc40f12e-6a01-4b92-b557-1df6cd4321ae service nova] Creating event network-vif-deleted:a0b6b77a-d633-4dea-b518-037d26f0130e for instance 166ab052-ea18-46b3-843c-a798152af35f on n-h1-857467-1 Sep 13 18:01:25.216674 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-23b01ad4-006a-4a33-b877-e6e0b2da5fa1 req-dc40f12e-6a01-4b92-b557-1df6cd4321ae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081051 Sep 13 18:01:25.217367 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4153/8251] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:01:25.264839 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:25.265586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:25.273308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:25.273802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:25.274271 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:25.275015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:25.275594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:25.275995 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:25.308837 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:25.309270 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:25.309709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:25.310216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lazy-loading 'fault' on Instance uuid 166ab052-ea18-46b3-843c-a798152af35f {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:01:25.362151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09a323c97974562b5f2278ebf558e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ba83cecdd44bd7a37d69600a2940fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:25.371916 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-60b038c6-1036-4e1a-af40-15569b564b74 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 200 len: 1356 microversion: 2.1 time: 0.111109 Sep 13 18:01:25.372498 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4099/8252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:25 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:26.397369 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:26.398121 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] [instance: 166ab052-ea18-46b3-843c-a798152af35f] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:26.404359 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:26.404865 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:26.405324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:26.406069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:26.406552 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:26.407004 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:26.420976 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] HTTP exception thrown: Instance 166ab052-ea18-46b3-843c-a798152af35f could not be found. Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Request method failure captured: Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f HTTP/1.1 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMLRG4AwEZ8CfUkq0lipC59vawLMNS4uWY3q9gN_s2DoQH_LKoO9qoHhpAx55JxfHRq8QXMjPT36o-z2kgRTMCue4P6PYTgx35S8ZpL-jmRMsM8i9aa4sflLoseOnHs22e1-HZ_K_aEZA-XokTsdeKaZnHNDEk5cz14rIbJhqUukVtU Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/22ba83cecdd44bd7a37d69600a2940fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 22ba83cecdd44bd7a37d69600a2940fa Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1213826295 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: d09a323c97974562b5f2278ebf558e86 Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1213826295-project Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 166ab052-ea18-46b3-843c-a798152af35f could not be found. Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '166ab052-ea18-46b3-843c-a798152af35f'} Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166ab052-ea18-46b3-843c-a798152af35f could not be found. Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166ab052-ea18-46b3-843c-a798152af35f could not be found. Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:01:26.422642 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166ab052-ea18-46b3-843c-a798152af35f could not be found. Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Returning 404 to user: Instance 166ab052-ea18-46b3-843c-a798152af35f could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-16c74d55-a9e1-400c-a92c-67fd97bef2b4 tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f" status: 404 len: 111 microversion: 2.1 time: 0.031961 Sep 13 18:01:26.428668 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4154/8253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:26 2022] GET /compute/v2.1/servers/166ab052-ea18-46b3-843c-a798152af35f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:01:29.718789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e0787a4-742c-4169-8ba9-da7db662a5ab tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] Calling method '.version_select at 0x7fbeb4ad9a60>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:29.746068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e0787a4-742c-4169-8ba9-da7db662a5ab tempest-TestNetworkAdvancedServerOps-1213826295 tempest-TestNetworkAdvancedServerOps-1213826295-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1872803795" status: 202 len: 0 microversion: 2.1 time: 0.030472 Sep 13 18:01:29.750619 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4100/8254] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Sep 13 18:01:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1872803795 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:01:41.399675 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=18 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:41.400588 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:41.587446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-54680049-afa9-4c1c-91e4-cc16400f6876 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'create', calling method: .version_select at 0x7fbeac779820>, body: {"keypair": {"name": "tempest-TestShelveInstance-962647550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYaOmyEn6musXwg3bJ4Tqtbp3Y00QFaoMFfLBdu5kXiACermtVzOzWZgJJVVoA0JQ2NhMd07JAsLrYWJKxi4kkDtz8PX5kH1HD5/6xyqjO6JB3RdGeOIgzofg5TRB4jaw=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:41.604669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-54680049-afa9-4c1c-91e4-cc16400f6876 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for project ea0164701854444abf1c6833cded41dd. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:01:41.612381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-54680049-afa9-4c1c-91e4-cc16400f6876 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for user 116f2c43f41e45f6bf83d482cca2f7d0 and project ea0164701854444abf1c6833cded41dd. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:01:41.639746 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-54680049-afa9-4c1c-91e4-cc16400f6876 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.246284 Sep 13 18:01:41.640371 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4155/8255] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 18:01:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:01:42.646916 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1729152343", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-962647550", "security_groups": [{"name": "tempest-secgroup-smoke-1245718842"}], "networks": [{"uuid": "3a6379ce-3e59-495e-a887-e0fca42319b1"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:42.657126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:42.657776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:42.762121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] validate_networks() for [('3a6379ce-3e59-495e-a887-e0fca42319b1', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:01:43.247175 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:01:43.247607 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:01:43.248117 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:01:43.248537 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:01:43.248952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:01:43.258108 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:43.258604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:43.259047 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:43.259783 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:43.260245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:43.260680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:43.278881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for project ea0164701854444abf1c6833cded41dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:01:43.284199 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for user 116f2c43f41e45f6bf83d482cca2f7d0 and project ea0164701854444abf1c6833cded41dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:01:43.297845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:01:43.300285 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:01:43.349025 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a25f09e9-dda6-40d2-8048-ac239493a142 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706380 Sep 13 18:01:43.350070 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4101/8256] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 18:01:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:01:43.361089 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c90ca780-07ae-4ecb-91d6-2dc35ed8f962 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:43.361874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c90ca780-07ae-4ecb-91d6-2dc35ed8f962 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:43.424488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c90ca780-07ae-4ecb-91d6-2dc35ed8f962 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:43.431933 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c90ca780-07ae-4ecb-91d6-2dc35ed8f962 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1246 microversion: 2.1 time: 0.074669 Sep 13 18:01:43.432835 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4156/8257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:43 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:44.457965 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:44.458635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:44.465845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:44.466354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:44.466911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:44.467860 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:44.468234 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:44.468687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:44.642248 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:44.654752 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-97011328-bccb-4c6f-b572-40da997e9100 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1306 microversion: 2.1 time: 0.200830 Sep 13 18:01:44.656039 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4102/8258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:44 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1306 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:45.679863 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:45.680497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:45.687827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:45.688334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:45.689295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:45.690299 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:45.690776 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:45.691743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:45.835529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:45.843565 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f2bd801e-2337-42a2-a882-0ec207fcd640 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.167819 Sep 13 18:01:45.844154 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4157/8259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:45 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:46.170127 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-b51a72b5-8a24-4c4a-b5ed-33f2f4532183 req-9d4f70a4-cb73-4467-965c-acb501d2f44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:46.183018 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b51a72b5-8a24-4c4a-b5ed-33f2f4532183 req-9d4f70a4-cb73-4467-965c-acb501d2f44c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:46.183747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b51a72b5-8a24-4c4a-b5ed-33f2f4532183 req-9d4f70a4-cb73-4467-965c-acb501d2f44c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:46.184296 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-b51a72b5-8a24-4c4a-b5ed-33f2f4532183 req-9d4f70a4-cb73-4467-965c-acb501d2f44c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:46.206178 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-b51a72b5-8a24-4c4a-b5ed-33f2f4532183 req-9d4f70a4-cb73-4467-965c-acb501d2f44c service nova] Creating event network-changed:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h2-857467-1 Sep 13 18:01:46.212568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-b51a72b5-8a24-4c4a-b5ed-33f2f4532183 req-9d4f70a4-cb73-4467-965c-acb501d2f44c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047166 Sep 13 18:01:46.214027 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4103/8260] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:01:46.869182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:46.869965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:46.877148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:46.877738 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:46.878241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:46.879803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:46.880287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:46.880735 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:47.025901 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:47.034594 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c7cb14b2-bcd0-4292-94cc-153fc6e4b479 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.169275 Sep 13 18:01:47.035189 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4158/8261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:46 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:48.059337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:48.060059 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:48.067298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:48.067793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:48.068237 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:48.068939 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:48.069401 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:48.069865 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:48.208405 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:48.220170 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d204c6f8-ac3e-4675-ada3-08fb3423f53b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.166285 Sep 13 18:01:48.221263 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4104/8262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:48 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:49.244580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:49.245214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:49.252380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:49.252883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:49.253513 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:49.254450 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:49.254924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:49.255372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:49.390866 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:49.399294 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-51f8f5a4-5e99-4cef-a623-bc1af002f5e5 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.158665 Sep 13 18:01:49.399866 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4159/8263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:49 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:50.423060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:50.423685 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:50.430587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:50.431076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:50.431516 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:50.432217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:50.432681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:50.433113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:50.569347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:50.577748 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-351b519f-110f-4a0e-958b-59f1cdaedcdb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.158550 Sep 13 18:01:50.578370 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4105/8264] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:50 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:51.601421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:51.602081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:51.609018 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:51.609515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:51.609992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:51.610700 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:51.611169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:51.611609 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:51.746728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:51.755200 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-32927cda-131f-4288-961f-85d596df2085 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.158464 Sep 13 18:01:51.755788 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4160/8265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:51 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:52.239594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-5e0d2ac7-cb26-400d-8f91-f4ff93cedc0a req-f798fbb3-e98e-4d57-8d68-c2a9dfdeff25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:52.254511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5e0d2ac7-cb26-400d-8f91-f4ff93cedc0a req-f798fbb3-e98e-4d57-8d68-c2a9dfdeff25 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:52.255408 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5e0d2ac7-cb26-400d-8f91-f4ff93cedc0a req-f798fbb3-e98e-4d57-8d68-c2a9dfdeff25 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:52.256174 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-5e0d2ac7-cb26-400d-8f91-f4ff93cedc0a req-f798fbb3-e98e-4d57-8d68-c2a9dfdeff25 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:52.267987 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-5e0d2ac7-cb26-400d-8f91-f4ff93cedc0a req-f798fbb3-e98e-4d57-8d68-c2a9dfdeff25 service nova] Creating event network-vif-plugged:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h2-857467-1 Sep 13 18:01:52.273794 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-5e0d2ac7-cb26-400d-8f91-f4ff93cedc0a req-f798fbb3-e98e-4d57-8d68-c2a9dfdeff25 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038221 Sep 13 18:01:52.274430 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4106/8266] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:01:52.777705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:52.778368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:52.785529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:52.786078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:52.786539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:52.787265 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:52.787733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:52.788212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:52.925844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:52.934360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4c2d65b1-8e39-4259-aa85-29ca11b4d4b4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1372 microversion: 2.1 time: 0.160511 Sep 13 18:01:52.934946 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4161/8267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:52 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:53.956910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:53.957814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:53.962230 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:53.962968 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:53.970118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:53.970589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:53.971025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:53.971712 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:53.972169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:53.972599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:54.107612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:54.116061 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b216142e-4d4d-4db5-9a8a-8a9c9b4aa7f8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1556 microversion: 2.1 time: 0.161028 Sep 13 18:01:54.116674 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4107/8268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:53 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:54.138208 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:01:54.138843 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:01:54.140725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:01:54.147581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:54.148082 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:54.148541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:54.149249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:54.149721 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:54.150188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:54.299264 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:01:54.307692 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3fefe0fe-8223-4476-8e65-f3482bb858a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1556 microversion: 2.1 time: 0.173279 Sep 13 18:01:54.308217 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4162/8269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:01:54 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:01:56.258861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-d0d79470-d7eb-42f1-9ca2-83296c21e8e5 req-52301444-b7df-4090-a10a-015d8ef45a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:01:56.270654 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d0d79470-d7eb-42f1-9ca2-83296c21e8e5 req-52301444-b7df-4090-a10a-015d8ef45a37 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:01:56.271170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d0d79470-d7eb-42f1-9ca2-83296c21e8e5 req-52301444-b7df-4090-a10a-015d8ef45a37 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:01:56.271621 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-d0d79470-d7eb-42f1-9ca2-83296c21e8e5 req-52301444-b7df-4090-a10a-015d8ef45a37 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:01:56.283781 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-d0d79470-d7eb-42f1-9ca2-83296c21e8e5 req-52301444-b7df-4090-a10a-015d8ef45a37 service nova] Creating event network-changed:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h2-857467-1 Sep 13 18:01:56.288877 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-d0d79470-d7eb-42f1-9ca2-83296c21e8e5 req-52301444-b7df-4090-a10a-015d8ef45a37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033651 Sep 13 18:01:56.289539 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4108/8270] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:23.106293 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:04:23.107312 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:04:23.108167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:23.108987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=36 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:23.109986 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:04:23.110161 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action (ip 10.222.0.61) !!! Sep 13 18:04:23.111482 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:04:23.111780 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action (ip 10.222.0.61) !!! Sep 13 18:04:23.114008 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:04:23.114161 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action (ip 10.222.0.61) !!! Sep 13 18:04:23.121289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:23.121878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:23.139251 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:23.139791 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:23.140247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:23.141031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:23.141511 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:23.141993 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:23.168292 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lazy-loading 'flavor' on Instance uuid 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:04:23.356075 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1bc69102-7977-4023-91bb-fe26a12070bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.251500 Sep 13 18:04:23.356691 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4163/8271] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:04:23 2022] POST /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 18:04:23.363793 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:04:23.364803 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:04:23.365453 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:23.366209 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=32 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:23.367333 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:04:23.367467 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb (ip 10.222.0.61) !!! Sep 13 18:04:23.368616 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:04:23.368754 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb (ip 10.222.0.61) !!! Sep 13 18:04:23.369752 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:04:23.369989 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb (ip 10.222.0.61) !!! Sep 13 18:04:23.377084 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:23.377802 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:23.389646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:23.390171 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:23.390614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:23.391321 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:23.391788 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:23.392225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:23.526560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:23.534321 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ce0b94e1-f1f2-4146-8e0b-b957a8e5ac92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.173042 Sep 13 18:04:23.535448 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4109/8272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:23 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:24.561326 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:24.562081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:24.572466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:24.572968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:24.573420 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:24.574160 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:24.574643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:24.575093 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:24.578944 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41464. Sep 13 18:04:24.582652 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41462. Sep 13 18:04:24.714286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:24.722522 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5c3ef446-adc0-4c80-b57c-6aa4b90d2c53 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.166875 Sep 13 18:04:24.723193 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4164/8273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:24 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:25.746901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:25.747508 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:25.759045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:25.759547 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:25.759997 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:25.760719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:25.761187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:25.761656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:25.769302 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41472. Sep 13 18:04:25.770071 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41470. Sep 13 18:04:26.228721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:26.236548 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6e377412-1f65-4c1a-97fe-f10c703bbf4c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.493625 Sep 13 18:04:26.237147 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4110/8274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:25 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:27.260509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:27.261159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:27.267937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:27.268440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:27.268890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:27.270298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:27.270783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:27.271232 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:27.401902 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:27.409554 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-729e5ca2-3200-473f-b59d-f50b327ab642 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.153003 Sep 13 18:04:27.410429 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4165/8275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:27 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:28.432216 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:28.432830 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:28.439693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:28.440181 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:28.440890 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:28.441578 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:28.442069 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:28.442499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:28.574982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:28.583487 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7bb61d26-3111-4d20-a00c-3dd49ba0252f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.155196 Sep 13 18:04:28.584093 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4111/8276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:28 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:29.608151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:29.608790 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:29.616124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:29.616641 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:29.617105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:29.617891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:29.620553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:29.620553 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:29.766133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:29.777576 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-86752a70-82e2-4749-8a6d-ec98068e7e60 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.173455 Sep 13 18:04:29.778215 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4166/8277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:29 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:30.802626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:30.803293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:30.810534 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:30.811034 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:30.811482 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:30.812198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:30.813449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:30.814348 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:30.953962 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:30.962193 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-1bff0694-4900-48ff-a602-d12bd41a11aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.164075 Sep 13 18:04:30.962781 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4112/8278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:30 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:31.988705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:31.989795 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:31.996867 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:31.997384 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:31.997871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:31.998596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:31.999079 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:31.999529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:32.136067 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:32.143908 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7f45b23b-7ef3-4f2a-b8e7-f1c32f28bb4e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.161204 Sep 13 18:04:32.145035 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4167/8279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:31 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:33.168576 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:33.169193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:33.176704 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:33.177187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:33.177656 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:33.178370 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:33.178832 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:33.179262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:33.308368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:33.316781 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b84054fa-b21e-47e7-938e-2d008244de31 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.151619 Sep 13 18:04:33.317358 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4113/8280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:33 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:34.341652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:34.342247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:34.349311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:34.349811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:34.350281 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:34.350982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:34.351451 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:34.351890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:34.482836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:34.491252 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-33589490-0896-4ab5-81e2-d3db6f48b660 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.153598 Sep 13 18:04:34.491859 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4168/8281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:34 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:35.515622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:35.516238 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:35.523345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:35.523827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:35.524264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:35.524976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:35.525471 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:35.525938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:35.654960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:35.662785 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-95a0ca4c-d35f-485d-bd0a-7440ff8fc7b8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1701 microversion: 2.1 time: 0.151063 Sep 13 18:04:35.663357 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4114/8282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:35 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1701 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:36.686374 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:36.687001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:36.694837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:36.695337 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:36.695787 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:36.696489 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:36.696962 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:36.697402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:36.834496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:36.842157 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0547f079-f704-4120-86a9-7a19517a2441 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1701 microversion: 2.1 time: 0.159666 Sep 13 18:04:36.842737 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4169/8283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:36 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:37.866341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:37.866900 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:37.873801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:37.874313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:37.874753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:37.875442 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:37.875904 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:37.876335 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:38.010072 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:38.017809 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2a447603-ea8b-444f-8d22-f2aafd4c0f6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1701 microversion: 2.1 time: 0.155555 Sep 13 18:04:38.018412 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4115/8284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:37 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:39.042424 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:39.043181 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:39.049796 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:39.050406 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:39.051151 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:39.051890 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:39.052373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:39.052825 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:39.149456 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-90a98061-a7d2-416f-8787-a94d03c61b8a req-505b0e3d-9357-462a-a393-846bc6ccc8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:39.162278 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-90a98061-a7d2-416f-8787-a94d03c61b8a req-505b0e3d-9357-462a-a393-846bc6ccc8a9 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:39.162774 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-90a98061-a7d2-416f-8787-a94d03c61b8a req-505b0e3d-9357-462a-a393-846bc6ccc8a9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:39.163222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-90a98061-a7d2-416f-8787-a94d03c61b8a req-505b0e3d-9357-462a-a393-846bc6ccc8a9 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:39.174736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-90a98061-a7d2-416f-8787-a94d03c61b8a req-505b0e3d-9357-462a-a393-846bc6ccc8a9 service nova] Creating event network-vif-plugged:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h2-857467-1 Sep 13 18:04:39.181690 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-90a98061-a7d2-416f-8787-a94d03c61b8a req-505b0e3d-9357-462a-a393-846bc6ccc8a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036171 Sep 13 18:04:39.182941 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4116/8285] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:04:39.196884 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:39.205345 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-dcf03bd2-7cbd-4cf1-bf05-536726be737b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1701 microversion: 2.1 time: 0.166885 Sep 13 18:04:39.206049 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4170/8286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:39 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:40.230341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:40.231192 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:40.237539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:40.239283 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:40.239764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:40.240488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:40.241027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:40.241473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:40.389597 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:40.399474 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c128eb7b-1b48-4e44-b1e2-2586c1edd50f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.174314 Sep 13 18:04:40.400089 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4117/8287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:40 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:41.424022 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:41.424878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:41.434844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:41.435969 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:41.436766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:41.438110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:41.438889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:41.439801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:41.620065 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:41.628131 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11ada207-1bf0-4dd1-9f36-0de37ce3ed0a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.208098 Sep 13 18:04:41.629463 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4171/8288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:41 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:42.655163 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:42.655789 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:42.664257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:42.665099 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:42.665546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:42.666665 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:42.667146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:42.667587 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:42.820076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:42.828243 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-2fb73965-e2b0-4618-8903-f1184732a253 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.177044 Sep 13 18:04:42.828985 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4118/8289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:42 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:43.853593 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:43.854817 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:43.863291 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:43.863624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:43.864046 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:43.864930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:43.865859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:43.866076 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:44.016456 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:44.027862 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-31c7b751-f429-455e-824e-431a83ba6d18 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.178006 Sep 13 18:04:44.043458 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4172/8290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:43 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:45.057590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:45.058967 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:45.074381 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:45.074981 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:45.079211 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:45.079871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:45.080608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:45.081121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:45.238737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:45.247965 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-49172809-0486-4576-b992-fd7ce34f9e2c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.194984 Sep 13 18:04:45.249297 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4119/8291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:45 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:46.275599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:46.276383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:46.284105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:46.285170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:46.285634 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:46.286417 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:46.286889 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:46.287334 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:46.444550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:46.452705 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b583c1a6-5c91-4b7b-af67-83a099489b3d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.181116 Sep 13 18:04:46.453533 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4173/8292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:46 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:47.480546 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:47.481388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:47.489565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:47.490078 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:47.490518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:47.491228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:47.491691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:47.492123 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:47.674633 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:47.683094 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8af348c7-5093-45f6-b536-8279ca01e8d6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.207113 Sep 13 18:04:47.697852 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4120/8293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:47 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:48.714362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:48.715757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:48.723459 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:48.723960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:48.724412 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:48.725144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:48.725617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:48.726087 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:48.870496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:48.879646 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-04c3e64f-236a-4138-a7f0-8bddf40b6c5b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.171120 Sep 13 18:04:48.880260 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4174/8294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:48 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:49.904505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:49.904971 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:49.912894 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:49.913395 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:49.913861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:49.914590 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:49.915136 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:49.915600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:50.062911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:50.071827 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5d69064c-d9be-4164-b67c-75ce6b1391ac tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1696 microversion: 2.1 time: 0.171462 Sep 13 18:04:50.072411 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4121/8295] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:49 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:51.095887 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:51.096546 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:51.104259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:51.104798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:51.105249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:51.106001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:51.106473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:51.106917 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:51.244530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:51.252357 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6ed48060-6ac7-4007-b8d9-2e3666c168af tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1678 microversion: 2.1 time: 0.160372 Sep 13 18:04:51.252948 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4175/8296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:51 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:04:52.276696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:52.277328 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:52.284337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:52.284770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:52.285214 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:52.285947 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:52.286414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:52.287747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:52.420910 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:52.429667 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a58980bf-917f-47a7-a5de-3a1f071bdd3e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1678 microversion: 2.1 time: 0.156890 Sep 13 18:04:52.430283 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4122/8297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:52 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:53.220174 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-1a2cafe6-80c3-4c29-82f4-8103759dc27d req-f831cdff-b11a-45a5-9c9b-8c0488cfd561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "name": "network-vif-unplugged", "status": "completed", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:53.226168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=27 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:53.232257 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a2cafe6-80c3-4c29-82f4-8103759dc27d req-f831cdff-b11a-45a5-9c9b-8c0488cfd561 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.232835 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a2cafe6-80c3-4c29-82f4-8103759dc27d req-f831cdff-b11a-45a5-9c9b-8c0488cfd561 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.233222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-1a2cafe6-80c3-4c29-82f4-8103759dc27d req-f831cdff-b11a-45a5-9c9b-8c0488cfd561 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.237315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:53.246797 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-1a2cafe6-80c3-4c29-82f4-8103759dc27d req-f831cdff-b11a-45a5-9c9b-8c0488cfd561 service nova] Creating event network-vif-unplugged:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h2-857467-1 Sep 13 18:04:53.252022 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-1a2cafe6-80c3-4c29-82f4-8103759dc27d req-f831cdff-b11a-45a5-9c9b-8c0488cfd561 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035647 Sep 13 18:04:53.252641 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4176/8298] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:04:53.454080 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:53.454622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:53.457455 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=29 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:53.464881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.465402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.465871 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.466600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.467082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.467518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.473403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=81 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:04:53.621196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:53.629024 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4f5a23e-1340-4bc4-972e-e652dd7aac6f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1621 microversion: 2.1 time: 0.179151 Sep 13 18:04:53.629606 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4123/8299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:53 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1621 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:53.652650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:04:53.653368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:53.660614 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.661125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.661612 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.662464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.662948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.663404 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.749056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122328) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 18:04:53.816253 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f5583ab-b9df-4551-b390-432a9bbd46fd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action" status: 202 len: 0 microversion: 2.1 time: 0.167621 Sep 13 18:04:53.816874 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4177/8300] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:04:53 2022] POST /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:04:53.829111 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:53.829797 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:53.836281 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.836694 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.837144 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.837902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:53.838361 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:53.838854 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:53.981295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:53.989045 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4bf79cd2-f266-4a27-aaff-b8746654621d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1629 microversion: 2.1 time: 0.164093 Sep 13 18:04:53.989694 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4124/8301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:53 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1629 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:55.014549 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:55.015234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:55.021247 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:55.021757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:55.022303 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:55.023011 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:55.023503 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:55.023928 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:55.156009 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:55.164955 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-412ad911-d03c-4bc6-8143-32e508d44e75 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1629 microversion: 2.1 time: 0.155606 Sep 13 18:04:55.165563 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4178/8302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:55 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:56.190963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:56.191586 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:56.198564 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:56.199055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:56.199499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:56.200198 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:56.200663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:56.201102 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:56.336178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:56.344046 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d6ddd1e2-2b6b-4ca9-a2a9-2144edfe4e22 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1629 microversion: 2.1 time: 0.157595 Sep 13 18:04:56.344633 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4125/8303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:56 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1629 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:57.367107 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:57.367750 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:57.374837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:57.375580 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:57.375899 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:57.376622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:57.377104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:57.377556 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:57.513030 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:57.521064 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-221e8358-aa07-4914-b6f4-9877241b0364 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1629 microversion: 2.1 time: 0.158384 Sep 13 18:04:57.521651 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4179/8304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:57 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1629 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:58.544938 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:58.545593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:58.552608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:58.553126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:58.554673 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:58.555386 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:58.555857 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:58.556295 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:58.692805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:58.701465 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b7957a32-7fac-4482-a14c-96ef778fbdd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1629 microversion: 2.1 time: 0.160429 Sep 13 18:04:58.702086 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4126/8305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:58 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:04:59.727475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:04:59.728119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:04:59.735175 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:59.735693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:59.736161 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:59.736893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:04:59.737372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:04:59.737836 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:04:59.974728 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:04:59.983267 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4ab65c06-adc9-48a9-9d15-d6cd9d0d7dbe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.260616 Sep 13 18:04:59.984172 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4180/8306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:04:59 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:00.191049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-37167e1a-2872-4bfd-8680-e92104f425cc req-ee97c052-cebf-43a5-a890-1dd521def600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:00.202497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-37167e1a-2872-4bfd-8680-e92104f425cc req-ee97c052-cebf-43a5-a890-1dd521def600 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:00.202991 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-37167e1a-2872-4bfd-8680-e92104f425cc req-ee97c052-cebf-43a5-a890-1dd521def600 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:00.203433 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-37167e1a-2872-4bfd-8680-e92104f425cc req-ee97c052-cebf-43a5-a890-1dd521def600 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:00.216422 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-37167e1a-2872-4bfd-8680-e92104f425cc req-ee97c052-cebf-43a5-a890-1dd521def600 service nova] Creating event network-changed:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h1-857467-1 Sep 13 18:05:00.223734 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-37167e1a-2872-4bfd-8680-e92104f425cc req-ee97c052-cebf-43a5-a890-1dd521def600 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036722 Sep 13 18:05:00.224361 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4127/8307] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:01.009414 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:01.010763 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:01.024444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:01.025350 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:01.026447 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:01.027656 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:01.028701 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:01.029994 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:01.237248 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:01.247000 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-66f97fd2-fa9b-43ac-9839-7482abe55ba6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.241982 Sep 13 18:05:01.248209 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4181/8308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:01 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:02.279429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:02.280269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:02.286806 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:02.288066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:02.289038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:02.289905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:02.290382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:02.290823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:02.437028 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:02.445604 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-44c60443-630f-4322-b556-93142e27496d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.171758 Sep 13 18:05:02.449960 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4128/8309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:02 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:03.478860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:03.479541 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:03.488308 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:03.490104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:03.490831 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:03.492105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:03.494178 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:03.496138 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:03.649915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:03.658458 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-231ae28f-6fed-484c-9545-01373d2a58ce tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.192178 Sep 13 18:05:03.670392 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4182/8310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:03 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:04.683241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:04.683862 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:04.691363 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:04.691859 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:04.692299 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:04.693010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:04.693473 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:04.694554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:04.844798 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:04.853484 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9e657f9c-6eeb-4a71-990a-f3f4d95ab449 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.173986 Sep 13 18:05:04.854171 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4129/8311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:04 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:05.878575 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:05.879252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:05.887749 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:05.888372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:05.888897 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:05.889733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:05.890307 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:05.890834 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:06.040043 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:06.048306 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-8bb19db1-3781-4657-ad42-750ee13640a3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.174129 Sep 13 18:05:06.048897 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4183/8312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:05 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:07.074003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:07.074855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:07.081922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:07.082414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:07.082853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:07.083562 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:07.084054 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:07.085115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:07.236489 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:07.245984 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54e02a63-7c90-483d-9915-529acfd908f9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.175821 Sep 13 18:05:07.246609 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4130/8313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:07 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:08.270534 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:08.271415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:08.279947 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:08.280469 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:08.280960 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:08.281885 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:08.282378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:08.282832 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:08.447382 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:08.455772 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-c357b3e2-73d5-4e2d-9187-20a9650e6df9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.189100 Sep 13 18:05:08.456478 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4184/8314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:08 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:09.480934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:09.481602 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:09.488626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:09.489118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:09.489568 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:09.490300 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:09.490770 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:09.491217 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:09.629525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:09.638068 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3620aec7-e169-4f7d-aaad-bfcf127b5942 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.161026 Sep 13 18:05:09.638651 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4131/8315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:09 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:10.662908 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:10.663540 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:10.670491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:10.670992 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:10.671442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:10.672158 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:10.672627 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:10.673069 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:10.895987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:10.904312 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-76aa09f6-731f-4ca5-b749-acbfb72bd049 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.245905 Sep 13 18:05:10.905110 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4185/8316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:10 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:11.929120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:11.929737 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:11.936626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:11.937118 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:11.937566 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:11.938301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:11.938772 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:11.939205 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:12.071847 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:12.079923 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed603349-2ff6-4700-aef2-ef9634ae1394 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.155322 Sep 13 18:05:12.080540 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4132/8317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:11 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:13.103319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:13.103983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:13.110965 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:13.111472 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:13.111956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:13.112669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:13.113142 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:13.113590 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:13.248689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:13.257034 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a1d3ce5f-beb5-4f77-9c42-4774598b3906 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.157293 Sep 13 18:05:13.257617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4186/8318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:13 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:14.280646 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:14.281269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:14.288193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:14.288681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:14.289116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:14.289805 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:14.290286 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:14.290713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:14.428824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:14.436730 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3277712f-09ee-4386-929f-0e6bba3a7874 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.160057 Sep 13 18:05:14.437305 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4133/8319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:14 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:15.462098 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:15.462733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:15.469600 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:15.470145 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:15.470635 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:15.472340 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:15.472818 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:15.473266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:15.609801 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:15.617958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d8d895e3-517d-4997-854c-20200c2def6c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.160844 Sep 13 18:05:15.618554 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4187/8320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:15 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:16.642093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:16.642689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:16.650038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:16.650522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:16.650960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:16.651652 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:16.652113 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:16.652542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:16.784150 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:16.795413 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c09f3f3f-610e-4cad-89a2-a7a6e9a39ef7 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.157515 Sep 13 18:05:16.796001 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4134/8321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:16 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:17.350249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-ed3ef148-97d5-405e-ac43-1717c0a29fec req-c407128b-f578-44ce-a15c-62f95cd2077c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "name": "network-vif-plugged", "status": "completed", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:05:17.360120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ed3ef148-97d5-405e-ac43-1717c0a29fec req-c407128b-f578-44ce-a15c-62f95cd2077c service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:17.360621 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ed3ef148-97d5-405e-ac43-1717c0a29fec req-c407128b-f578-44ce-a15c-62f95cd2077c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:17.361066 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-ed3ef148-97d5-405e-ac43-1717c0a29fec req-c407128b-f578-44ce-a15c-62f95cd2077c service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:17.372800 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-ed3ef148-97d5-405e-ac43-1717c0a29fec req-c407128b-f578-44ce-a15c-62f95cd2077c service nova] Creating event network-vif-plugged:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h1-857467-1 Sep 13 18:05:17.377958 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-ed3ef148-97d5-405e-ac43-1717c0a29fec req-c407128b-f578-44ce-a15c-62f95cd2077c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088488 Sep 13 18:05:17.378620 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4188/8322] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:05:17.819760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:17.820378 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:17.827224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:17.827713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:17.828156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:17.828852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:17.829312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:17.829734 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:17.973601 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:17.981568 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-438addc8-5786-4989-9694-65b08dd49761 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.166711 Sep 13 18:05:17.982200 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4135/8323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:17 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:19.006170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:19.007192 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:19.014515 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:19.015027 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:19.015483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:19.016206 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:19.016684 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:19.017133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:19.162215 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:19.170277 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2400ab90-0a25-40b6-be5b-4f75f592c2b2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1687 microversion: 2.1 time: 0.168447 Sep 13 18:05:19.170916 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4189/8324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:19 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:05:20.195511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:05:20.196062 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:05:20.203038 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:20.203532 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:20.203982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:20.204689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:05:20.205159 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:05:20.205594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:05:20.344845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:05:20.352872 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1e0810e-bde8-4c5d-b8b8-3cf5b6d544d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1674 microversion: 2.1 time: 0.162375 Sep 13 18:05:20.353447 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4136/8325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:05:20 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:06:56.928555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:56.929988 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:56.930958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=27 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:56.932462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=79 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:06:56.936446 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:56.937379 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:56.947095 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:56.947853 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:56.948386 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:56.949372 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:56.949967 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:56.950421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:56.979395 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Going to try to terminate instance {{(pid=122328) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:06:57.004423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-21e6abdf-d834-4b00-b026-577c2a59f702 req-30ad66e4-993e-4b9e-b093-9690b8adb225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:57.014913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-21e6abdf-d834-4b00-b026-577c2a59f702 req-30ad66e4-993e-4b9e-b093-9690b8adb225 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:57.015380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-21e6abdf-d834-4b00-b026-577c2a59f702 req-30ad66e4-993e-4b9e-b093-9690b8adb225 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:57.015920 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-21e6abdf-d834-4b00-b026-577c2a59f702 req-30ad66e4-993e-4b9e-b093-9690b8adb225 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:57.028391 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-21e6abdf-d834-4b00-b026-577c2a59f702 req-30ad66e4-993e-4b9e-b093-9690b8adb225 service nova] Creating event network-changed:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h1-857467-1 Sep 13 18:06:57.033974 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-21e6abdf-d834-4b00-b026-577c2a59f702 req-30ad66e4-993e-4b9e-b093-9690b8adb225 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105654 Sep 13 18:06:57.034787 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4137/8326] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:57.068840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4726b000-2d65-4f2f-83e0-818751a36dff tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 204 len: 0 microversion: 2.1 time: 0.142567 Sep 13 18:06:57.069450 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4190/8327] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 18:06:56 2022] DELETE /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:06:57.087517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:57.088341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:57.094960 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:57.095449 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:57.095940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:57.096689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:57.097154 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:57.097582 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:57.292444 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:57.300415 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ed7a1240-1c76-4760-ba2a-920c0a8b1438 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.217888 Sep 13 18:06:57.300996 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4138/8328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:57 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:58.326591 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:58.327408 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:58.334463 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:58.334972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:58.335434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:58.336148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:58.336848 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:58.337319 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:58.531190 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:58.539148 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-7cb75870-2d22-4056-8d93-b82eb78ee6b6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1680 microversion: 2.1 time: 0.217017 Sep 13 18:06:58.540245 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4191/8329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:58 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:06:59.317073 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-1d98dd30-7ca9-4a37-b977-0952b81d85c8 req-390576b1-e876-49f0-a8f8-c1228f33b269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda8f40-31c0-43f8-a566-cb50bfa0bdfb", "name": "network-vif-deleted", "tag": "d6e50775-49fc-4054-8dc3-a56ab1e584eb"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:06:59.330984 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1d98dd30-7ca9-4a37-b977-0952b81d85c8 req-390576b1-e876-49f0-a8f8-c1228f33b269 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.331824 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1d98dd30-7ca9-4a37-b977-0952b81d85c8 req-390576b1-e876-49f0-a8f8-c1228f33b269 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.332273 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-1d98dd30-7ca9-4a37-b977-0952b81d85c8 req-390576b1-e876-49f0-a8f8-c1228f33b269 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.344840 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-1d98dd30-7ca9-4a37-b977-0952b81d85c8 req-390576b1-e876-49f0-a8f8-c1228f33b269 service nova] Creating event network-vif-deleted:d6e50775-49fc-4054-8dc3-a56ab1e584eb for instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb on n-h1-857467-1 Sep 13 18:06:59.351478 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-1d98dd30-7ca9-4a37-b977-0952b81d85c8 req-390576b1-e876-49f0-a8f8-c1228f33b269 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038608 Sep 13 18:06:59.352194 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4139/8330] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:06:59.563712 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:06:59.564349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:06:59.572649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.573157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.573613 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.574362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.574837 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.575282 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.608322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:06:59.609105 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:06:59.609737 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:06:59.610242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.objects.instance [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lazy-loading 'fault' on Instance uuid 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb {{(pid=122328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:06:59.654838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:06:59.663026 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1cb21139-5e85-4042-8025-6b93b143cb8b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 200 len: 1336 microversion: 2.1 time: 0.103114 Sep 13 18:06:59.663620 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4192/8331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:06:59 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:00.688013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.688730 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:00.696815 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:00.697312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:00.697760 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:00.698497 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:00.698969 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:00.699409 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:00.713516 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] HTTP exception thrown: Instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb could not be found. Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Request method failure captured: Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb HTTP/1.1 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMV_mCSnVi48X7RjWJJDEYkV1UgnAtdyGRklypPNFiq2t7sBof_mzxrlUnLqRNl-50sW9MoD9FqWIyaH9CUjnrYW4bd690lRGLlNh75ZVmnS6A0rbYpOQGXA_BXbXrJOO1FqkhK-SBZp2PYdCSlSLk89-p3vW3EqClXx43mP-k3LT6s Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: ea0164701854444abf1c6833cded41dd Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestShelveInstance-688196816 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea0164701854444abf1c6833cded41dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea0164701854444abf1c6833cded41dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea0164701854444abf1c6833cded41dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea0164701854444abf1c6833cded41dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestShelveInstance-688196816 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: ea0164701854444abf1c6833cded41dd Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestShelveInstance-688196816 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestShelveInstance-688196816-project Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: 116f2c43f41e45f6bf83d482cca2f7d0 Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestShelveInstance-688196816-project Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb could not be found. Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '3cda8f40-31c0-43f8-a566-cb50bfa0bdfb'} Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb could not be found. Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb could not be found. Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:07:00.715918 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb could not be found. Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Returning 404 to user: Instance 3cda8f40-31c0-43f8-a566-cb50bfa0bdfb could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a003ef6-1a5e-439d-9365-da4e17951b6a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb" status: 404 len: 111 microversion: 2.1 time: 0.033808 Sep 13 18:07:00.721462 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4140/8332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:00 2022] GET /compute/v2.1/servers/3cda8f40-31c0-43f8-a566-cb50bfa0bdfb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:07:00.879270 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f5dc3c56-8204-44a4-8013-4d21b001a315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '.version_select at 0x7fbeac7903a0>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:00.908434 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f5dc3c56-8204-44a4-8013-4d21b001a315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-962647550" status: 202 len: 0 microversion: 2.1 time: 0.033012 Sep 13 18:07:00.908978 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4193/8333] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Sep 13 18:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-962647550 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:07:00.935937 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8f10ad7b-06a7-45fb-bd9b-3e51dbb2ce24 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'create', calling method: .version_select at 0x7fbeb4643430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1056827376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISSX84LWZdnRSRCs2FP+EkTYWdRAs0QYBzKK43SdbJjcl7RbnO117PmbwjGP4zOkTOfCL2DZHf+IZrEdk0liYPgqAYNVu4yNuFswcYsKyIkVMImsOMe8OMUwL/MsFJfIw=="}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:00.952167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8f10ad7b-06a7-45fb-bd9b-3e51dbb2ce24 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for project ea0164701854444abf1c6833cded41dd. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:07:00.957202 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-8f10ad7b-06a7-45fb-bd9b-3e51dbb2ce24 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for user 116f2c43f41e45f6bf83d482cca2f7d0 and project ea0164701854444abf1c6833cded41dd. Resources: {'key_pairs'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:07:00.984230 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8f10ad7b-06a7-45fb-bd9b-3e51dbb2ce24 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052163 Sep 13 18:07:00.984834 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4141/8334] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 18:07:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:17.173335 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-92156251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1056827376", "security_groups": [{"name": "tempest-secgroup-smoke-898847917"}], "networks": [{"uuid": "3a6379ce-3e59-495e-a887-e0fca42319b1"}], "block_device_mapping_v2": [{"uuid": "5b289cef-16d8-46f9-867f-16bb7ca19edd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:17.185746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:17.186620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:17.293704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.network.neutron [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] validate_networks() for [('3a6379ce-3e59-495e-a887-e0fca42319b1', None, None, None, None, None)] {{(pid=122328) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:07:17.979704 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Flavor limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:07:17.980139 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Image limits 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:07:17.980626 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Flavor pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:07:17.981070 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Image pref 0:0:0 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:07:17.981499 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.virt.hardware [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:07:17.990431 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:17.990927 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:17.991375 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:17.992113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:17.992581 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:17.993035 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:18.010537 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for project ea0164701854444abf1c6833cded41dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:07:18.015734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Getting quotas for user 116f2c43f41e45f6bf83d482cca2f7d0 and project ea0164701854444abf1c6833cded41dd. Resources: {'ram', 'instances', 'cores'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:07:18.074112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Going to run 1 instances... {{(pid=122328) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:07:18.076311 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b289cef-16d8-46f9-867f-16bb7ca19edd',volume_size=None,volume_type=None)] {{(pid=122328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:07:18.205879 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2f1b80c1-4a2f-4607-a437-55bfab299e62 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.036408 Sep 13 18:07:18.206888 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4194/8335] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 18:07:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:07:18.216212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=12 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:18.216973 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=4 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:18.217604 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:18.221450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c4951f6a-48db-4d95-91df-f7d2c95ca2fa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:18.222924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c4951f6a-48db-4d95-91df-f7d2c95ca2fa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:18.279135 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c4951f6a-48db-4d95-91df-f7d2c95ca2fa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:18.286185 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c4951f6a-48db-4d95-91df-f7d2c95ca2fa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1087 microversion: 2.1 time: 0.071683 Sep 13 18:07:18.286756 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4142/8336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:18 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:19.310315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:19.311081 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:19.319860 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:19.320368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:19.320975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:19.321710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:19.322226 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:19.322918 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:19.391761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:19.406057 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-850b0c7e-5753-4b39-abeb-e7b21edce305 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1193 microversion: 2.1 time: 0.100307 Sep 13 18:07:19.407079 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4195/8337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:19 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:07:20.430634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:20.431196 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:20.439398 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.440001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.440615 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.441543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.442375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.443036 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.685146 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:20.693731 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-54964b74-6632-42b1-b818-2003c91005e1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1270 microversion: 2.1 time: 0.267065 Sep 13 18:07:20.694626 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4143/8338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:20 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1270 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:20.880740 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-40c189d9-4e7b-4c88-a13b-2944f7e77554 req-964a4196-117d-4149-abc2-0ff044f497c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:20.896224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-40c189d9-4e7b-4c88-a13b-2944f7e77554 req-964a4196-117d-4149-abc2-0ff044f497c1 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:20.897483 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-40c189d9-4e7b-4c88-a13b-2944f7e77554 req-964a4196-117d-4149-abc2-0ff044f497c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:20.898031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-40c189d9-4e7b-4c88-a13b-2944f7e77554 req-964a4196-117d-4149-abc2-0ff044f497c1 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:20.912188 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-40c189d9-4e7b-4c88-a13b-2944f7e77554 req-964a4196-117d-4149-abc2-0ff044f497c1 service nova] Creating event network-changed:d0aa49fc-f643-4d45-a8b4-a17a2297cbc5 for instance eb79f407-61ba-4df5-8809-c0d3aee14913 on n-h2-857467-1 Sep 13 18:07:20.918385 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-40c189d9-4e7b-4c88-a13b-2944f7e77554 req-964a4196-117d-4149-abc2-0ff044f497c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041315 Sep 13 18:07:20.919945 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4196/8339] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:21.719055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:21.719691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:21.728311 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.729819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.730322 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:21.731172 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:21.731733 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:21.732255 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:22.122024 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:22.132018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d3c21556-74f0-4904-bb77-0af08d95c0a4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1270 microversion: 2.1 time: 0.417014 Sep 13 18:07:22.132617 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4144/8340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:21 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1270 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:23.157793 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:23.158628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:23.164929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:23.165430 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:23.165914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:23.166696 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:23.167242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:23.167682 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:23.300172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:23.309051 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-fe336d33-3067-45eb-992e-d307bbf51898 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1270 microversion: 2.1 time: 0.156380 Sep 13 18:07:23.309646 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4197/8341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:23 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:24.332365 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:24.333063 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:24.340624 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:24.341194 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:24.341776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:24.342881 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:24.343416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:24.343848 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:24.483620 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:24.491551 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-444dcb01-2c61-4a21-9313-5cec5fe2011c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1270 microversion: 2.1 time: 0.163042 Sep 13 18:07:24.492132 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4145/8342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:24 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:25.516599 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:25.517237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:25.523449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:25.523937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:25.524402 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:25.525110 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:25.525586 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:25.526633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:25.665767 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:25.673919 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9be36484-b29c-42c7-bf48-8d9a43e43ff6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.161698 Sep 13 18:07:25.674499 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4198/8343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:25 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:26.698940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:26.699554 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:26.705600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:26.706112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:26.706549 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:26.707242 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:26.707703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:26.708133 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:26.842246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:26.850264 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-05a57b89-8239-408a-b537-6e0139826ffe tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.155804 Sep 13 18:07:26.850847 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4146/8344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:26 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:27.874475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:27.875129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:27.881982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:27.882490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:27.882944 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:27.883653 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:27.884124 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:27.884566 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:28.001172 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:28.014748 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:28.022284 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-878be1ef-515d-4bf3-96b6-5a413a25f2da tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.152351 Sep 13 18:07:28.022859 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4199/8345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:27 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:29.042887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:29.046927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:29.047540 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:29.053796 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:29.054307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:29.054747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:29.055542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:29.056003 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:29.056438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:29.190368 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:29.198967 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-66763973-b243-4578-833c-2c5c6474e7dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.157775 Sep 13 18:07:29.199537 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4147/8346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:29 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:30.222274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:30.222910 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:30.224783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:07:30.231362 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:30.231869 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:30.232521 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:30.233241 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:30.233722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:30.234202 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:30.367986 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:30.376427 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-35379d0a-88ff-45bb-983b-8292dfb24b3a tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.158081 Sep 13 18:07:30.377006 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4200/8347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:30 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:31.399804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:31.400354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:31.408369 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:31.408852 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:31.409288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:31.410017 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:31.410476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:31.410905 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:31.546324 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:31.554598 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da13d98c-102a-44f1-abc6-ebded616507c tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.158965 Sep 13 18:07:31.555165 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4148/8348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:31 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:32.578071 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:32.578707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:32.585647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:32.586189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:32.586647 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:32.587365 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:32.587838 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:32.588520 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:32.727743 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:32.736314 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f3a3ee2d-29b2-49c7-b1a1-2317f0290f2b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.162256 Sep 13 18:07:32.736904 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4201/8349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:32 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:33.759253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:33.759811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:33.767091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:33.767579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:33.768019 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:33.768713 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:33.769176 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:33.769608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:33.903681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:33.911464 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d39ba307-eab1-4338-aa13-09d4f62ded92 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.156255 Sep 13 18:07:33.912050 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4149/8350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:33 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:07:34.934551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:34.935104 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:34.942368 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:34.942870 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:34.943320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:34.944031 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:34.944504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:34.944945 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:35.081371 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:35.089410 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-809db6a7-9736-469d-89fa-c884d45f6e7b tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.158933 Sep 13 18:07:35.090009 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4202/8351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:34 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:36.053974 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-a94cfb09-2a3f-4476-bbec-1922aae0bf6c req-9e252577-49d2-4eee-b96d-7db112d09439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "name": "network-vif-plugged", "status": "completed", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:36.065930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a94cfb09-2a3f-4476-bbec-1922aae0bf6c req-9e252577-49d2-4eee-b96d-7db112d09439 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.066427 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a94cfb09-2a3f-4476-bbec-1922aae0bf6c req-9e252577-49d2-4eee-b96d-7db112d09439 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.066869 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-a94cfb09-2a3f-4476-bbec-1922aae0bf6c req-9e252577-49d2-4eee-b96d-7db112d09439 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.079072 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-a94cfb09-2a3f-4476-bbec-1922aae0bf6c req-9e252577-49d2-4eee-b96d-7db112d09439 service nova] Creating event network-vif-plugged:d0aa49fc-f643-4d45-a8b4-a17a2297cbc5 for instance eb79f407-61ba-4df5-8809-c0d3aee14913 on n-h2-857467-1 Sep 13 18:07:36.084143 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-a94cfb09-2a3f-4476-bbec-1922aae0bf6c req-9e252577-49d2-4eee-b96d-7db112d09439 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036554 Sep 13 18:07:36.084768 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4150/8352] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:07:36.112312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:36.112999 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:36.121201 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.121707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.122189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.122904 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:36.123380 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:36.123827 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:36.266826 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:36.274871 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-28d88ff1-e6d0-4c84-bcec-6cd69a0688fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.166410 Sep 13 18:07:36.276326 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4203/8353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:36 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:37.302828 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:37.303542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:37.309918 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.310347 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.310804 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.311487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:37.311951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:37.312388 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:37.449439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:37.457276 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-840e6787-54c7-431c-b726-f2de96c0ae50 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1258 microversion: 2.1 time: 0.159605 Sep 13 18:07:37.457891 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4151/8354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:37 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:38.481757 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:38.482421 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:38.489514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.490072 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.490531 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.491242 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.491719 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.492167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.624488 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:38.632263 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e2da8736-59a3-4576-a20a-90f320a5f1ba tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1442 microversion: 2.1 time: 0.155128 Sep 13 18:07:38.632837 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4204/8355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:38 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:38.655074 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:07:38.655692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:07:38.662542 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.663033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.663479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.664178 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:38.664645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:38.665082 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:38.796846 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:07:38.805004 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-da2c145c-4762-423c-aafe-1eb23da62414 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1442 microversion: 2.1 time: 0.154408 Sep 13 18:07:38.805584 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4152/8356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:07:38 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:07:40.444931 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-be2bb302-c970-443c-bae4-5430b1226aac req-0a07a06e-d813-46be-9662-f0076e6652e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:07:40.456159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-be2bb302-c970-443c-bae4-5430b1226aac req-0a07a06e-d813-46be-9662-f0076e6652e2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:07:40.456649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-be2bb302-c970-443c-bae4-5430b1226aac req-0a07a06e-d813-46be-9662-f0076e6652e2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:07:40.457092 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-be2bb302-c970-443c-bae4-5430b1226aac req-0a07a06e-d813-46be-9662-f0076e6652e2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:07:40.468841 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-be2bb302-c970-443c-bae4-5430b1226aac req-0a07a06e-d813-46be-9662-f0076e6652e2 service nova] Creating event network-changed:d0aa49fc-f643-4d45-a8b4-a17a2297cbc5 for instance eb79f407-61ba-4df5-8809-c0d3aee14913 on n-h2-857467-1 Sep 13 18:07:40.474929 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-be2bb302-c970-443c-bae4-5430b1226aac req-0a07a06e-d813-46be-9662-f0076e6652e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033548 Sep 13 18:07:40.475551 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4205/8357] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:09:37.016437 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:09:37.017412 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:09:37.021428 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:37.021978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:37.024009 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=24 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:37.024672 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=56 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:37.026003 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:09:37.026163 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913/action (ip 10.222.0.61) !!! Sep 13 18:09:37.028092 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:09:37.028230 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913/action (ip 10.222.0.61) !!! Sep 13 18:09:37.039417 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:37.039915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:37.040389 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:37.041105 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:37.041600 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:37.042068 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:37.068474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lazy-loading 'flavor' on Instance uuid eb79f407-61ba-4df5-8809-c0d3aee14913 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:09:37.140005 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-8849f4d1-dc13-466b-a6e2-c831cf666e6e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913/action" status: 202 len: 0 microversion: 2.1 time: 0.125230 Sep 13 18:09:37.140604 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4153/8358] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:09:37 2022] POST /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:09:37.147257 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:09:37.148304 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:09:37.149266 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:37.150146 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=60 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:09:37.151191 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:09:37.151364 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 (ip 10.222.0.61) !!! Sep 13 18:09:37.152834 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:09:37.152834 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 (ip 10.222.0.61) !!! Sep 13 18:09:37.159120 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:37.159849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:37.171166 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:37.171674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:37.172133 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:37.172850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:37.173331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:37.174405 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:37.322878 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:37.331031 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-15677eb5-bbb4-4966-aaf0-59b0b139cb56 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.185744 Sep 13 18:09:37.331617 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4206/8359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:37 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:38.357941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:38.358565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:38.366780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:38.367269 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:38.367719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:38.368413 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:38.368879 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:38.369313 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:38.374403 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42040. Sep 13 18:09:38.375211 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42042. Sep 13 18:09:38.513686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:38.521628 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-524e16fb-5518-43f5-b442-73f367d1a9a2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.170028 Sep 13 18:09:38.522234 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4154/8360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:38 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:39.545881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:39.546502 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:39.555550 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:39.556056 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:39.556514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:39.557224 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:39.557702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:39.558173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:39.565420 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42048. Sep 13 18:09:39.578284 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42046. Sep 13 18:09:39.693249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:39.701126 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f87e4aff-80cd-4138-ac7f-a86e48841307 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.159256 Sep 13 18:09:39.701701 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4207/8361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:39 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:40.725468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:40.726140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:40.733140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:40.733634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:40.734116 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:40.734827 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:40.735297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:40.735738 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:40.871680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:40.879912 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3095d811-b8aa-4122-979c-6b7231ded28e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.158918 Sep 13 18:09:40.880493 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4155/8362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:40 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:41.904346 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:41.904951 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:41.912234 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:41.912731 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:41.913180 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:41.913905 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:41.914378 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:41.914816 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:42.051936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:42.059811 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-277a9518-f412-4cbc-8d60-af4d3b00ac82 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.159577 Sep 13 18:09:42.060404 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4208/8363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:41 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:43.083898 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:43.084524 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:43.091437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:43.091922 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:43.092362 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:43.093056 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:43.093514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:43.093972 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:43.230476 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:43.239018 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e6444c35-5eea-4d4e-88f0-c9c8065f6cfa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.159222 Sep 13 18:09:43.239610 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4156/8364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:43 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:44.263261 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:44.263893 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:44.271646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:44.272155 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:44.272615 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:44.273331 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:44.273804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:44.274276 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:44.410023 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:44.418030 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cf82588a-51c3-4dbd-89eb-71362a5527aa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.158664 Sep 13 18:09:44.418626 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4209/8365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:44 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:09:45.443493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:45.444066 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:45.451010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:45.451505 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:45.451954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:45.452655 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:45.453126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:45.453565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:45.586747 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:45.594620 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-40e58e58-a76d-4a10-b2f6-6dc1c46744dc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.155979 Sep 13 18:09:45.595198 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4157/8366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:45 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:46.619611 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:46.620298 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:46.629504 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:46.630050 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:46.630514 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:46.631236 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:46.631783 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:46.632464 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:46.775159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:46.787697 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b498355f-fd21-4b7f-bbf4-813f82a85f0f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.172102 Sep 13 18:09:46.788609 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4210/8367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:46 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:47.818626 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:47.819231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:47.826200 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:47.826691 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:47.827132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:47.827841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:47.828307 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:47.828742 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:48.017668 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:48.025918 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e877313f-eed0-4143-9244-b2c92a993a68 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.212250 Sep 13 18:09:48.026501 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4158/8368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:47 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:49.050844 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:49.051480 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:49.058617 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:49.059125 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:49.059579 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:49.060295 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:49.060773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:49.061214 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:49.193345 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:49.201069 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6b9826db-39f0-4f77-9723-a5ad0b97b5a9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.154806 Sep 13 18:09:49.201653 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4211/8369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:49 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:50.224719 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:50.225343 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:50.232458 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:50.232955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:50.233403 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.234132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:50.234603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:50.235050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:50.374924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:50.383432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a28b4169-c083-4013-a656-a3d4bbbc8042 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.162666 Sep 13 18:09:50.384030 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4159/8370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:50 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:51.408058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:51.408772 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:51.415915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.416426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.416883 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.417606 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.418113 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.418563 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.554140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:51.562077 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-6a7c70d5-cd9b-4956-87a4-00ca9afb6d63 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1568 microversion: 2.1 time: 0.158050 Sep 13 18:09:51.562664 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4212/8371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:51 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:51.584993 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:51.585632 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:51.592498 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.592986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.593493 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.594215 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.594676 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.595107 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.686272 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122327) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 18:09:51.758712 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-52f443ab-b7dd-4a92-a9bb-0ce7d46bcfe8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "POST /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913/action" status: 202 len: 0 microversion: 2.1 time: 0.177769 Sep 13 18:09:51.759338 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4160/8372] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:09:51 2022] POST /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:09:51.767539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:51.768434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:51.775438 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.775629 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.776008 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.776733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:51.777207 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:51.777655 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:51.975509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:51.983440 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0fe38160-860b-4e23-9742-a6df505e452f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1516 microversion: 2.1 time: 0.219842 Sep 13 18:09:51.984120 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4213/8373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:51 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:09:52.647032 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-68b2a640-ac3b-44bc-98e6-93ae56e35c10 req-e196fe66-e881-4b60-997e-98dfe4b5d6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "name": "network-vif-unplugged", "status": "completed", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:09:52.659913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-68b2a640-ac3b-44bc-98e6-93ae56e35c10 req-e196fe66-e881-4b60-997e-98dfe4b5d6ba service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:52.662312 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-68b2a640-ac3b-44bc-98e6-93ae56e35c10 req-e196fe66-e881-4b60-997e-98dfe4b5d6ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:52.663137 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-68b2a640-ac3b-44bc-98e6-93ae56e35c10 req-e196fe66-e881-4b60-997e-98dfe4b5d6ba service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:52.676372 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.compute.server_external_events [req-68b2a640-ac3b-44bc-98e6-93ae56e35c10 req-e196fe66-e881-4b60-997e-98dfe4b5d6ba service nova] Unable to find a host for instance eb79f407-61ba-4df5-8809-c0d3aee14913. Dropping event network-vif-unplugged {{(pid=122327) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 18:09:52.678501 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-68b2a640-ac3b-44bc-98e6-93ae56e35c10 req-e196fe66-e881-4b60-997e-98dfe4b5d6ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036689 Sep 13 18:09:52.679556 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4161/8374] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 18:09:53.007725 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:53.008353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:53.015416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.015920 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.016373 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.017086 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:53.017555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:53.018649 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:53.162245 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:53.170352 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3a35bb9e-1b92-4a85-9853-9018c93a9050 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1518 microversion: 2.1 time: 0.166527 Sep 13 18:09:53.170944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4214/8375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:53 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:54.196539 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:54.197371 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:54.204259 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.204749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.205246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.205983 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:54.206438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:54.206895 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:54.341929 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:54.349971 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-afffd53f-f803-45d0-bafd-5f02a8cf707e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1518 microversion: 2.1 time: 0.157649 Sep 13 18:09:54.350639 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4162/8376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:54 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:55.373685 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:55.374315 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:55.382475 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:55.382983 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:55.383440 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:55.384164 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:55.384636 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:55.385075 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:55.528078 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:55.536286 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a18197e7-fe26-4e21-9960-7919334c22d2 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1518 microversion: 2.1 time: 0.166704 Sep 13 18:09:55.536872 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4215/8377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:55 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:56.559634 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:56.560251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:56.567810 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:56.568559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:56.568998 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:56.569698 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:56.570183 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:56.570612 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:56.703841 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:56.712000 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c2b293ea-906e-45a6-871c-91fb192baafb tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1518 microversion: 2.1 time: 0.156257 Sep 13 18:09:56.712577 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4163/8378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:56 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:57.734786 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:57.735497 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:57.743677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:57.744188 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:57.744643 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:57.745390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:57.745896 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:57.746349 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:57.884702 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:57.893370 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-94fe50a3-488f-4e66-a52a-6003a8f0819e tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.161737 Sep 13 18:09:57.894001 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4216/8379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:57 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:09:58.916583 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:09:58.917206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:09:58.924288 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:58.924780 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:58.925219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:58.925952 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:09:58.926416 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:09:58.926849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:09:59.071042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:09:59.078828 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7d1b7375-e66c-4a68-b007-3d4101c38bd1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.166189 Sep 13 18:09:59.079414 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4164/8380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:09:58 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:00.103383 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:00.104005 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:00.110982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:00.112322 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:00.112968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:00.113686 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:00.114225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:00.114679 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:00.247286 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:00.255074 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-00503e09-1eca-41dc-9603-c5be9ea37ffa tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.155618 Sep 13 18:10:00.255650 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4217/8381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:00 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:01.278528 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:01.279140 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:01.286653 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:01.287132 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:01.287571 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:01.288264 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:01.288721 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:01.289148 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:01.420674 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:01.429197 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-07d6dcfb-272d-4484-8c8f-3d382dc93160 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.154569 Sep 13 18:10:01.429778 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4165/8382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:01 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:02.452669 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:02.453218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:02.460694 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:02.461199 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:02.461646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:02.462376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:02.462847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:02.463289 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:02.599859 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:02.607690 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-a3a31cd5-1457-4131-80ba-1c92b69fba04 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.159327 Sep 13 18:10:02.608278 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4218/8383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:02 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:03.632594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:03.633308 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:03.640228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:03.640727 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:03.641177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:03.641912 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:03.642382 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:03.643474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:03.776425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:03.784581 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-eb0a6a5e-a0c9-4cf2-bc5b-e66eb26247d1 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.156000 Sep 13 18:10:03.785159 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4166/8384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:03 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:04.808136 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:04.808762 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:04.815745 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:04.816239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:04.816707 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:04.817396 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:04.817888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:04.818602 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:04.949845 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:04.958168 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-9fa89cf4-9dc9-4a4f-afeb-70f7341b0bde tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.153954 Sep 13 18:10:04.958749 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4219/8385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:04 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:05.982334 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:05.982958 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:05.990101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:05.990595 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:05.991041 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:05.991740 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:05.992212 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:05.992645 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:05.996660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:06.128944 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:06.136799 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6759324a-2cf0-4d5d-b77b-566e4ca92bf6 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.158450 Sep 13 18:10:06.137376 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4167/8386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:05 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:07.161109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:07.161849 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:07.169058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:07.169565 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:07.170049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:07.170773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:07.171250 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:07.171693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:07.176726 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=85 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:07.315429 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:07.323667 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-87b59de7-4df3-462e-8261-0977bd4186fc tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.166938 Sep 13 18:10:07.324273 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4220/8387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:07 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:08.347556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:08.348112 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:08.350907 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:08.356319 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:08.356811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:08.357253 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:08.357982 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:08.358450 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:08.358884 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:08.501447 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:08.510336 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fc95ba77-2027-4a84-bf8f-948258dd8372 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.166861 Sep 13 18:10:08.511156 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4168/8388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:08 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:08.740150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-3983509b-bd59-4aa7-b2d1-fd06e70c85b2 req-5cb32bfb-4946-4c51-aa05-6aa378c5095b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "name": "network-vif-plugged", "status": "completed", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:10:08.746982 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=33 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:10:08.751467 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3983509b-bd59-4aa7-b2d1-fd06e70c85b2 req-5cb32bfb-4946-4c51-aa05-6aa378c5095b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:08.752812 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3983509b-bd59-4aa7-b2d1-fd06e70c85b2 req-5cb32bfb-4946-4c51-aa05-6aa378c5095b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:08.753325 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-3983509b-bd59-4aa7-b2d1-fd06e70c85b2 req-5cb32bfb-4946-4c51-aa05-6aa378c5095b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:08.764933 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-3983509b-bd59-4aa7-b2d1-fd06e70c85b2 req-5cb32bfb-4946-4c51-aa05-6aa378c5095b service nova] Creating event network-vif-plugged:d0aa49fc-f643-4d45-a8b4-a17a2297cbc5 for instance eb79f407-61ba-4df5-8809-c0d3aee14913 on n-h2-857467-1 Sep 13 18:10:08.770186 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-3983509b-bd59-4aa7-b2d1-fd06e70c85b2 req-5cb32bfb-4946-4c51-aa05-6aa378c5095b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034326 Sep 13 18:10:08.770803 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4221/8389] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:10:09.534891 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:09.535526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:09.542703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:09.543193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:09.543636 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:09.544352 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:09.544819 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:09.545251 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:09.677188 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:09.685542 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7ce9acc0-885a-43cc-898e-2b6599efd315 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1574 microversion: 2.1 time: 0.155598 Sep 13 18:10:09.686142 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4169/8390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:09 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:10:10.710914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:10:10.711605 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:10:10.717850 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:10.718364 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:10.718811 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:10.719512 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:10:10.719987 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:10:10.720428 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:10:10.858259 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:10:10.866504 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-465a31fa-a3b1-4bad-8d6c-07278a5ed87d tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1561 microversion: 2.1 time: 0.161666 Sep 13 18:10:10.867094 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4222/8391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:10:10 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:25.054853 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:25.055625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=16 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:25.060734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=3 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:25.061652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=13 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:25.063680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:25.064245 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:25.066628 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-9bf874de-4ef9-4e4d-83b3-9145a57d3a01 req-6785ddb9-2270-4881-bbe3-aeac16f5a012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:25.076033 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:25.076464 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:25.076941 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:25.077666 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:25.078445 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9bf874de-4ef9-4e4d-83b3-9145a57d3a01 req-6785ddb9-2270-4881-bbe3-aeac16f5a012 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:25.078811 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:25.078930 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9bf874de-4ef9-4e4d-83b3-9145a57d3a01 req-6785ddb9-2270-4881-bbe3-aeac16f5a012 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:25.079257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:25.079391 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-9bf874de-4ef9-4e4d-83b3-9145a57d3a01 req-6785ddb9-2270-4881-bbe3-aeac16f5a012 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:25.096548 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-9bf874de-4ef9-4e4d-83b3-9145a57d3a01 req-6785ddb9-2270-4881-bbe3-aeac16f5a012 service nova] Creating event network-changed:d0aa49fc-f643-4d45-a8b4-a17a2297cbc5 for instance eb79f407-61ba-4df5-8809-c0d3aee14913 on n-h2-857467-1 Sep 13 18:11:25.103414 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-9bf874de-4ef9-4e4d-83b3-9145a57d3a01 req-6785ddb9-2270-4881-bbe3-aeac16f5a012 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046453 Sep 13 18:11:25.104437 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4223/8392] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:25.111999 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:11:25.203818 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3b668026-6f5f-4c5d-8b3e-1248c4c3ef05 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "DELETE /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 204 len: 0 microversion: 2.1 time: 0.150538 Sep 13 18:11:25.204422 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4170/8393] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 18:11:25 2022] DELETE /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:11:25.213140 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:25.213892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:25.220444 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:25.220948 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:25.221460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:25.222216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:25.222693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:25.223144 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:25.365671 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:25.373704 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5cd80370-dd33-4c70-8363-a12ffcae5360 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.164805 Sep 13 18:11:25.374329 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4224/8394] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:25 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:26.396736 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:26.397488 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:26.404648 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:26.405142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:26.405589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:26.406337 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:26.406803 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:26.407241 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:26.582429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:26.590391 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-48673534-cb50-4cdd-8d4e-be33550d3bd8 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1567 microversion: 2.1 time: 0.197923 Sep 13 18:11:26.591260 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4171/8395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:26 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:27.450302 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-d6050e91-8b9b-4204-b398-8b7d0225d047 req-41a779a4-be79-4ac9-a561-63e1b51ca3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb79f407-61ba-4df5-8809-c0d3aee14913", "name": "network-vif-deleted", "tag": "d0aa49fc-f643-4d45-a8b4-a17a2297cbc5"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:27.462687 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6050e91-8b9b-4204-b398-8b7d0225d047 req-41a779a4-be79-4ac9-a561-63e1b51ca3d2 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:27.463182 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6050e91-8b9b-4204-b398-8b7d0225d047 req-41a779a4-be79-4ac9-a561-63e1b51ca3d2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:27.463623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-d6050e91-8b9b-4204-b398-8b7d0225d047 req-41a779a4-be79-4ac9-a561-63e1b51ca3d2 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:27.476597 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-d6050e91-8b9b-4204-b398-8b7d0225d047 req-41a779a4-be79-4ac9-a561-63e1b51ca3d2 service nova] Creating event network-vif-deleted:d0aa49fc-f643-4d45-a8b4-a17a2297cbc5 for instance eb79f407-61ba-4df5-8809-c0d3aee14913 on n-h2-857467-1 Sep 13 18:11:27.483626 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-d6050e91-8b9b-4204-b398-8b7d0225d047 req-41a779a4-be79-4ac9-a561-63e1b51ca3d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Sep 13 18:11:27.484244 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4225/8396] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:27.614948 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:27.615518 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:27.623101 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:27.623610 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:27.624045 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:27.624791 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:27.625257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:27.625692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:27.688492 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:27.697006 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-351467b9-9454-4605-9adf-c27564e929e4 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1218 microversion: 2.1 time: 0.086123 Sep 13 18:11:27.697590 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4172/8397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:27 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:28.720607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:28.721426 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:28.728545 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:28.729051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:28.729517 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:28.730260 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:28.731263 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:28.731710 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:28.799189 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:28.807094 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-059aa33f-3292-4310-982f-8ee42ca618bd tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1218 microversion: 2.1 time: 0.090825 Sep 13 18:11:28.807684 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4226/8398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:28 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:29.832410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:29.833477 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:29.840639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:29.841262 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:29.841792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:29.842541 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:29.843013 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:29.843461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:29.908120 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:29.916395 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-b7ed9dbb-e9c6-4c3f-8128-17f1c08d9369 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1218 microversion: 2.1 time: 0.088306 Sep 13 18:11:29.916992 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4173/8399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:29 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:30.939773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:30.940453 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:30.948037 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:30.948551 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:30.949012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:30.949739 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:30.950243 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:30.951204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:31.017819 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:31.025767 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-45650a1d-dd69-47c8-98de-caa76cf8e583 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1218 microversion: 2.1 time: 0.089903 Sep 13 18:11:31.026427 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4227/8400] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:30 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:32.049364 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:32.049930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:32.057499 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:32.058928 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:32.059375 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:32.061298 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:32.062023 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:32.062679 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:32.102845 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:32.103341 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:32.103782 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:32.104257 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lazy-loading 'fault' on Instance uuid eb79f407-61ba-4df5-8809-c0d3aee14913 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:11:32.152121 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f2c43f41e45f6bf83d482cca2f7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0164701854444abf1c6833cded41dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:32.162216 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5890a1b3-74a4-478a-8248-86d5771c92c9 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 200 len: 1223 microversion: 2.1 time: 0.116901 Sep 13 18:11:32.162808 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4174/8401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:32 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:33.187652 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:33.188287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] [instance: eb79f407-61ba-4df5-8809-c0d3aee14913] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:33.195668 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:33.196167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:33.196619 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:33.197330 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:33.197804 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:33.198268 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:33.213007 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] HTTP exception thrown: Instance eb79f407-61ba-4df5-8809-c0d3aee14913 could not be found. Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Request method failure captured: Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 HTTP/1.1 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMV_mCSnVi48X7RjWJJDEYkV1UgnAtdyGRklypPNFiq2t7sBof_mzxrlUnLqRNl-50sW9MoD9FqWIyaH9CUjnrYW4bd690lRGLlNh75ZVmnS6A0rbYpOQGXA_BXbXrJOO1FqkhK-SBZp2PYdCSlSLk89-p3vW3EqClXx43mP-k3LT6s Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: ea0164701854444abf1c6833cded41dd Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestShelveInstance-688196816 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea0164701854444abf1c6833cded41dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea0164701854444abf1c6833cded41dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea0164701854444abf1c6833cded41dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea0164701854444abf1c6833cded41dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestShelveInstance-688196816 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: ea0164701854444abf1c6833cded41dd Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestShelveInstance-688196816 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestShelveInstance-688196816-project Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: 116f2c43f41e45f6bf83d482cca2f7d0 Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestShelveInstance-688196816-project Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance eb79f407-61ba-4df5-8809-c0d3aee14913 could not be found. Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': 'eb79f407-61ba-4df5-8809-c0d3aee14913'} Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb79f407-61ba-4df5-8809-c0d3aee14913 could not be found. Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb79f407-61ba-4df5-8809-c0d3aee14913 could not be found. Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:11:33.214714 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb79f407-61ba-4df5-8809-c0d3aee14913 could not be found. Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Returning 404 to user: Instance eb79f407-61ba-4df5-8809-c0d3aee14913 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d2ea1d69-48ca-4045-a210-5078970c477f tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913" status: 404 len: 111 microversion: 2.1 time: 0.033503 Sep 13 18:11:33.219730 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4228/8402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:33 2022] GET /compute/v2.1/servers/eb79f407-61ba-4df5-8809-c0d3aee14913 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:11:33.381911 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6bcd1600-c9ac-4e68-98f2-3c920f0768f3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] Calling method '.version_select at 0x7fbeaff9eee0>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:33.421766 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6bcd1600-c9ac-4e68-98f2-3c920f0768f3 tempest-TestShelveInstance-688196816 tempest-TestShelveInstance-688196816-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1056827376" status: 202 len: 0 microversion: 2.1 time: 0.043717 Sep 13 18:11:33.422419 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4175/8403] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Sep 13 18:11:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1056827376 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 18:11:51.346722 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=12 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:51.349058 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=24 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:51.583929 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5b6cfb0b-55a0-48d5-a90c-fd45e23f3663 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Action: 'create', calling method: .version_select at 0x7fbeb4067ee0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1999688691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6iTS6jk0Tz+s64w93XFnd4rpABKfKNxmpzeHHL19RENaUa+8BHqNAmgBKhYY0yRPdLvDVmTwRRlMc+B66sm1Hcrn9hSRSQ5mlyjsOHao2Y2fC558Iy6aZSISAiVIxkA=="}} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:51.600888 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5b6cfb0b-55a0-48d5-a90c-fd45e23f3663 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Getting quotas for project 917c49b8ab3d449b9986d8ff4d3472ea. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:11:51.607332 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.quota [None req-5b6cfb0b-55a0-48d5-a90c-fd45e23f3663 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Getting quotas for user a2e735e79bae4c3babd1a9cf25f4beb9 and project 917c49b8ab3d449b9986d8ff4d3472ea. Resources: {'key_pairs'} {{(pid=122328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:11:51.638309 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5b6cfb0b-55a0-48d5-a90c-fd45e23f3663 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.298477 Sep 13 18:11:51.638972 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4229/8404] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Sep 13 18:11:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:11:52.666954 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-149194408", "imageRef": "5853c870-0393-4bca-bd0a-d3ea26765a2c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1999688691", "security_groups": [{"name": "tempest-secgroup-smoke-885958507"}], "networks": [{"uuid": "b28c7ddb-078e-42de-89ab-dfcb301f040e"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:52.677438 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:52.678570 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:11:52.791589 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] validate_networks() for [('b28c7ddb-078e-42de-89ab-dfcb301f040e', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:11:53.204976 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:11:53.205402 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:11:53.206061 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:11:53.206474 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:11:53.206915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:11:53.216015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:53.216599 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:53.217044 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:53.217777 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:53.218277 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:53.218706 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:53.235975 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Getting quotas for project 917c49b8ab3d449b9986d8ff4d3472ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:11:53.241185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Getting quotas for user a2e735e79bae4c3babd1a9cf25f4beb9 and project 917c49b8ab3d449b9986d8ff4d3472ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:11:53.254097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:11:53.256429 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5853c870-0393-4bca-bd0a-d3ea26765a2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:11:53.307006 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9872027d-f3be-44de-974d-59f82f378f13 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.644108 Sep 13 18:11:53.307871 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4176/8405] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 18:11:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:11:53.320413 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-3cd674de-7f8b-4e82-836d-e3b32b59d6a0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:53.321052 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-3cd674de-7f8b-4e82-836d-e3b32b59d6a0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:53.380968 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-3cd674de-7f8b-4e82-836d-e3b32b59d6a0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:53.389448 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-3cd674de-7f8b-4e82-836d-e3b32b59d6a0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1248 microversion: 2.1 time: 0.073633 Sep 13 18:11:53.390116 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4230/8406] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:53 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:54.423050 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:54.423951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:54.431978 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:54.432543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:54.432932 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:54.433901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:54.434410 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:54.434903 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:54.557185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:54.570432 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c1b06c52-85be-4d93-9fe9-369bd2385dc6 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1308 microversion: 2.1 time: 0.160765 Sep 13 18:11:54.571648 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4177/8407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:54 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:55.595603 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:55.597073 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:55.604807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:55.605316 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:55.605797 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:55.607197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:55.607673 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:55.608115 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:55.756442 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:55.767552 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ca0b69ca-df49-4bf3-bb47-845c9b5981fe tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.175797 Sep 13 18:11:55.769133 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4231/8408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:55 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:56.310225 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-f436c9c2-bebe-4ce6-987f-08739ddc876f req-1d80769c-6402-465b-8b62-ef4702a50704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:11:56.321902 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f436c9c2-bebe-4ce6-987f-08739ddc876f req-1d80769c-6402-465b-8b62-ef4702a50704 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:56.322752 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f436c9c2-bebe-4ce6-987f-08739ddc876f req-1d80769c-6402-465b-8b62-ef4702a50704 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:56.323439 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-f436c9c2-bebe-4ce6-987f-08739ddc876f req-1d80769c-6402-465b-8b62-ef4702a50704 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:56.346039 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-f436c9c2-bebe-4ce6-987f-08739ddc876f req-1d80769c-6402-465b-8b62-ef4702a50704 service nova] Creating event network-changed:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:11:56.351417 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-f436c9c2-bebe-4ce6-987f-08739ddc876f req-1d80769c-6402-465b-8b62-ef4702a50704 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047302 Sep 13 18:11:56.352106 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4178/8409] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 18:11:56.791970 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:56.792543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:56.800353 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:56.801381 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:56.801937 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:56.802676 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:56.803167 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:56.803624 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:56.950607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:56.959405 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-d3bafe08-c872-48f5-8894-46848209c7f1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.171398 Sep 13 18:11:56.959965 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4232/8410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:56 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:57.983924 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:57.984663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:57.990927 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:57.991419 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:57.991868 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:57.992561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:57.993027 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:57.993465 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:58.227353 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:58.235782 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-5eff8ce5-489f-45d7-891b-14033a6920eb tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.257682 Sep 13 18:11:58.236362 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4179/8411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:57 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:11:59.259088 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:11:59.259761 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:11:59.267607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:59.268159 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:59.268623 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:59.269650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:11:59.270170 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:11:59.270622 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:11:59.461227 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:11:59.469211 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-27484d7d-befb-4ea2-a8cc-5c73b2853c27 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.214127 Sep 13 18:11:59.469795 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4233/8412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:11:59 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:00.493010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:00.493630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:00.500913 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:00.501339 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:00.501776 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:00.502495 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:00.502963 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:00.503390 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:00.636836 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:00.645157 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-0b47aeaa-f56e-4d0e-ab04-5c2f0752a514 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.156154 Sep 13 18:12:00.645736 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4180/8413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:00 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:01.668163 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:01.669530 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:01.676789 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:01.677293 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:01.677754 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:01.678496 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:01.678972 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:01.679449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:01.815479 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:01.823833 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-e8ec4ddb-fb6a-4fd1-acc4-3c59104099b1 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.159519 Sep 13 18:12:01.824331 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4234/8414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:01 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:02.850917 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:02.851531 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:02.858663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:02.859149 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:02.859591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:02.860284 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:02.860744 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:02.861170 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:02.993483 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:03.002669 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-9a016fea-967f-4f5b-9830-006d63abe915 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.155452 Sep 13 18:12:03.003316 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4181/8415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:02 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:03.308357 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-04f18672-587e-4eab-b161-ca542f7aa97c req-fcee7bcd-bbcd-4ec2-89b4-cdeb3bae2299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "name": "network-vif-plugged", "status": "completed", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:12:03.320592 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-04f18672-587e-4eab-b161-ca542f7aa97c req-fcee7bcd-bbcd-4ec2-89b4-cdeb3bae2299 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:03.321109 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-04f18672-587e-4eab-b161-ca542f7aa97c req-fcee7bcd-bbcd-4ec2-89b4-cdeb3bae2299 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:03.321564 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-04f18672-587e-4eab-b161-ca542f7aa97c req-fcee7bcd-bbcd-4ec2-89b4-cdeb3bae2299 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:03.333513 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-04f18672-587e-4eab-b161-ca542f7aa97c req-fcee7bcd-bbcd-4ec2-89b4-cdeb3bae2299 service nova] Creating event network-vif-plugged:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:12:03.338524 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-04f18672-587e-4eab-b161-ca542f7aa97c req-fcee7bcd-bbcd-4ec2-89b4-cdeb3bae2299 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094822 Sep 13 18:12:03.339140 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4235/8416] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:12:04.026167 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:04.026785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:04.029543 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:04.030418 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:04.037385 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:04.037901 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:04.038346 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:04.039040 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:04.039503 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:04.039931 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:04.171261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:04.179736 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-27672d4c-4b95-426c-a7ef-ef0623ac6619 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1373 microversion: 2.1 time: 0.157415 Sep 13 18:12:04.180305 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4182/8417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:04 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:05.200137 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=6 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:12:05.205148 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:05.205798 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:05.212253 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.212753 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.213204 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.213923 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.214458 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.214903 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.354578 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:05.363627 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-b2510736-9749-413a-9b39-f69a03b4bfff tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1558 microversion: 2.1 time: 0.164422 Sep 13 18:12:05.364239 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4236/8418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:05 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:05.385538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:12:05.386185 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:12:05.393025 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.393517 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.394001 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.394703 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:05.395169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:05.395608 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:05.547855 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:12:05.555687 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-be12895a-30af-4caa-a25d-e52bef1262f0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1558 microversion: 2.1 time: 0.174014 Sep 13 18:12:05.556280 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4183/8419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:12:05 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:12:07.268422 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-a94cae68-c3aa-4846-b873-2d0f5e944b53 req-f90deed2-ed3f-48d7-9d3b-e03eff4b8b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:12:07.279638 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a94cae68-c3aa-4846-b873-2d0f5e944b53 req-f90deed2-ed3f-48d7-9d3b-e03eff4b8b6b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:12:07.280157 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a94cae68-c3aa-4846-b873-2d0f5e944b53 req-f90deed2-ed3f-48d7-9d3b-e03eff4b8b6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:12:07.280650 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-a94cae68-c3aa-4846-b873-2d0f5e944b53 req-f90deed2-ed3f-48d7-9d3b-e03eff4b8b6b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:12:07.292994 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-a94cae68-c3aa-4846-b873-2d0f5e944b53 req-f90deed2-ed3f-48d7-9d3b-e03eff4b8b6b service nova] Creating event network-changed:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:12:07.299066 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-a94cae68-c3aa-4846-b873-2d0f5e944b53 req-f90deed2-ed3f-48d7-9d3b-e03eff4b8b6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101397 Sep 13 18:12:07.300228 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4237/8420] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:14:43.976568 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:14:43.977469 n-d-857467-1 devstack@n-api.service[122327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 18:14:43.978301 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:43.979042 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=40 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:43.980048 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:14:43.980252 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851/action (ip 10.222.0.61) !!! Sep 13 18:14:43.982030 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:14:43.982162 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851/action (ip 10.222.0.61) !!! Sep 13 18:14:43.984063 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:14:43.984186 n-d-857467-1 devstack@n-api.service[122327]: Tue Sep 13 18:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851/action (ip 10.222.0.61) !!! Sep 13 18:14:44.000814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1263234875"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:44.003193 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:14:44.014158 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:44.014649 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:44.015093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:44.015795 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:44.016254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:44.016686 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:44.223843 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-14d94d12-7180-476b-a9ea-2611c75a9902 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "POST /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851/action" status: 202 len: 0 microversion: 2.1 time: 0.248893 Sep 13 18:14:44.224507 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4184/8421] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:14:43 2022] POST /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 18:14:52.072628 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:14:52.073466 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:14:52.074168 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:52.074938 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=34 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:14:52.076022 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:14:52.076197 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 13 18:14:52.078577 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 18:14:52.078719 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 13 18:14:52.080835 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 18:14:52.080962 n-d-857467-1 devstack@n-api.service[122328]: Tue Sep 13 18:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 13 18:14:52.115881 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-c3bc3b14-fe82-4d5e-8c95-002745d9897f req-9e3aca4c-39e3-403b-982e-e8b4539bb989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "name": "network-vif-plugged", "status": "completed", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:14:52.131646 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c3bc3b14-fe82-4d5e-8c95-002745d9897f req-9e3aca4c-39e3-403b-982e-e8b4539bb989 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:14:52.132466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c3bc3b14-fe82-4d5e-8c95-002745d9897f req-9e3aca4c-39e3-403b-982e-e8b4539bb989 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:14:52.133218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-c3bc3b14-fe82-4d5e-8c95-002745d9897f req-9e3aca4c-39e3-403b-982e-e8b4539bb989 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:14:52.148059 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-c3bc3b14-fe82-4d5e-8c95-002745d9897f req-9e3aca4c-39e3-403b-982e-e8b4539bb989 service nova] Creating event network-vif-plugged:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:14:52.154753 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-c3bc3b14-fe82-4d5e-8c95-002745d9897f req-9e3aca4c-39e3-403b-982e-e8b4539bb989 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085079 Sep 13 18:14:52.155469 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4238/8422] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:15:02.897745 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:02.898556 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:02.904880 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1325435122", "imageRef": "f07baaf0-54c5-4589-b765-efcf08f40b44", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1999688691", "security_groups": [{"name": "tempest-secgroup-smoke-885958507"}], "networks": [{"uuid": "b28c7ddb-078e-42de-89ab-dfcb301f040e"}]}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:15:02.932601 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [684f0caa-203b-4a09-8c66-385134a83888] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42588. Sep 13 18:15:02.933356 n-d-857467-1 devstack@n-api.service[122327]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a7e39fe-6809-4584-b09a-0f73ae612dfb] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42590. Sep 13 18:15:03.023893 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.network.neutron [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] validate_networks() for [('b28c7ddb-078e-42de-89ab-dfcb301f040e', None, None, None, None, None)] {{(pid=122327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 18:15:03.448330 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Flavor limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 18:15:03.448753 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Image limits 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 18:15:03.449226 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Flavor pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 18:15:03.449643 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Image pref 0:0:0 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 18:15:03.450093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.virt.hardware [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 18:15:03.459049 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:03.459472 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:03.459915 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:03.460639 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:03.461097 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:03.461525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:03.479227 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Getting quotas for project 917c49b8ab3d449b9986d8ff4d3472ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 18:15:03.484487 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.quota [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Getting quotas for user a2e735e79bae4c3babd1a9cf25f4beb9 and project 917c49b8ab3d449b9986d8ff4d3472ea. Resources: {'ram', 'instances', 'cores'} {{(pid=122327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 18:15:03.499051 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Going to run 1 instances... {{(pid=122327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 18:15:03.501635 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f07baaf0-54c5-4589-b765-efcf08f40b44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 18:15:03.552427 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-6ad33c08-58ff-46c2-a9a7-56026c742c3e tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.657519 Sep 13 18:15:03.553093 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4185/8423] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Sep 13 18:15:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 18:15:03.564747 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f7e15a06-825b-4db7-bfef-f8edf8d63cee tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:03.565620 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f7e15a06-825b-4db7-bfef-f8edf8d63cee tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:03.569274 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:03.569975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:03.583278 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [74819f8f-25d3-49ec-a339-6bf0cd8c2f7b] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42604. Sep 13 18:15:03.585069 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b846141-065b-4b20-8bb8-3eaf5fbc3fb8] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42606. Sep 13 18:15:03.635285 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f7e15a06-825b-4db7-bfef-f8edf8d63cee tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:03.643379 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f7e15a06-825b-4db7-bfef-f8edf8d63cee tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1249 microversion: 2.1 time: 0.082619 Sep 13 18:15:03.643896 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4239/8424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:03 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:04.666461 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:04.667030 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:04.674115 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:04.674614 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:04.675596 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:04.676289 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:04.676761 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:04.677219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:04.780010 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:04.793365 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-4b65c929-abe8-4cd8-8523-06c1b7f75485 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1309 microversion: 2.1 time: 0.131035 Sep 13 18:15:04.805467 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4186/8425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:04 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:05.819061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:05.820249 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:05.828449 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:05.829001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:05.829460 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:05.830218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:05.830689 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:05.831874 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:06.012197 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:06.020555 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-ce578d51-0ceb-44a1-91b1-f2b4fc1cf82b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.206529 Sep 13 18:15:06.025162 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4240/8426] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:05 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:06.130764 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-473e2290-30c8-4e4c-8748-09258a9cd742 req-4d06f0b8-2348-4e31-9e88-3dabf877737d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "name": "network-vif-unplugged", "status": "completed", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:15:06.144699 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-473e2290-30c8-4e4c-8748-09258a9cd742 req-4d06f0b8-2348-4e31-9e88-3dabf877737d service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:06.145538 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-473e2290-30c8-4e4c-8748-09258a9cd742 req-4d06f0b8-2348-4e31-9e88-3dabf877737d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:06.146220 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-473e2290-30c8-4e4c-8748-09258a9cd742 req-4d06f0b8-2348-4e31-9e88-3dabf877737d service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:06.162503 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-473e2290-30c8-4e4c-8748-09258a9cd742 req-4d06f0b8-2348-4e31-9e88-3dabf877737d service nova] Creating event network-vif-unplugged:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:15:06.168240 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-473e2290-30c8-4e4c-8748-09258a9cd742 req-4d06f0b8-2348-4e31-9e88-3dabf877737d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043389 Sep 13 18:15:06.169544 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4187/8427] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:15:07.044123 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:07.044803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:07.052871 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:07.053390 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:07.053946 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:07.054691 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:07.055173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:07.055991 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:07.208436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:07.216840 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-f08bc5b7-4583-4882-bcf2-20e653fc9c24 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.176511 Sep 13 18:15:07.217421 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4241/8428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:07 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:08.243046 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:08.243749 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:08.250015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:08.250507 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:08.250955 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:08.251659 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:08.252124 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:08.252560 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:08.398616 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:08.406448 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c04cc176-58d3-4f78-be81-644bb6ccc7fa tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.169423 Sep 13 18:15:08.407058 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4188/8429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:08 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:15:09.430354 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:09.430980 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:09.437922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:09.438436 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:09.438892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:09.439607 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:09.440083 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:09.441036 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:09.589490 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:09.598887 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2de8be7a-46e1-4f8a-b71c-fff5b2b7b2bf tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.172396 Sep 13 18:15:09.599490 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4242/8430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:09 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:15:10.622548 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:10.623145 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:10.630765 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:10.631261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:10.631709 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:10.632414 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:10.632883 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:10.633323 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:10.783930 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:10.792746 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-d5e8976a-2fe7-4b5b-9278-cf29eb13624b tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.174065 Sep 13 18:15:10.793345 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4189/8431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:10 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:11.816171 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:11.817021 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:11.824173 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:11.824677 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:11.825134 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:11.825847 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:11.826338 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:11.826781 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:11.982574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:11.991908 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-cda96e98-84ea-4730-a022-1e7b2eb475f2 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.180211 Sep 13 18:15:12.006652 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4243/8432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:11 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:13.017695 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:13.019561 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:13.031316 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:13.032254 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:13.032951 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:13.034011 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:13.034861 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:13.035565 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:13.184425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:13.192495 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-3c105def-9c88-46a0-8c58-d5db0b160d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.179883 Sep 13 18:15:13.193285 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4190/8433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:13 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:14.219237 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:14.219891 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:14.222915 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell0:SELECT=2 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:14.228305 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:14.228803 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:14.229252 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:14.230001 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:14.230476 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:14.230916 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:14.387222 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:14.396799 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-2e3ea4c5-1509-47b9-a7ad-427118b5de6d tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.181372 Sep 13 18:15:14.401882 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4244/8434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:14 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:15.419885 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:15.420509 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:15.422559 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:15.423345 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell0:SELECT=6 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:15:15.430680 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:15.431177 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:15.431619 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:15.432333 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:15.432794 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:15.433224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:15.643366 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:15.656585 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-55cab308-3730-4ab7-9160-648e5f176134 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.240602 Sep 13 18:15:15.657181 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4191/8435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:15 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:16.680529 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:16.682185 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:16.690020 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:16.691509 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:16.692129 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:16.693061 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:16.693543 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:16.694051 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:16.829558 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:16.838118 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-1b30801a-1551-4c5f-bd8e-52cf2b543147 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.161679 Sep 13 18:15:16.838703 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4245/8436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:16 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:17.388681 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [req-9963359f-8166-49ae-9193-076e5879e5a2 req-401add26-179c-44ce-952f-903bab6415c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c347a9-f931-4f26-8309-76df23b4ec57", "tag": "669d351d-bc8d-44b6-8221-feb7cec17b3c"}]} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:15:17.399304 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9963359f-8166-49ae-9193-076e5879e5a2 req-401add26-179c-44ce-952f-903bab6415c5 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:17.399793 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9963359f-8166-49ae-9193-076e5879e5a2 req-401add26-179c-44ce-952f-903bab6415c5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:17.400572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [req-9963359f-8166-49ae-9193-076e5879e5a2 req-401add26-179c-44ce-952f-903bab6415c5 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:17.412890 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.compute.server_external_events [req-9963359f-8166-49ae-9193-076e5879e5a2 req-401add26-179c-44ce-952f-903bab6415c5 service nova] Creating event network-changed:669d351d-bc8d-44b6-8221-feb7cec17b3c for instance 51c347a9-f931-4f26-8309-76df23b4ec57 on n-h1-857467-1 Sep 13 18:15:17.417908 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [req-9963359f-8166-49ae-9193-076e5879e5a2 req-401add26-179c-44ce-952f-903bab6415c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032953 Sep 13 18:15:17.418490 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4192/8437] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:15:17.863320 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:17.864150 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:17.872049 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:17.872570 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:17.873033 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:17.873766 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:17.874284 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:17.874734 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:18.014473 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:18.022273 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-39da1977-c59d-476f-bb41-b3567203a0c0 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.163903 Sep 13 18:15:18.022855 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4246/8438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:17 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:19.046849 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:19.047579 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:19.054573 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:19.055060 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:19.055500 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:19.056206 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:19.056663 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:19.057086 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:19.190425 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:19.198296 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-c443855a-c5b6-46bd-8f45-1de9bacb1621 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.156605 Sep 13 18:15:19.198879 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4193/8439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:19 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:20.220616 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:20.221287 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:20.228246 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:20.228746 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:20.229194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:20.229924 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:20.230400 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:20.230840 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:20.367491 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:20.375463 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-235d53c5-0b6b-46d9-9c81-14fb1bf3229c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.158787 Sep 13 18:15:20.376087 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4247/8440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:20 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:21.399325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:21.399892 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:21.406756 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:21.407246 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:21.407693 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:21.408423 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:21.408934 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:21.409434 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:21.540231 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:21.547954 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ad86d9f8-62d4-454e-becc-e13428ade45c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.152643 Sep 13 18:15:21.548541 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4194/8441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:21 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:22.007952 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-33e74cd1-b07b-4bbe-9710-dc1bd49b9d6d req-f112bc6e-3d66-4a99-ac39-1c473cd769c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c347a9-f931-4f26-8309-76df23b4ec57", "name": "network-vif-plugged", "status": "completed", "tag": "669d351d-bc8d-44b6-8221-feb7cec17b3c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:15:22.018589 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-33e74cd1-b07b-4bbe-9710-dc1bd49b9d6d req-f112bc6e-3d66-4a99-ac39-1c473cd769c4 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:22.019103 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-33e74cd1-b07b-4bbe-9710-dc1bd49b9d6d req-f112bc6e-3d66-4a99-ac39-1c473cd769c4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:22.019555 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-33e74cd1-b07b-4bbe-9710-dc1bd49b9d6d req-f112bc6e-3d66-4a99-ac39-1c473cd769c4 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:22.030766 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-33e74cd1-b07b-4bbe-9710-dc1bd49b9d6d req-f112bc6e-3d66-4a99-ac39-1c473cd769c4 service nova] Creating event network-vif-plugged:669d351d-bc8d-44b6-8221-feb7cec17b3c for instance 51c347a9-f931-4f26-8309-76df23b4ec57 on n-h1-857467-1 Sep 13 18:15:22.036102 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-33e74cd1-b07b-4bbe-9710-dc1bd49b9d6d req-f112bc6e-3d66-4a99-ac39-1c473cd769c4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Sep 13 18:15:22.036704 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4248/8442] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:15:22.571696 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:22.572320 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:22.579187 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:22.579675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:22.580119 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:22.580814 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:22.581290 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:22.581724 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:22.716522 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:22.724586 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-804c117f-3913-4199-bd6f-19e4a6485394 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1374 microversion: 2.1 time: 0.157032 Sep 13 18:15:22.725172 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4195/8443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:22 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:23.749466 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:23.750212 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:23.756495 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:23.756998 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:23.757455 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:23.758194 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:23.758674 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:23.759119 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:23.894892 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:23.902588 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-5ded394c-ac95-41f3-a7e1-19c57f4dde2f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1559 microversion: 2.1 time: 0.158302 Sep 13 18:15:23.903165 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4249/8444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:23 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:15:23.926064 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:15:23.926689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:15:23.933511 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:23.934081 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:23.934525 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:23.935228 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:23.935692 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:23.936126 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:24.075093 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:15:24.083389 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-dc081a0f-d5ec-478e-99df-93b9a6ce2d75 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1559 microversion: 2.1 time: 0.162065 Sep 13 18:15:24.083979 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4196/8445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:15:23 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:15:25.985415 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-7dc9de3b-ec9f-424d-b3bd-13ce0b3b67ad req-1ad6785a-9c90-44da-9e51-be77a6902f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c347a9-f931-4f26-8309-76df23b4ec57", "tag": "669d351d-bc8d-44b6-8221-feb7cec17b3c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:15:25.996094 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7dc9de3b-ec9f-424d-b3bd-13ce0b3b67ad req-1ad6785a-9c90-44da-9e51-be77a6902f40 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:15:25.996633 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7dc9de3b-ec9f-424d-b3bd-13ce0b3b67ad req-1ad6785a-9c90-44da-9e51-be77a6902f40 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:15:25.997216 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-7dc9de3b-ec9f-424d-b3bd-13ce0b3b67ad req-1ad6785a-9c90-44da-9e51-be77a6902f40 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:15:26.012109 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-7dc9de3b-ec9f-424d-b3bd-13ce0b3b67ad req-1ad6785a-9c90-44da-9e51-be77a6902f40 service nova] Creating event network-changed:669d351d-bc8d-44b6-8221-feb7cec17b3c for instance 51c347a9-f931-4f26-8309-76df23b4ec57 on n-h1-857467-1 Sep 13 18:15:26.018732 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-7dc9de3b-ec9f-424d-b3bd-13ce0b3b67ad req-1ad6785a-9c90-44da-9e51-be77a6902f40 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035939 Sep 13 18:15:26.019422 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4250/8446] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:17:27.838005 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:17:27.838775 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=60 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:17:27.895980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1076110404"}} {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:17:27.898437 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:27.904642 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:27.905169 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:27.905611 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:27.906349 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:27.907079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:27.907514 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:28.230939 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-7e707071-e09e-49de-b8ff-db90c9d8edf8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "POST /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57/action" status: 202 len: 0 microversion: 2.1 time: 0.394842 Sep 13 18:17:28.231600 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4197/8447] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Sep 13 18:17:27 2022] POST /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 13 18:17:36.584959 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_api:SELECT=26 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:17:36.585936 n-d-857467-1 devstack@n-api.service[122328]: DEBUG dbcounter [-] [122328] Writing DB stats nova_cell1:SELECT=58 {{(pid=122328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:17:36.663169 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-225a6eae-6420-4dd3-bcd9-f37a9fa86a4c req-f7fe23bf-3b45-4fa5-bd24-a7f0e7175cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c347a9-f931-4f26-8309-76df23b4ec57", "name": "network-vif-plugged", "status": "completed", "tag": "669d351d-bc8d-44b6-8221-feb7cec17b3c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:17:36.674411 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-225a6eae-6420-4dd3-bcd9-f37a9fa86a4c req-f7fe23bf-3b45-4fa5-bd24-a7f0e7175cd6 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:36.674914 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-225a6eae-6420-4dd3-bcd9-f37a9fa86a4c req-f7fe23bf-3b45-4fa5-bd24-a7f0e7175cd6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:36.675370 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-225a6eae-6420-4dd3-bcd9-f37a9fa86a4c req-f7fe23bf-3b45-4fa5-bd24-a7f0e7175cd6 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:36.688093 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-225a6eae-6420-4dd3-bcd9-f37a9fa86a4c req-f7fe23bf-3b45-4fa5-bd24-a7f0e7175cd6 service nova] Creating event network-vif-plugged:669d351d-bc8d-44b6-8221-feb7cec17b3c for instance 51c347a9-f931-4f26-8309-76df23b4ec57 on n-h1-857467-1 Sep 13 18:17:36.694727 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-225a6eae-6420-4dd3-bcd9-f37a9fa86a4c req-f7fe23bf-3b45-4fa5-bd24-a7f0e7175cd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119470 Sep 13 18:17:36.696056 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4251/8448] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:17:45.993055 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_api:SELECT=2 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:17:45.993864 n-d-857467-1 devstack@n-api.service[122327]: DEBUG dbcounter [-] [122327] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 18:17:45.998052 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:45.998650 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:46.007106 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:46.007603 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:46.008297 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:46.009016 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:46.009479 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:46.010303 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:46.040424 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:17:46.060956 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-79a22e96-d03a-43b9-a0e7-6d21d86789ae req-a40ee141-fb75-4538-ae25-b87ef502fc2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c347a9-f931-4f26-8309-76df23b4ec57", "tag": "669d351d-bc8d-44b6-8221-feb7cec17b3c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:17:46.073312 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79a22e96-d03a-43b9-a0e7-6d21d86789ae req-a40ee141-fb75-4538-ae25-b87ef502fc2f service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:46.073941 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79a22e96-d03a-43b9-a0e7-6d21d86789ae req-a40ee141-fb75-4538-ae25-b87ef502fc2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:46.074662 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-79a22e96-d03a-43b9-a0e7-6d21d86789ae req-a40ee141-fb75-4538-ae25-b87ef502fc2f service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:46.087333 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-79a22e96-d03a-43b9-a0e7-6d21d86789ae req-a40ee141-fb75-4538-ae25-b87ef502fc2f service nova] Creating event network-changed:669d351d-bc8d-44b6-8221-feb7cec17b3c for instance 51c347a9-f931-4f26-8309-76df23b4ec57 on n-h1-857467-1 Sep 13 18:17:46.092965 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-79a22e96-d03a-43b9-a0e7-6d21d86789ae req-a40ee141-fb75-4538-ae25-b87ef502fc2f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099377 Sep 13 18:17:46.094863 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4252/8449] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:17:46.128461 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-e5971e8e-fde6-446c-899a-7c542a0f744f tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "DELETE /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 204 len: 0 microversion: 2.1 time: 0.137230 Sep 13 18:17:46.129077 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4198/8450] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 18:17:45 2022] DELETE /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:17:46.153922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:46.155823 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:46.162705 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:46.163788 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:46.164244 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:46.164975 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:46.165452 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:46.165922 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:46.360457 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:17:46.368349 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-837b143f-b612-40d4-99ef-4cbd5dc12843 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1684 microversion: 2.1 time: 0.221720 Sep 13 18:17:46.368944 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4253/8451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:46 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:17:47.393240 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:47.393986 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:47.400801 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:47.401293 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:47.401739 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:47.402468 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:47.402940 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:47.403380 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:47.633256 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:17:47.641260 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-ebc89fbe-7f52-4ef1-98d1-68893a97a1c8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1684 microversion: 2.1 time: 0.252930 Sep 13 18:17:47.642097 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4199/8452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:47 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1684 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:17:48.379539 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-2b788d8d-b988-408c-8bc8-e44e6108b485 req-a22aad3c-f5ca-4715-bb76-63084f22897b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c347a9-f931-4f26-8309-76df23b4ec57", "name": "network-vif-deleted", "tag": "669d351d-bc8d-44b6-8221-feb7cec17b3c"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:17:48.390084 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2b788d8d-b988-408c-8bc8-e44e6108b485 req-a22aad3c-f5ca-4715-bb76-63084f22897b service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:48.390799 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2b788d8d-b988-408c-8bc8-e44e6108b485 req-a22aad3c-f5ca-4715-bb76-63084f22897b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:48.391376 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-2b788d8d-b988-408c-8bc8-e44e6108b485 req-a22aad3c-f5ca-4715-bb76-63084f22897b service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:48.402681 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-2b788d8d-b988-408c-8bc8-e44e6108b485 req-a22aad3c-f5ca-4715-bb76-63084f22897b service nova] Creating event network-vif-deleted:669d351d-bc8d-44b6-8221-feb7cec17b3c for instance 51c347a9-f931-4f26-8309-76df23b4ec57 on n-h1-857467-1 Sep 13 18:17:48.408327 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-2b788d8d-b988-408c-8bc8-e44e6108b485 req-a22aad3c-f5ca-4715-bb76-63084f22897b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032587 Sep 13 18:17:48.408922 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4254/8453] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:17:48.665219 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:48.665887 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:48.673618 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:48.674173 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:48.674630 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:48.675354 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:48.675823 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:48.676261 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:48.711622 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:48.711771 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:48.712249 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:48.712647 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.objects.instance [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lazy-loading 'fault' on Instance uuid 51c347a9-f931-4f26-8309-76df23b4ec57 {{(pid=122327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 18:17:48.755594 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:17:48.763539 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-a46dc949-0adc-4cee-9c34-cd2b914bd7de tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 200 len: 1339 microversion: 2.1 time: 0.102259 Sep 13 18:17:48.764349 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4200/8454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:48 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:17:49.789648 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:49.790392 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 51c347a9-f931-4f26-8309-76df23b4ec57] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:49.796733 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:49.797239 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:49.797693 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:49.798409 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:49.798880 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:49.799324 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:49.812486 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.wsgi [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] HTTP exception thrown: Instance 51c347a9-f931-4f26-8309-76df23b4ec57 could not be found. Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Request method failure captured: Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: request: GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 HTTP/1.1 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Accept: application/json Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Accept-Encoding: identity Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Connection: close Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Content-Length: 0 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Content-Type: application/json Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Host: 10.222.0.61 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: Openstack-System-Scope: None Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: User-Agent: python-urllib3/1.26.12 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Auth-Token: gAAAAABjIMfi2bYnJ0iSB8ji7f-dbrKJC7dqheeKwpU8t8lHR4CWSVHxEfFuq8BEADiz3Kk12whZ-nkQvZehLg_Ui-5Q6AmJt6MnfzEBm3TNdbbQFlZBSp1MxuJfbS0WXQcUC9ASAccCuGj6x4mxiaP0GI9iHzABfRaoqevhXwXuj2oP97AXUNI Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Id: None Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Domain-Name: None Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Identity-Status: Confirmed Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Is-Admin-Project: True Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Id: default Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Domain-Name: Default Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Id: 917c49b8ab3d449b9986d8ff4d3472ea Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Project-Name: tempest-TestSnapshotPattern-478047784 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Role: member,reader Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Roles: member,reader Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant: tempest-TestSnapshotPattern-478047784 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Id: 917c49b8ab3d449b9986d8ff4d3472ea Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-Tenant-Name: tempest-TestSnapshotPattern-478047784 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-User: tempest-TestSnapshotPattern-478047784-project Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Id: default Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-User-Domain-Name: Default Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-User-Id: a2e735e79bae4c3babd1a9cf25f4beb9 Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: X-User-Name: tempest-TestSnapshotPattern-478047784-project Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: method: > Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: exception: Instance 51c347a9-f931-4f26-8309-76df23b4ec57 could not be found. Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: action_args: {'id': '51c347a9-f931-4f26-8309-76df23b4ec57'} Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c347a9-f931-4f26-8309-76df23b4ec57 could not be found. Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c347a9-f931-4f26-8309-76df23b4ec57 could not be found. Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:17:49.814225 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c347a9-f931-4f26-8309-76df23b4ec57 could not be found. Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: ERROR nova.api.openstack.wsgi Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Returning 404 to user: Instance 51c347a9-f931-4f26-8309-76df23b4ec57 could not be found. {{(pid=122328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-4f92d07d-d76f-4add-bb3b-ebf75f06ac8c tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57" status: 404 len: 111 microversion: 2.1 time: 0.031065 Sep 13 18:17:49.820360 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4255/8455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:49 2022] GET /compute/v2.1/servers/51c347a9-f931-4f26-8309-76df23b4ec57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:17:51.467689 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:51.468210 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:51.472271 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-85be6e3e-e38a-4922-8ccf-40336402a2b0 req-cbdb6d2e-7773-4f0a-9f16-8b1e491f8012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:17:51.476980 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:51.477475 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:51.477946 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:51.478687 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:51.479156 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:51.479591 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:51.483730 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85be6e3e-e38a-4922-8ccf-40336402a2b0 req-cbdb6d2e-7773-4f0a-9f16-8b1e491f8012 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:51.484301 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85be6e3e-e38a-4922-8ccf-40336402a2b0 req-cbdb6d2e-7773-4f0a-9f16-8b1e491f8012 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:51.485596 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-85be6e3e-e38a-4922-8ccf-40336402a2b0 req-cbdb6d2e-7773-4f0a-9f16-8b1e491f8012 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:51.497504 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-85be6e3e-e38a-4922-8ccf-40336402a2b0 req-cbdb6d2e-7773-4f0a-9f16-8b1e491f8012 service nova] Creating event network-changed:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:17:51.503587 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-85be6e3e-e38a-4922-8ccf-40336402a2b0 req-cbdb6d2e-7773-4f0a-9f16-8b1e491f8012 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036845 Sep 13 18:17:51.504288 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4256/8456] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:17:51.509755 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Going to try to terminate instance {{(pid=122327) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 18:17:51.591969 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-788463ca-352e-475f-9e85-c95553e1bb15 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 204 len: 0 microversion: 2.1 time: 0.128081 Sep 13 18:17:51.592900 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4201/8457] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Sep 13 18:17:51 2022] DELETE /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 18:17:51.604807 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:51.605882 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.compute.api [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122328) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:51.614272 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:51.614894 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:51.615434 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:51.616218 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:51.616773 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:51.617416 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:51.760112 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.policy [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122328) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:17:51.768005 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-0d24154d-2923-4c87-b1b6-d7fd3e91c491 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1681 microversion: 2.1 time: 0.169026 Sep 13 18:17:51.768591 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4257/8458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:51 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 18:17:52.792526 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:52.793222 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:52.800660 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:52.801151 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:52.801593 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:52.802325 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:52.802792 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:52.803224 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:53.028079 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.policy [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e735e79bae4c3babd1a9cf25f4beb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917c49b8ab3d449b9986d8ff4d3472ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122327) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 18:17:53.047775 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-97ae5896-e0a8-4bca-b548-48f6b8d641b8 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 200 len: 1681 microversion: 2.1 time: 0.255084 Sep 13 18:17:53.049581 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4202/8459] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:52 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 18:17:53.520567 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [req-55b1e934-3fa9-442d-b2ca-be99a845cdac req-1d3ac4c7-26b7-4195-995e-0d97041e1843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e639a8f-4cb9-411e-b1f7-c0e3c6fef851", "name": "network-vif-deleted", "tag": "0a4986d8-f152-4ade-91a0-a5be9453e1f7"}]} {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 18:17:53.531012 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-55b1e934-3fa9-442d-b2ca-be99a845cdac req-1d3ac4c7-26b7-4195-995e-0d97041e1843 service nova] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:53.531574 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-55b1e934-3fa9-442d-b2ca-be99a845cdac req-1d3ac4c7-26b7-4195-995e-0d97041e1843 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:53.532557 n-d-857467-1 devstack@n-api.service[122328]: DEBUG oslo_concurrency.lockutils [req-55b1e934-3fa9-442d-b2ca-be99a845cdac req-1d3ac4c7-26b7-4195-995e-0d97041e1843 service nova] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:53.544243 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.compute.server_external_events [req-55b1e934-3fa9-442d-b2ca-be99a845cdac req-1d3ac4c7-26b7-4195-995e-0d97041e1843 service nova] Creating event network-vif-deleted:0a4986d8-f152-4ade-91a0-a5be9453e1f7 for instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 on n-h2-857467-1 Sep 13 18:17:53.549358 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [req-55b1e934-3fa9-442d-b2ca-be99a845cdac req-1d3ac4c7-26b7-4195-995e-0d97041e1843 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 Sep 13 18:17:53.549934 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4258/8460] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Sep 13 18:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 18:17:54.073015 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '>' {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:54.073572 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.compute.api [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [instance: 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851] Fetching instance by UUID {{(pid=122327) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 18:17:54.081142 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:54.081625 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:54.082091 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:54.082785 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Acquiring lock "0841d836-33cc-4a39-be55-6b5864390dd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 18:17:54.083244 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 18:17:54.083675 n-d-857467-1 devstack@n-api.service[122327]: DEBUG oslo_concurrency.lockutils [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Lock "0841d836-33cc-4a39-be55-6b5864390dd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 18:17:54.097705 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.wsgi [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] HTTP exception thrown: Instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 could not be found. Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Request method failure captured: Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: request: GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 HTTP/1.1 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Accept: application/json Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Accept-Encoding: identity Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Connection: close Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Content-Length: 0 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Content-Type: application/json Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Host: 10.222.0.61 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: Openstack-System-Scope: None Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: User-Agent: python-urllib3/1.26.12 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Auth-Token: gAAAAABjIMfi2bYnJ0iSB8ji7f-dbrKJC7dqheeKwpU8t8lHR4CWSVHxEfFuq8BEADiz3Kk12whZ-nkQvZehLg_Ui-5Q6AmJt6MnfzEBm3TNdbbQFlZBSp1MxuJfbS0WXQcUC9ASAccCuGj6x4mxiaP0GI9iHzABfRaoqevhXwXuj2oP97AXUNI Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Id: None Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Domain-Name: None Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Identity-Status: Confirmed Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Is-Admin-Project: True Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Id: default Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Domain-Name: Default Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Id: 917c49b8ab3d449b9986d8ff4d3472ea Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Project-Name: tempest-TestSnapshotPattern-478047784 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Role: member,reader Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Roles: member,reader Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/917c49b8ab3d449b9986d8ff4d3472ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant: tempest-TestSnapshotPattern-478047784 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Id: 917c49b8ab3d449b9986d8ff4d3472ea Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-Tenant-Name: tempest-TestSnapshotPattern-478047784 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-User: tempest-TestSnapshotPattern-478047784-project Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Id: default Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-User-Domain-Name: Default Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-User-Id: a2e735e79bae4c3babd1a9cf25f4beb9 Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: X-User-Name: tempest-TestSnapshotPattern-478047784-project Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: method: > Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: exception: Instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 could not be found. Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: action_args: {'id': '7e639a8f-4cb9-411e-b1f7-c0e3c6fef851'} Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: {{(pid=122327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 could not be found. Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 could not be found. Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 18:17:54.099367 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 could not be found. Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: ERROR nova.api.openstack.wsgi Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: DEBUG nova.api.openstack.wsgi [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Returning 404 to user: Instance 7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 could not be found. {{(pid=122327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: INFO nova.api.openstack.requestlog [None req-fa269718-746d-4fd6-9853-8a68c7a2a9a7 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851" status: 404 len: 111 microversion: 2.1 time: 0.031962 Sep 13 18:17:54.105076 n-d-857467-1 devstack@n-api.service[122327]: [pid: 122327|app: 0|req: 4203/8461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Sep 13 18:17:54 2022] GET /compute/v2.1/servers/7e639a8f-4cb9-411e-b1f7-c0e3c6fef851 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 18:17:54.259028 n-d-857467-1 devstack@n-api.service[122328]: DEBUG nova.api.openstack.wsgi [None req-11ea7c17-fd35-4a01-b8c7-6c4d68bbfc61 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] Calling method '.version_select at 0x7fbeac6c7160>' {{(pid=122328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 18:17:54.263525 n-d-857467-1 devstack@n-api.service[122328]: ERROR oslo.messaging._drivers.impl_rabbit [None req-11ea7c17-fd35-4a01-b8c7-6c4d68bbfc61 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [9ea0d3b1-a414-45dd-90cd-674e5695e5db] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 18:17:55.271653 n-d-857467-1 devstack@n-api.service[122328]: INFO oslo.messaging._drivers.impl_rabbit [None req-11ea7c17-fd35-4a01-b8c7-6c4d68bbfc61 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] [9ea0d3b1-a414-45dd-90cd-674e5695e5db] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 43004. Sep 13 18:17:55.290580 n-d-857467-1 devstack@n-api.service[122328]: INFO nova.api.openstack.requestlog [None req-11ea7c17-fd35-4a01-b8c7-6c4d68bbfc61 tempest-TestSnapshotPattern-478047784 tempest-TestSnapshotPattern-478047784-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1999688691" status: 202 len: 0 microversion: 2.1 time: 1.035839 Sep 13 18:17:55.291167 n-d-857467-1 devstack@n-api.service[122328]: [pid: 122328|app: 0|req: 4259/8462] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Sep 13 18:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1999688691 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)